2026-03-26 18:30:05 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-26 18:30:05 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-26 18:30:05 [ayvens.es] INFO: Starting spider ayvens.es
2026-03-26 18:30:05 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-26 18:30:05 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-26 18:30:05 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-26 18:30:05 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-26 18:30:05 [scrapy.extensions.telnet] INFO: Telnet Password: ea57b690d4b33aa6
2026-03-26 18:30:05 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-26 18:30:05 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/ayvens.es/task_38_2026-03-26T18_30_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-26 18:30:05 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-26 18:30:05 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-26 18:30:05 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-26 18:30:05 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-26 18:30:05 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-26 18:30:05 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-26 18:30:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-26 18:30:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2107
2026-03-26 18:30:05 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-26 18:30:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-26 18:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: en
2026-03-26 18:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27en%27%20and%20RowKey%20eq%20%27en%27 HTTP/1.1" 200 None
2026-03-26 18:30:06 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-26 18:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-26 18:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-26 18:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-26 18:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-26 18:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-26 18:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-26 18:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-26 18:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-26 18:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-26 18:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-26 18:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-26 18:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-26 18:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-26 18:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-26 18:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-26 18:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-26 18:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-26 18:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-26 18:30:06 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-26 18:30:06 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-26 18:30:06 [scrapy.core.engine] INFO: Spider opened
2026-03-26 18:30:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-26 18:30:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-26 18:30:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 141MiB
2026-03-26 18:30:06 [scrapy-playwright] INFO: Starting download handler
2026-03-26 18:30:06 [scrapy-playwright] INFO: Starting download handler
2026-03-26 18:30:11 [scrapy-playwright] INFO: Launching browser firefox
2026-03-26 18:30:11 [scrapy-playwright] INFO: Browser firefox launched
2026-03-26 18:30:11 [scrapy-playwright] DEBUG: Browser context started: 'default' (persistent=False, remote=False)
2026-03-26 18:30:12 [scrapy-playwright] DEBUG: [Context=default] New page created, page count is 1 (1 for all contexts)
2026-03-26 18:30:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/lots> (resource type: document)
2026-03-26 18:30:12 [scrapy-playwright] DEBUG: [Context=default] Response: <407 https://carmarket.ayvens.com/en-gb/lots>
2026-03-26 18:30:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/lots> (resource type: document)
2026-03-26 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/lots>
2026-03-26 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Medium.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Regular.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Semibold.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Bold.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Medium.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Regular.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-SemiBold.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/styles-ETA5EMQJ.css> (resource type: stylesheet, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-R5GGQAWE.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-YI6GGZZZ.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-NAGGRITV.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-BBQ7R2BV.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HPL7GXW6.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ADG3G2OJ.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7JYRLYWD.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2S63FZXS.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-K7GQAXGO.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-PMQRMPGY.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/polyfills-FFHMD2TL.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/main-NKPAFEH2.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg>
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg>
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/line.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/line.svg>
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg>
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/loader.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/loader.svg>
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Medium.woff2>
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Regular.woff2>
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Regular.woff2>
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Semibold.woff2>
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Bold.woff2>
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/styles-ETA5EMQJ.css>
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Medium.woff2>
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2>
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-R5GGQAWE.js>
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-YI6GGZZZ.js>
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2>
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/SourceSans3-Bold-OH3V3LEB.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/SourceSans3-Regular-VMJBJIXS.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/SourceSans3-SemiBold-NPKTOIJ5.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-SemiBold.woff2>
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-QV3UPEBS.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-R5GGQAWE.js)
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AQBI4CYB.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-R5GGQAWE.js)
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EIXBRKXP.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-R5GGQAWE.js)
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-5567JMUS.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-R5GGQAWE.js)
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-NAGGRITV.js>
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-4CLCTAJ7.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-YI6GGZZZ.js)
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2>
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-CQOH37XC.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-NAGGRITV.js)
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HQZHDCQG.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-NAGGRITV.js)
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-BBQ7R2BV.js>
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-QZ2M64VL.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-BBQ7R2BV.js)
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HPL7GXW6.js>
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ADG3G2OJ.js>
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EVZDJ3YH.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2BYH6G4C.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AHM2LY2L.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VGUEXTON.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-SUQC6PCL.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7DYAUIPQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-6BXXUPPN.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7JYRLYWD.js>
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2S63FZXS.js>
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-K7GQAXGO.js>
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-SALCXTDR.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-K7GQAXGO.js)
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-PMQRMPGY.js>
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/polyfills-FFHMD2TL.js>
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/main-NKPAFEH2.js>
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-OF6JT4KC.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-Y6LYHJ33.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ELPOVYM7.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VBU7AOHF.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-SPE4D2IX.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-N2FZW7V7.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VPLHK2CL.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AVZZH6AV.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-KLKMSQPH.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2FANG3NP.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ABBXN5WQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-NPJHDJ36.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-MLMYZRAG.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-5D4JF6DX.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7IEPAGTW.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ZYL3EWWF.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-WWYAPULQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XXARMH2T.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AYT4KML6.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-CX65R3QQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XGLUMAK5.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EHSUL3RU.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7UDVUMWJ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-WRLSZEDX.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XCHSKDZH.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2>
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2>
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/SourceSans3-Bold-OH3V3LEB.woff2>
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/SourceSans3-Regular-VMJBJIXS.woff2>
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2>
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/SourceSans3-SemiBold-NPKTOIJ5.woff2>
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AQBI4CYB.js>
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-QV3UPEBS.js>
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EIXBRKXP.js>
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-5567JMUS.js>
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-4CLCTAJ7.js>
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-CQOH37XC.js>
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HQZHDCQG.js>
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EVZDJ3YH.js>
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2BYH6G4C.js>
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AHM2LY2L.js>
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-QZ2M64VL.js>
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VGUEXTON.js>
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-SUQC6PCL.js>
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7DYAUIPQ.js>
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-6BXXUPPN.js>
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-SALCXTDR.js>
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-OF6JT4KC.js>
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ELPOVYM7.js>
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-Y6LYHJ33.js>
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-SPE4D2IX.js>
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VBU7AOHF.js>
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-N2FZW7V7.js>
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VPLHK2CL.js>
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AVZZH6AV.js>
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-KLKMSQPH.js>
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2FANG3NP.js>
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ABBXN5WQ.js>
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-NPJHDJ36.js>
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-MLMYZRAG.js>
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-5D4JF6DX.js>
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7IEPAGTW.js>
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ZYL3EWWF.js>
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-WWYAPULQ.js>
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XXARMH2T.js>
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-CX65R3QQ.js>
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AYT4KML6.js>
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EHSUL3RU.js>
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XGLUMAK5.js>
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-WRLSZEDX.js>
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7UDVUMWJ.js>
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XCHSKDZH.js>
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://js.monitor.azure.com/scripts/b/ai.config.1.cfg.json> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-U3DCL5KE.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7HVTDVUE.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens-white-bg_192x192.png> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens-white-bg_192x192.png>
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens.svg>
2026-03-26 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-U3DCL5KE.js>
2026-03-26 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7HVTDVUE.js>
2026-03-26 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VPZ5PCFV.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-7HVTDVUE.js)
2026-03-26 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VPZ5PCFV.js>
2026-03-26 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-R57BLUBZ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-VPZ5PCFV.js)
2026-03-26 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-R57BLUBZ.js>
2026-03-26 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://js.monitor.azure.com/scripts/b/ai.config.1.cfg.json>
2026-03-26 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XI7MA6UU.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-253AOQV4.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-Y26P6NOT.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-VPZ5PCFV.js)
2026-03-26 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XI7MA6UU.js>
2026-03-26 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-E2QM5VHP.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-XI7MA6UU.js)
2026-03-26 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-QVU7EFJH.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-XI7MA6UU.js)
2026-03-26 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-CJQ6ZMFR.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-XI7MA6UU.js)
2026-03-26 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-253AOQV4.js>
2026-03-26 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-Y26P6NOT.js>
2026-03-26 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-PU5AH4GE.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-26 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-6AWK7DQQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-26 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-JMKQRIJX.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-26 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-OXIZJZO4.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-26 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-H7VMIGZK.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-26 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-E2QM5VHP.js>
2026-03-26 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-QVU7EFJH.js>
2026-03-26 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-CJQ6ZMFR.js>
2026-03-26 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-PU5AH4GE.js>
2026-03-26 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-6AWK7DQQ.js>
2026-03-26 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-H7VMIGZK.js>
2026-03-26 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-JMKQRIJX.js>
2026-03-26 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-OXIZJZO4.js>
2026-03-26 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/loader.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/loader.svg>
2026-03-26 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg>
2026-03-26 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/line.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/line.svg>
2026-03-26 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg>
2026-03-26 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg>
2026-03-26 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-26 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-BQLC5RJD.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-26 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HGLYMGTS.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-PU5AH4GE.js)
2026-03-26 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VNA57F7Z.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-253AOQV4.js)
2026-03-26 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EXKYPD3J.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-253AOQV4.js)
2026-03-26 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-BQLC5RJD.js>
2026-03-26 18:30:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://carmarket.ayvens.com/en-gb/lots> (referer: None) ['playwright']
2026-03-26 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/down.svg>
2026-03-26 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HGLYMGTS.js>
2026-03-26 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VNA57F7Z.js>
2026-03-26 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AZBPSD4I.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HGLYMGTS.js)
2026-03-26 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2NCM5KDW.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HGLYMGTS.js)
2026-03-26 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/bell.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/bell.svg>
2026-03-26 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EXKYPD3J.js>
2026-03-26 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/next-breadcrumb.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/next-breadcrumb.svg>
2026-03-26 18:30:18 [ayvens.es] INFO: Cookies from Playwright: [{'name': 'ai_user', 'value': 'gollkfWuHW+REeQ52a6SDR|2026-03-26T18:30:16.548Z', 'domain': 'carmarket.ayvens.com', 'path': '/', 'expires': 1806085816, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}, {'name': 'user_culture', 'value': 'en-gb', 'domain': 'carmarket.ayvens.com', 'path': '/', 'expires': -1, 'httpOnly': False, 'secure': False, 'sameSite': 'None'}, {'name': 'ai_session', 'value': 'KWqCLhlOFC7wqMzZvAQtZr|1774549817902|1774549817902', 'domain': 'carmarket.ayvens.com', 'path': '/', 'expires': 1774551617, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}]
2026-03-26 18:30:18 [ayvens.es] INFO: Scrapy-formatted cookies: [{'name': 'ai_user', 'value': 'gollkfWuHW+REeQ52a6SDR|2026-03-26T18:30:16.548Z', 'domain': 'carmarket.ayvens.com', 'path': '/'}, {'name': 'user_culture', 'value': 'en-gb', 'domain': 'carmarket.ayvens.com', 'path': '/'}, {'name': 'ai_session', 'value': 'KWqCLhlOFC7wqMzZvAQtZr|1774549817902|1774549817902', 'domain': 'carmarket.ayvens.com', 'path': '/'}]
2026-03-26 18:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /SpiderData(PartitionKey='Ayvens',RowKey='cookies') HTTP/1.1" 204 0
2026-03-26 18:30:18 [ayvens.es] INFO: Intercepting token...
2026-03-26 18:30:18 [ayvens.es] INFO: Scrolling element to trigger lazy load...
2026-03-26 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-26 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VUZVFPNF.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 18:30:18 [ayvens.es] INFO: GraphQL headers: {'host': 'api-carmarket.ayvens.com', 'user-agent': 'Mozilla/5.0 (X11; Linux x86_64; rv:125.0) Gecko/20100101 Firefox/125.0', 'accept': 'application/json, text/plain, */*', 'accept-language': 'en-US,en;q=0.5', 'accept-encoding': 'gzip, deflate, br', 'content-type': 'application/json', 'content-length': '839', 'referer': 'https://carmarket.ayvens.com/', 'x-ald-subscription-key': '3b2cc62fd26c4e29a762db3de181266b', 'x-tenant': 'ald', 'x-country': 'gb', 'origin': 'https://carmarket.ayvens.com', 'sec-fetch-dest': 'empty', 'sec-fetch-mode': 'cors', 'sec-fetch-site': 'same-site', 'proxy-authorization': 'Basic Y3VzdG9tZXItaW5maW5pdF9zb3VyY2luZ192Ml9XQjdOUi1jYy1HQjozY35+YWdLUmM2MlZaQUw=', 'connection': 'keep-alive'}
2026-03-26 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AZBPSD4I.js>
2026-03-26 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://api-carmarket.ayvens.com/graphql/saleevents> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-26 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/logo-ayvens.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-fr.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-es.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-be.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-de.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-it.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/loader.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2NCM5KDW.js>
2026-03-26 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VUZVFPNF.js>
2026-03-26 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/logo-ayvens.svg>
2026-03-26 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-26 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-FX6676C7.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-VUZVFPNF.js)
2026-03-26 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/loader.svg>
2026-03-26 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://dc.services.visualstudio.com/v2/track>
2026-03-26 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://dc.services.visualstudio.com/v2/track>
2026-03-26 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/chevron-down.svg>
2026-03-26 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-FX6676C7.js>
2026-03-26 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/otSDKStub.js> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-03-26 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/down.svg>
2026-03-26 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-it.svg>
2026-03-26 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-be.svg>
2026-03-26 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-es.svg>
2026-03-26 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-de.svg>
2026-03-26 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-fr.svg>
2026-03-26 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-BK6NFD4R.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-26 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://dc.services.visualstudio.com/v2/track>
2026-03-26 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/be.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/gr.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-26 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-75KGV5DF.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-OXIZJZO4.js)
2026-03-26 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-BK6NFD4R.js>
2026-03-26 18:30:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/otSDKStub.js>
2026-03-26 18:30:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/flags/be.svg>
2026-03-26 18:30:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/consent/019908df-58e4-7710-aaa7-4d6e79279bd9/019908df-58e4-7710-aaa7-4d6e79279bd9.json> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-26 18:30:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/flags/gr.svg>
2026-03-26 18:30:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-75KGV5DF.js>
2026-03-26 18:30:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/consent/019908df-58e4-7710-aaa7-4d6e79279bd9/019908df-58e4-7710-aaa7-4d6e79279bd9.json>
2026-03-26 18:30:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/202601.1.0/otBannerSdk.js> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-03-26 18:30:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/202601.1.0/otBannerSdk.js>
2026-03-26 18:30:20 [ayvens.es] INFO: ✅ Intercepted token: 3b2cc62fd26c4e29a762db3de181266b
2026-03-26 18:30:20 [ayvens.es] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 0
2026-03-26 18:30:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 18:30:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-26 18:30:22 [ayvens.es] INFO: Found listing with ID: 1985097
2026-03-26 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985097%27 HTTP/1.1" 200 None
2026-03-26 18:30:22 [ayvens.es] INFO: Scrape type for 1985097: 1
2026-03-26 18:30:22 [ayvens.es] INFO: Extracting data for car ID: 1985097
2026-03-26 18:30:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fe4a21a-a0b6-52b7-a676-8068ef50acaf with identifier: 1985097
2026-03-26 18:30:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fe4a21a-a0b6-52b7-a676-8068ef50acaf with scrape type 1
2026-03-26 18:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1fe4a21a-a0b6-52b7-a676-8068ef50acaf
2026-03-26 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F503%252Fb1cb914cde20427f83a98952258ad0fc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/503/b1cb914cde20427f83a98952258ad0fc/images/large/1.jpg not downloaded yet
2026-03-26 18:30:22 [ayvens.es] INFO: Found listing with ID: 1985098
2026-03-26 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985098%27 HTTP/1.1" 200 None
2026-03-26 18:30:22 [ayvens.es] INFO: Scrape type for 1985098: 1
2026-03-26 18:30:22 [ayvens.es] INFO: Extracting data for car ID: 1985098
2026-03-26 18:30:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1161af14-6dd0-5484-8bec-7db37cec99f9 with identifier: 1985098
2026-03-26 18:30:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1161af14-6dd0-5484-8bec-7db37cec99f9 with scrape type 1
2026-03-26 18:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1161af14-6dd0-5484-8bec-7db37cec99f9
2026-03-26 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F493%252Fe5060dba1d4e41b7b5fb7cacfd0d848a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/493/e5060dba1d4e41b7b5fb7cacfd0d848a/images/large/1.jpg not downloaded yet
2026-03-26 18:30:22 [ayvens.es] INFO: Found listing with ID: 1985099
2026-03-26 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985099%27 HTTP/1.1" 200 None
2026-03-26 18:30:22 [ayvens.es] INFO: Scrape type for 1985099: 1
2026-03-26 18:30:22 [ayvens.es] INFO: Extracting data for car ID: 1985099
2026-03-26 18:30:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78233c73-1d43-5698-b2b2-d3c507d59211 with identifier: 1985099
2026-03-26 18:30:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78233c73-1d43-5698-b2b2-d3c507d59211 with scrape type 1
2026-03-26 18:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 78233c73-1d43-5698-b2b2-d3c507d59211
2026-03-26 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F199%252F9df5292a669749c19e8655bd4c289f3f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/199/9df5292a669749c19e8655bd4c289f3f/images/large/1.jpg not downloaded yet
2026-03-26 18:30:22 [ayvens.es] INFO: Found listing with ID: 1985100
2026-03-26 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985100%27 HTTP/1.1" 200 None
2026-03-26 18:30:22 [ayvens.es] INFO: Scrape type for 1985100: 1
2026-03-26 18:30:22 [ayvens.es] INFO: Extracting data for car ID: 1985100
2026-03-26 18:30:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a9f62e4-244d-5076-af93-35f627a9a3c6 with identifier: 1985100
2026-03-26 18:30:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a9f62e4-244d-5076-af93-35f627a9a3c6 with scrape type 1
2026-03-26 18:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1a9f62e4-244d-5076-af93-35f627a9a3c6
2026-03-26 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F836%252Fc3b0bba5939849d1b1c3ed1bf7b02d56%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/836/c3b0bba5939849d1b1c3ed1bf7b02d56/images/large/1.jpg not downloaded yet
2026-03-26 18:30:22 [ayvens.es] INFO: Found listing with ID: 1985101
2026-03-26 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985101%27 HTTP/1.1" 200 None
2026-03-26 18:30:22 [ayvens.es] INFO: Scrape type for 1985101: 1
2026-03-26 18:30:22 [ayvens.es] INFO: Extracting data for car ID: 1985101
2026-03-26 18:30:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: debd3101-cd3e-5892-bec0-e2d286aeee11 with identifier: 1985101
2026-03-26 18:30:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item debd3101-cd3e-5892-bec0-e2d286aeee11 with scrape type 1
2026-03-26 18:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item debd3101-cd3e-5892-bec0-e2d286aeee11
2026-03-26 18:30:22 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item debd3101-cd3e-5892-bec0-e2d286aeee11
2026-03-26 18:30:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: debd3101-cd3e-5892-bec0-e2d286aeee11, identifier: 1985101
2026-03-26 18:30:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: debd3101-cd3e-5892-bec0-e2d286aeee11 with identifier: 1985101
2026-03-26 18:30:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:30:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:30:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: debd3101-cd3e-5892-bec0-e2d286aeee11 with identifier: 1985101
2026-03-26 18:30:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: debd3101-cd3e-5892-bec0-e2d286aeee11 with identifier: 1985101 to the API
2026-03-26 18:30:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:30:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:30:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 96,
 'color': 'Gris plata metalizad',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'gas',
 'id': 'debd3101-cd3e-5892-bec0-e2d286aeee11',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 43770,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON ST 1.5 TGI 96kW DSG-7 S&S Xcellence',
 'transmission': 'manual',
 'trim': 'ST 1.5 TGI 96kW DSG-7 S&S Xcellence',
 'vin': None,
 'year': 2020}
2026-03-26 18:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985101%27 HTTP/1.1" 200 None
2026-03-26 18:30:23 [ayvens.es] INFO: Saving data for 1985101: {'created_time': 1774549823.730588, 'last_price_update_time': 1774549823.730599, 'auction_closing_time': 1774612800.0}
2026-03-26 18:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985101') HTTP/1.1" 204 0
2026-03-26 18:30:23 [ayvens.es] INFO: Found listing with ID: 1985102
2026-03-26 18:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985102%27 HTTP/1.1" 200 None
2026-03-26 18:30:23 [ayvens.es] INFO: Scrape type for 1985102: 1
2026-03-26 18:30:23 [ayvens.es] INFO: Extracting data for car ID: 1985102
2026-03-26 18:30:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d70fe5ab-b422-59ad-98fa-71d371578526 with identifier: 1985102
2026-03-26 18:30:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d70fe5ab-b422-59ad-98fa-71d371578526 with scrape type 1
2026-03-26 18:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d70fe5ab-b422-59ad-98fa-71d371578526
2026-03-26 18:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F072%252F9fa43e7780204dd9b1147c232cc6843b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/072/9fa43e7780204dd9b1147c232cc6843b/images/large/1.jpg not downloaded yet
2026-03-26 18:30:23 [ayvens.es] INFO: Found listing with ID: 1985103
2026-03-26 18:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985103%27 HTTP/1.1" 200 None
2026-03-26 18:30:23 [ayvens.es] INFO: Scrape type for 1985103: 1
2026-03-26 18:30:23 [ayvens.es] INFO: Extracting data for car ID: 1985103
2026-03-26 18:30:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e1b3ce8-5eba-5e3f-85a5-23c9023818a1 with identifier: 1985103
2026-03-26 18:30:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e1b3ce8-5eba-5e3f-85a5-23c9023818a1 with scrape type 1
2026-03-26 18:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5e1b3ce8-5eba-5e3f-85a5-23c9023818a1
2026-03-26 18:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F668%252F8fcd9f4976f24aae9267fa5674986dda%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/668/8fcd9f4976f24aae9267fa5674986dda/images/large/1.jpg not downloaded yet
2026-03-26 18:30:23 [ayvens.es] INFO: Found listing with ID: 1985104
2026-03-26 18:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985104%27 HTTP/1.1" 200 None
2026-03-26 18:30:23 [ayvens.es] INFO: Scrape type for 1985104: 1
2026-03-26 18:30:23 [ayvens.es] INFO: Extracting data for car ID: 1985104
2026-03-26 18:30:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca8813be-824c-5c1b-9d58-2738f2eb06d4 with identifier: 1985104
2026-03-26 18:30:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca8813be-824c-5c1b-9d58-2738f2eb06d4 with scrape type 1
2026-03-26 18:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ca8813be-824c-5c1b-9d58-2738f2eb06d4
2026-03-26 18:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F644%252F8327cae1a3714ed98215ab4d14e91416%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/644/8327cae1a3714ed98215ab4d14e91416/images/large/1.jpg not downloaded yet
2026-03-26 18:30:23 [ayvens.es] INFO: Found listing with ID: 1985105
2026-03-26 18:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985105%27 HTTP/1.1" 200 None
2026-03-26 18:30:23 [ayvens.es] INFO: Scrape type for 1985105: 1
2026-03-26 18:30:23 [ayvens.es] INFO: Extracting data for car ID: 1985105
2026-03-26 18:30:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f90508c4-65b9-5d4b-afd1-5a71a3fb0744 with identifier: 1985105
2026-03-26 18:30:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f90508c4-65b9-5d4b-afd1-5a71a3fb0744 with scrape type 1
2026-03-26 18:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f90508c4-65b9-5d4b-afd1-5a71a3fb0744
2026-03-26 18:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F089%252F18d4f0d392d742eab751bf47a54d5bd5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/089/18d4f0d392d742eab751bf47a54d5bd5/images/large/1.jpg not downloaded yet
2026-03-26 18:30:23 [ayvens.es] INFO: Found listing with ID: 1985106
2026-03-26 18:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985106%27 HTTP/1.1" 200 None
2026-03-26 18:30:23 [ayvens.es] INFO: Scrape type for 1985106: 1
2026-03-26 18:30:23 [ayvens.es] INFO: Extracting data for car ID: 1985106
2026-03-26 18:30:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 800a2363-5128-50d7-aa8b-2c2c8be67c97 with identifier: 1985106
2026-03-26 18:30:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 800a2363-5128-50d7-aa8b-2c2c8be67c97 with scrape type 1
2026-03-26 18:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 800a2363-5128-50d7-aa8b-2c2c8be67c97
2026-03-26 18:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F053%252F7cfe1be888a84a3bb8c76860cd234596%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/053/7cfe1be888a84a3bb8c76860cd234596/images/large/1.jpg not downloaded yet
2026-03-26 18:30:23 [ayvens.es] INFO: Found listing with ID: 1985107
2026-03-26 18:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985107%27 HTTP/1.1" 200 None
2026-03-26 18:30:24 [ayvens.es] INFO: Scrape type for 1985107: 1
2026-03-26 18:30:24 [ayvens.es] INFO: Extracting data for car ID: 1985107
2026-03-26 18:30:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e04ddbf-1a9d-5a22-82c1-c15273cc74a8 with identifier: 1985107
2026-03-26 18:30:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e04ddbf-1a9d-5a22-82c1-c15273cc74a8 with scrape type 1
2026-03-26 18:30:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6e04ddbf-1a9d-5a22-82c1-c15273cc74a8
2026-03-26 18:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F860%252F3afa940ec7944d6b885e4261700811a0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:30:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/860/3afa940ec7944d6b885e4261700811a0/images/large/1.jpg not downloaded yet
2026-03-26 18:30:24 [ayvens.es] INFO: Found listing with ID: 1985108
2026-03-26 18:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985108%27 HTTP/1.1" 200 None
2026-03-26 18:30:24 [ayvens.es] INFO: Scrape type for 1985108: 1
2026-03-26 18:30:24 [ayvens.es] INFO: Extracting data for car ID: 1985108
2026-03-26 18:30:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ec7cecd-7ced-5062-bc30-8399efb3b6c0 with identifier: 1985108
2026-03-26 18:30:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ec7cecd-7ced-5062-bc30-8399efb3b6c0 with scrape type 1
2026-03-26 18:30:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8ec7cecd-7ced-5062-bc30-8399efb3b6c0
2026-03-26 18:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F243%252Fc2d321e5a29a4bd38bef5abd6c3a4ee9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:30:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/243/c2d321e5a29a4bd38bef5abd6c3a4ee9/images/large/1.jpg not downloaded yet
2026-03-26 18:30:24 [ayvens.es] INFO: Found listing with ID: 1985109
2026-03-26 18:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985109%27 HTTP/1.1" 200 None
2026-03-26 18:30:24 [ayvens.es] INFO: Scrape type for 1985109: 1
2026-03-26 18:30:24 [ayvens.es] INFO: Extracting data for car ID: 1985109
2026-03-26 18:30:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 569475b6-49ce-522f-9c0c-b9760863b4e4 with identifier: 1985109
2026-03-26 18:30:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 569475b6-49ce-522f-9c0c-b9760863b4e4 with scrape type 1
2026-03-26 18:30:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 569475b6-49ce-522f-9c0c-b9760863b4e4
2026-03-26 18:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F302%252F7e88896b2bec4af0be049bb45ce0d4a0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:30:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/302/7e88896b2bec4af0be049bb45ce0d4a0/images/large/1.jpg not downloaded yet
2026-03-26 18:30:24 [ayvens.es] INFO: Found listing with ID: 1985110
2026-03-26 18:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985110%27 HTTP/1.1" 200 None
2026-03-26 18:30:24 [ayvens.es] INFO: Scrape type for 1985110: 1
2026-03-26 18:30:24 [ayvens.es] INFO: Extracting data for car ID: 1985110
2026-03-26 18:30:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 673df575-e494-57ec-a35b-64dd5d6d8d22 with identifier: 1985110
2026-03-26 18:30:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 673df575-e494-57ec-a35b-64dd5d6d8d22 with scrape type 1
2026-03-26 18:30:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 673df575-e494-57ec-a35b-64dd5d6d8d22
2026-03-26 18:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F209%252F0c9b84fe410d485cb75f04bf7fb9878f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:30:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/209/0c9b84fe410d485cb75f04bf7fb9878f/images/large/1.jpg not downloaded yet
2026-03-26 18:30:24 [ayvens.es] INFO: Found listing with ID: 1985111
2026-03-26 18:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985111%27 HTTP/1.1" 200 None
2026-03-26 18:30:24 [ayvens.es] INFO: Scrape type for 1985111: 1
2026-03-26 18:30:24 [ayvens.es] INFO: Extracting data for car ID: 1985111
2026-03-26 18:30:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 218aae88-e2f3-523c-b3e3-994af649cc37 with identifier: 1985111
2026-03-26 18:30:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 218aae88-e2f3-523c-b3e3-994af649cc37 with scrape type 1
2026-03-26 18:30:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 218aae88-e2f3-523c-b3e3-994af649cc37
2026-03-26 18:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F248%252Ff7f4db6ed03b4ebf9306a5f74d3ee3da%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:30:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/248/f7f4db6ed03b4ebf9306a5f74d3ee3da/images/large/1.jpg not downloaded yet
2026-03-26 18:30:24 [ayvens.es] INFO: Found listing with ID: 1985112
2026-03-26 18:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985112%27 HTTP/1.1" 200 None
2026-03-26 18:30:24 [ayvens.es] INFO: Scrape type for 1985112: 1
2026-03-26 18:30:24 [ayvens.es] INFO: Extracting data for car ID: 1985112
2026-03-26 18:30:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1fb8ed9-1353-5267-afc7-3f0e4e474f8c with identifier: 1985112
2026-03-26 18:30:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1fb8ed9-1353-5267-afc7-3f0e4e474f8c with scrape type 1
2026-03-26 18:30:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a1fb8ed9-1353-5267-afc7-3f0e4e474f8c
2026-03-26 18:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F305%252F22d4a67e5f024424b8f09f78e8ce82e4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:30:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/305/22d4a67e5f024424b8f09f78e8ce82e4/images/large/1.jpg not downloaded yet
2026-03-26 18:30:24 [ayvens.es] INFO: Found listing with ID: 1985113
2026-03-26 18:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985113%27 HTTP/1.1" 200 None
2026-03-26 18:30:24 [ayvens.es] INFO: Scrape type for 1985113: 1
2026-03-26 18:30:24 [ayvens.es] INFO: Extracting data for car ID: 1985113
2026-03-26 18:30:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01dc0839-e7df-5edf-a29d-79c066f5e0d8 with identifier: 1985113
2026-03-26 18:30:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01dc0839-e7df-5edf-a29d-79c066f5e0d8 with scrape type 1
2026-03-26 18:30:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 01dc0839-e7df-5edf-a29d-79c066f5e0d8
2026-03-26 18:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F235%252Fa4a39913198045a99473e32ac51a7e7e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:30:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/235/a4a39913198045a99473e32ac51a7e7e/images/large/1.jpg not downloaded yet
2026-03-26 18:30:24 [ayvens.es] INFO: Found listing with ID: 1985114
2026-03-26 18:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985114%27 HTTP/1.1" 200 None
2026-03-26 18:30:24 [ayvens.es] INFO: Scrape type for 1985114: 1
2026-03-26 18:30:24 [ayvens.es] INFO: Extracting data for car ID: 1985114
2026-03-26 18:30:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1723b41c-02ac-5da3-b59f-1a344f548fae with identifier: 1985114
2026-03-26 18:30:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1723b41c-02ac-5da3-b59f-1a344f548fae with scrape type 1
2026-03-26 18:30:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1723b41c-02ac-5da3-b59f-1a344f548fae
2026-03-26 18:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F603%252F4c2697865013421498b064acacde9f53%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:30:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/603/4c2697865013421498b064acacde9f53/images/large/1.jpg not downloaded yet
2026-03-26 18:30:24 [ayvens.es] INFO: Found listing with ID: 1985115
2026-03-26 18:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985115%27 HTTP/1.1" 200 None
2026-03-26 18:30:24 [ayvens.es] INFO: Scrape type for 1985115: 1
2026-03-26 18:30:24 [ayvens.es] INFO: Extracting data for car ID: 1985115
2026-03-26 18:30:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e641143-2de8-5ef6-93c3-b6cb58652a3b with identifier: 1985115
2026-03-26 18:30:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e641143-2de8-5ef6-93c3-b6cb58652a3b with scrape type 1
2026-03-26 18:30:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1e641143-2de8-5ef6-93c3-b6cb58652a3b
2026-03-26 18:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F962%252Ff84d77dd96574484a7a8e8d669705daf%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:30:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/962/f84d77dd96574484a7a8e8d669705daf/images/large/1.jpg not downloaded yet
2026-03-26 18:30:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/493/e5060dba1d4e41b7b5fb7cacfd0d848a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:30:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/503/b1cb914cde20427f83a98952258ad0fc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:30:24 [ayvens.es] INFO: Found listing with ID: 1985116
2026-03-26 18:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985116%27 HTTP/1.1" 200 None
2026-03-26 18:30:24 [ayvens.es] INFO: Scrape type for 1985116: 1
2026-03-26 18:30:24 [ayvens.es] INFO: Extracting data for car ID: 1985116
2026-03-26 18:30:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2291ad8-5fdc-5c48-a6f1-faad15ea5095 with identifier: 1985116
2026-03-26 18:30:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2291ad8-5fdc-5c48-a6f1-faad15ea5095 with scrape type 1
2026-03-26 18:30:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a2291ad8-5fdc-5c48-a6f1-faad15ea5095
2026-03-26 18:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F520%252F1ac05c7b989e46cb9f7e5a333d782e7e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:30:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/520/1ac05c7b989e46cb9f7e5a333d782e7e/images/large/1.jpg not downloaded yet
2026-03-26 18:30:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/199/9df5292a669749c19e8655bd4c289f3f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:30:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/072/9fa43e7780204dd9b1147c232cc6843b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:30:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/668/8fcd9f4976f24aae9267fa5674986dda/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:30:24 [ayvens.es] INFO: Found listing with ID: 1985117
2026-03-26 18:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985117%27 HTTP/1.1" 200 None
2026-03-26 18:30:24 [ayvens.es] INFO: Scrape type for 1985117: 1
2026-03-26 18:30:24 [ayvens.es] INFO: Extracting data for car ID: 1985117
2026-03-26 18:30:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd977eb1-f321-5bbf-9f04-1e3454d8d1a2 with identifier: 1985117
2026-03-26 18:30:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd977eb1-f321-5bbf-9f04-1e3454d8d1a2 with scrape type 1
2026-03-26 18:30:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item bd977eb1-f321-5bbf-9f04-1e3454d8d1a2
2026-03-26 18:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F043%252F4cd90668e89f424a8ec4fda9fcece04d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:30:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/043/4cd90668e89f424a8ec4fda9fcece04d/images/large/1.jpg not downloaded yet
2026-03-26 18:30:24 [ayvens.es] INFO: Found listing with ID: 1985118
2026-03-26 18:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985118%27 HTTP/1.1" 200 None
2026-03-26 18:30:24 [ayvens.es] INFO: Scrape type for 1985118: 1
2026-03-26 18:30:24 [ayvens.es] INFO: Extracting data for car ID: 1985118
2026-03-26 18:30:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6be343e3-0d03-56ef-ace5-c151a14e9bee with identifier: 1985118
2026-03-26 18:30:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6be343e3-0d03-56ef-ace5-c151a14e9bee with scrape type 1
2026-03-26 18:30:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6be343e3-0d03-56ef-ace5-c151a14e9bee
2026-03-26 18:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F032%252Fc796a74581e0459b99055c86f9f21016%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:30:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/032/c796a74581e0459b99055c86f9f21016/images/large/1.jpg not downloaded yet
2026-03-26 18:30:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-26 18:30:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-26 18:30:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:30:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28ae11d0>
2026-03-26 18:30:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:30:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-26 18:30:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2118
2026-03-26 18:30:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-26 18:30:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:30:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:30:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1161af14-6dd0-5484-8bec-7db37cec99f9/1161af14-6dd0-5484-8bec-7db37cec99f9_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F493%252Fe5060dba1d4e41b7b5fb7cacfd0d848a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/493/e5060dba1d4e41b7b5fb7cacfd0d848a/images/large/1.jpg saved to cache
2026-03-26 18:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1161af14-6dd0-5484-8bec-7db37cec99f9
2026-03-26 18:30:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1161af14-6dd0-5484-8bec-7db37cec99f9, skipping ID generation
2026-03-26 18:30:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1161af14-6dd0-5484-8bec-7db37cec99f9 with scrape type 1
2026-03-26 18:30:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1161af14-6dd0-5484-8bec-7db37cec99f9 sending to next pipeline
2026-03-26 18:30:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1161af14-6dd0-5484-8bec-7db37cec99f9, identifier: 1985098
2026-03-26 18:30:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:30:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a283ba050>
2026-03-26 18:30:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:30:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:30:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:30:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fe4a21a-a0b6-52b7-a676-8068ef50acaf/1fe4a21a-a0b6-52b7-a676-8068ef50acaf_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F503%252Fb1cb914cde20427f83a98952258ad0fc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/503/b1cb914cde20427f83a98952258ad0fc/images/large/1.jpg saved to cache
2026-03-26 18:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1fe4a21a-a0b6-52b7-a676-8068ef50acaf
2026-03-26 18:30:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1fe4a21a-a0b6-52b7-a676-8068ef50acaf, skipping ID generation
2026-03-26 18:30:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fe4a21a-a0b6-52b7-a676-8068ef50acaf with scrape type 1
2026-03-26 18:30:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1fe4a21a-a0b6-52b7-a676-8068ef50acaf sending to next pipeline
2026-03-26 18:30:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1fe4a21a-a0b6-52b7-a676-8068ef50acaf, identifier: 1985097
2026-03-26 18:30:25 [ayvens.es] INFO: Found listing with ID: 1985119
2026-03-26 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985119%27 HTTP/1.1" 200 None
2026-03-26 18:30:25 [ayvens.es] INFO: Scrape type for 1985119: 1
2026-03-26 18:30:25 [ayvens.es] INFO: Extracting data for car ID: 1985119
2026-03-26 18:30:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f05e3c4-111d-5bac-a31f-6ab61087c362 with identifier: 1985119
2026-03-26 18:30:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f05e3c4-111d-5bac-a31f-6ab61087c362 with scrape type 1
2026-03-26 18:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9f05e3c4-111d-5bac-a31f-6ab61087c362
2026-03-26 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F056%252F3f27b432ddd640b0a4dc3e3532c0147a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/056/3f27b432ddd640b0a4dc3e3532c0147a/images/large/1.jpg not downloaded yet
2026-03-26 18:30:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1161af14-6dd0-5484-8bec-7db37cec99f9 with identifier: 1985098
2026-03-26 18:30:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:30:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1161af14-6dd0-5484-8bec-7db37cec99f9 with identifier: 1985098
2026-03-26 18:30:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1161af14-6dd0-5484-8bec-7db37cec99f9 with identifier: 1985098 to the API
2026-03-26 18:30:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:30:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:30:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/493/e5060dba1d4e41b7b5fb7cacfd0d848a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'Blanco glaciar',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'gas',
 'id': '1161af14-6dd0-5484-8bec-7db37cec99f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'DACIA',
 'model': 'SANDERO',
 'odometer': 68528,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1161af14-6dd0-5484-8bec-7db37cec99f9/1161af14-6dd0-5484-8bec-7db37cec99f9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 313069,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/493/e5060dba1d4e41b7b5fb7cacfd0d848a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DACIA SANDERO Comfort 74kW (100CV) ECO-G',
 'transmission': 'manual',
 'trim': 'Comfort 74kW (100CV) ECO-G',
 'vin': None,
 'year': 2022}
2026-03-26 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985098%27 HTTP/1.1" 200 None
2026-03-26 18:30:26 [ayvens.es] INFO: Saving data for 1985098: {'created_time': 1774549826.380451, 'last_price_update_time': 1774549826.380463, 'auction_closing_time': 1774612800.0}
2026-03-26 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985098') HTTP/1.1" 204 0
2026-03-26 18:30:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1fe4a21a-a0b6-52b7-a676-8068ef50acaf with identifier: 1985097
2026-03-26 18:30:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:30:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:30:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1fe4a21a-a0b6-52b7-a676-8068ef50acaf with identifier: 1985097
2026-03-26 18:30:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1fe4a21a-a0b6-52b7-a676-8068ef50acaf with identifier: 1985097 to the API
2026-03-26 18:30:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:30:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:30:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/503/b1cb914cde20427f83a98952258ad0fc/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'electric',
 'id': '1fe4a21a-a0b6-52b7-a676-8068ef50acaf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'MODEL 3',
 'odometer': 33415,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fe4a21a-a0b6-52b7-a676-8068ef50acaf/1fe4a21a-a0b6-52b7-a676-8068ef50acaf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 320713,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/503/b1cb914cde20427f83a98952258ad0fc/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA MODEL 3 Estandar Plus RWD',
 'transmission': 'manual',
 'trim': 'Estandar Plus RWD',
 'vin': None,
 'year': 2020}
2026-03-26 18:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985097%27 HTTP/1.1" 200 None
2026-03-26 18:30:28 [ayvens.es] INFO: Saving data for 1985097: {'created_time': 1774549828.264784, 'last_price_update_time': 1774549828.264795, 'auction_closing_time': 1774612800.0}
2026-03-26 18:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985097') HTTP/1.1" 204 0
2026-03-26 18:30:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:30:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a283b8a10>
2026-03-26 18:30:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:30:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:30:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:30:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78233c73-1d43-5698-b2b2-d3c507d59211/78233c73-1d43-5698-b2b2-d3c507d59211_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F199%252F9df5292a669749c19e8655bd4c289f3f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/199/9df5292a669749c19e8655bd4c289f3f/images/large/1.jpg saved to cache
2026-03-26 18:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 78233c73-1d43-5698-b2b2-d3c507d59211
2026-03-26 18:30:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 78233c73-1d43-5698-b2b2-d3c507d59211, skipping ID generation
2026-03-26 18:30:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78233c73-1d43-5698-b2b2-d3c507d59211 with scrape type 1
2026-03-26 18:30:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 78233c73-1d43-5698-b2b2-d3c507d59211 sending to next pipeline
2026-03-26 18:30:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 78233c73-1d43-5698-b2b2-d3c507d59211, identifier: 1985099
2026-03-26 18:30:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:30:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28ad82d0>
2026-03-26 18:30:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:30:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:30:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:30:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d70fe5ab-b422-59ad-98fa-71d371578526/d70fe5ab-b422-59ad-98fa-71d371578526_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F072%252F9fa43e7780204dd9b1147c232cc6843b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/072/9fa43e7780204dd9b1147c232cc6843b/images/large/1.jpg saved to cache
2026-03-26 18:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d70fe5ab-b422-59ad-98fa-71d371578526
2026-03-26 18:30:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d70fe5ab-b422-59ad-98fa-71d371578526, skipping ID generation
2026-03-26 18:30:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d70fe5ab-b422-59ad-98fa-71d371578526 with scrape type 1
2026-03-26 18:30:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d70fe5ab-b422-59ad-98fa-71d371578526 sending to next pipeline
2026-03-26 18:30:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d70fe5ab-b422-59ad-98fa-71d371578526, identifier: 1985102
2026-03-26 18:30:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:30:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a290b56d0>
2026-03-26 18:30:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:30:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:30:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:30:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e1b3ce8-5eba-5e3f-85a5-23c9023818a1/5e1b3ce8-5eba-5e3f-85a5-23c9023818a1_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F668%252F8fcd9f4976f24aae9267fa5674986dda%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/668/8fcd9f4976f24aae9267fa5674986dda/images/large/1.jpg saved to cache
2026-03-26 18:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5e1b3ce8-5eba-5e3f-85a5-23c9023818a1
2026-03-26 18:30:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5e1b3ce8-5eba-5e3f-85a5-23c9023818a1, skipping ID generation
2026-03-26 18:30:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e1b3ce8-5eba-5e3f-85a5-23c9023818a1 with scrape type 1
2026-03-26 18:30:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5e1b3ce8-5eba-5e3f-85a5-23c9023818a1 sending to next pipeline
2026-03-26 18:30:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5e1b3ce8-5eba-5e3f-85a5-23c9023818a1, identifier: 1985103
2026-03-26 18:30:28 [ayvens.es] INFO: Found listing with ID: 1985120
2026-03-26 18:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985120%27 HTTP/1.1" 200 None
2026-03-26 18:30:28 [ayvens.es] INFO: Scrape type for 1985120: 1
2026-03-26 18:30:28 [ayvens.es] INFO: Extracting data for car ID: 1985120
2026-03-26 18:30:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c29cc68d-dd6b-5840-843a-c42cda9d3d6f with identifier: 1985120
2026-03-26 18:30:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c29cc68d-dd6b-5840-843a-c42cda9d3d6f with scrape type 1
2026-03-26 18:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c29cc68d-dd6b-5840-843a-c42cda9d3d6f
2026-03-26 18:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F283%252F607709341fd84130910d218a5fef1800%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/283/607709341fd84130910d218a5fef1800/images/large/1.jpg not downloaded yet
2026-03-26 18:30:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 78233c73-1d43-5698-b2b2-d3c507d59211 with identifier: 1985099
2026-03-26 18:30:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 78233c73-1d43-5698-b2b2-d3c507d59211 with identifier: 1985099
2026-03-26 18:30:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 78233c73-1d43-5698-b2b2-d3c507d59211 with identifier: 1985099 to the API
2026-03-26 18:30:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:30:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:30:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/199/9df5292a669749c19e8655bd4c289f3f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'color': 'Blanco glaciar',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'gas',
 'id': '78233c73-1d43-5698-b2b2-d3c507d59211',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 85704,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78233c73-1d43-5698-b2b2-d3c507d59211/78233c73-1d43-5698-b2b2-d3c507d59211_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344159,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/199/9df5292a669749c19e8655bd4c289f3f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO Business TCe 74 kW (100CV) GLP',
 'transmission': 'manual',
 'trim': 'Business TCe 74 kW (100CV) GLP',
 'vin': None,
 'year': 2021}
2026-03-26 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985099%27 HTTP/1.1" 200 None
2026-03-26 18:30:29 [ayvens.es] INFO: Saving data for 1985099: {'created_time': 1774549829.525117, 'last_price_update_time': 1774549829.525127, 'auction_closing_time': 1774612800.0}
2026-03-26 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985099') HTTP/1.1" 204 0
2026-03-26 18:30:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d70fe5ab-b422-59ad-98fa-71d371578526 with identifier: 1985102
2026-03-26 18:30:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d70fe5ab-b422-59ad-98fa-71d371578526 with identifier: 1985102
2026-03-26 18:30:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d70fe5ab-b422-59ad-98fa-71d371578526 with identifier: 1985102 to the API
2026-03-26 18:30:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:30:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:30:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/072/9fa43e7780204dd9b1147c232cc6843b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '0.9L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'gas',
 'id': 'd70fe5ab-b422-59ad-98fa-71d371578526',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 170128,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d70fe5ab-b422-59ad-98fa-71d371578526/d70fe5ab-b422-59ad-98fa-71d371578526_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 315383,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/072/9fa43e7780204dd9b1147c232cc6843b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO Business TCe 66kW (90CV) GLP -18',
 'transmission': 'manual',
 'trim': 'Business TCe 66kW (90CV) GLP -18',
 'vin': None,
 'year': 2019}
2026-03-26 18:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985102%27 HTTP/1.1" 200 None
2026-03-26 18:30:31 [ayvens.es] INFO: Saving data for 1985102: {'created_time': 1774549831.005296, 'last_price_update_time': 1774549831.005308, 'auction_closing_time': 1774612800.0}
2026-03-26 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985102') HTTP/1.1" 204 0
2026-03-26 18:30:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5e1b3ce8-5eba-5e3f-85a5-23c9023818a1 with identifier: 1985103
2026-03-26 18:30:31 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:30:31 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:30:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5e1b3ce8-5eba-5e3f-85a5-23c9023818a1 with identifier: 1985103
2026-03-26 18:30:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5e1b3ce8-5eba-5e3f-85a5-23c9023818a1 with identifier: 1985103 to the API
2026-03-26 18:30:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:30:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:30:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/668/8fcd9f4976f24aae9267fa5674986dda/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 30,
 'color': 'Gris artense',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '5e1b3ce8-5eba-5e3f-85a5-23c9023818a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 140767,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e1b3ce8-5eba-5e3f-85a5-23c9023818a1/5e1b3ce8-5eba-5e3f-85a5-23c9023818a1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 358951,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/668/8fcd9f4976f24aae9267fa5674986dda/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 300 e-EAT8 GT',
 'transmission': 'manual',
 'trim': '300 e-EAT8 GT',
 'vin': None,
 'year': 2022}
2026-03-26 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985103%27 HTTP/1.1" 200 None
2026-03-26 18:30:31 [ayvens.es] INFO: Saving data for 1985103: {'created_time': 1774549831.427602, 'last_price_update_time': 1774549831.427613, 'auction_closing_time': 1774612800.0}
2026-03-26 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985103') HTTP/1.1" 204 0
2026-03-26 18:30:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/089/18d4f0d392d742eab751bf47a54d5bd5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:30:31 [ayvens.es] INFO: Found listing with ID: 1985121
2026-03-26 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985121%27 HTTP/1.1" 200 None
2026-03-26 18:30:31 [ayvens.es] INFO: Scrape type for 1985121: 1
2026-03-26 18:30:31 [ayvens.es] INFO: Extracting data for car ID: 1985121
2026-03-26 18:30:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0814d961-8d95-5ca6-ad77-9aee5a9bed95 with identifier: 1985121
2026-03-26 18:30:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0814d961-8d95-5ca6-ad77-9aee5a9bed95 with scrape type 1
2026-03-26 18:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0814d961-8d95-5ca6-ad77-9aee5a9bed95
2026-03-26 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F556%252Fdde8dd05974b4abe9d81f75f5a9aebd0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/556/dde8dd05974b4abe9d81f75f5a9aebd0/images/large/1.jpg not downloaded yet
2026-03-26 18:30:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/836/c3b0bba5939849d1b1c3ed1bf7b02d56/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:30:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/053/7cfe1be888a84a3bb8c76860cd234596/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:30:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/860/3afa940ec7944d6b885e4261700811a0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:30:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/209/0c9b84fe410d485cb75f04bf7fb9878f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:30:31 [ayvens.es] INFO: Found listing with ID: 1985122
2026-03-26 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985122%27 HTTP/1.1" 200 None
2026-03-26 18:30:31 [ayvens.es] INFO: Scrape type for 1985122: 1
2026-03-26 18:30:31 [ayvens.es] INFO: Extracting data for car ID: 1985122
2026-03-26 18:30:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c01575cd-becb-5fc6-b2d1-7af68dd7abc1 with identifier: 1985122
2026-03-26 18:30:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c01575cd-becb-5fc6-b2d1-7af68dd7abc1 with scrape type 1
2026-03-26 18:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c01575cd-becb-5fc6-b2d1-7af68dd7abc1
2026-03-26 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F241%252F07673603ecfa4929a00dc0f4d9a63b21%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/241/07673603ecfa4929a00dc0f4d9a63b21/images/large/1.jpg not downloaded yet
2026-03-26 18:30:31 [ayvens.es] INFO: Found listing with ID: 1985123
2026-03-26 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985123%27 HTTP/1.1" 200 None
2026-03-26 18:30:31 [ayvens.es] INFO: Scrape type for 1985123: 1
2026-03-26 18:30:31 [ayvens.es] INFO: Extracting data for car ID: 1985123
2026-03-26 18:30:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82a4586e-47a7-5f26-a728-e0a20ea1e9ab with identifier: 1985123
2026-03-26 18:30:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82a4586e-47a7-5f26-a728-e0a20ea1e9ab with scrape type 1
2026-03-26 18:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 82a4586e-47a7-5f26-a728-e0a20ea1e9ab
2026-03-26 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F532%252Fb29a33552a9a4d39a835872e4c97d333%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/532/b29a33552a9a4d39a835872e4c97d333/images/large/1.jpg not downloaded yet
2026-03-26 18:30:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/243/c2d321e5a29a4bd38bef5abd6c3a4ee9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:30:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/302/7e88896b2bec4af0be049bb45ce0d4a0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:30:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/644/8327cae1a3714ed98215ab4d14e91416/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:30:31 [ayvens.es] INFO: Found listing with ID: 1985124
2026-03-26 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985124%27 HTTP/1.1" 200 None
2026-03-26 18:30:31 [ayvens.es] INFO: Scrape type for 1985124: 1
2026-03-26 18:30:31 [ayvens.es] INFO: Extracting data for car ID: 1985124
2026-03-26 18:30:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ef8f64f-dbc0-5ead-8562-34bdd2a83c04 with identifier: 1985124
2026-03-26 18:30:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ef8f64f-dbc0-5ead-8562-34bdd2a83c04 with scrape type 1
2026-03-26 18:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1ef8f64f-dbc0-5ead-8562-34bdd2a83c04
2026-03-26 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F904%252F384be6545da548f9af2f4df68b4429b8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/904/384be6545da548f9af2f4df68b4429b8/images/large/1.jpg not downloaded yet
2026-03-26 18:30:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:30:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28ea1b90>
2026-03-26 18:30:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:30:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:30:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:30:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f90508c4-65b9-5d4b-afd1-5a71a3fb0744/f90508c4-65b9-5d4b-afd1-5a71a3fb0744_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F089%252F18d4f0d392d742eab751bf47a54d5bd5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/089/18d4f0d392d742eab751bf47a54d5bd5/images/large/1.jpg saved to cache
2026-03-26 18:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f90508c4-65b9-5d4b-afd1-5a71a3fb0744
2026-03-26 18:30:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f90508c4-65b9-5d4b-afd1-5a71a3fb0744, skipping ID generation
2026-03-26 18:30:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f90508c4-65b9-5d4b-afd1-5a71a3fb0744 with scrape type 1
2026-03-26 18:30:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f90508c4-65b9-5d4b-afd1-5a71a3fb0744 sending to next pipeline
2026-03-26 18:30:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f90508c4-65b9-5d4b-afd1-5a71a3fb0744, identifier: 1985105
2026-03-26 18:30:31 [ayvens.es] INFO: Found listing with ID: 1985125
2026-03-26 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985125%27 HTTP/1.1" 200 None
2026-03-26 18:30:31 [ayvens.es] INFO: Scrape type for 1985125: 1
2026-03-26 18:30:31 [ayvens.es] INFO: Extracting data for car ID: 1985125
2026-03-26 18:30:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 555b676c-3d6b-5446-9a8e-e99a7d873c26 with identifier: 1985125
2026-03-26 18:30:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 555b676c-3d6b-5446-9a8e-e99a7d873c26 with scrape type 1
2026-03-26 18:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 555b676c-3d6b-5446-9a8e-e99a7d873c26
2026-03-26 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F646%252F211717e20e8f455b86cd8c5e95a4f01e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/646/211717e20e8f455b86cd8c5e95a4f01e/images/large/1.jpg not downloaded yet
2026-03-26 18:30:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f90508c4-65b9-5d4b-afd1-5a71a3fb0744 with identifier: 1985105
2026-03-26 18:30:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f90508c4-65b9-5d4b-afd1-5a71a3fb0744 with identifier: 1985105
2026-03-26 18:30:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f90508c4-65b9-5d4b-afd1-5a71a3fb0744 with identifier: 1985105 to the API
2026-03-26 18:30:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:30:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:30:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/089/18d4f0d392d742eab751bf47a54d5bd5/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 92,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'gas',
 'id': 'f90508c4-65b9-5d4b-afd1-5a71a3fb0744',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'IBIZA',
 'odometer': 51609,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f90508c4-65b9-5d4b-afd1-5a71a3fb0744/f90508c4-65b9-5d4b-afd1-5a71a3fb0744_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347251,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/089/18d4f0d392d742eab751bf47a54d5bd5/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT IBIZA 1.0 TGI 66kW (90CV) Style Go',
 'transmission': 'manual',
 'trim': '1.0 TGI 66kW (90CV) Style Go',
 'vin': None,
 'year': 2020}
2026-03-26 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985105%27 HTTP/1.1" 200 None
2026-03-26 18:30:32 [ayvens.es] INFO: Saving data for 1985105: {'created_time': 1774549832.130424, 'last_price_update_time': 1774549832.130437, 'auction_closing_time': 1774612800.0}
2026-03-26 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985105') HTTP/1.1" 204 0
2026-03-26 18:30:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:30:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c21350>
2026-03-26 18:30:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:30:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:30:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:30:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a9f62e4-244d-5076-af93-35f627a9a3c6/1a9f62e4-244d-5076-af93-35f627a9a3c6_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F836%252Fc3b0bba5939849d1b1c3ed1bf7b02d56%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/836/c3b0bba5939849d1b1c3ed1bf7b02d56/images/large/1.jpg saved to cache
2026-03-26 18:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1a9f62e4-244d-5076-af93-35f627a9a3c6
2026-03-26 18:30:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1a9f62e4-244d-5076-af93-35f627a9a3c6, skipping ID generation
2026-03-26 18:30:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a9f62e4-244d-5076-af93-35f627a9a3c6 with scrape type 1
2026-03-26 18:30:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1a9f62e4-244d-5076-af93-35f627a9a3c6 sending to next pipeline
2026-03-26 18:30:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1a9f62e4-244d-5076-af93-35f627a9a3c6, identifier: 1985100
2026-03-26 18:30:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:30:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28317f90>
2026-03-26 18:30:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:30:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:30:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:30:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_800a2363-5128-50d7-aa8b-2c2c8be67c97/800a2363-5128-50d7-aa8b-2c2c8be67c97_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F053%252F7cfe1be888a84a3bb8c76860cd234596%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/053/7cfe1be888a84a3bb8c76860cd234596/images/large/1.jpg saved to cache
2026-03-26 18:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 800a2363-5128-50d7-aa8b-2c2c8be67c97
2026-03-26 18:30:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 800a2363-5128-50d7-aa8b-2c2c8be67c97, skipping ID generation
2026-03-26 18:30:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 800a2363-5128-50d7-aa8b-2c2c8be67c97 with scrape type 1
2026-03-26 18:30:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 800a2363-5128-50d7-aa8b-2c2c8be67c97 sending to next pipeline
2026-03-26 18:30:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 800a2363-5128-50d7-aa8b-2c2c8be67c97, identifier: 1985106
2026-03-26 18:30:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:30:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c4f210>
2026-03-26 18:30:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:30:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:30:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:30:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e04ddbf-1a9d-5a22-82c1-c15273cc74a8/6e04ddbf-1a9d-5a22-82c1-c15273cc74a8_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F860%252F3afa940ec7944d6b885e4261700811a0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/860/3afa940ec7944d6b885e4261700811a0/images/large/1.jpg saved to cache
2026-03-26 18:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6e04ddbf-1a9d-5a22-82c1-c15273cc74a8
2026-03-26 18:30:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6e04ddbf-1a9d-5a22-82c1-c15273cc74a8, skipping ID generation
2026-03-26 18:30:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e04ddbf-1a9d-5a22-82c1-c15273cc74a8 with scrape type 1
2026-03-26 18:30:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6e04ddbf-1a9d-5a22-82c1-c15273cc74a8 sending to next pipeline
2026-03-26 18:30:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6e04ddbf-1a9d-5a22-82c1-c15273cc74a8, identifier: 1985107
2026-03-26 18:30:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:30:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28329810>
2026-03-26 18:30:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:30:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:30:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:30:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_673df575-e494-57ec-a35b-64dd5d6d8d22/673df575-e494-57ec-a35b-64dd5d6d8d22_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F209%252F0c9b84fe410d485cb75f04bf7fb9878f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/209/0c9b84fe410d485cb75f04bf7fb9878f/images/large/1.jpg saved to cache
2026-03-26 18:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 673df575-e494-57ec-a35b-64dd5d6d8d22
2026-03-26 18:30:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 673df575-e494-57ec-a35b-64dd5d6d8d22, skipping ID generation
2026-03-26 18:30:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 673df575-e494-57ec-a35b-64dd5d6d8d22 with scrape type 1
2026-03-26 18:30:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 673df575-e494-57ec-a35b-64dd5d6d8d22 sending to next pipeline
2026-03-26 18:30:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 673df575-e494-57ec-a35b-64dd5d6d8d22, identifier: 1985110
2026-03-26 18:30:32 [ayvens.es] INFO: Found listing with ID: 1985126
2026-03-26 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985126%27 HTTP/1.1" 200 None
2026-03-26 18:30:32 [ayvens.es] INFO: Scrape type for 1985126: 1
2026-03-26 18:30:32 [ayvens.es] INFO: Extracting data for car ID: 1985126
2026-03-26 18:30:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 352fcc91-819e-5358-88b0-ae0c1739d5ab with identifier: 1985126
2026-03-26 18:30:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 352fcc91-819e-5358-88b0-ae0c1739d5ab with scrape type 1
2026-03-26 18:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 352fcc91-819e-5358-88b0-ae0c1739d5ab
2026-03-26 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F771%252Ff650b92bd0af4e889d71e0ca7a083f4e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/771/f650b92bd0af4e889d71e0ca7a083f4e/images/large/1.jpg not downloaded yet
2026-03-26 18:30:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1a9f62e4-244d-5076-af93-35f627a9a3c6 with identifier: 1985100
2026-03-26 18:30:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1a9f62e4-244d-5076-af93-35f627a9a3c6 with identifier: 1985100
2026-03-26 18:30:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1a9f62e4-244d-5076-af93-35f627a9a3c6 with identifier: 1985100 to the API
2026-03-26 18:30:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:30:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:30:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/836/c3b0bba5939849d1b1c3ed1bf7b02d56/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 30,
 'color': 'Gris artense',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '1a9f62e4-244d-5076-af93-35f627a9a3c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 157737,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a9f62e4-244d-5076-af93-35f627a9a3c6/1a9f62e4-244d-5076-af93-35f627a9a3c6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 375923,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/836/c3b0bba5939849d1b1c3ed1bf7b02d56/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 300 e-EAT8 GT',
 'transmission': 'manual',
 'trim': '300 e-EAT8 GT',
 'vin': None,
 'year': 2022}
2026-03-26 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985100%27 HTTP/1.1" 200 None
2026-03-26 18:30:33 [ayvens.es] INFO: Saving data for 1985100: {'created_time': 1774549833.219907, 'last_price_update_time': 1774549833.219918, 'auction_closing_time': 1774612800.0}
2026-03-26 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985100') HTTP/1.1" 204 0
2026-03-26 18:30:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 800a2363-5128-50d7-aa8b-2c2c8be67c97 with identifier: 1985106
2026-03-26 18:30:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 800a2363-5128-50d7-aa8b-2c2c8be67c97 with identifier: 1985106
2026-03-26 18:30:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 800a2363-5128-50d7-aa8b-2c2c8be67c97 with identifier: 1985106 to the API
2026-03-26 18:30:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:30:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:30:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/053/7cfe1be888a84a3bb8c76860cd234596/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'electric',
 'id': '800a2363-5128-50d7-aa8b-2c2c8be67c97',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 100040,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_800a2363-5128-50d7-aa8b-2c2c8be67c97/800a2363-5128-50d7-aa8b-2c2c8be67c97_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 439394,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/053/7cfe1be888a84a3bb8c76860cd234596/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-16',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS Z.E. Flexi***BATERIA EN REGIMEN DE '
          'ALQUILER***',
 'transmission': 'manual',
 'trim': 'Z.E. Flexi***BATERIA EN REGIMEN DE ALQUILER***',
 'vin': None,
 'year': 2019}
2026-03-26 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985106%27 HTTP/1.1" 200 None
2026-03-26 18:30:33 [ayvens.es] INFO: Saving data for 1985106: {'created_time': 1774549833.541067, 'last_price_update_time': 1774549833.541077, 'auction_closing_time': 1774612800.0}
2026-03-26 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985106') HTTP/1.1" 204 0
2026-03-26 18:30:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6e04ddbf-1a9d-5a22-82c1-c15273cc74a8 with identifier: 1985107
2026-03-26 18:30:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6e04ddbf-1a9d-5a22-82c1-c15273cc74a8 with identifier: 1985107
2026-03-26 18:30:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 6e04ddbf-1a9d-5a22-82c1-c15273cc74a8 with identifier: 1985107 to the API
2026-03-26 18:30:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:30:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:30:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/860/3afa940ec7944d6b885e4261700811a0/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.6L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'gas',
 'id': '6e04ddbf-1a9d-5a22-82c1-c15273cc74a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'DACIA',
 'model': 'DOKKER',
 'odometer': 285469,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e04ddbf-1a9d-5a22-82c1-c15273cc74a8/6e04ddbf-1a9d-5a22-82c1-c15273cc74a8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340415,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/860/3afa940ec7944d6b885e4261700811a0/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-28',
 'seats_number': 2,
 'seller_name': None,
 'title': 'DACIA DOKKER Van Essential 1.6 80kW (107CV) GLP',
 'transmission': 'manual',
 'trim': 'Van Essential 1.6 80kW (107CV) GLP',
 'vin': None,
 'year': 2019}
2026-03-26 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985107%27 HTTP/1.1" 200 None
2026-03-26 18:30:33 [ayvens.es] INFO: Saving data for 1985107: {'created_time': 1774549833.83095, 'last_price_update_time': 1774549833.830959, 'auction_closing_time': 1774612800.0}
2026-03-26 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985107') HTTP/1.1" 204 0
2026-03-26 18:30:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 673df575-e494-57ec-a35b-64dd5d6d8d22 with identifier: 1985110
2026-03-26 18:30:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:30:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 673df575-e494-57ec-a35b-64dd5d6d8d22 with identifier: 1985110
2026-03-26 18:30:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 673df575-e494-57ec-a35b-64dd5d6d8d22 with identifier: 1985110 to the API
2026-03-26 18:30:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:30:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:30:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/209/0c9b84fe410d485cb75f04bf7fb9878f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 35,
 'color': 'Cristal pearl',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '673df575-e494-57ec-a35b-64dd5d6d8d22',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS 7 CROSSBACK',
 'odometer': 135426,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_673df575-e494-57ec-a35b-64dd5d6d8d22/673df575-e494-57ec-a35b-64dd5d6d8d22_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 364385,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/209/0c9b84fe410d485cb75f04bf7fb9878f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS 7 CROSSBACK 1.6 E-Tense 225 PERFORMANCE LINE Auto',
 'transmission': 'manual',
 'trim': '1.6 E-Tense 225 PERFORMANCE LINE Auto',
 'vin': None,
 'year': 2021}
2026-03-26 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985110%27 HTTP/1.1" 200 None
2026-03-26 18:30:34 [ayvens.es] INFO: Saving data for 1985110: {'created_time': 1774549834.178591, 'last_price_update_time': 1774549834.178601, 'auction_closing_time': 1774612800.0}
2026-03-26 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985110') HTTP/1.1" 204 0
2026-03-26 18:30:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:30:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28375010>
2026-03-26 18:30:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:30:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:30:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:30:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ec7cecd-7ced-5062-bc30-8399efb3b6c0/8ec7cecd-7ced-5062-bc30-8399efb3b6c0_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F243%252Fc2d321e5a29a4bd38bef5abd6c3a4ee9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/243/c2d321e5a29a4bd38bef5abd6c3a4ee9/images/large/1.jpg saved to cache
2026-03-26 18:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8ec7cecd-7ced-5062-bc30-8399efb3b6c0
2026-03-26 18:30:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8ec7cecd-7ced-5062-bc30-8399efb3b6c0, skipping ID generation
2026-03-26 18:30:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ec7cecd-7ced-5062-bc30-8399efb3b6c0 with scrape type 1
2026-03-26 18:30:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8ec7cecd-7ced-5062-bc30-8399efb3b6c0 sending to next pipeline
2026-03-26 18:30:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8ec7cecd-7ced-5062-bc30-8399efb3b6c0, identifier: 1985108
2026-03-26 18:30:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:30:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28315bd0>
2026-03-26 18:30:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:30:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:30:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:30:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_569475b6-49ce-522f-9c0c-b9760863b4e4/569475b6-49ce-522f-9c0c-b9760863b4e4_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F302%252F7e88896b2bec4af0be049bb45ce0d4a0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/302/7e88896b2bec4af0be049bb45ce0d4a0/images/large/1.jpg saved to cache
2026-03-26 18:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 569475b6-49ce-522f-9c0c-b9760863b4e4
2026-03-26 18:30:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 569475b6-49ce-522f-9c0c-b9760863b4e4, skipping ID generation
2026-03-26 18:30:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 569475b6-49ce-522f-9c0c-b9760863b4e4 with scrape type 1
2026-03-26 18:30:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 569475b6-49ce-522f-9c0c-b9760863b4e4 sending to next pipeline
2026-03-26 18:30:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 569475b6-49ce-522f-9c0c-b9760863b4e4, identifier: 1985109
2026-03-26 18:30:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:30:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a2ab0c450>
2026-03-26 18:30:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:30:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:30:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:30:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca8813be-824c-5c1b-9d58-2738f2eb06d4/ca8813be-824c-5c1b-9d58-2738f2eb06d4_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F644%252F8327cae1a3714ed98215ab4d14e91416%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/644/8327cae1a3714ed98215ab4d14e91416/images/large/1.jpg saved to cache
2026-03-26 18:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ca8813be-824c-5c1b-9d58-2738f2eb06d4
2026-03-26 18:30:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ca8813be-824c-5c1b-9d58-2738f2eb06d4, skipping ID generation
2026-03-26 18:30:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca8813be-824c-5c1b-9d58-2738f2eb06d4 with scrape type 1
2026-03-26 18:30:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ca8813be-824c-5c1b-9d58-2738f2eb06d4 sending to next pipeline
2026-03-26 18:30:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ca8813be-824c-5c1b-9d58-2738f2eb06d4, identifier: 1985104
2026-03-26 18:30:34 [ayvens.es] INFO: Found listing with ID: 1985127
2026-03-26 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985127%27 HTTP/1.1" 200 None
2026-03-26 18:30:34 [ayvens.es] INFO: Scrape type for 1985127: 1
2026-03-26 18:30:34 [ayvens.es] INFO: Extracting data for car ID: 1985127
2026-03-26 18:30:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df06afe5-f2e3-542f-b91a-0c8e24dc5e3a with identifier: 1985127
2026-03-26 18:30:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df06afe5-f2e3-542f-b91a-0c8e24dc5e3a with scrape type 1
2026-03-26 18:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item df06afe5-f2e3-542f-b91a-0c8e24dc5e3a
2026-03-26 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F945%252F743fdc4409db41409e6914ddbb1a446d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/945/743fdc4409db41409e6914ddbb1a446d/images/large/1.jpg not downloaded yet
2026-03-26 18:30:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8ec7cecd-7ced-5062-bc30-8399efb3b6c0 with identifier: 1985108
2026-03-26 18:30:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8ec7cecd-7ced-5062-bc30-8399efb3b6c0 with identifier: 1985108
2026-03-26 18:30:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8ec7cecd-7ced-5062-bc30-8399efb3b6c0 with identifier: 1985108 to the API
2026-03-26 18:30:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:30:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:30:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/243/c2d321e5a29a4bd38bef5abd6c3a4ee9/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 84,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '8ec7cecd-7ced-5062-bc30-8399efb3b6c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'YARIS',
 'odometer': 71730,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ec7cecd-7ced-5062-bc30-8399efb3b6c0/8ec7cecd-7ced-5062-bc30-8399efb3b6c0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 613424,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/243/c2d321e5a29a4bd38bef5abd6c3a4ee9/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA YARIS 1.5 100H Active',
 'transmission': 'manual',
 'trim': '1.5 100H Active',
 'vin': None,
 'year': 2020}
2026-03-26 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985108%27 HTTP/1.1" 200 None
2026-03-26 18:30:35 [ayvens.es] INFO: Saving data for 1985108: {'created_time': 1774549835.055532, 'last_price_update_time': 1774549835.055542, 'auction_closing_time': 1774612800.0}
2026-03-26 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985108') HTTP/1.1" 204 0
2026-03-26 18:30:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 569475b6-49ce-522f-9c0c-b9760863b4e4 with identifier: 1985109
2026-03-26 18:30:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:30:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 569475b6-49ce-522f-9c0c-b9760863b4e4 with identifier: 1985109
2026-03-26 18:30:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 569475b6-49ce-522f-9c0c-b9760863b4e4 with identifier: 1985109 to the API
2026-03-26 18:30:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:30:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:30:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/302/7e88896b2bec4af0be049bb45ce0d4a0/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Magnetico',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '569475b6-49ce-522f-9c0c-b9760863b4e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'S-MAX',
 'odometer': 79919,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_569475b6-49ce-522f-9c0c-b9760863b4e4/569475b6-49ce-522f-9c0c-b9760863b4e4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 578449,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/302/7e88896b2bec4af0be049bb45ce0d4a0/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-08',
 'seats_number': 7,
 'seller_name': None,
 'title': 'FORD S-MAX 2.5 Duratec Atkinson FHEV 140kW Titanium',
 'transmission': 'manual',
 'trim': '2.5 Duratec Atkinson FHEV 140kW Titanium',
 'vin': None,
 'year': 2022}
2026-03-26 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985109%27 HTTP/1.1" 200 None
2026-03-26 18:30:35 [ayvens.es] INFO: Saving data for 1985109: {'created_time': 1774549835.35631, 'last_price_update_time': 1774549835.35632, 'auction_closing_time': 1774612800.0}
2026-03-26 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985109') HTTP/1.1" 204 0
2026-03-26 18:30:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ca8813be-824c-5c1b-9d58-2738f2eb06d4 with identifier: 1985104
2026-03-26 18:30:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:30:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ca8813be-824c-5c1b-9d58-2738f2eb06d4 with identifier: 1985104
2026-03-26 18:30:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ca8813be-824c-5c1b-9d58-2738f2eb06d4 with identifier: 1985104 to the API
2026-03-26 18:30:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:30:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:30:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/644/8327cae1a3714ed98215ab4d14e91416/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 85,
 'color': 'Azul indigo',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'ca8813be-824c-5c1b-9d58-2738f2eb06d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'PRIUS',
 'odometer': 118160,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca8813be-824c-5c1b-9d58-2738f2eb06d4/ca8813be-824c-5c1b-9d58-2738f2eb06d4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 702011,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/644/8327cae1a3714ed98215ab4d14e91416/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA PRIUS 1.8 Prius AWD-i',
 'transmission': 'manual',
 'trim': '1.8 Prius AWD-i',
 'vin': None,
 'year': 2020}
2026-03-26 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985104%27 HTTP/1.1" 200 None
2026-03-26 18:30:35 [ayvens.es] INFO: Saving data for 1985104: {'created_time': 1774549835.675599, 'last_price_update_time': 1774549835.675609, 'auction_closing_time': 1774612800.0}
2026-03-26 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985104') HTTP/1.1" 204 0
2026-03-26 18:30:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/235/a4a39913198045a99473e32ac51a7e7e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:30:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/520/1ac05c7b989e46cb9f7e5a333d782e7e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:30:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/603/4c2697865013421498b064acacde9f53/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:30:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/962/f84d77dd96574484a7a8e8d669705daf/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:30:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/043/4cd90668e89f424a8ec4fda9fcece04d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:30:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/305/22d4a67e5f024424b8f09f78e8ce82e4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:30:35 [ayvens.es] INFO: Found listing with ID: 1985128
2026-03-26 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985128%27 HTTP/1.1" 200 None
2026-03-26 18:30:35 [ayvens.es] INFO: Scrape type for 1985128: 1
2026-03-26 18:30:35 [ayvens.es] INFO: Extracting data for car ID: 1985128
2026-03-26 18:30:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b392d3df-96cd-57f0-9f76-f1e0e7524788 with identifier: 1985128
2026-03-26 18:30:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b392d3df-96cd-57f0-9f76-f1e0e7524788 with scrape type 1
2026-03-26 18:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b392d3df-96cd-57f0-9f76-f1e0e7524788
2026-03-26 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F215%252Fcdc22ba912ef48c98ef3a5c856699cd4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/215/cdc22ba912ef48c98ef3a5c856699cd4/images/large/1.jpg not downloaded yet
2026-03-26 18:30:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/032/c796a74581e0459b99055c86f9f21016/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:30:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/248/f7f4db6ed03b4ebf9306a5f74d3ee3da/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:30:35 [ayvens.es] INFO: Found listing with ID: 1985129
2026-03-26 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985129%27 HTTP/1.1" 200 None
2026-03-26 18:30:35 [ayvens.es] INFO: Scrape type for 1985129: 1
2026-03-26 18:30:35 [ayvens.es] INFO: Extracting data for car ID: 1985129
2026-03-26 18:30:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0d05976-222d-516a-82d2-6b8da1182cc2 with identifier: 1985129
2026-03-26 18:30:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0d05976-222d-516a-82d2-6b8da1182cc2 with scrape type 1
2026-03-26 18:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a0d05976-222d-516a-82d2-6b8da1182cc2
2026-03-26 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F889%252Fcba17f34ef654e4281c4fd836cbd1de9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/889/cba17f34ef654e4281c4fd836cbd1de9/images/large/1.jpg not downloaded yet
2026-03-26 18:30:35 [ayvens.es] INFO: Found listing with ID: 1985130
2026-03-26 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985130%27 HTTP/1.1" 200 None
2026-03-26 18:30:35 [ayvens.es] INFO: Scrape type for 1985130: 1
2026-03-26 18:30:35 [ayvens.es] INFO: Extracting data for car ID: 1985130
2026-03-26 18:30:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73f9b14e-1224-5da0-8b3b-a578f85f6a3c with identifier: 1985130
2026-03-26 18:30:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73f9b14e-1224-5da0-8b3b-a578f85f6a3c with scrape type 1
2026-03-26 18:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 73f9b14e-1224-5da0-8b3b-a578f85f6a3c
2026-03-26 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F568%252F5381bc1809bb49e2bbda4aa25b39dfe9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/568/5381bc1809bb49e2bbda4aa25b39dfe9/images/large/1.jpg not downloaded yet
2026-03-26 18:30:35 [ayvens.es] INFO: Found listing with ID: 1985131
2026-03-26 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985131%27 HTTP/1.1" 200 None
2026-03-26 18:30:35 [ayvens.es] INFO: Scrape type for 1985131: 1
2026-03-26 18:30:35 [ayvens.es] INFO: Extracting data for car ID: 1985131
2026-03-26 18:30:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0baf8e1-d0eb-5b8f-ab61-071704423eaf with identifier: 1985131
2026-03-26 18:30:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0baf8e1-d0eb-5b8f-ab61-071704423eaf with scrape type 1
2026-03-26 18:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a0baf8e1-d0eb-5b8f-ab61-071704423eaf
2026-03-26 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F019%252Fb257a16b7a2843fe9234c1c65ae55ac6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/019/b257a16b7a2843fe9234c1c65ae55ac6/images/large/1.jpg not downloaded yet
2026-03-26 18:30:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:30:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28e8fb50>
2026-03-26 18:30:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:30:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:30:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:30:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01dc0839-e7df-5edf-a29d-79c066f5e0d8/01dc0839-e7df-5edf-a29d-79c066f5e0d8_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F235%252Fa4a39913198045a99473e32ac51a7e7e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/235/a4a39913198045a99473e32ac51a7e7e/images/large/1.jpg saved to cache
2026-03-26 18:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 01dc0839-e7df-5edf-a29d-79c066f5e0d8
2026-03-26 18:30:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 01dc0839-e7df-5edf-a29d-79c066f5e0d8, skipping ID generation
2026-03-26 18:30:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01dc0839-e7df-5edf-a29d-79c066f5e0d8 with scrape type 1
2026-03-26 18:30:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 01dc0839-e7df-5edf-a29d-79c066f5e0d8 sending to next pipeline
2026-03-26 18:30:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 01dc0839-e7df-5edf-a29d-79c066f5e0d8, identifier: 1985113
2026-03-26 18:30:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:30:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c30050>
2026-03-26 18:30:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:30:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:30:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:30:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2291ad8-5fdc-5c48-a6f1-faad15ea5095/a2291ad8-5fdc-5c48-a6f1-faad15ea5095_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F520%252F1ac05c7b989e46cb9f7e5a333d782e7e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/520/1ac05c7b989e46cb9f7e5a333d782e7e/images/large/1.jpg saved to cache
2026-03-26 18:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a2291ad8-5fdc-5c48-a6f1-faad15ea5095
2026-03-26 18:30:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a2291ad8-5fdc-5c48-a6f1-faad15ea5095, skipping ID generation
2026-03-26 18:30:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2291ad8-5fdc-5c48-a6f1-faad15ea5095 with scrape type 1
2026-03-26 18:30:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a2291ad8-5fdc-5c48-a6f1-faad15ea5095 sending to next pipeline
2026-03-26 18:30:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a2291ad8-5fdc-5c48-a6f1-faad15ea5095, identifier: 1985116
2026-03-26 18:30:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:30:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a2820df90>
2026-03-26 18:30:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:30:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:30:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:30:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1723b41c-02ac-5da3-b59f-1a344f548fae/1723b41c-02ac-5da3-b59f-1a344f548fae_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F603%252F4c2697865013421498b064acacde9f53%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/603/4c2697865013421498b064acacde9f53/images/large/1.jpg saved to cache
2026-03-26 18:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1723b41c-02ac-5da3-b59f-1a344f548fae
2026-03-26 18:30:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1723b41c-02ac-5da3-b59f-1a344f548fae, skipping ID generation
2026-03-26 18:30:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1723b41c-02ac-5da3-b59f-1a344f548fae with scrape type 1
2026-03-26 18:30:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1723b41c-02ac-5da3-b59f-1a344f548fae sending to next pipeline
2026-03-26 18:30:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1723b41c-02ac-5da3-b59f-1a344f548fae, identifier: 1985114
2026-03-26 18:30:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:30:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c54b10>
2026-03-26 18:30:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:30:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:30:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:30:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e641143-2de8-5ef6-93c3-b6cb58652a3b/1e641143-2de8-5ef6-93c3-b6cb58652a3b_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F962%252Ff84d77dd96574484a7a8e8d669705daf%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/962/f84d77dd96574484a7a8e8d669705daf/images/large/1.jpg saved to cache
2026-03-26 18:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1e641143-2de8-5ef6-93c3-b6cb58652a3b
2026-03-26 18:30:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1e641143-2de8-5ef6-93c3-b6cb58652a3b, skipping ID generation
2026-03-26 18:30:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e641143-2de8-5ef6-93c3-b6cb58652a3b with scrape type 1
2026-03-26 18:30:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1e641143-2de8-5ef6-93c3-b6cb58652a3b sending to next pipeline
2026-03-26 18:30:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1e641143-2de8-5ef6-93c3-b6cb58652a3b, identifier: 1985115
2026-03-26 18:30:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:30:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28e8fb50>
2026-03-26 18:30:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:30:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:30:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:30:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd977eb1-f321-5bbf-9f04-1e3454d8d1a2/bd977eb1-f321-5bbf-9f04-1e3454d8d1a2_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F043%252F4cd90668e89f424a8ec4fda9fcece04d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/043/4cd90668e89f424a8ec4fda9fcece04d/images/large/1.jpg saved to cache
2026-03-26 18:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bd977eb1-f321-5bbf-9f04-1e3454d8d1a2
2026-03-26 18:30:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bd977eb1-f321-5bbf-9f04-1e3454d8d1a2, skipping ID generation
2026-03-26 18:30:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd977eb1-f321-5bbf-9f04-1e3454d8d1a2 with scrape type 1
2026-03-26 18:30:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bd977eb1-f321-5bbf-9f04-1e3454d8d1a2 sending to next pipeline
2026-03-26 18:30:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: bd977eb1-f321-5bbf-9f04-1e3454d8d1a2, identifier: 1985117
2026-03-26 18:30:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:30:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a2820a5d0>
2026-03-26 18:30:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:30:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:30:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:30:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1fb8ed9-1353-5267-afc7-3f0e4e474f8c/a1fb8ed9-1353-5267-afc7-3f0e4e474f8c_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F305%252F22d4a67e5f024424b8f09f78e8ce82e4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/305/22d4a67e5f024424b8f09f78e8ce82e4/images/large/1.jpg saved to cache
2026-03-26 18:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a1fb8ed9-1353-5267-afc7-3f0e4e474f8c
2026-03-26 18:30:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a1fb8ed9-1353-5267-afc7-3f0e4e474f8c, skipping ID generation
2026-03-26 18:30:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1fb8ed9-1353-5267-afc7-3f0e4e474f8c with scrape type 1
2026-03-26 18:30:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a1fb8ed9-1353-5267-afc7-3f0e4e474f8c sending to next pipeline
2026-03-26 18:30:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a1fb8ed9-1353-5267-afc7-3f0e4e474f8c, identifier: 1985112
2026-03-26 18:30:36 [ayvens.es] INFO: Found listing with ID: 1985132
2026-03-26 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985132%27 HTTP/1.1" 200 None
2026-03-26 18:30:36 [ayvens.es] INFO: Scrape type for 1985132: 1
2026-03-26 18:30:36 [ayvens.es] INFO: Extracting data for car ID: 1985132
2026-03-26 18:30:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fa5dc20-9053-5234-8077-4c013b9169b0 with identifier: 1985132
2026-03-26 18:30:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fa5dc20-9053-5234-8077-4c013b9169b0 with scrape type 1
2026-03-26 18:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5fa5dc20-9053-5234-8077-4c013b9169b0
2026-03-26 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F496%252Fde467c9279154da7816f6de401095a21%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/496/de467c9279154da7816f6de401095a21/images/large/1.jpg not downloaded yet
2026-03-26 18:30:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 01dc0839-e7df-5edf-a29d-79c066f5e0d8 with identifier: 1985113
2026-03-26 18:30:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 01dc0839-e7df-5edf-a29d-79c066f5e0d8 with identifier: 1985113
2026-03-26 18:30:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 01dc0839-e7df-5edf-a29d-79c066f5e0d8 with identifier: 1985113 to the API
2026-03-26 18:30:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:30:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:30:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/235/a4a39913198045a99473e32ac51a7e7e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.4L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'gas',
 'id': '01dc0839-e7df-5edf-a29d-79c066f5e0d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'FIORINO',
 'odometer': 93935,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01dc0839-e7df-5edf-a29d-79c066f5e0d8/01dc0839-e7df-5edf-a29d-79c066f5e0d8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 323114,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/235/a4a39913198045a99473e32ac51a7e7e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-23',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FIAT FIORINO Cargo SX 1.4 Natural Power 52kW (70CV)',
 'transmission': 'manual',
 'trim': 'Cargo SX 1.4 Natural Power 52kW (70CV)',
 'vin': None,
 'year': 2021}
2026-03-26 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985113%27 HTTP/1.1" 200 None
2026-03-26 18:30:37 [ayvens.es] INFO: Saving data for 1985113: {'created_time': 1774549837.25918, 'last_price_update_time': 1774549837.259192, 'auction_closing_time': 1774612800.0}
2026-03-26 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985113') HTTP/1.1" 204 0
2026-03-26 18:30:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a2291ad8-5fdc-5c48-a6f1-faad15ea5095 with identifier: 1985116
2026-03-26 18:30:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:30:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a2291ad8-5fdc-5c48-a6f1-faad15ea5095 with identifier: 1985116
2026-03-26 18:30:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a2291ad8-5fdc-5c48-a6f1-faad15ea5095 with identifier: 1985116 to the API
2026-03-26 18:30:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:30:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:30:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/520/1ac05c7b989e46cb9f7e5a333d782e7e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'color': 'Plata',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'a2291ad8-5fdc-5c48-a6f1-faad15ea5095',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'COROLLA',
 'odometer': 125026,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2291ad8-5fdc-5c48-a6f1-faad15ea5095/a2291ad8-5fdc-5c48-a6f1-faad15ea5095_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 264771,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/520/1ac05c7b989e46cb9f7e5a333d782e7e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA COROLLA 1.8 125H ACTIVE TECH E-CVT',
 'transmission': 'manual',
 'trim': '1.8 125H ACTIVE TECH E-CVT',
 'vin': None,
 'year': 2022}
2026-03-26 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985116%27 HTTP/1.1" 200 None
2026-03-26 18:30:37 [ayvens.es] INFO: Saving data for 1985116: {'created_time': 1774549837.645374, 'last_price_update_time': 1774549837.645385, 'auction_closing_time': 1774612800.0}
2026-03-26 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985116') HTTP/1.1" 204 0
2026-03-26 18:30:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1723b41c-02ac-5da3-b59f-1a344f548fae with identifier: 1985114
2026-03-26 18:30:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1723b41c-02ac-5da3-b59f-1a344f548fae with identifier: 1985114
2026-03-26 18:30:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1723b41c-02ac-5da3-b59f-1a344f548fae with identifier: 1985114 to the API
2026-03-26 18:30:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:30:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:30:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/603/4c2697865013421498b064acacde9f53/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '1723b41c-02ac-5da3-b59f-1a344f548fae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'KONA',
 'odometer': 138518,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1723b41c-02ac-5da3-b59f-1a344f548fae/1723b41c-02ac-5da3-b59f-1a344f548fae_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 355659,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/603/4c2697865013421498b064acacde9f53/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI KONA 1.6 GDI HEV Style Sky DT',
 'transmission': 'manual',
 'trim': '1.6 GDI HEV Style Sky DT',
 'vin': None,
 'year': 2020}
2026-03-26 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985114%27 HTTP/1.1" 200 None
2026-03-26 18:30:37 [ayvens.es] INFO: Saving data for 1985114: {'created_time': 1774549837.942763, 'last_price_update_time': 1774549837.942773, 'auction_closing_time': 1774612800.0}
2026-03-26 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985114') HTTP/1.1" 204 0
2026-03-26 18:30:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1e641143-2de8-5ef6-93c3-b6cb58652a3b with identifier: 1985115
2026-03-26 18:30:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:30:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1e641143-2de8-5ef6-93c3-b6cb58652a3b with identifier: 1985115
2026-03-26 18:30:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1e641143-2de8-5ef6-93c3-b6cb58652a3b with identifier: 1985115 to the API
2026-03-26 18:30:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:30:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:30:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/962/f84d77dd96574484a7a8e8d669705daf/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'gas',
 'id': '1e641143-2de8-5ef6-93c3-b6cb58652a3b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'IBIZA',
 'odometer': 60089,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e641143-2de8-5ef6-93c3-b6cb58652a3b/1e641143-2de8-5ef6-93c3-b6cb58652a3b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336875,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/962/f84d77dd96574484a7a8e8d669705daf/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT IBIZA 1.0 TGI 66kW (90CV) Reference',
 'transmission': 'manual',
 'trim': '1.0 TGI 66kW (90CV) Reference',
 'vin': None,
 'year': 2021}
2026-03-26 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985115%27 HTTP/1.1" 200 None
2026-03-26 18:30:38 [ayvens.es] INFO: Saving data for 1985115: {'created_time': 1774549838.272622, 'last_price_update_time': 1774549838.272633, 'auction_closing_time': 1774612800.0}
2026-03-26 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985115') HTTP/1.1" 204 0
2026-03-26 18:30:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: bd977eb1-f321-5bbf-9f04-1e3454d8d1a2 with identifier: 1985117
2026-03-26 18:30:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:30:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: bd977eb1-f321-5bbf-9f04-1e3454d8d1a2 with identifier: 1985117
2026-03-26 18:30:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: bd977eb1-f321-5bbf-9f04-1e3454d8d1a2 with identifier: 1985117 to the API
2026-03-26 18:30:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:30:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:30:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/043/4cd90668e89f424a8ec4fda9fcece04d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 96,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'gas',
 'id': 'bd977eb1-f321-5bbf-9f04-1e3454d8d1a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 83129,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd977eb1-f321-5bbf-9f04-1e3454d8d1a2/bd977eb1-f321-5bbf-9f04-1e3454d8d1a2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329412,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/043/4cd90668e89f424a8ec4fda9fcece04d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON 1.4 TGI GNC St&Sp Style',
 'transmission': 'manual',
 'trim': '1.4 TGI GNC St&Sp Style',
 'vin': None,
 'year': 2018}
2026-03-26 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985117%27 HTTP/1.1" 200 None
2026-03-26 18:30:38 [ayvens.es] INFO: Saving data for 1985117: {'created_time': 1774549838.574609, 'last_price_update_time': 1774549838.574619, 'auction_closing_time': 1774612800.0}
2026-03-26 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985117') HTTP/1.1" 204 0
2026-03-26 18:30:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a1fb8ed9-1353-5267-afc7-3f0e4e474f8c with identifier: 1985112
2026-03-26 18:30:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:30:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a1fb8ed9-1353-5267-afc7-3f0e4e474f8c with identifier: 1985112
2026-03-26 18:30:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a1fb8ed9-1353-5267-afc7-3f0e4e474f8c with identifier: 1985112 to the API
2026-03-26 18:30:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:30:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:30:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/305/22d4a67e5f024424b8f09f78e8ce82e4/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Blanco perlado icebe',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'a1fb8ed9-1353-5267-afc7-3f0e4e474f8c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'C-HR',
 'odometer': 51308,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1fb8ed9-1353-5267-afc7-3f0e4e474f8c/a1fb8ed9-1353-5267-afc7-3f0e4e474f8c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 348292,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/305/22d4a67e5f024424b8f09f78e8ce82e4/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA C-HR 2.0 180H Advance',
 'transmission': 'manual',
 'trim': '2.0 180H Advance',
 'vin': None,
 'year': 2022}
2026-03-26 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985112%27 HTTP/1.1" 200 None
2026-03-26 18:30:38 [ayvens.es] INFO: Saving data for 1985112: {'created_time': 1774549838.912182, 'last_price_update_time': 1774549838.912193, 'auction_closing_time': 1774612800.0}
2026-03-26 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985112') HTTP/1.1" 204 0
2026-03-26 18:30:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:30:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28e8f850>
2026-03-26 18:30:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:30:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6be343e3-0d03-56ef-ace5-c151a14e9bee/6be343e3-0d03-56ef-ace5-c151a14e9bee_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F032%252Fc796a74581e0459b99055c86f9f21016%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/032/c796a74581e0459b99055c86f9f21016/images/large/1.jpg saved to cache
2026-03-26 18:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6be343e3-0d03-56ef-ace5-c151a14e9bee
2026-03-26 18:30:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6be343e3-0d03-56ef-ace5-c151a14e9bee, skipping ID generation
2026-03-26 18:30:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6be343e3-0d03-56ef-ace5-c151a14e9bee with scrape type 1
2026-03-26 18:30:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6be343e3-0d03-56ef-ace5-c151a14e9bee sending to next pipeline
2026-03-26 18:30:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6be343e3-0d03-56ef-ace5-c151a14e9bee, identifier: 1985118
2026-03-26 18:30:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:30:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c20790>
2026-03-26 18:30:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:30:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_218aae88-e2f3-523c-b3e3-994af649cc37/218aae88-e2f3-523c-b3e3-994af649cc37_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F248%252Ff7f4db6ed03b4ebf9306a5f74d3ee3da%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/248/f7f4db6ed03b4ebf9306a5f74d3ee3da/images/large/1.jpg saved to cache
2026-03-26 18:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 218aae88-e2f3-523c-b3e3-994af649cc37
2026-03-26 18:30:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 218aae88-e2f3-523c-b3e3-994af649cc37, skipping ID generation
2026-03-26 18:30:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 218aae88-e2f3-523c-b3e3-994af649cc37 with scrape type 1
2026-03-26 18:30:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 218aae88-e2f3-523c-b3e3-994af649cc37 sending to next pipeline
2026-03-26 18:30:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 218aae88-e2f3-523c-b3e3-994af649cc37, identifier: 1985111
2026-03-26 18:30:39 [ayvens.es] INFO: Found listing with ID: 1985133
2026-03-26 18:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985133%27 HTTP/1.1" 200 None
2026-03-26 18:30:39 [ayvens.es] INFO: Scrape type for 1985133: 1
2026-03-26 18:30:39 [ayvens.es] INFO: Extracting data for car ID: 1985133
2026-03-26 18:30:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc38130b-1de5-5618-aaa7-d4524d4ce57d with identifier: 1985133
2026-03-26 18:30:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc38130b-1de5-5618-aaa7-d4524d4ce57d with scrape type 1
2026-03-26 18:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item bc38130b-1de5-5618-aaa7-d4524d4ce57d
2026-03-26 18:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F828%252F15878b38149344859342df16f7467f90%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/828/15878b38149344859342df16f7467f90/images/large/1.jpg not downloaded yet
2026-03-26 18:30:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6be343e3-0d03-56ef-ace5-c151a14e9bee with identifier: 1985118
2026-03-26 18:30:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:30:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6be343e3-0d03-56ef-ace5-c151a14e9bee with identifier: 1985118
2026-03-26 18:30:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 6be343e3-0d03-56ef-ace5-c151a14e9bee with identifier: 1985118 to the API
2026-03-26 18:30:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:30:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:30:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/032/c796a74581e0459b99055c86f9f21016/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 35,
 'color': 'Plata florete',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '6be343e3-0d03-56ef-ace5-c151a14e9bee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q5',
 'odometer': 72323,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6be343e3-0d03-56ef-ace5-c151a14e9bee/6be343e3-0d03-56ef-ace5-c151a14e9bee_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 338236,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/032/c796a74581e0459b99055c86f9f21016/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q5 Advanced 50 TFSI e quattro-ultra',
 'transmission': 'manual',
 'trim': 'Advanced 50 TFSI e quattro-ultra',
 'vin': None,
 'year': 2021}
2026-03-26 18:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985118%27 HTTP/1.1" 200 None
2026-03-26 18:30:39 [ayvens.es] INFO: Saving data for 1985118: {'created_time': 1774549839.615716, 'last_price_update_time': 1774549839.615726, 'auction_closing_time': 1774612800.0}
2026-03-26 18:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985118') HTTP/1.1" 204 0
2026-03-26 18:30:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 218aae88-e2f3-523c-b3e3-994af649cc37 with identifier: 1985111
2026-03-26 18:30:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:30:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 218aae88-e2f3-523c-b3e3-994af649cc37 with identifier: 1985111
2026-03-26 18:30:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 218aae88-e2f3-523c-b3e3-994af649cc37 with identifier: 1985111 to the API
2026-03-26 18:30:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:30:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:30:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/248/f7f4db6ed03b4ebf9306a5f74d3ee3da/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Plata solar',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '218aae88-e2f3-523c-b3e3-994af649cc37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'KUGA',
 'odometer': 99940,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_218aae88-e2f3-523c-b3e3-994af649cc37/218aae88-e2f3-523c-b3e3-994af649cc37_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685244,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/248/f7f4db6ed03b4ebf9306a5f74d3ee3da/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD KUGA Titanium 2.5 Duratec FHEV 140kW Auto',
 'transmission': 'manual',
 'trim': 'Titanium 2.5 Duratec FHEV 140kW Auto',
 'vin': None,
 'year': 2022}
2026-03-26 18:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985111%27 HTTP/1.1" 200 None
2026-03-26 18:30:39 [ayvens.es] INFO: Saving data for 1985111: {'created_time': 1774549839.916557, 'last_price_update_time': 1774549839.916567, 'auction_closing_time': 1774612800.0}
2026-03-26 18:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985111') HTTP/1.1" 204 0
2026-03-26 18:30:39 [ayvens.es] INFO: Found listing with ID: 1985134
2026-03-26 18:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985134%27 HTTP/1.1" 200 None
2026-03-26 18:30:39 [ayvens.es] INFO: Scrape type for 1985134: 1
2026-03-26 18:30:39 [ayvens.es] INFO: Extracting data for car ID: 1985134
2026-03-26 18:30:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b8cc4be-dbb4-5cd3-b02f-bfc8f44fdf8b with identifier: 1985134
2026-03-26 18:30:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b8cc4be-dbb4-5cd3-b02f-bfc8f44fdf8b with scrape type 1
2026-03-26 18:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9b8cc4be-dbb4-5cd3-b02f-bfc8f44fdf8b
2026-03-26 18:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F894%252F23660671120b48f7b910356f58903c77%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/894/23660671120b48f7b910356f58903c77/images/large/1.jpg not downloaded yet
2026-03-26 18:30:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/532/b29a33552a9a4d39a835872e4c97d333/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:30:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/556/dde8dd05974b4abe9d81f75f5a9aebd0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:30:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/904/384be6545da548f9af2f4df68b4429b8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:30:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/056/3f27b432ddd640b0a4dc3e3532c0147a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:30:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/283/607709341fd84130910d218a5fef1800/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:30:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/241/07673603ecfa4929a00dc0f4d9a63b21/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:30:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/771/f650b92bd0af4e889d71e0ca7a083f4e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:30:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/646/211717e20e8f455b86cd8c5e95a4f01e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:30:39 [ayvens.es] INFO: Found listing with ID: 1985135
2026-03-26 18:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985135%27 HTTP/1.1" 200 None
2026-03-26 18:30:39 [ayvens.es] INFO: Scrape type for 1985135: 1
2026-03-26 18:30:40 [ayvens.es] INFO: Extracting data for car ID: 1985135
2026-03-26 18:30:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70204556-35c5-5331-b9d0-16bda6d2753e with identifier: 1985135
2026-03-26 18:30:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70204556-35c5-5331-b9d0-16bda6d2753e with scrape type 1
2026-03-26 18:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 70204556-35c5-5331-b9d0-16bda6d2753e
2026-03-26 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F593%252Fd8cdb287bdf345f392ecb220cdab1865%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/593/d8cdb287bdf345f392ecb220cdab1865/images/large/1.jpg not downloaded yet
2026-03-26 18:30:40 [ayvens.es] INFO: Found listing with ID: 1985136
2026-03-26 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985136%27 HTTP/1.1" 200 None
2026-03-26 18:30:40 [ayvens.es] INFO: Scrape type for 1985136: 1
2026-03-26 18:30:40 [ayvens.es] INFO: Extracting data for car ID: 1985136
2026-03-26 18:30:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: debf2a9a-a3c0-5840-a118-8dc8ff66c0ac with identifier: 1985136
2026-03-26 18:30:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item debf2a9a-a3c0-5840-a118-8dc8ff66c0ac with scrape type 1
2026-03-26 18:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item debf2a9a-a3c0-5840-a118-8dc8ff66c0ac
2026-03-26 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F986%252Fdd60d9dbf23d4ebe90b6ed835cd60d80%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/986/dd60d9dbf23d4ebe90b6ed835cd60d80/images/large/1.jpg not downloaded yet
2026-03-26 18:30:40 [ayvens.es] INFO: Found listing with ID: 1985137
2026-03-26 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985137%27 HTTP/1.1" 200 None
2026-03-26 18:30:40 [ayvens.es] INFO: Scrape type for 1985137: 1
2026-03-26 18:30:40 [ayvens.es] INFO: Extracting data for car ID: 1985137
2026-03-26 18:30:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2677a33c-72d7-52d8-95b9-7c25f3de008d with identifier: 1985137
2026-03-26 18:30:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2677a33c-72d7-52d8-95b9-7c25f3de008d with scrape type 1
2026-03-26 18:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2677a33c-72d7-52d8-95b9-7c25f3de008d
2026-03-26 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F986%252Fe38546d5b47b472c84c0321fd27248b0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/986/e38546d5b47b472c84c0321fd27248b0/images/large/1.jpg not downloaded yet
2026-03-26 18:30:40 [ayvens.es] INFO: Found listing with ID: 1985138
2026-03-26 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985138%27 HTTP/1.1" 200 None
2026-03-26 18:30:40 [ayvens.es] INFO: Scrape type for 1985138: 1
2026-03-26 18:30:40 [ayvens.es] INFO: Extracting data for car ID: 1985138
2026-03-26 18:30:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84bde4b2-4964-576b-b4e6-7b19f06a9d1b with identifier: 1985138
2026-03-26 18:30:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84bde4b2-4964-576b-b4e6-7b19f06a9d1b with scrape type 1
2026-03-26 18:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 84bde4b2-4964-576b-b4e6-7b19f06a9d1b
2026-03-26 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F219%252Fbb7bcd22d378470398097b280b58edc7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/219/bb7bcd22d378470398097b280b58edc7/images/large/1.jpg not downloaded yet
2026-03-26 18:30:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:30:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a29042c10>
2026-03-26 18:30:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:30:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82a4586e-47a7-5f26-a728-e0a20ea1e9ab/82a4586e-47a7-5f26-a728-e0a20ea1e9ab_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F532%252Fb29a33552a9a4d39a835872e4c97d333%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/532/b29a33552a9a4d39a835872e4c97d333/images/large/1.jpg saved to cache
2026-03-26 18:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 82a4586e-47a7-5f26-a728-e0a20ea1e9ab
2026-03-26 18:30:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 82a4586e-47a7-5f26-a728-e0a20ea1e9ab, skipping ID generation
2026-03-26 18:30:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82a4586e-47a7-5f26-a728-e0a20ea1e9ab with scrape type 1
2026-03-26 18:30:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 82a4586e-47a7-5f26-a728-e0a20ea1e9ab sending to next pipeline
2026-03-26 18:30:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 82a4586e-47a7-5f26-a728-e0a20ea1e9ab, identifier: 1985123
2026-03-26 18:30:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:30:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28e54650>
2026-03-26 18:30:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:30:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0814d961-8d95-5ca6-ad77-9aee5a9bed95/0814d961-8d95-5ca6-ad77-9aee5a9bed95_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F556%252Fdde8dd05974b4abe9d81f75f5a9aebd0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/556/dde8dd05974b4abe9d81f75f5a9aebd0/images/large/1.jpg saved to cache
2026-03-26 18:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0814d961-8d95-5ca6-ad77-9aee5a9bed95
2026-03-26 18:30:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0814d961-8d95-5ca6-ad77-9aee5a9bed95, skipping ID generation
2026-03-26 18:30:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0814d961-8d95-5ca6-ad77-9aee5a9bed95 with scrape type 1
2026-03-26 18:30:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0814d961-8d95-5ca6-ad77-9aee5a9bed95 sending to next pipeline
2026-03-26 18:30:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0814d961-8d95-5ca6-ad77-9aee5a9bed95, identifier: 1985121
2026-03-26 18:30:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:30:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28acef10>
2026-03-26 18:30:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:30:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ef8f64f-dbc0-5ead-8562-34bdd2a83c04/1ef8f64f-dbc0-5ead-8562-34bdd2a83c04_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F904%252F384be6545da548f9af2f4df68b4429b8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/904/384be6545da548f9af2f4df68b4429b8/images/large/1.jpg saved to cache
2026-03-26 18:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1ef8f64f-dbc0-5ead-8562-34bdd2a83c04
2026-03-26 18:30:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1ef8f64f-dbc0-5ead-8562-34bdd2a83c04, skipping ID generation
2026-03-26 18:30:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ef8f64f-dbc0-5ead-8562-34bdd2a83c04 with scrape type 1
2026-03-26 18:30:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1ef8f64f-dbc0-5ead-8562-34bdd2a83c04 sending to next pipeline
2026-03-26 18:30:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1ef8f64f-dbc0-5ead-8562-34bdd2a83c04, identifier: 1985124
2026-03-26 18:30:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:30:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28ecd9d0>
2026-03-26 18:30:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:30:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f05e3c4-111d-5bac-a31f-6ab61087c362/9f05e3c4-111d-5bac-a31f-6ab61087c362_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F056%252F3f27b432ddd640b0a4dc3e3532c0147a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/056/3f27b432ddd640b0a4dc3e3532c0147a/images/large/1.jpg saved to cache
2026-03-26 18:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9f05e3c4-111d-5bac-a31f-6ab61087c362
2026-03-26 18:30:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9f05e3c4-111d-5bac-a31f-6ab61087c362, skipping ID generation
2026-03-26 18:30:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f05e3c4-111d-5bac-a31f-6ab61087c362 with scrape type 1
2026-03-26 18:30:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9f05e3c4-111d-5bac-a31f-6ab61087c362 sending to next pipeline
2026-03-26 18:30:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9f05e3c4-111d-5bac-a31f-6ab61087c362, identifier: 1985119
2026-03-26 18:30:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:30:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28abaf90>
2026-03-26 18:30:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:30:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c29cc68d-dd6b-5840-843a-c42cda9d3d6f/c29cc68d-dd6b-5840-843a-c42cda9d3d6f_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F283%252F607709341fd84130910d218a5fef1800%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/283/607709341fd84130910d218a5fef1800/images/large/1.jpg saved to cache
2026-03-26 18:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c29cc68d-dd6b-5840-843a-c42cda9d3d6f
2026-03-26 18:30:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c29cc68d-dd6b-5840-843a-c42cda9d3d6f, skipping ID generation
2026-03-26 18:30:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c29cc68d-dd6b-5840-843a-c42cda9d3d6f with scrape type 1
2026-03-26 18:30:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c29cc68d-dd6b-5840-843a-c42cda9d3d6f sending to next pipeline
2026-03-26 18:30:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c29cc68d-dd6b-5840-843a-c42cda9d3d6f, identifier: 1985120
2026-03-26 18:30:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:30:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a2901b910>
2026-03-26 18:30:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:30:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c01575cd-becb-5fc6-b2d1-7af68dd7abc1/c01575cd-becb-5fc6-b2d1-7af68dd7abc1_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F241%252F07673603ecfa4929a00dc0f4d9a63b21%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/241/07673603ecfa4929a00dc0f4d9a63b21/images/large/1.jpg saved to cache
2026-03-26 18:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c01575cd-becb-5fc6-b2d1-7af68dd7abc1
2026-03-26 18:30:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c01575cd-becb-5fc6-b2d1-7af68dd7abc1, skipping ID generation
2026-03-26 18:30:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c01575cd-becb-5fc6-b2d1-7af68dd7abc1 with scrape type 1
2026-03-26 18:30:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c01575cd-becb-5fc6-b2d1-7af68dd7abc1 sending to next pipeline
2026-03-26 18:30:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c01575cd-becb-5fc6-b2d1-7af68dd7abc1, identifier: 1985122
2026-03-26 18:30:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:30:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28acdfd0>
2026-03-26 18:30:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:30:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_352fcc91-819e-5358-88b0-ae0c1739d5ab/352fcc91-819e-5358-88b0-ae0c1739d5ab_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F771%252Ff650b92bd0af4e889d71e0ca7a083f4e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/771/f650b92bd0af4e889d71e0ca7a083f4e/images/large/1.jpg saved to cache
2026-03-26 18:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 352fcc91-819e-5358-88b0-ae0c1739d5ab
2026-03-26 18:30:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 352fcc91-819e-5358-88b0-ae0c1739d5ab, skipping ID generation
2026-03-26 18:30:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 352fcc91-819e-5358-88b0-ae0c1739d5ab with scrape type 1
2026-03-26 18:30:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 352fcc91-819e-5358-88b0-ae0c1739d5ab sending to next pipeline
2026-03-26 18:30:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 352fcc91-819e-5358-88b0-ae0c1739d5ab, identifier: 1985126
2026-03-26 18:30:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:30:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28ca66d0>
2026-03-26 18:30:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:30:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_555b676c-3d6b-5446-9a8e-e99a7d873c26/555b676c-3d6b-5446-9a8e-e99a7d873c26_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F646%252F211717e20e8f455b86cd8c5e95a4f01e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/646/211717e20e8f455b86cd8c5e95a4f01e/images/large/1.jpg saved to cache
2026-03-26 18:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 555b676c-3d6b-5446-9a8e-e99a7d873c26
2026-03-26 18:30:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 555b676c-3d6b-5446-9a8e-e99a7d873c26, skipping ID generation
2026-03-26 18:30:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 555b676c-3d6b-5446-9a8e-e99a7d873c26 with scrape type 1
2026-03-26 18:30:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 555b676c-3d6b-5446-9a8e-e99a7d873c26 sending to next pipeline
2026-03-26 18:30:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 555b676c-3d6b-5446-9a8e-e99a7d873c26, identifier: 1985125
2026-03-26 18:30:41 [ayvens.es] INFO: Found listing with ID: 1985139
2026-03-26 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985139%27 HTTP/1.1" 200 None
2026-03-26 18:30:41 [ayvens.es] INFO: Scrape type for 1985139: 1
2026-03-26 18:30:41 [ayvens.es] INFO: Extracting data for car ID: 1985139
2026-03-26 18:30:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77c3f14a-a25a-5fd3-984c-9fa85ef08063 with identifier: 1985139
2026-03-26 18:30:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77c3f14a-a25a-5fd3-984c-9fa85ef08063 with scrape type 1
2026-03-26 18:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 77c3f14a-a25a-5fd3-984c-9fa85ef08063
2026-03-26 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F560%252F79747601f0d64d28bd58b2808a9c2d91%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/560/79747601f0d64d28bd58b2808a9c2d91/images/large/1.jpg not downloaded yet
2026-03-26 18:30:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 82a4586e-47a7-5f26-a728-e0a20ea1e9ab with identifier: 1985123
2026-03-26 18:30:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 82a4586e-47a7-5f26-a728-e0a20ea1e9ab with identifier: 1985123
2026-03-26 18:30:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 82a4586e-47a7-5f26-a728-e0a20ea1e9ab with identifier: 1985123 to the API
2026-03-26 18:30:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:30:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:30:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/532/b29a33552a9a4d39a835872e4c97d333/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '82a4586e-47a7-5f26-a728-e0a20ea1e9ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'KONA',
 'odometer': 118149,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82a4586e-47a7-5f26-a728-e0a20ea1e9ab/82a4586e-47a7-5f26-a728-e0a20ea1e9ab_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342570,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/532/b29a33552a9a4d39a835872e4c97d333/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI KONA 1.6 GDI HEV Style Sky DT',
 'transmission': 'manual',
 'trim': '1.6 GDI HEV Style Sky DT',
 'vin': None,
 'year': 2020}
2026-03-26 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985123%27 HTTP/1.1" 200 None
2026-03-26 18:30:41 [ayvens.es] INFO: Saving data for 1985123: {'created_time': 1774549841.79347, 'last_price_update_time': 1774549841.793479, 'auction_closing_time': 1774612800.0}
2026-03-26 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985123') HTTP/1.1" 204 0
2026-03-26 18:30:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0814d961-8d95-5ca6-ad77-9aee5a9bed95 with identifier: 1985121
2026-03-26 18:30:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:30:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0814d961-8d95-5ca6-ad77-9aee5a9bed95 with identifier: 1985121
2026-03-26 18:30:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0814d961-8d95-5ca6-ad77-9aee5a9bed95 with identifier: 1985121 to the API
2026-03-26 18:30:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:30:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:30:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/556/dde8dd05974b4abe9d81f75f5a9aebd0/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Azul chrome',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '0814d961-8d95-5ca6-ad77-9aee5a9bed95',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'S-MAX',
 'odometer': 184770,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0814d961-8d95-5ca6-ad77-9aee5a9bed95/0814d961-8d95-5ca6-ad77-9aee5a9bed95_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 380284,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/556/dde8dd05974b4abe9d81f75f5a9aebd0/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-03',
 'seats_number': 7,
 'seller_name': None,
 'title': 'FORD S-MAX 2.5 Duratec Atkinson FHEV 140kW Trend',
 'transmission': 'manual',
 'trim': '2.5 Duratec Atkinson FHEV 140kW Trend',
 'vin': None,
 'year': 2021}
2026-03-26 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985121%27 HTTP/1.1" 200 None
2026-03-26 18:30:42 [ayvens.es] INFO: Saving data for 1985121: {'created_time': 1774549842.098696, 'last_price_update_time': 1774549842.098707, 'auction_closing_time': 1774612800.0}
2026-03-26 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985121') HTTP/1.1" 204 0
2026-03-26 18:30:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1ef8f64f-dbc0-5ead-8562-34bdd2a83c04 with identifier: 1985124
2026-03-26 18:30:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1ef8f64f-dbc0-5ead-8562-34bdd2a83c04 with identifier: 1985124
2026-03-26 18:30:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1ef8f64f-dbc0-5ead-8562-34bdd2a83c04 with identifier: 1985124 to the API
2026-03-26 18:30:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:30:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:30:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/904/384be6545da548f9af2f4df68b4429b8/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.6L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'gas',
 'id': '1ef8f64f-dbc0-5ead-8562-34bdd2a83c04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'DACIA',
 'model': 'DOKKER',
 'odometer': 152919,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ef8f64f-dbc0-5ead-8562-34bdd2a83c04/1ef8f64f-dbc0-5ead-8562-34bdd2a83c04_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 322066,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/904/384be6545da548f9af2f4df68b4429b8/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-28',
 'seats_number': 2,
 'seller_name': None,
 'title': 'DACIA DOKKER Van Essential 1.6 80kW (107CV) GLP',
 'transmission': 'manual',
 'trim': 'Van Essential 1.6 80kW (107CV) GLP',
 'vin': None,
 'year': 2019}
2026-03-26 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985124%27 HTTP/1.1" 200 None
2026-03-26 18:30:42 [ayvens.es] INFO: Saving data for 1985124: {'created_time': 1774549842.639075, 'last_price_update_time': 1774549842.639085, 'auction_closing_time': 1774612800.0}
2026-03-26 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985124') HTTP/1.1" 204 0
2026-03-26 18:30:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9f05e3c4-111d-5bac-a31f-6ab61087c362 with identifier: 1985119
2026-03-26 18:30:42 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:30:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9f05e3c4-111d-5bac-a31f-6ab61087c362 with identifier: 1985119
2026-03-26 18:30:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9f05e3c4-111d-5bac-a31f-6ab61087c362 with identifier: 1985119 to the API
2026-03-26 18:30:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:30:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:30:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/056/3f27b432ddd640b0a4dc3e3532c0147a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Blanco glaciar',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'electric',
 'id': '9f05e3c4-111d-5bac-a31f-6ab61087c362',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'ID.4',
 'odometer': 27153,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f05e3c4-111d-5bac-a31f-6ab61087c362/9f05e3c4-111d-5bac-a31f-6ab61087c362_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 549097,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/056/3f27b432ddd640b0a4dc3e3532c0147a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN ID.4 1st Max 150kW (204CV) Automatico 1 vel.',
 'transmission': 'manual',
 'trim': '1st Max 150kW (204CV) Automatico 1 vel.',
 'vin': None,
 'year': 2021}
2026-03-26 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985119%27 HTTP/1.1" 200 None
2026-03-26 18:30:42 [ayvens.es] INFO: Saving data for 1985119: {'created_time': 1774549842.946755, 'last_price_update_time': 1774549842.946765, 'auction_closing_time': 1774612800.0}
2026-03-26 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985119') HTTP/1.1" 204 0
2026-03-26 18:30:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c29cc68d-dd6b-5840-843a-c42cda9d3d6f with identifier: 1985120
2026-03-26 18:30:42 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:30:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c29cc68d-dd6b-5840-843a-c42cda9d3d6f with identifier: 1985120
2026-03-26 18:30:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c29cc68d-dd6b-5840-843a-c42cda9d3d6f with identifier: 1985120 to the API
2026-03-26 18:30:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:30:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:30:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/283/607709341fd84130910d218a5fef1800/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'color': 'Blanco classic',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.8L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'c29cc68d-dd6b-5840-843a-c42cda9d3d6f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'COROLLA',
 'odometer': 87649,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c29cc68d-dd6b-5840-843a-c42cda9d3d6f/c29cc68d-dd6b-5840-843a-c42cda9d3d6f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 443681,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/283/607709341fd84130910d218a5fef1800/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA COROLLA 1.8 125H BUSINESS PLUS E-CVT SEDAN',
 'transmission': 'manual',
 'trim': '1.8 125H BUSINESS PLUS E-CVT SEDAN',
 'vin': None,
 'year': 2021}
2026-03-26 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985120%27 HTTP/1.1" 200 None
2026-03-26 18:30:43 [ayvens.es] INFO: Saving data for 1985120: {'created_time': 1774549843.251148, 'last_price_update_time': 1774549843.251158, 'auction_closing_time': 1774612800.0}
2026-03-26 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985120') HTTP/1.1" 204 0
2026-03-26 18:30:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c01575cd-becb-5fc6-b2d1-7af68dd7abc1 with identifier: 1985122
2026-03-26 18:30:43 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:30:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c01575cd-becb-5fc6-b2d1-7af68dd7abc1 with identifier: 1985122
2026-03-26 18:30:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c01575cd-becb-5fc6-b2d1-7af68dd7abc1 with identifier: 1985122 to the API
2026-03-26 18:30:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:30:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:30:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/241/07673603ecfa4929a00dc0f4d9a63b21/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 53,
 'color': 'Fuji white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'c01575cd-becb-5fc6-b2d1-7af68dd7abc1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER VELAR',
 'odometer': 91979,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c01575cd-becb-5fc6-b2d1-7af68dd7abc1/c01575cd-becb-5fc6-b2d1-7af68dd7abc1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 333425,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/241/07673603ecfa4929a00dc0f4d9a63b21/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER RANGE ROVER VELAR 2.0 I4 PHEV 297kW (404CV) SE 4WD Auto',
 'transmission': 'manual',
 'trim': '2.0 I4 PHEV 297kW (404CV) SE 4WD Auto',
 'vin': None,
 'year': 2022}
2026-03-26 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985122%27 HTTP/1.1" 200 None
2026-03-26 18:30:43 [ayvens.es] INFO: Saving data for 1985122: {'created_time': 1774549843.574849, 'last_price_update_time': 1774549843.574862, 'auction_closing_time': 1774612800.0}
2026-03-26 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985122') HTTP/1.1" 204 0
2026-03-26 18:30:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 352fcc91-819e-5358-88b0-ae0c1739d5ab with identifier: 1985126
2026-03-26 18:30:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 352fcc91-819e-5358-88b0-ae0c1739d5ab with identifier: 1985126
2026-03-26 18:30:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 352fcc91-819e-5358-88b0-ae0c1739d5ab with identifier: 1985126 to the API
2026-03-26 18:30:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:30:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:30:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/771/f650b92bd0af4e889d71e0ca7a083f4e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'color': 'Blanco classic',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '352fcc91-819e-5358-88b0-ae0c1739d5ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'COROLLA',
 'odometer': 166796,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_352fcc91-819e-5358-88b0-ae0c1739d5ab/352fcc91-819e-5358-88b0-ae0c1739d5ab_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342130,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/771/f650b92bd0af4e889d71e0ca7a083f4e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA COROLLA 1.8 125H BUSINESS PLUS E-CVT TOU SPORT',
 'transmission': 'manual',
 'trim': '1.8 125H BUSINESS PLUS E-CVT TOU SPORT',
 'vin': None,
 'year': 2021}
2026-03-26 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985126%27 HTTP/1.1" 200 None
2026-03-26 18:30:43 [ayvens.es] INFO: Saving data for 1985126: {'created_time': 1774549843.892324, 'last_price_update_time': 1774549843.892336, 'auction_closing_time': 1774612800.0}
2026-03-26 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985126') HTTP/1.1" 204 0
2026-03-26 18:30:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 555b676c-3d6b-5446-9a8e-e99a7d873c26 with identifier: 1985125
2026-03-26 18:30:43 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:30:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 555b676c-3d6b-5446-9a8e-e99a7d873c26 with identifier: 1985125
2026-03-26 18:30:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 555b676c-3d6b-5446-9a8e-e99a7d873c26 with identifier: 1985125 to the API
2026-03-26 18:30:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:30:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:30:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/646/211717e20e8f455b86cd8c5e95a4f01e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'Blanco perlado',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '555b676c-3d6b-5446-9a8e-e99a7d873c26',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'C-HR',
 'odometer': 105301,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_555b676c-3d6b-5446-9a8e-e99a7d873c26/555b676c-3d6b-5446-9a8e-e99a7d873c26_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 358231,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/646/211717e20e8f455b86cd8c5e95a4f01e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA C-HR 1.8 125H Advance',
 'transmission': 'manual',
 'trim': '1.8 125H Advance',
 'vin': None,
 'year': 2021}
2026-03-26 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985125%27 HTTP/1.1" 200 None
2026-03-26 18:30:44 [ayvens.es] INFO: Saving data for 1985125: {'created_time': 1774549844.288761, 'last_price_update_time': 1774549844.288771, 'auction_closing_time': 1774612800.0}
2026-03-26 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985125') HTTP/1.1" 204 0
2026-03-26 18:30:44 [ayvens.es] INFO: Found listing with ID: 1985140
2026-03-26 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985140%27 HTTP/1.1" 200 None
2026-03-26 18:30:44 [ayvens.es] INFO: Scrape type for 1985140: 1
2026-03-26 18:30:44 [ayvens.es] INFO: Extracting data for car ID: 1985140
2026-03-26 18:30:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a165c801-554f-5084-b78d-0be69f60fcd9 with identifier: 1985140
2026-03-26 18:30:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a165c801-554f-5084-b78d-0be69f60fcd9 with scrape type 1
2026-03-26 18:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a165c801-554f-5084-b78d-0be69f60fcd9
2026-03-26 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F402%252Fc9f936523fdc4422a58bbccf8c754388%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/402/c9f936523fdc4422a58bbccf8c754388/images/large/1.jpg not downloaded yet
2026-03-26 18:30:44 [ayvens.es] INFO: Found listing with ID: 1985141
2026-03-26 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985141%27 HTTP/1.1" 200 None
2026-03-26 18:30:44 [ayvens.es] INFO: Scrape type for 1985141: 1
2026-03-26 18:30:44 [ayvens.es] INFO: Extracting data for car ID: 1985141
2026-03-26 18:30:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f023b4dd-a1e7-5dea-a492-69972e48942f with identifier: 1985141
2026-03-26 18:30:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f023b4dd-a1e7-5dea-a492-69972e48942f with scrape type 1
2026-03-26 18:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f023b4dd-a1e7-5dea-a492-69972e48942f
2026-03-26 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F848%252Ffc8bb66732314018ab06b09e340b4fe2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/848/fc8bb66732314018ab06b09e340b4fe2/images/large/1.jpg not downloaded yet
2026-03-26 18:30:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/215/cdc22ba912ef48c98ef3a5c856699cd4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:30:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/945/743fdc4409db41409e6914ddbb1a446d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:30:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/894/23660671120b48f7b910356f58903c77/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:30:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/889/cba17f34ef654e4281c4fd836cbd1de9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:30:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/496/de467c9279154da7816f6de401095a21/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:30:44 [ayvens.es] INFO: Found listing with ID: 1985142
2026-03-26 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985142%27 HTTP/1.1" 200 None
2026-03-26 18:30:44 [ayvens.es] INFO: Scrape type for 1985142: 1
2026-03-26 18:30:44 [ayvens.es] INFO: Extracting data for car ID: 1985142
2026-03-26 18:30:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ccf28aa7-e983-5243-b12e-12b40b5a3054 with identifier: 1985142
2026-03-26 18:30:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccf28aa7-e983-5243-b12e-12b40b5a3054 with scrape type 1
2026-03-26 18:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ccf28aa7-e983-5243-b12e-12b40b5a3054
2026-03-26 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F338%252F42168a2246b44ebd94a91b75d6fee67a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/338/42168a2246b44ebd94a91b75d6fee67a/images/large/1.jpg not downloaded yet
2026-03-26 18:30:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/019/b257a16b7a2843fe9234c1c65ae55ac6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:30:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/568/5381bc1809bb49e2bbda4aa25b39dfe9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:30:44 [ayvens.es] INFO: Found listing with ID: 1985143
2026-03-26 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985143%27 HTTP/1.1" 200 None
2026-03-26 18:30:44 [ayvens.es] INFO: Scrape type for 1985143: 1
2026-03-26 18:30:44 [ayvens.es] INFO: Extracting data for car ID: 1985143
2026-03-26 18:30:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de63f54e-b163-5c18-9e43-119bfef08014 with identifier: 1985143
2026-03-26 18:30:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de63f54e-b163-5c18-9e43-119bfef08014 with scrape type 1
2026-03-26 18:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item de63f54e-b163-5c18-9e43-119bfef08014
2026-03-26 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F999%252Ff46e36c896bb4fa0bafef36950f59844%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/999/f46e36c896bb4fa0bafef36950f59844/images/large/1.jpg not downloaded yet
2026-03-26 18:30:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/828/15878b38149344859342df16f7467f90/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:30:44 [ayvens.es] INFO: Found listing with ID: 1985144
2026-03-26 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985144%27 HTTP/1.1" 200 None
2026-03-26 18:30:44 [ayvens.es] INFO: Scrape type for 1985144: 1
2026-03-26 18:30:44 [ayvens.es] INFO: Extracting data for car ID: 1985144
2026-03-26 18:30:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f24a1988-5e63-5b07-b8ff-466840c2f1d1 with identifier: 1985144
2026-03-26 18:30:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f24a1988-5e63-5b07-b8ff-466840c2f1d1 with scrape type 1
2026-03-26 18:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f24a1988-5e63-5b07-b8ff-466840c2f1d1
2026-03-26 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F331%252F6e722783fa9b461485e7636e8e51bbb0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/331/6e722783fa9b461485e7636e8e51bbb0/images/large/1.jpg not downloaded yet
2026-03-26 18:30:44 [ayvens.es] INFO: Found listing with ID: 1985145
2026-03-26 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985145%27 HTTP/1.1" 200 None
2026-03-26 18:30:44 [ayvens.es] INFO: Scrape type for 1985145: 1
2026-03-26 18:30:44 [ayvens.es] INFO: Extracting data for car ID: 1985145
2026-03-26 18:30:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d7c00aa-4909-5da9-ae1f-af2d593a314d with identifier: 1985145
2026-03-26 18:30:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d7c00aa-4909-5da9-ae1f-af2d593a314d with scrape type 1
2026-03-26 18:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9d7c00aa-4909-5da9-ae1f-af2d593a314d
2026-03-26 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F356%252F8e0c6027cbf1427dbb3aa4269feb8f6c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/356/8e0c6027cbf1427dbb3aa4269feb8f6c/images/large/1.jpg not downloaded yet
2026-03-26 18:30:44 [ayvens.es] INFO: Found listing with ID: 1985146
2026-03-26 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985146%27 HTTP/1.1" 200 None
2026-03-26 18:30:44 [ayvens.es] INFO: Scrape type for 1985146: 1
2026-03-26 18:30:44 [ayvens.es] INFO: Extracting data for car ID: 1985146
2026-03-26 18:30:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d7d1b29-b856-5563-b4bd-27a8c05b57d7 with identifier: 1985146
2026-03-26 18:30:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d7d1b29-b856-5563-b4bd-27a8c05b57d7 with scrape type 1
2026-03-26 18:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4d7d1b29-b856-5563-b4bd-27a8c05b57d7
2026-03-26 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F029%252F33ff71bce5d14793a705e37eb3e1a3ae%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/029/33ff71bce5d14793a705e37eb3e1a3ae/images/large/1.jpg not downloaded yet
2026-03-26 18:30:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:30:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28ff47d0>
2026-03-26 18:30:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:30:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b392d3df-96cd-57f0-9f76-f1e0e7524788/b392d3df-96cd-57f0-9f76-f1e0e7524788_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F215%252Fcdc22ba912ef48c98ef3a5c856699cd4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/215/cdc22ba912ef48c98ef3a5c856699cd4/images/large/1.jpg saved to cache
2026-03-26 18:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b392d3df-96cd-57f0-9f76-f1e0e7524788
2026-03-26 18:30:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b392d3df-96cd-57f0-9f76-f1e0e7524788, skipping ID generation
2026-03-26 18:30:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b392d3df-96cd-57f0-9f76-f1e0e7524788 with scrape type 1
2026-03-26 18:30:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b392d3df-96cd-57f0-9f76-f1e0e7524788 sending to next pipeline
2026-03-26 18:30:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b392d3df-96cd-57f0-9f76-f1e0e7524788, identifier: 1985128
2026-03-26 18:30:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:30:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28e5f110>
2026-03-26 18:30:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:30:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df06afe5-f2e3-542f-b91a-0c8e24dc5e3a/df06afe5-f2e3-542f-b91a-0c8e24dc5e3a_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F945%252F743fdc4409db41409e6914ddbb1a446d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/945/743fdc4409db41409e6914ddbb1a446d/images/large/1.jpg saved to cache
2026-03-26 18:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item df06afe5-f2e3-542f-b91a-0c8e24dc5e3a
2026-03-26 18:30:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: df06afe5-f2e3-542f-b91a-0c8e24dc5e3a, skipping ID generation
2026-03-26 18:30:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df06afe5-f2e3-542f-b91a-0c8e24dc5e3a with scrape type 1
2026-03-26 18:30:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item df06afe5-f2e3-542f-b91a-0c8e24dc5e3a sending to next pipeline
2026-03-26 18:30:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: df06afe5-f2e3-542f-b91a-0c8e24dc5e3a, identifier: 1985127
2026-03-26 18:30:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:30:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28d1c7d0>
2026-03-26 18:30:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:30:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b8cc4be-dbb4-5cd3-b02f-bfc8f44fdf8b/9b8cc4be-dbb4-5cd3-b02f-bfc8f44fdf8b_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F894%252F23660671120b48f7b910356f58903c77%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/894/23660671120b48f7b910356f58903c77/images/large/1.jpg saved to cache
2026-03-26 18:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9b8cc4be-dbb4-5cd3-b02f-bfc8f44fdf8b
2026-03-26 18:30:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9b8cc4be-dbb4-5cd3-b02f-bfc8f44fdf8b, skipping ID generation
2026-03-26 18:30:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b8cc4be-dbb4-5cd3-b02f-bfc8f44fdf8b with scrape type 1
2026-03-26 18:30:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9b8cc4be-dbb4-5cd3-b02f-bfc8f44fdf8b sending to next pipeline
2026-03-26 18:30:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9b8cc4be-dbb4-5cd3-b02f-bfc8f44fdf8b, identifier: 1985134
2026-03-26 18:30:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:30:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28ec1d50>
2026-03-26 18:30:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:30:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0d05976-222d-516a-82d2-6b8da1182cc2/a0d05976-222d-516a-82d2-6b8da1182cc2_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F889%252Fcba17f34ef654e4281c4fd836cbd1de9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/889/cba17f34ef654e4281c4fd836cbd1de9/images/large/1.jpg saved to cache
2026-03-26 18:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a0d05976-222d-516a-82d2-6b8da1182cc2
2026-03-26 18:30:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a0d05976-222d-516a-82d2-6b8da1182cc2, skipping ID generation
2026-03-26 18:30:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0d05976-222d-516a-82d2-6b8da1182cc2 with scrape type 1
2026-03-26 18:30:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a0d05976-222d-516a-82d2-6b8da1182cc2 sending to next pipeline
2026-03-26 18:30:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a0d05976-222d-516a-82d2-6b8da1182cc2, identifier: 1985129
2026-03-26 18:30:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:30:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28ff48d0>
2026-03-26 18:30:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:30:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fa5dc20-9053-5234-8077-4c013b9169b0/5fa5dc20-9053-5234-8077-4c013b9169b0_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F496%252Fde467c9279154da7816f6de401095a21%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/496/de467c9279154da7816f6de401095a21/images/large/1.jpg saved to cache
2026-03-26 18:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5fa5dc20-9053-5234-8077-4c013b9169b0
2026-03-26 18:30:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5fa5dc20-9053-5234-8077-4c013b9169b0, skipping ID generation
2026-03-26 18:30:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fa5dc20-9053-5234-8077-4c013b9169b0 with scrape type 1
2026-03-26 18:30:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5fa5dc20-9053-5234-8077-4c013b9169b0 sending to next pipeline
2026-03-26 18:30:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5fa5dc20-9053-5234-8077-4c013b9169b0, identifier: 1985132
2026-03-26 18:30:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b392d3df-96cd-57f0-9f76-f1e0e7524788 with identifier: 1985128
2026-03-26 18:30:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:30:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b392d3df-96cd-57f0-9f76-f1e0e7524788 with identifier: 1985128
2026-03-26 18:30:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b392d3df-96cd-57f0-9f76-f1e0e7524788 with identifier: 1985128 to the API
2026-03-26 18:30:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:30:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:30:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/215/cdc22ba912ef48c98ef3a5c856699cd4/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 35,
 'color': 'Negro mito',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'b392d3df-96cd-57f0-9f76-f1e0e7524788',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q5',
 'odometer': 101555,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b392d3df-96cd-57f0-9f76-f1e0e7524788/b392d3df-96cd-57f0-9f76-f1e0e7524788_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 351272,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/215/cdc22ba912ef48c98ef3a5c856699cd4/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q5 Advanced 50 TFSI e quattro-ultra',
 'transmission': 'manual',
 'trim': 'Advanced 50 TFSI e quattro-ultra',
 'vin': None,
 'year': 2021}
2026-03-26 18:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985128%27 HTTP/1.1" 200 None
2026-03-26 18:30:45 [ayvens.es] INFO: Saving data for 1985128: {'created_time': 1774549845.847398, 'last_price_update_time': 1774549845.847408, 'auction_closing_time': 1774612800.0}
2026-03-26 18:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985128') HTTP/1.1" 204 0
2026-03-26 18:30:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: df06afe5-f2e3-542f-b91a-0c8e24dc5e3a with identifier: 1985127
2026-03-26 18:30:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: df06afe5-f2e3-542f-b91a-0c8e24dc5e3a with identifier: 1985127
2026-03-26 18:30:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: df06afe5-f2e3-542f-b91a-0c8e24dc5e3a with identifier: 1985127 to the API
2026-03-26 18:30:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:30:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:30:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/945/743fdc4409db41409e6914ddbb1a446d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Blanco perlado icebe',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'df06afe5-f2e3-542f-b91a-0c8e24dc5e3a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'C-HR',
 'odometer': 131643,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df06afe5-f2e3-542f-b91a-0c8e24dc5e3a/df06afe5-f2e3-542f-b91a-0c8e24dc5e3a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344205,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/945/743fdc4409db41409e6914ddbb1a446d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA C-HR 2.0 180H Advance',
 'transmission': 'manual',
 'trim': '2.0 180H Advance',
 'vin': None,
 'year': 2022}
2026-03-26 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985127%27 HTTP/1.1" 200 None
2026-03-26 18:30:46 [ayvens.es] INFO: Saving data for 1985127: {'created_time': 1774549846.236773, 'last_price_update_time': 1774549846.236784, 'auction_closing_time': 1774612800.0}
2026-03-26 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985127') HTTP/1.1" 204 0
2026-03-26 18:30:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9b8cc4be-dbb4-5cd3-b02f-bfc8f44fdf8b with identifier: 1985134
2026-03-26 18:30:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:30:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9b8cc4be-dbb4-5cd3-b02f-bfc8f44fdf8b with identifier: 1985134
2026-03-26 18:30:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9b8cc4be-dbb4-5cd3-b02f-bfc8f44fdf8b with identifier: 1985134 to the API
2026-03-26 18:30:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:30:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:30:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/894/23660671120b48f7b910356f58903c77/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'color': 'Serie',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'gas',
 'id': '9b8cc4be-dbb4-5cd3-b02f-bfc8f44fdf8b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'DACIA',
 'model': 'SANDERO',
 'odometer': 65394,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b8cc4be-dbb4-5cd3-b02f-bfc8f44fdf8b/9b8cc4be-dbb4-5cd3-b02f-bfc8f44fdf8b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 346425,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/894/23660671120b48f7b910356f58903c77/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DACIA SANDERO Essential 74kW (100CV) ECO-G',
 'transmission': 'manual',
 'trim': 'Essential 74kW (100CV) ECO-G',
 'vin': None,
 'year': 2023}
2026-03-26 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985134%27 HTTP/1.1" 200 None
2026-03-26 18:30:46 [ayvens.es] INFO: Saving data for 1985134: {'created_time': 1774549846.613226, 'last_price_update_time': 1774549846.613236, 'auction_closing_time': 1774612800.0}
2026-03-26 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985134') HTTP/1.1" 204 0
2026-03-26 18:30:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a0d05976-222d-516a-82d2-6b8da1182cc2 with identifier: 1985129
2026-03-26 18:30:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:30:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a0d05976-222d-516a-82d2-6b8da1182cc2 with identifier: 1985129
2026-03-26 18:30:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a0d05976-222d-516a-82d2-6b8da1182cc2 with identifier: 1985129 to the API
2026-03-26 18:30:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:30:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:30:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/889/cba17f34ef654e4281c4fd836cbd1de9/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 48,
 'color': 'Negro onyx metalizad',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'a0d05976-222d-516a-82d2-6b8da1182cc2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 76638,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0d05976-222d-516a-82d2-6b8da1182cc2/a0d05976-222d-516a-82d2-6b8da1182cc2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 320551,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/889/cba17f34ef654e4281c4fd836cbd1de9/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T5 Twin Recharge Inscription Ex Auto',
 'transmission': 'manual',
 'trim': '1.5 T5 Twin Recharge Inscription Ex Auto',
 'vin': None,
 'year': 2022}
2026-03-26 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985129%27 HTTP/1.1" 200 None
2026-03-26 18:30:46 [ayvens.es] INFO: Saving data for 1985129: {'created_time': 1774549846.958069, 'last_price_update_time': 1774549846.958081, 'auction_closing_time': 1774612800.0}
2026-03-26 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985129') HTTP/1.1" 204 0
2026-03-26 18:30:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5fa5dc20-9053-5234-8077-4c013b9169b0 with identifier: 1985132
2026-03-26 18:30:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:30:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5fa5dc20-9053-5234-8077-4c013b9169b0 with identifier: 1985132
2026-03-26 18:30:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5fa5dc20-9053-5234-8077-4c013b9169b0 with identifier: 1985132 to the API
2026-03-26 18:30:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:30:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:30:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/496/de467c9279154da7816f6de401095a21/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Blanco neutro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'gas',
 'id': '5fa5dc20-9053-5234-8077-4c013b9169b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CAPTUR',
 'odometer': 114538,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fa5dc20-9053-5234-8077-4c013b9169b0/5fa5dc20-9053-5234-8077-4c013b9169b0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 362630,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/496/de467c9279154da7816f6de401095a21/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CAPTUR Intens TCe 74kW (100CV) GLP',
 'transmission': 'manual',
 'trim': 'Intens TCe 74kW (100CV) GLP',
 'vin': None,
 'year': 2022}
2026-03-26 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985132%27 HTTP/1.1" 200 None
2026-03-26 18:30:47 [ayvens.es] INFO: Saving data for 1985132: {'created_time': 1774549847.309197, 'last_price_update_time': 1774549847.309207, 'auction_closing_time': 1774612800.0}
2026-03-26 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985132') HTTP/1.1" 204 0
2026-03-26 18:30:47 [ayvens.es] INFO: Found listing with ID: 1985147
2026-03-26 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985147%27 HTTP/1.1" 200 None
2026-03-26 18:30:47 [ayvens.es] INFO: Scrape type for 1985147: 1
2026-03-26 18:30:47 [ayvens.es] INFO: Extracting data for car ID: 1985147
2026-03-26 18:30:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 831db8e6-f4b0-5ee1-8661-b92d3b5437fb with identifier: 1985147
2026-03-26 18:30:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 831db8e6-f4b0-5ee1-8661-b92d3b5437fb with scrape type 1
2026-03-26 18:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 831db8e6-f4b0-5ee1-8661-b92d3b5437fb
2026-03-26 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F326%252Faf5db6c0b5e44541abf655140e7fb90e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/326/af5db6c0b5e44541abf655140e7fb90e/images/large/1.jpg not downloaded yet
2026-03-26 18:30:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:30:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a29057c50>
2026-03-26 18:30:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:30:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0baf8e1-d0eb-5b8f-ab61-071704423eaf/a0baf8e1-d0eb-5b8f-ab61-071704423eaf_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F019%252Fb257a16b7a2843fe9234c1c65ae55ac6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/019/b257a16b7a2843fe9234c1c65ae55ac6/images/large/1.jpg saved to cache
2026-03-26 18:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a0baf8e1-d0eb-5b8f-ab61-071704423eaf
2026-03-26 18:30:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a0baf8e1-d0eb-5b8f-ab61-071704423eaf, skipping ID generation
2026-03-26 18:30:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0baf8e1-d0eb-5b8f-ab61-071704423eaf with scrape type 1
2026-03-26 18:30:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a0baf8e1-d0eb-5b8f-ab61-071704423eaf sending to next pipeline
2026-03-26 18:30:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a0baf8e1-d0eb-5b8f-ab61-071704423eaf, identifier: 1985131
2026-03-26 18:30:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:30:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a2820d810>
2026-03-26 18:30:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:30:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73f9b14e-1224-5da0-8b3b-a578f85f6a3c/73f9b14e-1224-5da0-8b3b-a578f85f6a3c_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F568%252F5381bc1809bb49e2bbda4aa25b39dfe9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/568/5381bc1809bb49e2bbda4aa25b39dfe9/images/large/1.jpg saved to cache
2026-03-26 18:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 73f9b14e-1224-5da0-8b3b-a578f85f6a3c
2026-03-26 18:30:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 73f9b14e-1224-5da0-8b3b-a578f85f6a3c, skipping ID generation
2026-03-26 18:30:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73f9b14e-1224-5da0-8b3b-a578f85f6a3c with scrape type 1
2026-03-26 18:30:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 73f9b14e-1224-5da0-8b3b-a578f85f6a3c sending to next pipeline
2026-03-26 18:30:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 73f9b14e-1224-5da0-8b3b-a578f85f6a3c, identifier: 1985130
2026-03-26 18:30:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:30:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28deb1d0>
2026-03-26 18:30:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:30:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc38130b-1de5-5618-aaa7-d4524d4ce57d/bc38130b-1de5-5618-aaa7-d4524d4ce57d_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F828%252F15878b38149344859342df16f7467f90%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/828/15878b38149344859342df16f7467f90/images/large/1.jpg saved to cache
2026-03-26 18:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bc38130b-1de5-5618-aaa7-d4524d4ce57d
2026-03-26 18:30:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bc38130b-1de5-5618-aaa7-d4524d4ce57d, skipping ID generation
2026-03-26 18:30:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc38130b-1de5-5618-aaa7-d4524d4ce57d with scrape type 1
2026-03-26 18:30:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bc38130b-1de5-5618-aaa7-d4524d4ce57d sending to next pipeline
2026-03-26 18:30:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: bc38130b-1de5-5618-aaa7-d4524d4ce57d, identifier: 1985133
2026-03-26 18:30:47 [ayvens.es] INFO: Found listing with ID: 1985148
2026-03-26 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985148%27 HTTP/1.1" 200 None
2026-03-26 18:30:47 [ayvens.es] INFO: Scrape type for 1985148: 1
2026-03-26 18:30:47 [ayvens.es] INFO: Extracting data for car ID: 1985148
2026-03-26 18:30:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ac6a881-f309-51e5-b620-f9497b6572ba with identifier: 1985148
2026-03-26 18:30:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ac6a881-f309-51e5-b620-f9497b6572ba with scrape type 1
2026-03-26 18:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5ac6a881-f309-51e5-b620-f9497b6572ba
2026-03-26 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F637%252F4ea343641aec490e834bb511cf465a54%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/637/4ea343641aec490e834bb511cf465a54/images/large/1.jpg not downloaded yet
2026-03-26 18:30:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a0baf8e1-d0eb-5b8f-ab61-071704423eaf with identifier: 1985131
2026-03-26 18:30:47 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:30:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a0baf8e1-d0eb-5b8f-ab61-071704423eaf with identifier: 1985131
2026-03-26 18:30:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a0baf8e1-d0eb-5b8f-ab61-071704423eaf with identifier: 1985131 to the API
2026-03-26 18:30:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:30:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:30:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/019/b257a16b7a2843fe9234c1c65ae55ac6/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'color': 'Negro sport',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'a0baf8e1-d0eb-5b8f-ab61-071704423eaf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'ARKANA',
 'odometer': 88813,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0baf8e1-d0eb-5b8f-ab61-071704423eaf/a0baf8e1-d0eb-5b8f-ab61-071704423eaf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691240,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/019/b257a16b7a2843fe9234c1c65ae55ac6/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT ARKANA E-Tech Engineered full hyb. 105kW(145CV)',
 'transmission': 'manual',
 'trim': 'E-Tech Engineered full hyb. 105kW(145CV)',
 'vin': None,
 'year': 2023}
2026-03-26 18:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985131%27 HTTP/1.1" 200 None
2026-03-26 18:30:48 [ayvens.es] INFO: Saving data for 1985131: {'created_time': 1774549848.254293, 'last_price_update_time': 1774549848.254303, 'auction_closing_time': 1774612800.0}
2026-03-26 18:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985131') HTTP/1.1" 204 0
2026-03-26 18:30:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 73f9b14e-1224-5da0-8b3b-a578f85f6a3c with identifier: 1985130
2026-03-26 18:30:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 73f9b14e-1224-5da0-8b3b-a578f85f6a3c with identifier: 1985130
2026-03-26 18:30:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 73f9b14e-1224-5da0-8b3b-a578f85f6a3c with identifier: 1985130 to the API
2026-03-26 18:30:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:30:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:30:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/568/5381bc1809bb49e2bbda4aa25b39dfe9/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'gas',
 'id': '73f9b14e-1224-5da0-8b3b-a578f85f6a3c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT COURIER',
 'odometer': 158882,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73f9b14e-1224-5da0-8b3b-a578f85f6a3c/73f9b14e-1224-5da0-8b3b-a578f85f6a3c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 532167,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/568/5381bc1809bb49e2bbda4aa25b39dfe9/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD TRANSIT COURIER Kombi 1.5 TDCi 56kW Trend GLP',
 'transmission': 'manual',
 'trim': 'Kombi 1.5 TDCi 56kW Trend GLP',
 'vin': None,
 'year': 2020}
2026-03-26 18:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985130%27 HTTP/1.1" 200 None
2026-03-26 18:30:48 [ayvens.es] INFO: Saving data for 1985130: {'created_time': 1774549848.598484, 'last_price_update_time': 1774549848.598493, 'auction_closing_time': 1774612800.0}
2026-03-26 18:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985130') HTTP/1.1" 204 0
2026-03-26 18:30:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: bc38130b-1de5-5618-aaa7-d4524d4ce57d with identifier: 1985133
2026-03-26 18:30:48 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:30:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: bc38130b-1de5-5618-aaa7-d4524d4ce57d with identifier: 1985133
2026-03-26 18:30:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: bc38130b-1de5-5618-aaa7-d4524d4ce57d with identifier: 1985133 to the API
2026-03-26 18:30:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:30:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:30:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/828/15878b38149344859342df16f7467f90/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 26,
 'color': 'Polar white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'bc38130b-1de5-5618-aaa7-d4524d4ce57d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'IONIQ',
 'odometer': 81964,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc38130b-1de5-5618-aaa7-d4524d4ce57d/bc38130b-1de5-5618-aaa7-d4524d4ce57d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 622322,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/828/15878b38149344859342df16f7467f90/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI IONIQ 1.6 GDI PHEV Klass DCT',
 'transmission': 'manual',
 'trim': '1.6 GDI PHEV Klass DCT',
 'vin': None,
 'year': 2022}
2026-03-26 18:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985133%27 HTTP/1.1" 200 None
2026-03-26 18:30:48 [ayvens.es] INFO: Saving data for 1985133: {'created_time': 1774549848.960903, 'last_price_update_time': 1774549848.960916, 'auction_closing_time': 1774612800.0}
2026-03-26 18:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985133') HTTP/1.1" 204 0
2026-03-26 18:30:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/402/c9f936523fdc4422a58bbccf8c754388/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:30:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/848/fc8bb66732314018ab06b09e340b4fe2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:30:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/986/e38546d5b47b472c84c0321fd27248b0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:30:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/338/42168a2246b44ebd94a91b75d6fee67a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:30:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/560/79747601f0d64d28bd58b2808a9c2d91/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:30:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/219/bb7bcd22d378470398097b280b58edc7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:30:48 [ayvens.es] INFO: Found listing with ID: 1985149
2026-03-26 18:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985149%27 HTTP/1.1" 200 None
2026-03-26 18:30:49 [ayvens.es] INFO: Scrape type for 1985149: 1
2026-03-26 18:30:49 [ayvens.es] INFO: Extracting data for car ID: 1985149
2026-03-26 18:30:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49422cd1-9d6f-59ea-a1b7-5d65c95ec78c with identifier: 1985149
2026-03-26 18:30:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49422cd1-9d6f-59ea-a1b7-5d65c95ec78c with scrape type 1
2026-03-26 18:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 49422cd1-9d6f-59ea-a1b7-5d65c95ec78c
2026-03-26 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F002%252F1a019fd1a7c64976a5969084361f9397%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/002/1a019fd1a7c64976a5969084361f9397/images/large/1.jpg not downloaded yet
2026-03-26 18:30:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/593/d8cdb287bdf345f392ecb220cdab1865/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:30:49 [ayvens.es] INFO: Found listing with ID: 1985150
2026-03-26 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985150%27 HTTP/1.1" 200 None
2026-03-26 18:30:49 [ayvens.es] INFO: Scrape type for 1985150: 1
2026-03-26 18:30:49 [ayvens.es] INFO: Extracting data for car ID: 1985150
2026-03-26 18:30:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc967560-abce-52ea-bc36-82c68fea75bc with identifier: 1985150
2026-03-26 18:30:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc967560-abce-52ea-bc36-82c68fea75bc with scrape type 1
2026-03-26 18:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item cc967560-abce-52ea-bc36-82c68fea75bc
2026-03-26 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F158%252F81a55281e4ba45b4883200717268ff5e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/158/81a55281e4ba45b4883200717268ff5e/images/large/1.jpg not downloaded yet
2026-03-26 18:30:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/986/dd60d9dbf23d4ebe90b6ed835cd60d80/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:30:49 [ayvens.es] INFO: Found listing with ID: 1985151
2026-03-26 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985151%27 HTTP/1.1" 200 None
2026-03-26 18:30:49 [ayvens.es] INFO: Scrape type for 1985151: 1
2026-03-26 18:30:49 [ayvens.es] INFO: Extracting data for car ID: 1985151
2026-03-26 18:30:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d7a9eb9-51f3-58e2-94d4-c71b47b6f8e9 with identifier: 1985151
2026-03-26 18:30:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d7a9eb9-51f3-58e2-94d4-c71b47b6f8e9 with scrape type 1
2026-03-26 18:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0d7a9eb9-51f3-58e2-94d4-c71b47b6f8e9
2026-03-26 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F937%252F1143f4f8a0e84b8da65be999f389ca28%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/937/1143f4f8a0e84b8da65be999f389ca28/images/large/1.jpg not downloaded yet
2026-03-26 18:30:49 [ayvens.es] INFO: Found listing with ID: 1985152
2026-03-26 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985152%27 HTTP/1.1" 200 None
2026-03-26 18:30:49 [ayvens.es] INFO: Scrape type for 1985152: 1
2026-03-26 18:30:49 [ayvens.es] INFO: Extracting data for car ID: 1985152
2026-03-26 18:30:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4228209a-b622-5b81-8ca8-8d0d1e9232da with identifier: 1985152
2026-03-26 18:30:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4228209a-b622-5b81-8ca8-8d0d1e9232da with scrape type 1
2026-03-26 18:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4228209a-b622-5b81-8ca8-8d0d1e9232da
2026-03-26 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F457%252F6c3d8729695e42c091b92865931872f2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/457/6c3d8729695e42c091b92865931872f2/images/large/1.jpg not downloaded yet
2026-03-26 18:30:49 [ayvens.es] INFO: Found listing with ID: 1985153
2026-03-26 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985153%27 HTTP/1.1" 200 None
2026-03-26 18:30:49 [ayvens.es] INFO: Scrape type for 1985153: 1
2026-03-26 18:30:49 [ayvens.es] INFO: Extracting data for car ID: 1985153
2026-03-26 18:30:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f95658c3-2fe4-5849-89d9-858f2a4c7620 with identifier: 1985153
2026-03-26 18:30:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f95658c3-2fe4-5849-89d9-858f2a4c7620 with scrape type 1
2026-03-26 18:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f95658c3-2fe4-5849-89d9-858f2a4c7620
2026-03-26 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F134%252F32cdb95dfb244ff8b0c4dbaf7808de4f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/134/32cdb95dfb244ff8b0c4dbaf7808de4f/images/large/1.jpg not downloaded yet
2026-03-26 18:30:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:30:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28208d10>
2026-03-26 18:30:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:30:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a165c801-554f-5084-b78d-0be69f60fcd9/a165c801-554f-5084-b78d-0be69f60fcd9_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F402%252Fc9f936523fdc4422a58bbccf8c754388%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/402/c9f936523fdc4422a58bbccf8c754388/images/large/1.jpg saved to cache
2026-03-26 18:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a165c801-554f-5084-b78d-0be69f60fcd9
2026-03-26 18:30:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a165c801-554f-5084-b78d-0be69f60fcd9, skipping ID generation
2026-03-26 18:30:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a165c801-554f-5084-b78d-0be69f60fcd9 with scrape type 1
2026-03-26 18:30:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a165c801-554f-5084-b78d-0be69f60fcd9 sending to next pipeline
2026-03-26 18:30:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a165c801-554f-5084-b78d-0be69f60fcd9, identifier: 1985140
2026-03-26 18:30:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:30:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28e9a9d0>
2026-03-26 18:30:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:30:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f023b4dd-a1e7-5dea-a492-69972e48942f/f023b4dd-a1e7-5dea-a492-69972e48942f_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F848%252Ffc8bb66732314018ab06b09e340b4fe2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/848/fc8bb66732314018ab06b09e340b4fe2/images/large/1.jpg saved to cache
2026-03-26 18:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f023b4dd-a1e7-5dea-a492-69972e48942f
2026-03-26 18:30:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f023b4dd-a1e7-5dea-a492-69972e48942f, skipping ID generation
2026-03-26 18:30:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f023b4dd-a1e7-5dea-a492-69972e48942f with scrape type 1
2026-03-26 18:30:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f023b4dd-a1e7-5dea-a492-69972e48942f sending to next pipeline
2026-03-26 18:30:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f023b4dd-a1e7-5dea-a492-69972e48942f, identifier: 1985141
2026-03-26 18:30:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:30:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a290b4210>
2026-03-26 18:30:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:30:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2677a33c-72d7-52d8-95b9-7c25f3de008d/2677a33c-72d7-52d8-95b9-7c25f3de008d_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F986%252Fe38546d5b47b472c84c0321fd27248b0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/986/e38546d5b47b472c84c0321fd27248b0/images/large/1.jpg saved to cache
2026-03-26 18:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2677a33c-72d7-52d8-95b9-7c25f3de008d
2026-03-26 18:30:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2677a33c-72d7-52d8-95b9-7c25f3de008d, skipping ID generation
2026-03-26 18:30:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2677a33c-72d7-52d8-95b9-7c25f3de008d with scrape type 1
2026-03-26 18:30:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2677a33c-72d7-52d8-95b9-7c25f3de008d sending to next pipeline
2026-03-26 18:30:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2677a33c-72d7-52d8-95b9-7c25f3de008d, identifier: 1985137
2026-03-26 18:30:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:30:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a283d91d0>
2026-03-26 18:30:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:30:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccf28aa7-e983-5243-b12e-12b40b5a3054/ccf28aa7-e983-5243-b12e-12b40b5a3054_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F338%252F42168a2246b44ebd94a91b75d6fee67a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/338/42168a2246b44ebd94a91b75d6fee67a/images/large/1.jpg saved to cache
2026-03-26 18:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ccf28aa7-e983-5243-b12e-12b40b5a3054
2026-03-26 18:30:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ccf28aa7-e983-5243-b12e-12b40b5a3054, skipping ID generation
2026-03-26 18:30:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccf28aa7-e983-5243-b12e-12b40b5a3054 with scrape type 1
2026-03-26 18:30:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ccf28aa7-e983-5243-b12e-12b40b5a3054 sending to next pipeline
2026-03-26 18:30:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ccf28aa7-e983-5243-b12e-12b40b5a3054, identifier: 1985142
2026-03-26 18:30:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:30:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28e9b050>
2026-03-26 18:30:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:30:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77c3f14a-a25a-5fd3-984c-9fa85ef08063/77c3f14a-a25a-5fd3-984c-9fa85ef08063_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F560%252F79747601f0d64d28bd58b2808a9c2d91%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/560/79747601f0d64d28bd58b2808a9c2d91/images/large/1.jpg saved to cache
2026-03-26 18:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 77c3f14a-a25a-5fd3-984c-9fa85ef08063
2026-03-26 18:30:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 77c3f14a-a25a-5fd3-984c-9fa85ef08063, skipping ID generation
2026-03-26 18:30:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77c3f14a-a25a-5fd3-984c-9fa85ef08063 with scrape type 1
2026-03-26 18:30:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 77c3f14a-a25a-5fd3-984c-9fa85ef08063 sending to next pipeline
2026-03-26 18:30:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 77c3f14a-a25a-5fd3-984c-9fa85ef08063, identifier: 1985139
2026-03-26 18:30:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:30:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28ad8d10>
2026-03-26 18:30:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:30:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84bde4b2-4964-576b-b4e6-7b19f06a9d1b/84bde4b2-4964-576b-b4e6-7b19f06a9d1b_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F219%252Fbb7bcd22d378470398097b280b58edc7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/219/bb7bcd22d378470398097b280b58edc7/images/large/1.jpg saved to cache
2026-03-26 18:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 84bde4b2-4964-576b-b4e6-7b19f06a9d1b
2026-03-26 18:30:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 84bde4b2-4964-576b-b4e6-7b19f06a9d1b, skipping ID generation
2026-03-26 18:30:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84bde4b2-4964-576b-b4e6-7b19f06a9d1b with scrape type 1
2026-03-26 18:30:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 84bde4b2-4964-576b-b4e6-7b19f06a9d1b sending to next pipeline
2026-03-26 18:30:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 84bde4b2-4964-576b-b4e6-7b19f06a9d1b, identifier: 1985138
2026-03-26 18:30:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/999/f46e36c896bb4fa0bafef36950f59844/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:30:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a165c801-554f-5084-b78d-0be69f60fcd9 with identifier: 1985140
2026-03-26 18:30:50 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:30:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a165c801-554f-5084-b78d-0be69f60fcd9 with identifier: 1985140
2026-03-26 18:30:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a165c801-554f-5084-b78d-0be69f60fcd9 with identifier: 1985140 to the API
2026-03-26 18:30:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:30:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:30:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/402/c9f936523fdc4422a58bbccf8c754388/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 25,
 'color': 'Azul navarra',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'a165c801-554f-5084-b78d-0be69f60fcd9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3',
 'odometer': 99799,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a165c801-554f-5084-b78d-0be69f60fcd9/a165c801-554f-5084-b78d-0be69f60fcd9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 388262,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/402/c9f936523fdc4422a58bbccf8c754388/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 Sportback Advanced 40 TFSI e 150kW S tro',
 'transmission': 'manual',
 'trim': 'Sportback Advanced 40 TFSI e 150kW S tro',
 'vin': None,
 'year': 2022}
2026-03-26 18:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985140%27 HTTP/1.1" 200 None
2026-03-26 18:30:50 [ayvens.es] INFO: Saving data for 1985140: {'created_time': 1774549850.603584, 'last_price_update_time': 1774549850.603595, 'auction_closing_time': 1774612800.0}
2026-03-26 18:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985140') HTTP/1.1" 204 0
2026-03-26 18:30:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f023b4dd-a1e7-5dea-a492-69972e48942f with identifier: 1985141
2026-03-26 18:30:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f023b4dd-a1e7-5dea-a492-69972e48942f with identifier: 1985141
2026-03-26 18:30:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f023b4dd-a1e7-5dea-a492-69972e48942f with identifier: 1985141 to the API
2026-03-26 18:30:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:30:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:30:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/848/fc8bb66732314018ab06b09e340b4fe2/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 30,
 'color': 'Gris artense',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'f023b4dd-a1e7-5dea-a492-69972e48942f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 177974,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f023b4dd-a1e7-5dea-a492-69972e48942f/f023b4dd-a1e7-5dea-a492-69972e48942f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 384341,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/848/fc8bb66732314018ab06b09e340b4fe2/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 300 e-EAT8 GT',
 'transmission': 'manual',
 'trim': '300 e-EAT8 GT',
 'vin': None,
 'year': 2022}
2026-03-26 18:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985141%27 HTTP/1.1" 200 None
2026-03-26 18:30:50 [ayvens.es] INFO: Saving data for 1985141: {'created_time': 1774549850.946875, 'last_price_update_time': 1774549850.946887, 'auction_closing_time': 1774612800.0}
2026-03-26 18:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985141') HTTP/1.1" 204 0
2026-03-26 18:30:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2677a33c-72d7-52d8-95b9-7c25f3de008d with identifier: 1985137
2026-03-26 18:30:50 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:30:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2677a33c-72d7-52d8-95b9-7c25f3de008d with identifier: 1985137
2026-03-26 18:30:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 2677a33c-72d7-52d8-95b9-7c25f3de008d with identifier: 1985137 to the API
2026-03-26 18:30:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:30:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:30:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/986/e38546d5b47b472c84c0321fd27248b0/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'Blanco nacarado',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '2677a33c-72d7-52d8-95b9-7c25f3de008d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508',
 'odometer': 110246,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2677a33c-72d7-52d8-95b9-7c25f3de008d/2677a33c-72d7-52d8-95b9-7c25f3de008d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342572,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/986/e38546d5b47b472c84c0321fd27248b0/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 SW Allure HYBRID 225 e-EAT8',
 'transmission': 'manual',
 'trim': 'SW Allure HYBRID 225 e-EAT8',
 'vin': None,
 'year': 2020}
2026-03-26 18:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985137%27 HTTP/1.1" 200 None
2026-03-26 18:30:51 [ayvens.es] INFO: Saving data for 1985137: {'created_time': 1774549851.27244, 'last_price_update_time': 1774549851.272449, 'auction_closing_time': 1774612800.0}
2026-03-26 18:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985137') HTTP/1.1" 204 0
2026-03-26 18:30:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ccf28aa7-e983-5243-b12e-12b40b5a3054 with identifier: 1985142
2026-03-26 18:30:51 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:30:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ccf28aa7-e983-5243-b12e-12b40b5a3054 with identifier: 1985142
2026-03-26 18:30:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ccf28aa7-e983-5243-b12e-12b40b5a3054 with identifier: 1985142 to the API
2026-03-26 18:30:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:30:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:30:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/338/42168a2246b44ebd94a91b75d6fee67a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 37,
 'color': 'Negro metalizado',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'ccf28aa7-e983-5243-b12e-12b40b5a3054',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 SPORTBACK',
 'odometer': 68318,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccf28aa7-e983-5243-b12e-12b40b5a3054/ccf28aa7-e983-5243-b12e-12b40b5a3054_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 378700,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/338/42168a2246b44ebd94a91b75d6fee67a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 SPORTBACK 45 TFSI e 180kW S tronic Advanced',
 'transmission': 'manual',
 'trim': '45 TFSI e 180kW S tronic Advanced',
 'vin': None,
 'year': 2021}
2026-03-26 18:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985142%27 HTTP/1.1" 200 None
2026-03-26 18:30:51 [ayvens.es] INFO: Saving data for 1985142: {'created_time': 1774549851.624558, 'last_price_update_time': 1774549851.624569, 'auction_closing_time': 1774612800.0}
2026-03-26 18:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985142') HTTP/1.1" 204 0
2026-03-26 18:30:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 77c3f14a-a25a-5fd3-984c-9fa85ef08063 with identifier: 1985139
2026-03-26 18:30:51 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:30:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 77c3f14a-a25a-5fd3-984c-9fa85ef08063 with identifier: 1985139
2026-03-26 18:30:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 77c3f14a-a25a-5fd3-984c-9fa85ef08063 with identifier: 1985139 to the API
2026-03-26 18:30:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:30:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:30:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/560/79747601f0d64d28bd58b2808a9c2d91/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '77c3f14a-a25a-5fd3-984c-9fa85ef08063',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'RAV4',
 'odometer': 70093,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77c3f14a-a25a-5fd3-984c-9fa85ef08063/77c3f14a-a25a-5fd3-984c-9fa85ef08063_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 421748,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/560/79747601f0d64d28bd58b2808a9c2d91/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA RAV4 2.5l 220H Advance',
 'transmission': 'manual',
 'trim': '2.5l 220H Advance',
 'vin': None,
 'year': 2022}
2026-03-26 18:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985139%27 HTTP/1.1" 200 None
2026-03-26 18:30:51 [ayvens.es] INFO: Saving data for 1985139: {'created_time': 1774549851.964335, 'last_price_update_time': 1774549851.964345, 'auction_closing_time': 1774612800.0}
2026-03-26 18:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985139') HTTP/1.1" 204 0
2026-03-26 18:30:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 84bde4b2-4964-576b-b4e6-7b19f06a9d1b with identifier: 1985138
2026-03-26 18:30:51 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:30:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 84bde4b2-4964-576b-b4e6-7b19f06a9d1b with identifier: 1985138
2026-03-26 18:30:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 84bde4b2-4964-576b-b4e6-7b19f06a9d1b with identifier: 1985138 to the API
2026-03-26 18:30:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:30:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:30:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/219/bb7bcd22d378470398097b280b58edc7/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 29,
 'color': 'Nacarada rojo ultima',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '84bde4b2-4964-576b-b4e6-7b19f06a9d1b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 119325,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84bde4b2-4964-576b-b4e6-7b19f06a9d1b/84bde4b2-4964-576b-b4e6-7b19f06a9d1b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 380743,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/219/bb7bcd22d378470398097b280b58edc7/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 300 e-EAT8 GT',
 'transmission': 'manual',
 'trim': '300 e-EAT8 GT',
 'vin': None,
 'year': 2021}
2026-03-26 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985138%27 HTTP/1.1" 200 None
2026-03-26 18:30:52 [ayvens.es] INFO: Saving data for 1985138: {'created_time': 1774549852.33663, 'last_price_update_time': 1774549852.336642, 'auction_closing_time': 1774612800.0}
2026-03-26 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985138') HTTP/1.1" 204 0
2026-03-26 18:30:52 [ayvens.es] INFO: Found listing with ID: 1985154
2026-03-26 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985154%27 HTTP/1.1" 200 None
2026-03-26 18:30:52 [ayvens.es] INFO: Scrape type for 1985154: 1
2026-03-26 18:30:52 [ayvens.es] INFO: Extracting data for car ID: 1985154
2026-03-26 18:30:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9035439-892b-54bf-94f4-7289ee8fbe26 with identifier: 1985154
2026-03-26 18:30:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9035439-892b-54bf-94f4-7289ee8fbe26 with scrape type 1
2026-03-26 18:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f9035439-892b-54bf-94f4-7289ee8fbe26
2026-03-26 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F068%252Fd8e3b9323a5a4fbc87e609f8a4c86dd6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/068/d8e3b9323a5a4fbc87e609f8a4c86dd6/images/large/1.jpg not downloaded yet
2026-03-26 18:30:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:30:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28314d10>
2026-03-26 18:30:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:30:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:30:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:30:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70204556-35c5-5331-b9d0-16bda6d2753e/70204556-35c5-5331-b9d0-16bda6d2753e_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F593%252Fd8cdb287bdf345f392ecb220cdab1865%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/593/d8cdb287bdf345f392ecb220cdab1865/images/large/1.jpg saved to cache
2026-03-26 18:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 70204556-35c5-5331-b9d0-16bda6d2753e
2026-03-26 18:30:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 70204556-35c5-5331-b9d0-16bda6d2753e, skipping ID generation
2026-03-26 18:30:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70204556-35c5-5331-b9d0-16bda6d2753e with scrape type 1
2026-03-26 18:30:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 70204556-35c5-5331-b9d0-16bda6d2753e sending to next pipeline
2026-03-26 18:30:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 70204556-35c5-5331-b9d0-16bda6d2753e, identifier: 1985135
2026-03-26 18:30:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:30:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a283ee110>
2026-03-26 18:30:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:30:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:30:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:30:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_debf2a9a-a3c0-5840-a118-8dc8ff66c0ac/debf2a9a-a3c0-5840-a118-8dc8ff66c0ac_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F986%252Fdd60d9dbf23d4ebe90b6ed835cd60d80%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/986/dd60d9dbf23d4ebe90b6ed835cd60d80/images/large/1.jpg saved to cache
2026-03-26 18:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item debf2a9a-a3c0-5840-a118-8dc8ff66c0ac
2026-03-26 18:30:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: debf2a9a-a3c0-5840-a118-8dc8ff66c0ac, skipping ID generation
2026-03-26 18:30:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item debf2a9a-a3c0-5840-a118-8dc8ff66c0ac with scrape type 1
2026-03-26 18:30:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item debf2a9a-a3c0-5840-a118-8dc8ff66c0ac sending to next pipeline
2026-03-26 18:30:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: debf2a9a-a3c0-5840-a118-8dc8ff66c0ac, identifier: 1985136
2026-03-26 18:30:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/029/33ff71bce5d14793a705e37eb3e1a3ae/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:30:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 70204556-35c5-5331-b9d0-16bda6d2753e with identifier: 1985135
2026-03-26 18:30:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 70204556-35c5-5331-b9d0-16bda6d2753e with identifier: 1985135
2026-03-26 18:30:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 70204556-35c5-5331-b9d0-16bda6d2753e with identifier: 1985135 to the API
2026-03-26 18:30:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:30:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:30:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/593/d8cdb287bdf345f392ecb220cdab1865/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '70204556-35c5-5331-b9d0-16bda6d2753e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'KUGA',
 'odometer': 197208,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70204556-35c5-5331-b9d0-16bda6d2753e/70204556-35c5-5331-b9d0-16bda6d2753e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 550369,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/593/d8cdb287bdf345f392ecb220cdab1865/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD KUGA ST-Line X 2.5 Duratec FHEV Auto',
 'transmission': 'manual',
 'trim': 'ST-Line X 2.5 Duratec FHEV Auto',
 'vin': None,
 'year': 2021}
2026-03-26 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985135%27 HTTP/1.1" 200 None
2026-03-26 18:30:53 [ayvens.es] INFO: Saving data for 1985135: {'created_time': 1774549853.157322, 'last_price_update_time': 1774549853.157332, 'auction_closing_time': 1774612800.0}
2026-03-26 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985135') HTTP/1.1" 204 0
2026-03-26 18:30:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: debf2a9a-a3c0-5840-a118-8dc8ff66c0ac with identifier: 1985136
2026-03-26 18:30:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: debf2a9a-a3c0-5840-a118-8dc8ff66c0ac with identifier: 1985136
2026-03-26 18:30:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: debf2a9a-a3c0-5840-a118-8dc8ff66c0ac with identifier: 1985136 to the API
2026-03-26 18:30:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:30:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:30:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/986/dd60d9dbf23d4ebe90b6ed835cd60d80/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'electric',
 'id': 'debf2a9a-a3c0-5840-a118-8dc8ff66c0ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'MODEL 3',
 'odometer': 165630,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_debf2a9a-a3c0-5840-a118-8dc8ff66c0ac/debf2a9a-a3c0-5840-a118-8dc8ff66c0ac_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617215,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/986/dd60d9dbf23d4ebe90b6ed835cd60d80/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA MODEL 3 Gran Autonomia 4WD',
 'transmission': 'manual',
 'trim': 'Gran Autonomia 4WD',
 'vin': None,
 'year': 2021}
2026-03-26 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985136%27 HTTP/1.1" 200 None
2026-03-26 18:30:53 [ayvens.es] INFO: Saving data for 1985136: {'created_time': 1774549853.494357, 'last_price_update_time': 1774549853.494368, 'auction_closing_time': 1774612800.0}
2026-03-26 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985136') HTTP/1.1" 204 0
2026-03-26 18:30:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/002/1a019fd1a7c64976a5969084361f9397/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:30:53 [ayvens.es] INFO: Found listing with ID: 1985155
2026-03-26 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985155%27 HTTP/1.1" 200 None
2026-03-26 18:30:53 [ayvens.es] INFO: Scrape type for 1985155: 1
2026-03-26 18:30:53 [ayvens.es] INFO: Extracting data for car ID: 1985155
2026-03-26 18:30:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76129068-965c-536d-a702-87d4652eb5d1 with identifier: 1985155
2026-03-26 18:30:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76129068-965c-536d-a702-87d4652eb5d1 with scrape type 1
2026-03-26 18:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 76129068-965c-536d-a702-87d4652eb5d1
2026-03-26 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F732%252Fbb6f2cdfe930474b81aed4aad16fc27a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/732/bb6f2cdfe930474b81aed4aad16fc27a/images/large/1.jpg not downloaded yet
2026-03-26 18:30:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/356/8e0c6027cbf1427dbb3aa4269feb8f6c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:30:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:30:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28bd7350>
2026-03-26 18:30:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:30:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:30:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:30:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de63f54e-b163-5c18-9e43-119bfef08014/de63f54e-b163-5c18-9e43-119bfef08014_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F999%252Ff46e36c896bb4fa0bafef36950f59844%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/999/f46e36c896bb4fa0bafef36950f59844/images/large/1.jpg saved to cache
2026-03-26 18:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item de63f54e-b163-5c18-9e43-119bfef08014
2026-03-26 18:30:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: de63f54e-b163-5c18-9e43-119bfef08014, skipping ID generation
2026-03-26 18:30:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de63f54e-b163-5c18-9e43-119bfef08014 with scrape type 1
2026-03-26 18:30:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item de63f54e-b163-5c18-9e43-119bfef08014 sending to next pipeline
2026-03-26 18:30:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: de63f54e-b163-5c18-9e43-119bfef08014, identifier: 1985143
2026-03-26 18:30:53 [ayvens.es] INFO: Found listing with ID: 1985156
2026-03-26 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985156%27 HTTP/1.1" 200 None
2026-03-26 18:30:53 [ayvens.es] INFO: Scrape type for 1985156: 1
2026-03-26 18:30:53 [ayvens.es] INFO: Extracting data for car ID: 1985156
2026-03-26 18:30:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fad74783-9ccd-52f5-b303-c2f1088863a9 with identifier: 1985156
2026-03-26 18:30:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fad74783-9ccd-52f5-b303-c2f1088863a9 with scrape type 1
2026-03-26 18:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item fad74783-9ccd-52f5-b303-c2f1088863a9
2026-03-26 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F522%252F3267276c041a469fa1fab03f24407291%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/522/3267276c041a469fa1fab03f24407291/images/large/1.jpg not downloaded yet
2026-03-26 18:30:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: de63f54e-b163-5c18-9e43-119bfef08014 with identifier: 1985143
2026-03-26 18:30:53 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:30:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: de63f54e-b163-5c18-9e43-119bfef08014 with identifier: 1985143
2026-03-26 18:30:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: de63f54e-b163-5c18-9e43-119bfef08014 with identifier: 1985143 to the API
2026-03-26 18:30:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:30:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:30:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/999/f46e36c896bb4fa0bafef36950f59844/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'Gris grafito',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'de63f54e-b163-5c18-9e43-119bfef08014',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'RAV4',
 'odometer': 118564,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de63f54e-b163-5c18-9e43-119bfef08014/de63f54e-b163-5c18-9e43-119bfef08014_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 368801,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/999/f46e36c896bb4fa0bafef36950f59844/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA RAV4 2.5l 220H Advance',
 'transmission': 'manual',
 'trim': '2.5l 220H Advance',
 'vin': None,
 'year': 2022}
2026-03-26 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985143%27 HTTP/1.1" 200 None
2026-03-26 18:30:54 [ayvens.es] INFO: Saving data for 1985143: {'created_time': 1774549854.102659, 'last_price_update_time': 1774549854.102671, 'auction_closing_time': 1774612800.0}
2026-03-26 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985143') HTTP/1.1" 204 0
2026-03-26 18:30:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/326/af5db6c0b5e44541abf655140e7fb90e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:30:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/637/4ea343641aec490e834bb511cf465a54/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:30:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/158/81a55281e4ba45b4883200717268ff5e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:30:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:30:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28dd0a50>
2026-03-26 18:30:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:30:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d7d1b29-b856-5563-b4bd-27a8c05b57d7/4d7d1b29-b856-5563-b4bd-27a8c05b57d7_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F029%252F33ff71bce5d14793a705e37eb3e1a3ae%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/029/33ff71bce5d14793a705e37eb3e1a3ae/images/large/1.jpg saved to cache
2026-03-26 18:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4d7d1b29-b856-5563-b4bd-27a8c05b57d7
2026-03-26 18:30:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4d7d1b29-b856-5563-b4bd-27a8c05b57d7, skipping ID generation
2026-03-26 18:30:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d7d1b29-b856-5563-b4bd-27a8c05b57d7 with scrape type 1
2026-03-26 18:30:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4d7d1b29-b856-5563-b4bd-27a8c05b57d7 sending to next pipeline
2026-03-26 18:30:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4d7d1b29-b856-5563-b4bd-27a8c05b57d7, identifier: 1985146
2026-03-26 18:30:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/331/6e722783fa9b461485e7636e8e51bbb0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:30:54 [ayvens.es] INFO: Found listing with ID: 1985157
2026-03-26 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985157%27 HTTP/1.1" 200 None
2026-03-26 18:30:54 [ayvens.es] INFO: Scrape type for 1985157: 1
2026-03-26 18:30:54 [ayvens.es] INFO: Extracting data for car ID: 1985157
2026-03-26 18:30:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fa1781b-0acd-59e9-9c54-762201135ac6 with identifier: 1985157
2026-03-26 18:30:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fa1781b-0acd-59e9-9c54-762201135ac6 with scrape type 1
2026-03-26 18:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5fa1781b-0acd-59e9-9c54-762201135ac6
2026-03-26 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F936%252F9c4230507cd74a4093668ff4c4e07ce4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/936/9c4230507cd74a4093668ff4c4e07ce4/images/large/1.jpg not downloaded yet
2026-03-26 18:30:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4d7d1b29-b856-5563-b4bd-27a8c05b57d7 with identifier: 1985146
2026-03-26 18:30:54 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:30:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4d7d1b29-b856-5563-b4bd-27a8c05b57d7 with identifier: 1985146
2026-03-26 18:30:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 4d7d1b29-b856-5563-b4bd-27a8c05b57d7 with identifier: 1985146 to the API
2026-03-26 18:30:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:30:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:30:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/029/33ff71bce5d14793a705e37eb3e1a3ae/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 24,
 'color': 'Pintura metalizada n',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '4d7d1b29-b856-5563-b4bd-27a8c05b57d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'LYNK & CO',
 'model': '1',
 'odometer': 55538,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d7d1b29-b856-5563-b4bd-27a8c05b57d7/4d7d1b29-b856-5563-b4bd-27a8c05b57d7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 382176,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/029/33ff71bce5d14793a705e37eb3e1a3ae/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-01-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LYNK & CO 1 1.5 PHEV 6.6kW',
 'transmission': 'manual',
 'trim': '1.5 PHEV 6.6kW',
 'vin': None,
 'year': 2024}
2026-03-26 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985146%27 HTTP/1.1" 200 None
2026-03-26 18:30:54 [ayvens.es] INFO: Saving data for 1985146: {'created_time': 1774549854.672579, 'last_price_update_time': 1774549854.672589, 'auction_closing_time': 1774612800.0}
2026-03-26 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985146') HTTP/1.1" 204 0
2026-03-26 18:30:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:30:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28dea9d0>
2026-03-26 18:30:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:30:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49422cd1-9d6f-59ea-a1b7-5d65c95ec78c/49422cd1-9d6f-59ea-a1b7-5d65c95ec78c_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F002%252F1a019fd1a7c64976a5969084361f9397%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/002/1a019fd1a7c64976a5969084361f9397/images/large/1.jpg saved to cache
2026-03-26 18:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 49422cd1-9d6f-59ea-a1b7-5d65c95ec78c
2026-03-26 18:30:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 49422cd1-9d6f-59ea-a1b7-5d65c95ec78c, skipping ID generation
2026-03-26 18:30:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49422cd1-9d6f-59ea-a1b7-5d65c95ec78c with scrape type 1
2026-03-26 18:30:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 49422cd1-9d6f-59ea-a1b7-5d65c95ec78c sending to next pipeline
2026-03-26 18:30:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 49422cd1-9d6f-59ea-a1b7-5d65c95ec78c, identifier: 1985149
2026-03-26 18:30:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:30:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c20750>
2026-03-26 18:30:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:30:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d7c00aa-4909-5da9-ae1f-af2d593a314d/9d7c00aa-4909-5da9-ae1f-af2d593a314d_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F356%252F8e0c6027cbf1427dbb3aa4269feb8f6c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/356/8e0c6027cbf1427dbb3aa4269feb8f6c/images/large/1.jpg saved to cache
2026-03-26 18:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9d7c00aa-4909-5da9-ae1f-af2d593a314d
2026-03-26 18:30:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9d7c00aa-4909-5da9-ae1f-af2d593a314d, skipping ID generation
2026-03-26 18:30:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d7c00aa-4909-5da9-ae1f-af2d593a314d with scrape type 1
2026-03-26 18:30:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9d7c00aa-4909-5da9-ae1f-af2d593a314d sending to next pipeline
2026-03-26 18:30:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9d7c00aa-4909-5da9-ae1f-af2d593a314d, identifier: 1985145
2026-03-26 18:30:55 [ayvens.es] INFO: Found listing with ID: 1985158
2026-03-26 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985158%27 HTTP/1.1" 200 None
2026-03-26 18:30:55 [ayvens.es] INFO: Scrape type for 1985158: 1
2026-03-26 18:30:55 [ayvens.es] INFO: Extracting data for car ID: 1985158
2026-03-26 18:30:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e53ed169-7340-5015-8514-d0d718f5f41a with identifier: 1985158
2026-03-26 18:30:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e53ed169-7340-5015-8514-d0d718f5f41a with scrape type 1
2026-03-26 18:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e53ed169-7340-5015-8514-d0d718f5f41a
2026-03-26 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F045%252F0d614f8fba504206991ceed07cac69eb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/045/0d614f8fba504206991ceed07cac69eb/images/large/1.jpg not downloaded yet
2026-03-26 18:30:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 49422cd1-9d6f-59ea-a1b7-5d65c95ec78c with identifier: 1985149
2026-03-26 18:30:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 49422cd1-9d6f-59ea-a1b7-5d65c95ec78c with identifier: 1985149
2026-03-26 18:30:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 49422cd1-9d6f-59ea-a1b7-5d65c95ec78c with identifier: 1985149 to the API
2026-03-26 18:30:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:30:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:30:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/002/1a019fd1a7c64976a5969084361f9397/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'Blanco classic',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '49422cd1-9d6f-59ea-a1b7-5d65c95ec78c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'RAV4',
 'odometer': 122290,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49422cd1-9d6f-59ea-a1b7-5d65c95ec78c/49422cd1-9d6f-59ea-a1b7-5d65c95ec78c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 323675,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/002/1a019fd1a7c64976a5969084361f9397/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA RAV4 2.5l 220H Advance',
 'transmission': 'manual',
 'trim': '2.5l 220H Advance',
 'vin': None,
 'year': 2020}
2026-03-26 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985149%27 HTTP/1.1" 200 None
2026-03-26 18:30:55 [ayvens.es] INFO: Saving data for 1985149: {'created_time': 1774549855.451363, 'last_price_update_time': 1774549855.451374, 'auction_closing_time': 1774612800.0}
2026-03-26 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985149') HTTP/1.1" 204 0
2026-03-26 18:30:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9d7c00aa-4909-5da9-ae1f-af2d593a314d with identifier: 1985145
2026-03-26 18:30:55 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:30:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9d7c00aa-4909-5da9-ae1f-af2d593a314d with identifier: 1985145
2026-03-26 18:30:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9d7c00aa-4909-5da9-ae1f-af2d593a314d with identifier: 1985145 to the API
2026-03-26 18:30:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:30:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:30:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/356/8e0c6027cbf1427dbb3aa4269feb8f6c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 46,
 'color': 'Plata mojave metaliz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '9d7c00aa-4909-5da9-ae1f-af2d593a314d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLC-CLASS',
 'odometer': 128956,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d7c00aa-4909-5da9-ae1f-af2d593a314d/9d7c00aa-4909-5da9-ae1f-af2d593a314d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 376866,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/356/8e0c6027cbf1427dbb3aa4269feb8f6c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLC-CLASS GLC 300 de 4MATIC',
 'transmission': 'manual',
 'trim': 'GLC 300 de 4MATIC',
 'vin': None,
 'year': 2022}
2026-03-26 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985145%27 HTTP/1.1" 200 None
2026-03-26 18:30:55 [ayvens.es] INFO: Saving data for 1985145: {'created_time': 1774549855.826249, 'last_price_update_time': 1774549855.826259, 'auction_closing_time': 1774612800.0}
2026-03-26 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985145') HTTP/1.1" 204 0
2026-03-26 18:30:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:30:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28deb250>
2026-03-26 18:30:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:30:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:30:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:30:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_831db8e6-f4b0-5ee1-8661-b92d3b5437fb/831db8e6-f4b0-5ee1-8661-b92d3b5437fb_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F326%252Faf5db6c0b5e44541abf655140e7fb90e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/326/af5db6c0b5e44541abf655140e7fb90e/images/large/1.jpg saved to cache
2026-03-26 18:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 831db8e6-f4b0-5ee1-8661-b92d3b5437fb
2026-03-26 18:30:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 831db8e6-f4b0-5ee1-8661-b92d3b5437fb, skipping ID generation
2026-03-26 18:30:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 831db8e6-f4b0-5ee1-8661-b92d3b5437fb with scrape type 1
2026-03-26 18:30:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 831db8e6-f4b0-5ee1-8661-b92d3b5437fb sending to next pipeline
2026-03-26 18:30:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 831db8e6-f4b0-5ee1-8661-b92d3b5437fb, identifier: 1985147
2026-03-26 18:30:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:30:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28ec25d0>
2026-03-26 18:30:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:30:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:30:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:30:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ac6a881-f309-51e5-b620-f9497b6572ba/5ac6a881-f309-51e5-b620-f9497b6572ba_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F637%252F4ea343641aec490e834bb511cf465a54%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/637/4ea343641aec490e834bb511cf465a54/images/large/1.jpg saved to cache
2026-03-26 18:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5ac6a881-f309-51e5-b620-f9497b6572ba
2026-03-26 18:30:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5ac6a881-f309-51e5-b620-f9497b6572ba, skipping ID generation
2026-03-26 18:30:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ac6a881-f309-51e5-b620-f9497b6572ba with scrape type 1
2026-03-26 18:30:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5ac6a881-f309-51e5-b620-f9497b6572ba sending to next pipeline
2026-03-26 18:30:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5ac6a881-f309-51e5-b620-f9497b6572ba, identifier: 1985148
2026-03-26 18:30:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:30:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a283e0690>
2026-03-26 18:30:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:30:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:30:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:30:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc967560-abce-52ea-bc36-82c68fea75bc/cc967560-abce-52ea-bc36-82c68fea75bc_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F158%252F81a55281e4ba45b4883200717268ff5e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/158/81a55281e4ba45b4883200717268ff5e/images/large/1.jpg saved to cache
2026-03-26 18:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cc967560-abce-52ea-bc36-82c68fea75bc
2026-03-26 18:30:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cc967560-abce-52ea-bc36-82c68fea75bc, skipping ID generation
2026-03-26 18:30:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc967560-abce-52ea-bc36-82c68fea75bc with scrape type 1
2026-03-26 18:30:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cc967560-abce-52ea-bc36-82c68fea75bc sending to next pipeline
2026-03-26 18:30:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: cc967560-abce-52ea-bc36-82c68fea75bc, identifier: 1985150
2026-03-26 18:30:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:30:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28cadbd0>
2026-03-26 18:30:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:30:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:30:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:30:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f24a1988-5e63-5b07-b8ff-466840c2f1d1/f24a1988-5e63-5b07-b8ff-466840c2f1d1_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F331%252F6e722783fa9b461485e7636e8e51bbb0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/331/6e722783fa9b461485e7636e8e51bbb0/images/large/1.jpg saved to cache
2026-03-26 18:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f24a1988-5e63-5b07-b8ff-466840c2f1d1
2026-03-26 18:30:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f24a1988-5e63-5b07-b8ff-466840c2f1d1, skipping ID generation
2026-03-26 18:30:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f24a1988-5e63-5b07-b8ff-466840c2f1d1 with scrape type 1
2026-03-26 18:30:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f24a1988-5e63-5b07-b8ff-466840c2f1d1 sending to next pipeline
2026-03-26 18:30:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f24a1988-5e63-5b07-b8ff-466840c2f1d1, identifier: 1985144
2026-03-26 18:30:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/457/6c3d8729695e42c091b92865931872f2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:30:56 [ayvens.es] INFO: Found listing with ID: 1985159
2026-03-26 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985159%27 HTTP/1.1" 200 None
2026-03-26 18:30:56 [ayvens.es] INFO: Scrape type for 1985159: 1
2026-03-26 18:30:56 [ayvens.es] INFO: Extracting data for car ID: 1985159
2026-03-26 18:30:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d524e75-84cd-56cd-9c8a-58195b020310 with identifier: 1985159
2026-03-26 18:30:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d524e75-84cd-56cd-9c8a-58195b020310 with scrape type 1
2026-03-26 18:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3d524e75-84cd-56cd-9c8a-58195b020310
2026-03-26 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F854%252F22beec3bda6c4c7db917e83f66381e1c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/854/22beec3bda6c4c7db917e83f66381e1c/images/large/1.jpg not downloaded yet
2026-03-26 18:30:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 831db8e6-f4b0-5ee1-8661-b92d3b5437fb with identifier: 1985147
2026-03-26 18:30:56 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:30:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 831db8e6-f4b0-5ee1-8661-b92d3b5437fb with identifier: 1985147
2026-03-26 18:30:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 831db8e6-f4b0-5ee1-8661-b92d3b5437fb with identifier: 1985147 to the API
2026-03-26 18:30:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:30:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:30:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/326/af5db6c0b5e44541abf655140e7fb90e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 24,
 'color': 'Silver dawn',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '831db8e6-f4b0-5ee1-8661-b92d3b5437fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC60',
 'odometer': 77792,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_831db8e6-f4b0-5ee1-8661-b92d3b5437fb/831db8e6-f4b0-5ee1-8661-b92d3b5437fb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 333588,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/326/af5db6c0b5e44541abf655140e7fb90e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC60 2.0 T6 AWD Recharge Inscription Exp Auto',
 'transmission': 'manual',
 'trim': '2.0 T6 AWD Recharge Inscription Exp Auto',
 'vin': None,
 'year': 2022}
2026-03-26 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985147%27 HTTP/1.1" 200 None
2026-03-26 18:30:56 [ayvens.es] INFO: Saving data for 1985147: {'created_time': 1774549856.94478, 'last_price_update_time': 1774549856.944791, 'auction_closing_time': 1774612800.0}
2026-03-26 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985147') HTTP/1.1" 204 0
2026-03-26 18:30:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5ac6a881-f309-51e5-b620-f9497b6572ba with identifier: 1985148
2026-03-26 18:30:56 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:30:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5ac6a881-f309-51e5-b620-f9497b6572ba with identifier: 1985148
2026-03-26 18:30:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5ac6a881-f309-51e5-b620-f9497b6572ba with identifier: 1985148 to the API
2026-03-26 18:30:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:30:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:30:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/637/4ea343641aec490e834bb511cf465a54/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 45,
 'color': 'Gris dophin',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '5ac6a881-f309-51e5-b620-f9497b6572ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'TARRACO',
 'odometer': 178641,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ac6a881-f309-51e5-b620-f9497b6572ba/5ac6a881-f309-51e5-b620-f9497b6572ba_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 338497,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/637/4ea343641aec490e834bb511cf465a54/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT TARRACO 1.4 E-Hybrid 180kW DSG Xcellence GO',
 'transmission': 'manual',
 'trim': '1.4 E-Hybrid 180kW DSG Xcellence GO',
 'vin': None,
 'year': 2021}
2026-03-26 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985148%27 HTTP/1.1" 200 None
2026-03-26 18:30:57 [ayvens.es] INFO: Saving data for 1985148: {'created_time': 1774549857.368364, 'last_price_update_time': 1774549857.368378, 'auction_closing_time': 1774612800.0}
2026-03-26 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985148') HTTP/1.1" 204 0
2026-03-26 18:30:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: cc967560-abce-52ea-bc36-82c68fea75bc with identifier: 1985150
2026-03-26 18:30:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: cc967560-abce-52ea-bc36-82c68fea75bc with identifier: 1985150
2026-03-26 18:30:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: cc967560-abce-52ea-bc36-82c68fea75bc with identifier: 1985150 to the API
2026-03-26 18:30:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:30:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:30:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/158/81a55281e4ba45b4883200717268ff5e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'electric',
 'id': 'cc967560-abce-52ea-bc36-82c68fea75bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'ZOE',
 'odometer': 51496,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc967560-abce-52ea-bc36-82c68fea75bc/cc967560-abce-52ea-bc36-82c68fea75bc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 341843,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/158/81a55281e4ba45b4883200717268ff5e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT ZOE Life 40 R90 Flexi***BATERIA EN REGIMEN DE ALQUILER***',
 'transmission': 'manual',
 'trim': 'Life 40 R90 Flexi***BATERIA EN REGIMEN DE ALQUILER***',
 'vin': None,
 'year': 2018}
2026-03-26 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985150%27 HTTP/1.1" 200 None
2026-03-26 18:30:57 [ayvens.es] INFO: Saving data for 1985150: {'created_time': 1774549857.873526, 'last_price_update_time': 1774549857.873537, 'auction_closing_time': 1774612800.0}
2026-03-26 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985150') HTTP/1.1" 204 0
2026-03-26 18:30:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f24a1988-5e63-5b07-b8ff-466840c2f1d1 with identifier: 1985144
2026-03-26 18:30:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f24a1988-5e63-5b07-b8ff-466840c2f1d1 with identifier: 1985144
2026-03-26 18:30:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f24a1988-5e63-5b07-b8ff-466840c2f1d1 with identifier: 1985144 to the API
2026-03-26 18:30:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:30:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:30:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/331/6e722783fa9b461485e7636e8e51bbb0/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'Polar white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'f24a1988-5e63-5b07-b8ff-466840c2f1d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'TUCSON',
 'odometer': 46054,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f24a1988-5e63-5b07-b8ff-466840c2f1d1/f24a1988-5e63-5b07-b8ff-466840c2f1d1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 514137,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/331/6e722783fa9b461485e7636e8e51bbb0/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI TUCSON 1.6 CRDI 100kW (136CV) 48V Maxx',
 'transmission': 'manual',
 'trim': '1.6 CRDI 100kW (136CV) 48V Maxx',
 'vin': None,
 'year': 2021}
2026-03-26 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985144%27 HTTP/1.1" 200 None
2026-03-26 18:30:58 [ayvens.es] INFO: Saving data for 1985144: {'created_time': 1774549858.212941, 'last_price_update_time': 1774549858.212952, 'auction_closing_time': 1774612800.0}
2026-03-26 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985144') HTTP/1.1" 204 0
2026-03-26 18:30:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/134/32cdb95dfb244ff8b0c4dbaf7808de4f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:30:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/937/1143f4f8a0e84b8da65be999f389ca28/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:30:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/068/d8e3b9323a5a4fbc87e609f8a4c86dd6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:30:58 [ayvens.es] INFO: Found listing with ID: 1985160
2026-03-26 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985160%27 HTTP/1.1" 200 None
2026-03-26 18:30:58 [ayvens.es] INFO: Scrape type for 1985160: 1
2026-03-26 18:30:58 [ayvens.es] INFO: Extracting data for car ID: 1985160
2026-03-26 18:30:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d9464ee-e72d-50b4-9b48-d2be12a04596 with identifier: 1985160
2026-03-26 18:30:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d9464ee-e72d-50b4-9b48-d2be12a04596 with scrape type 1
2026-03-26 18:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8d9464ee-e72d-50b4-9b48-d2be12a04596
2026-03-26 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F010%252F9e9ddbd3f6ce49a4b84cc6ca2bd99337%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/010/9e9ddbd3f6ce49a4b84cc6ca2bd99337/images/large/1.jpg not downloaded yet
2026-03-26 18:30:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/732/bb6f2cdfe930474b81aed4aad16fc27a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:30:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:30:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a29049890>
2026-03-26 18:30:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:30:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:30:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:30:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4228209a-b622-5b81-8ca8-8d0d1e9232da/4228209a-b622-5b81-8ca8-8d0d1e9232da_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F457%252F6c3d8729695e42c091b92865931872f2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/457/6c3d8729695e42c091b92865931872f2/images/large/1.jpg saved to cache
2026-03-26 18:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4228209a-b622-5b81-8ca8-8d0d1e9232da
2026-03-26 18:30:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4228209a-b622-5b81-8ca8-8d0d1e9232da, skipping ID generation
2026-03-26 18:30:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4228209a-b622-5b81-8ca8-8d0d1e9232da with scrape type 1
2026-03-26 18:30:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4228209a-b622-5b81-8ca8-8d0d1e9232da sending to next pipeline
2026-03-26 18:30:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4228209a-b622-5b81-8ca8-8d0d1e9232da, identifier: 1985152
2026-03-26 18:30:58 [ayvens.es] INFO: Found listing with ID: 1985161
2026-03-26 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985161%27 HTTP/1.1" 200 None
2026-03-26 18:30:58 [ayvens.es] INFO: Scrape type for 1985161: 1
2026-03-26 18:30:58 [ayvens.es] INFO: Extracting data for car ID: 1985161
2026-03-26 18:30:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7c84b47-43f6-55db-ab70-0553fbbe1e1d with identifier: 1985161
2026-03-26 18:30:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7c84b47-43f6-55db-ab70-0553fbbe1e1d with scrape type 1
2026-03-26 18:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e7c84b47-43f6-55db-ab70-0553fbbe1e1d
2026-03-26 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F239%252F57602fdfeee5419c859ff1141a352463%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/239/57602fdfeee5419c859ff1141a352463/images/large/1.jpg not downloaded yet
2026-03-26 18:30:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4228209a-b622-5b81-8ca8-8d0d1e9232da with identifier: 1985152
2026-03-26 18:30:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4228209a-b622-5b81-8ca8-8d0d1e9232da with identifier: 1985152
2026-03-26 18:30:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 4228209a-b622-5b81-8ca8-8d0d1e9232da with identifier: 1985152 to the API
2026-03-26 18:30:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:30:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:30:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/457/6c3d8729695e42c091b92865931872f2/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Plata solar',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '4228209a-b622-5b81-8ca8-8d0d1e9232da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'KUGA',
 'odometer': 101966,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4228209a-b622-5b81-8ca8-8d0d1e9232da/4228209a-b622-5b81-8ca8-8d0d1e9232da_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 363490,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/457/6c3d8729695e42c091b92865931872f2/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD KUGA Titanium 2.5 Duratec FHEV 140kW Auto',
 'transmission': 'manual',
 'trim': 'Titanium 2.5 Duratec FHEV 140kW Auto',
 'vin': None,
 'year': 2022}
2026-03-26 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985152%27 HTTP/1.1" 200 None
2026-03-26 18:30:59 [ayvens.es] INFO: Saving data for 1985152: {'created_time': 1774549859.561168, 'last_price_update_time': 1774549859.561178, 'auction_closing_time': 1774612800.0}
2026-03-26 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985152') HTTP/1.1" 204 0
2026-03-26 18:30:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/522/3267276c041a469fa1fab03f24407291/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:30:59 [ayvens.es] INFO: Found listing with ID: 1985162
2026-03-26 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985162%27 HTTP/1.1" 200 None
2026-03-26 18:30:59 [ayvens.es] INFO: Scrape type for 1985162: 1
2026-03-26 18:30:59 [ayvens.es] INFO: Extracting data for car ID: 1985162
2026-03-26 18:30:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 026a5f3f-6004-5b27-b1f3-e59f210be48c with identifier: 1985162
2026-03-26 18:30:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 026a5f3f-6004-5b27-b1f3-e59f210be48c with scrape type 1
2026-03-26 18:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 026a5f3f-6004-5b27-b1f3-e59f210be48c
2026-03-26 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F719%252Fff347d69fa614700bdb62f4493866059%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/719/ff347d69fa614700bdb62f4493866059/images/large/1.jpg not downloaded yet
2026-03-26 18:30:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:30:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a283164d0>
2026-03-26 18:30:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:30:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:30:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:30:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f95658c3-2fe4-5849-89d9-858f2a4c7620/f95658c3-2fe4-5849-89d9-858f2a4c7620_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F134%252F32cdb95dfb244ff8b0c4dbaf7808de4f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/134/32cdb95dfb244ff8b0c4dbaf7808de4f/images/large/1.jpg saved to cache
2026-03-26 18:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f95658c3-2fe4-5849-89d9-858f2a4c7620
2026-03-26 18:30:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f95658c3-2fe4-5849-89d9-858f2a4c7620, skipping ID generation
2026-03-26 18:30:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f95658c3-2fe4-5849-89d9-858f2a4c7620 with scrape type 1
2026-03-26 18:30:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f95658c3-2fe4-5849-89d9-858f2a4c7620 sending to next pipeline
2026-03-26 18:30:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f95658c3-2fe4-5849-89d9-858f2a4c7620, identifier: 1985153
2026-03-26 18:30:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:30:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28eb7550>
2026-03-26 18:30:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:30:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:30:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:30:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d7a9eb9-51f3-58e2-94d4-c71b47b6f8e9/0d7a9eb9-51f3-58e2-94d4-c71b47b6f8e9_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F937%252F1143f4f8a0e84b8da65be999f389ca28%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/937/1143f4f8a0e84b8da65be999f389ca28/images/large/1.jpg saved to cache
2026-03-26 18:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0d7a9eb9-51f3-58e2-94d4-c71b47b6f8e9
2026-03-26 18:30:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0d7a9eb9-51f3-58e2-94d4-c71b47b6f8e9, skipping ID generation
2026-03-26 18:30:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d7a9eb9-51f3-58e2-94d4-c71b47b6f8e9 with scrape type 1
2026-03-26 18:30:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0d7a9eb9-51f3-58e2-94d4-c71b47b6f8e9 sending to next pipeline
2026-03-26 18:30:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0d7a9eb9-51f3-58e2-94d4-c71b47b6f8e9, identifier: 1985151
2026-03-26 18:30:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:30:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a283e0850>
2026-03-26 18:30:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:30:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:30:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9035439-892b-54bf-94f4-7289ee8fbe26/f9035439-892b-54bf-94f4-7289ee8fbe26_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F068%252Fd8e3b9323a5a4fbc87e609f8a4c86dd6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/068/d8e3b9323a5a4fbc87e609f8a4c86dd6/images/large/1.jpg saved to cache
2026-03-26 18:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f9035439-892b-54bf-94f4-7289ee8fbe26
2026-03-26 18:31:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f9035439-892b-54bf-94f4-7289ee8fbe26, skipping ID generation
2026-03-26 18:31:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9035439-892b-54bf-94f4-7289ee8fbe26 with scrape type 1
2026-03-26 18:31:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f9035439-892b-54bf-94f4-7289ee8fbe26 sending to next pipeline
2026-03-26 18:31:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f9035439-892b-54bf-94f4-7289ee8fbe26, identifier: 1985154
2026-03-26 18:31:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a283e22d0>
2026-03-26 18:31:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76129068-965c-536d-a702-87d4652eb5d1/76129068-965c-536d-a702-87d4652eb5d1_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F732%252Fbb6f2cdfe930474b81aed4aad16fc27a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/732/bb6f2cdfe930474b81aed4aad16fc27a/images/large/1.jpg saved to cache
2026-03-26 18:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 76129068-965c-536d-a702-87d4652eb5d1
2026-03-26 18:31:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 76129068-965c-536d-a702-87d4652eb5d1, skipping ID generation
2026-03-26 18:31:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76129068-965c-536d-a702-87d4652eb5d1 with scrape type 1
2026-03-26 18:31:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 76129068-965c-536d-a702-87d4652eb5d1 sending to next pipeline
2026-03-26 18:31:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 76129068-965c-536d-a702-87d4652eb5d1, identifier: 1985155
2026-03-26 18:31:00 [ayvens.es] INFO: Found listing with ID: 1985163
2026-03-26 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985163%27 HTTP/1.1" 200 None
2026-03-26 18:31:00 [ayvens.es] INFO: Scrape type for 1985163: 1
2026-03-26 18:31:00 [ayvens.es] INFO: Extracting data for car ID: 1985163
2026-03-26 18:31:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9b14c89-a185-5080-b534-fccbd4686b55 with identifier: 1985163
2026-03-26 18:31:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9b14c89-a185-5080-b534-fccbd4686b55 with scrape type 1
2026-03-26 18:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a9b14c89-a185-5080-b534-fccbd4686b55
2026-03-26 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F281%252F763db42cdc9444279cb77dd5465b26c0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/281/763db42cdc9444279cb77dd5465b26c0/images/large/1.jpg not downloaded yet
2026-03-26 18:31:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f95658c3-2fe4-5849-89d9-858f2a4c7620 with identifier: 1985153
2026-03-26 18:31:00 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:31:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f95658c3-2fe4-5849-89d9-858f2a4c7620 with identifier: 1985153
2026-03-26 18:31:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f95658c3-2fe4-5849-89d9-858f2a4c7620 with identifier: 1985153 to the API
2026-03-26 18:31:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/134/32cdb95dfb244ff8b0c4dbaf7808de4f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 44,
 'color': 'Santorini black meta',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'f95658c3-2fe4-5849-89d9-858f2a4c7620',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER EVOQUE',
 'odometer': 84217,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f95658c3-2fe4-5849-89d9-858f2a4c7620/f95658c3-2fe4-5849-89d9-858f2a4c7620_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 337883,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/134/32cdb95dfb244ff8b0c4dbaf7808de4f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER RANGE ROVER EVOQUE 1.5 P300e Autobiography AUTO 4WD PHEV',
 'transmission': 'manual',
 'trim': '1.5 P300e Autobiography AUTO 4WD PHEV',
 'vin': None,
 'year': 2021}
2026-03-26 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985153%27 HTTP/1.1" 200 None
2026-03-26 18:31:00 [ayvens.es] INFO: Saving data for 1985153: {'created_time': 1774549860.719048, 'last_price_update_time': 1774549860.719062, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985153') HTTP/1.1" 204 0
2026-03-26 18:31:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0d7a9eb9-51f3-58e2-94d4-c71b47b6f8e9 with identifier: 1985151
2026-03-26 18:31:00 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:31:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0d7a9eb9-51f3-58e2-94d4-c71b47b6f8e9 with identifier: 1985151
2026-03-26 18:31:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0d7a9eb9-51f3-58e2-94d4-c71b47b6f8e9 with identifier: 1985151 to the API
2026-03-26 18:31:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/937/1143f4f8a0e84b8da65be999f389ca28/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Gris himalaya',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'electric',
 'id': '0d7a9eb9-51f3-58e2-94d4-c71b47b6f8e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'MOKKA',
 'odometer': 142324,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d7a9eb9-51f3-58e2-94d4-c71b47b6f8e9/0d7a9eb9-51f3-58e2-94d4-c71b47b6f8e9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 591574,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/937/1143f4f8a0e84b8da65be999f389ca28/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL MOKKA BEV 50kWh Business Elegance',
 'transmission': 'manual',
 'trim': 'BEV 50kWh Business Elegance',
 'vin': None,
 'year': 2022}
2026-03-26 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985151%27 HTTP/1.1" 200 None
2026-03-26 18:31:01 [ayvens.es] INFO: Saving data for 1985151: {'created_time': 1774549861.269645, 'last_price_update_time': 1774549861.269655, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985151') HTTP/1.1" 204 0
2026-03-26 18:31:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f9035439-892b-54bf-94f4-7289ee8fbe26 with identifier: 1985154
2026-03-26 18:31:01 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:31:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f9035439-892b-54bf-94f4-7289ee8fbe26 with identifier: 1985154
2026-03-26 18:31:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f9035439-892b-54bf-94f4-7289ee8fbe26 with identifier: 1985154 to the API
2026-03-26 18:31:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/068/d8e3b9323a5a4fbc87e609f8a4c86dd6/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Gris tif',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'electric',
 'id': 'f9035439-892b-54bf-94f4-7289ee8fbe26',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q4',
 'odometer': 184934,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9035439-892b-54bf-94f4-7289ee8fbe26/f9035439-892b-54bf-94f4-7289ee8fbe26_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 335605,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/068/d8e3b9323a5a4fbc87e609f8a4c86dd6/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q4 Advanced 40 e-tron 150kW 82kWh',
 'transmission': 'manual',
 'trim': 'Advanced 40 e-tron 150kW 82kWh',
 'vin': None,
 'year': 2022}
2026-03-26 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985154%27 HTTP/1.1" 200 None
2026-03-26 18:31:01 [ayvens.es] INFO: Saving data for 1985154: {'created_time': 1774549861.62809, 'last_price_update_time': 1774549861.628101, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985154') HTTP/1.1" 204 0
2026-03-26 18:31:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 76129068-965c-536d-a702-87d4652eb5d1 with identifier: 1985155
2026-03-26 18:31:01 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:31:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 76129068-965c-536d-a702-87d4652eb5d1 with identifier: 1985155
2026-03-26 18:31:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 76129068-965c-536d-a702-87d4652eb5d1 with identifier: 1985155 to the API
2026-03-26 18:31:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/732/bb6f2cdfe930474b81aed4aad16fc27a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 96,
 'color': 'Gris tecnico',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'gas',
 'id': '76129068-965c-536d-a702-87d4652eb5d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 187830,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76129068-965c-536d-a702-87d4652eb5d1/76129068-965c-536d-a702-87d4652eb5d1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 327527,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/732/bb6f2cdfe930474b81aed4aad16fc27a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON 1.4 TGI GNC St&Sp Style',
 'transmission': 'manual',
 'trim': '1.4 TGI GNC St&Sp Style',
 'vin': None,
 'year': 2016}
2026-03-26 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985155%27 HTTP/1.1" 200 None
2026-03-26 18:31:01 [ayvens.es] INFO: Saving data for 1985155: {'created_time': 1774549861.969507, 'last_price_update_time': 1774549861.969517, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985155') HTTP/1.1" 204 0
2026-03-26 18:31:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/936/9c4230507cd74a4093668ff4c4e07ce4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:01 [ayvens.es] INFO: Found listing with ID: 1985164
2026-03-26 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985164%27 HTTP/1.1" 200 None
2026-03-26 18:31:02 [ayvens.es] INFO: Scrape type for 1985164: 1
2026-03-26 18:31:02 [ayvens.es] INFO: Extracting data for car ID: 1985164
2026-03-26 18:31:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e23cb883-811b-54ff-989f-972d41185059 with identifier: 1985164
2026-03-26 18:31:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e23cb883-811b-54ff-989f-972d41185059 with scrape type 1
2026-03-26 18:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e23cb883-811b-54ff-989f-972d41185059
2026-03-26 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F961%252F1cea844cc56746c08bb8cb2284576628%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/961/1cea844cc56746c08bb8cb2284576628/images/large/1.jpg not downloaded yet
2026-03-26 18:31:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28d3f4d0>
2026-03-26 18:31:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fad74783-9ccd-52f5-b303-c2f1088863a9/fad74783-9ccd-52f5-b303-c2f1088863a9_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F522%252F3267276c041a469fa1fab03f24407291%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/522/3267276c041a469fa1fab03f24407291/images/large/1.jpg saved to cache
2026-03-26 18:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fad74783-9ccd-52f5-b303-c2f1088863a9
2026-03-26 18:31:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fad74783-9ccd-52f5-b303-c2f1088863a9, skipping ID generation
2026-03-26 18:31:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fad74783-9ccd-52f5-b303-c2f1088863a9 with scrape type 1
2026-03-26 18:31:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fad74783-9ccd-52f5-b303-c2f1088863a9 sending to next pipeline
2026-03-26 18:31:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: fad74783-9ccd-52f5-b303-c2f1088863a9, identifier: 1985156
2026-03-26 18:31:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/854/22beec3bda6c4c7db917e83f66381e1c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: fad74783-9ccd-52f5-b303-c2f1088863a9 with identifier: 1985156
2026-03-26 18:31:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:31:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: fad74783-9ccd-52f5-b303-c2f1088863a9 with identifier: 1985156
2026-03-26 18:31:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: fad74783-9ccd-52f5-b303-c2f1088863a9 with identifier: 1985156 to the API
2026-03-26 18:31:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/522/3267276c041a469fa1fab03f24407291/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 55,
 'color': 'Denin blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'fad74783-9ccd-52f5-b303-c2f1088863a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC60',
 'odometer': 84312,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fad74783-9ccd-52f5-b303-c2f1088863a9/fad74783-9ccd-52f5-b303-c2f1088863a9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 322079,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/522/3267276c041a469fa1fab03f24407291/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC60 2.0 T6 AWD Recharge Inscription Exp Auto',
 'transmission': 'manual',
 'trim': '2.0 T6 AWD Recharge Inscription Exp Auto',
 'vin': None,
 'year': 2022}
2026-03-26 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985156%27 HTTP/1.1" 200 None
2026-03-26 18:31:02 [ayvens.es] INFO: Saving data for 1985156: {'created_time': 1774549862.523459, 'last_price_update_time': 1774549862.52347, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985156') HTTP/1.1" 204 0
2026-03-26 18:31:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/045/0d614f8fba504206991ceed07cac69eb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:02 [ayvens.es] INFO: Found listing with ID: 1985165
2026-03-26 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985165%27 HTTP/1.1" 200 None
2026-03-26 18:31:02 [ayvens.es] INFO: Scrape type for 1985165: 1
2026-03-26 18:31:02 [ayvens.es] INFO: Extracting data for car ID: 1985165
2026-03-26 18:31:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87f9e348-15d3-5b38-827d-27a947d15580 with identifier: 1985165
2026-03-26 18:31:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87f9e348-15d3-5b38-827d-27a947d15580 with scrape type 1
2026-03-26 18:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 87f9e348-15d3-5b38-827d-27a947d15580
2026-03-26 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F269%252F85f2663b6e7d4a2f8e7c4cf1bbdb62c8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/269/85f2663b6e7d4a2f8e7c4cf1bbdb62c8/images/large/1.jpg not downloaded yet
2026-03-26 18:31:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c5ead0>
2026-03-26 18:31:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fa1781b-0acd-59e9-9c54-762201135ac6/5fa1781b-0acd-59e9-9c54-762201135ac6_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F936%252F9c4230507cd74a4093668ff4c4e07ce4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/936/9c4230507cd74a4093668ff4c4e07ce4/images/large/1.jpg saved to cache
2026-03-26 18:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5fa1781b-0acd-59e9-9c54-762201135ac6
2026-03-26 18:31:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5fa1781b-0acd-59e9-9c54-762201135ac6, skipping ID generation
2026-03-26 18:31:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fa1781b-0acd-59e9-9c54-762201135ac6 with scrape type 1
2026-03-26 18:31:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5fa1781b-0acd-59e9-9c54-762201135ac6 sending to next pipeline
2026-03-26 18:31:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5fa1781b-0acd-59e9-9c54-762201135ac6, identifier: 1985157
2026-03-26 18:31:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/010/9e9ddbd3f6ce49a4b84cc6ca2bd99337/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:02 [ayvens.es] INFO: Found listing with ID: 1985166
2026-03-26 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985166%27 HTTP/1.1" 200 None
2026-03-26 18:31:02 [ayvens.es] INFO: Scrape type for 1985166: 1
2026-03-26 18:31:02 [ayvens.es] INFO: Extracting data for car ID: 1985166
2026-03-26 18:31:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 520129e3-f827-5ef9-a39b-2866ee22db7c with identifier: 1985166
2026-03-26 18:31:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 520129e3-f827-5ef9-a39b-2866ee22db7c with scrape type 1
2026-03-26 18:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 520129e3-f827-5ef9-a39b-2866ee22db7c
2026-03-26 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F958%252F09cb439f3406426fae72937fd9127e7d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/958/09cb439f3406426fae72937fd9127e7d/images/large/1.jpg not downloaded yet
2026-03-26 18:31:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5fa1781b-0acd-59e9-9c54-762201135ac6 with identifier: 1985157
2026-03-26 18:31:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5fa1781b-0acd-59e9-9c54-762201135ac6 with identifier: 1985157
2026-03-26 18:31:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5fa1781b-0acd-59e9-9c54-762201135ac6 with identifier: 1985157 to the API
2026-03-26 18:31:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/936/9c4230507cd74a4093668ff4c4e07ce4/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Gris himalaya',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'electric',
 'id': '5fa1781b-0acd-59e9-9c54-762201135ac6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'MOKKA',
 'odometer': 149247,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fa1781b-0acd-59e9-9c54-762201135ac6/5fa1781b-0acd-59e9-9c54-762201135ac6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 566226,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/936/9c4230507cd74a4093668ff4c4e07ce4/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL MOKKA BEV 50kWh Business Elegance',
 'transmission': 'manual',
 'trim': 'BEV 50kWh Business Elegance',
 'vin': None,
 'year': 2022}
2026-03-26 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985157%27 HTTP/1.1" 200 None
2026-03-26 18:31:03 [ayvens.es] INFO: Saving data for 1985157: {'created_time': 1774549863.195754, 'last_price_update_time': 1774549863.195767, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985157') HTTP/1.1" 204 0
2026-03-26 18:31:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28371990>
2026-03-26 18:31:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d524e75-84cd-56cd-9c8a-58195b020310/3d524e75-84cd-56cd-9c8a-58195b020310_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F854%252F22beec3bda6c4c7db917e83f66381e1c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/854/22beec3bda6c4c7db917e83f66381e1c/images/large/1.jpg saved to cache
2026-03-26 18:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3d524e75-84cd-56cd-9c8a-58195b020310
2026-03-26 18:31:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3d524e75-84cd-56cd-9c8a-58195b020310, skipping ID generation
2026-03-26 18:31:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d524e75-84cd-56cd-9c8a-58195b020310 with scrape type 1
2026-03-26 18:31:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3d524e75-84cd-56cd-9c8a-58195b020310 sending to next pipeline
2026-03-26 18:31:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3d524e75-84cd-56cd-9c8a-58195b020310, identifier: 1985159
2026-03-26 18:31:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/719/ff347d69fa614700bdb62f4493866059/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:03 [ayvens.es] INFO: Found listing with ID: 1985167
2026-03-26 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985167%27 HTTP/1.1" 200 None
2026-03-26 18:31:03 [ayvens.es] INFO: Scrape type for 1985167: 1
2026-03-26 18:31:03 [ayvens.es] INFO: Extracting data for car ID: 1985167
2026-03-26 18:31:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebfef7c0-0f3b-5d31-95c7-3f99c2e44e9c with identifier: 1985167
2026-03-26 18:31:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebfef7c0-0f3b-5d31-95c7-3f99c2e44e9c with scrape type 1
2026-03-26 18:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ebfef7c0-0f3b-5d31-95c7-3f99c2e44e9c
2026-03-26 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F389%252Fab1290ac746f4f5bb2dc1276237d7d18%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/389/ab1290ac746f4f5bb2dc1276237d7d18/images/large/1.jpg not downloaded yet
2026-03-26 18:31:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3d524e75-84cd-56cd-9c8a-58195b020310 with identifier: 1985159
2026-03-26 18:31:03 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:31:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3d524e75-84cd-56cd-9c8a-58195b020310 with identifier: 1985159
2026-03-26 18:31:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3d524e75-84cd-56cd-9c8a-58195b020310 with identifier: 1985159 to the API
2026-03-26 18:31:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/854/22beec3bda6c4c7db917e83f66381e1c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'Gris celestita',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '3d524e75-84cd-56cd-9c8a-58195b020310',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'C-HR',
 'odometer': 80036,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d524e75-84cd-56cd-9c8a-58195b020310/3d524e75-84cd-56cd-9c8a-58195b020310_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 348900,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/854/22beec3bda6c4c7db917e83f66381e1c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA C-HR 1.8 125H Advance',
 'transmission': 'manual',
 'trim': '1.8 125H Advance',
 'vin': None,
 'year': 2021}
2026-03-26 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985159%27 HTTP/1.1" 200 None
2026-03-26 18:31:04 [ayvens.es] INFO: Saving data for 1985159: {'created_time': 1774549864.173215, 'last_price_update_time': 1774549864.173225, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985159') HTTP/1.1" 204 0
2026-03-26 18:31:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/239/57602fdfeee5419c859ff1141a352463/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28355750>
2026-03-26 18:31:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e53ed169-7340-5015-8514-d0d718f5f41a/e53ed169-7340-5015-8514-d0d718f5f41a_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F045%252F0d614f8fba504206991ceed07cac69eb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/045/0d614f8fba504206991ceed07cac69eb/images/large/1.jpg saved to cache
2026-03-26 18:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e53ed169-7340-5015-8514-d0d718f5f41a
2026-03-26 18:31:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e53ed169-7340-5015-8514-d0d718f5f41a, skipping ID generation
2026-03-26 18:31:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e53ed169-7340-5015-8514-d0d718f5f41a with scrape type 1
2026-03-26 18:31:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e53ed169-7340-5015-8514-d0d718f5f41a sending to next pipeline
2026-03-26 18:31:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e53ed169-7340-5015-8514-d0d718f5f41a, identifier: 1985158
2026-03-26 18:31:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28ace190>
2026-03-26 18:31:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d9464ee-e72d-50b4-9b48-d2be12a04596/8d9464ee-e72d-50b4-9b48-d2be12a04596_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F010%252F9e9ddbd3f6ce49a4b84cc6ca2bd99337%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/010/9e9ddbd3f6ce49a4b84cc6ca2bd99337/images/large/1.jpg saved to cache
2026-03-26 18:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8d9464ee-e72d-50b4-9b48-d2be12a04596
2026-03-26 18:31:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8d9464ee-e72d-50b4-9b48-d2be12a04596, skipping ID generation
2026-03-26 18:31:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d9464ee-e72d-50b4-9b48-d2be12a04596 with scrape type 1
2026-03-26 18:31:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8d9464ee-e72d-50b4-9b48-d2be12a04596 sending to next pipeline
2026-03-26 18:31:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8d9464ee-e72d-50b4-9b48-d2be12a04596, identifier: 1985160
2026-03-26 18:31:04 [ayvens.es] INFO: Found listing with ID: 1985168
2026-03-26 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985168%27 HTTP/1.1" 200 None
2026-03-26 18:31:04 [ayvens.es] INFO: Scrape type for 1985168: 1
2026-03-26 18:31:04 [ayvens.es] INFO: Extracting data for car ID: 1985168
2026-03-26 18:31:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20e21d06-9f06-5084-92de-c7be078c1249 with identifier: 1985168
2026-03-26 18:31:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20e21d06-9f06-5084-92de-c7be078c1249 with scrape type 1
2026-03-26 18:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 20e21d06-9f06-5084-92de-c7be078c1249
2026-03-26 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F118%252Ff3b8e2c049f84b6591b63f39dfa25a0a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/118/f3b8e2c049f84b6591b63f39dfa25a0a/images/large/1.jpg not downloaded yet
2026-03-26 18:31:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e53ed169-7340-5015-8514-d0d718f5f41a with identifier: 1985158
2026-03-26 18:31:04 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:31:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e53ed169-7340-5015-8514-d0d718f5f41a with identifier: 1985158
2026-03-26 18:31:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e53ed169-7340-5015-8514-d0d718f5f41a with identifier: 1985158 to the API
2026-03-26 18:31:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/045/0d614f8fba504206991ceed07cac69eb/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'e53ed169-7340-5015-8514-d0d718f5f41a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'PRIUS+',
 'odometer': 86901,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e53ed169-7340-5015-8514-d0d718f5f41a/e53ed169-7340-5015-8514-d0d718f5f41a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 528185,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/045/0d614f8fba504206991ceed07cac69eb/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-16',
 'seats_number': 7,
 'seller_name': None,
 'title': 'TOYOTA PRIUS+ Executive',
 'transmission': 'manual',
 'trim': 'Executive',
 'vin': None,
 'year': 2019}
2026-03-26 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985158%27 HTTP/1.1" 200 None
2026-03-26 18:31:04 [ayvens.es] INFO: Saving data for 1985158: {'created_time': 1774549864.980364, 'last_price_update_time': 1774549864.980375, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985158') HTTP/1.1" 204 0
2026-03-26 18:31:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8d9464ee-e72d-50b4-9b48-d2be12a04596 with identifier: 1985160
2026-03-26 18:31:05 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:31:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8d9464ee-e72d-50b4-9b48-d2be12a04596 with identifier: 1985160
2026-03-26 18:31:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8d9464ee-e72d-50b4-9b48-d2be12a04596 with identifier: 1985160 to the API
2026-03-26 18:31:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/010/9e9ddbd3f6ce49a4b84cc6ca2bd99337/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 45,
 'color': 'Mineralweiss',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '8d9464ee-e72d-50b4-9b48-d2be12a04596',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X3',
 'odometer': 74152,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d9464ee-e72d-50b4-9b48-d2be12a04596/8d9464ee-e72d-50b4-9b48-d2be12a04596_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 349948,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/010/9e9ddbd3f6ce49a4b84cc6ca2bd99337/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 xDrive30e xLine',
 'transmission': 'manual',
 'trim': 'xDrive30e xLine',
 'vin': None,
 'year': 2021}
2026-03-26 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985160%27 HTTP/1.1" 200 None
2026-03-26 18:31:05 [ayvens.es] INFO: Saving data for 1985160: {'created_time': 1774549865.572683, 'last_price_update_time': 1774549865.572693, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985160') HTTP/1.1" 204 0
2026-03-26 18:31:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c19990>
2026-03-26 18:31:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_026a5f3f-6004-5b27-b1f3-e59f210be48c/026a5f3f-6004-5b27-b1f3-e59f210be48c_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F719%252Fff347d69fa614700bdb62f4493866059%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/719/ff347d69fa614700bdb62f4493866059/images/large/1.jpg saved to cache
2026-03-26 18:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 026a5f3f-6004-5b27-b1f3-e59f210be48c
2026-03-26 18:31:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 026a5f3f-6004-5b27-b1f3-e59f210be48c, skipping ID generation
2026-03-26 18:31:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 026a5f3f-6004-5b27-b1f3-e59f210be48c with scrape type 1
2026-03-26 18:31:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 026a5f3f-6004-5b27-b1f3-e59f210be48c sending to next pipeline
2026-03-26 18:31:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 026a5f3f-6004-5b27-b1f3-e59f210be48c, identifier: 1985162
2026-03-26 18:31:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/281/763db42cdc9444279cb77dd5465b26c0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:05 [ayvens.es] INFO: Found listing with ID: 1985169
2026-03-26 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985169%27 HTTP/1.1" 200 None
2026-03-26 18:31:05 [ayvens.es] INFO: Scrape type for 1985169: 1
2026-03-26 18:31:05 [ayvens.es] INFO: Extracting data for car ID: 1985169
2026-03-26 18:31:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09d23b40-c4c5-5a39-9c27-0ea2cd6806b2 with identifier: 1985169
2026-03-26 18:31:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09d23b40-c4c5-5a39-9c27-0ea2cd6806b2 with scrape type 1
2026-03-26 18:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 09d23b40-c4c5-5a39-9c27-0ea2cd6806b2
2026-03-26 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F708%252F1995c3f318eb43e1ba17963b048595a3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/708/1995c3f318eb43e1ba17963b048595a3/images/large/1.jpg not downloaded yet
2026-03-26 18:31:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 026a5f3f-6004-5b27-b1f3-e59f210be48c with identifier: 1985162
2026-03-26 18:31:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 026a5f3f-6004-5b27-b1f3-e59f210be48c with identifier: 1985162
2026-03-26 18:31:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 026a5f3f-6004-5b27-b1f3-e59f210be48c with identifier: 1985162 to the API
2026-03-26 18:31:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/719/ff347d69fa614700bdb62f4493866059/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.6L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'gas',
 'id': '026a5f3f-6004-5b27-b1f3-e59f210be48c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'DACIA',
 'model': 'DOKKER',
 'odometer': 108329,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_026a5f3f-6004-5b27-b1f3-e59f210be48c/026a5f3f-6004-5b27-b1f3-e59f210be48c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 318449,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/719/ff347d69fa614700bdb62f4493866059/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-22',
 'seats_number': 2,
 'seller_name': None,
 'title': 'DACIA DOKKER Van Essential 1.6 80kW (110CV) GLP+++Revisar '
          'peritacion+++',
 'transmission': 'manual',
 'trim': 'Van Essential 1.6 80kW (110CV) GLP+++Revisar peritacion+++',
 'vin': None,
 'year': 2020}
2026-03-26 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985162%27 HTTP/1.1" 200 None
2026-03-26 18:31:06 [ayvens.es] INFO: Saving data for 1985162: {'created_time': 1774549866.292488, 'last_price_update_time': 1774549866.292499, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985162') HTTP/1.1" 204 0
2026-03-26 18:31:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c44b90>
2026-03-26 18:31:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7c84b47-43f6-55db-ab70-0553fbbe1e1d/e7c84b47-43f6-55db-ab70-0553fbbe1e1d_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F239%252F57602fdfeee5419c859ff1141a352463%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/239/57602fdfeee5419c859ff1141a352463/images/large/1.jpg saved to cache
2026-03-26 18:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e7c84b47-43f6-55db-ab70-0553fbbe1e1d
2026-03-26 18:31:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e7c84b47-43f6-55db-ab70-0553fbbe1e1d, skipping ID generation
2026-03-26 18:31:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7c84b47-43f6-55db-ab70-0553fbbe1e1d with scrape type 1
2026-03-26 18:31:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e7c84b47-43f6-55db-ab70-0553fbbe1e1d sending to next pipeline
2026-03-26 18:31:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e7c84b47-43f6-55db-ab70-0553fbbe1e1d, identifier: 1985161
2026-03-26 18:31:06 [scrapy.extensions.logstats] INFO: Crawled 3 pages (at 3 pages/min), scraped 65 items (at 65 items/min)
2026-03-26 18:31:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 177MiB
2026-03-26 18:31:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e7c84b47-43f6-55db-ab70-0553fbbe1e1d with identifier: 1985161
2026-03-26 18:31:06 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:31:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e7c84b47-43f6-55db-ab70-0553fbbe1e1d with identifier: 1985161
2026-03-26 18:31:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e7c84b47-43f6-55db-ab70-0553fbbe1e1d with identifier: 1985161 to the API
2026-03-26 18:31:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/239/57602fdfeee5419c859ff1141a352463/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Dover white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'e7c84b47-43f6-55db-ab70-0553fbbe1e1d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'MG',
 'model': 'HS',
 'odometer': 64132,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7c84b47-43f6-55db-ab70-0553fbbe1e1d/e7c84b47-43f6-55db-ab70-0553fbbe1e1d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 498709,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/239/57602fdfeee5419c859ff1141a352463/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-10',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MG HS Luxury',
 'transmission': 'manual',
 'trim': 'Luxury',
 'vin': None,
 'year': 2022}
2026-03-26 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985161%27 HTTP/1.1" 200 None
2026-03-26 18:31:06 [ayvens.es] INFO: Saving data for 1985161: {'created_time': 1774549866.927511, 'last_price_update_time': 1774549866.927529, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985161') HTTP/1.1" 204 0
2026-03-26 18:31:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/961/1cea844cc56746c08bb8cb2284576628/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:06 [ayvens.es] INFO: Found listing with ID: 1985170
2026-03-26 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985170%27 HTTP/1.1" 200 None
2026-03-26 18:31:06 [ayvens.es] INFO: Scrape type for 1985170: 1
2026-03-26 18:31:06 [ayvens.es] INFO: Extracting data for car ID: 1985170
2026-03-26 18:31:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 381bd381-91a2-58bc-9ea5-66e728730942 with identifier: 1985170
2026-03-26 18:31:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 381bd381-91a2-58bc-9ea5-66e728730942 with scrape type 1
2026-03-26 18:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 381bd381-91a2-58bc-9ea5-66e728730942
2026-03-26 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F899%252F303299766d314c60ba7d70844bb49603%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/899/303299766d314c60ba7d70844bb49603/images/large/1.jpg not downloaded yet
2026-03-26 18:31:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28232290>
2026-03-26 18:31:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9b14c89-a185-5080-b534-fccbd4686b55/a9b14c89-a185-5080-b534-fccbd4686b55_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F281%252F763db42cdc9444279cb77dd5465b26c0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/281/763db42cdc9444279cb77dd5465b26c0/images/large/1.jpg saved to cache
2026-03-26 18:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a9b14c89-a185-5080-b534-fccbd4686b55
2026-03-26 18:31:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a9b14c89-a185-5080-b534-fccbd4686b55, skipping ID generation
2026-03-26 18:31:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9b14c89-a185-5080-b534-fccbd4686b55 with scrape type 1
2026-03-26 18:31:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a9b14c89-a185-5080-b534-fccbd4686b55 sending to next pipeline
2026-03-26 18:31:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a9b14c89-a185-5080-b534-fccbd4686b55, identifier: 1985163
2026-03-26 18:31:07 [ayvens.es] INFO: Found listing with ID: 1985171
2026-03-26 18:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985171%27 HTTP/1.1" 200 None
2026-03-26 18:31:07 [ayvens.es] INFO: Scrape type for 1985171: 1
2026-03-26 18:31:07 [ayvens.es] INFO: Extracting data for car ID: 1985171
2026-03-26 18:31:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59948686-fd9c-56d5-9a63-188a1a464b24 with identifier: 1985171
2026-03-26 18:31:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59948686-fd9c-56d5-9a63-188a1a464b24 with scrape type 1
2026-03-26 18:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 59948686-fd9c-56d5-9a63-188a1a464b24
2026-03-26 18:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F521%252Fa079d1afc3424fb5881c1e7a1a395db1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/521/a079d1afc3424fb5881c1e7a1a395db1/images/large/1.jpg not downloaded yet
2026-03-26 18:31:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a9b14c89-a185-5080-b534-fccbd4686b55 with identifier: 1985163
2026-03-26 18:31:07 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:31:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a9b14c89-a185-5080-b534-fccbd4686b55 with identifier: 1985163
2026-03-26 18:31:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a9b14c89-a185-5080-b534-fccbd4686b55 with identifier: 1985163 to the API
2026-03-26 18:31:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/281/763db42cdc9444279cb77dd5465b26c0/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 35,
 'color': 'Gris manhattan',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'a9b14c89-a185-5080-b534-fccbd4686b55',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q5',
 'odometer': 67060,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9b14c89-a185-5080-b534-fccbd4686b55/a9b14c89-a185-5080-b534-fccbd4686b55_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 365303,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/281/763db42cdc9444279cb77dd5465b26c0/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q5 Advanced 50 TFSI e quattro-ultra',
 'transmission': 'manual',
 'trim': 'Advanced 50 TFSI e quattro-ultra',
 'vin': None,
 'year': 2021}
2026-03-26 18:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985163%27 HTTP/1.1" 200 None
2026-03-26 18:31:07 [ayvens.es] INFO: Saving data for 1985163: {'created_time': 1774549867.608061, 'last_price_update_time': 1774549867.608072, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985163') HTTP/1.1" 204 0
2026-03-26 18:31:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/269/85f2663b6e7d4a2f8e7c4cf1bbdb62c8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:07 [ayvens.es] INFO: Found listing with ID: 1985172
2026-03-26 18:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985172%27 HTTP/1.1" 200 None
2026-03-26 18:31:07 [ayvens.es] INFO: Scrape type for 1985172: 1
2026-03-26 18:31:07 [ayvens.es] INFO: Extracting data for car ID: 1985172
2026-03-26 18:31:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b369788-d4eb-5689-8931-75faba6f2673 with identifier: 1985172
2026-03-26 18:31:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b369788-d4eb-5689-8931-75faba6f2673 with scrape type 1
2026-03-26 18:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8b369788-d4eb-5689-8931-75faba6f2673
2026-03-26 18:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F590%252F163f6051f2574a958e8e440f5ec21ae1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/590/163f6051f2574a958e8e440f5ec21ae1/images/large/1.jpg not downloaded yet
2026-03-26 18:31:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a2c2a0150>
2026-03-26 18:31:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e23cb883-811b-54ff-989f-972d41185059/e23cb883-811b-54ff-989f-972d41185059_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F961%252F1cea844cc56746c08bb8cb2284576628%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/961/1cea844cc56746c08bb8cb2284576628/images/large/1.jpg saved to cache
2026-03-26 18:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e23cb883-811b-54ff-989f-972d41185059
2026-03-26 18:31:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e23cb883-811b-54ff-989f-972d41185059, skipping ID generation
2026-03-26 18:31:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e23cb883-811b-54ff-989f-972d41185059 with scrape type 1
2026-03-26 18:31:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e23cb883-811b-54ff-989f-972d41185059 sending to next pipeline
2026-03-26 18:31:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e23cb883-811b-54ff-989f-972d41185059, identifier: 1985164
2026-03-26 18:31:08 [ayvens.es] INFO: Found listing with ID: 1985173
2026-03-26 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985173%27 HTTP/1.1" 200 None
2026-03-26 18:31:08 [ayvens.es] INFO: Scrape type for 1985173: 1
2026-03-26 18:31:08 [ayvens.es] INFO: Extracting data for car ID: 1985173
2026-03-26 18:31:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac7fe4d8-befd-554d-81a1-577326e0e094 with identifier: 1985173
2026-03-26 18:31:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac7fe4d8-befd-554d-81a1-577326e0e094 with scrape type 1
2026-03-26 18:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ac7fe4d8-befd-554d-81a1-577326e0e094
2026-03-26 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F938%252Fb318fd50027c43e3af02db01baeeb9c5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/938/b318fd50027c43e3af02db01baeeb9c5/images/large/1.jpg not downloaded yet
2026-03-26 18:31:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e23cb883-811b-54ff-989f-972d41185059 with identifier: 1985164
2026-03-26 18:31:08 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:31:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e23cb883-811b-54ff-989f-972d41185059 with identifier: 1985164
2026-03-26 18:31:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e23cb883-811b-54ff-989f-972d41185059 with identifier: 1985164 to the API
2026-03-26 18:31:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/961/1cea844cc56746c08bb8cb2284576628/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 19,
 'color': 'Negro obsidiana meta',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'e23cb883-811b-54ff-989f-972d41185059',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLE',
 'odometer': 112338,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e23cb883-811b-54ff-989f-972d41185059/e23cb883-811b-54ff-989f-972d41185059_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330239,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/961/1cea844cc56746c08bb8cb2284576628/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLE GLE 350 de 4MATIC (Hibrido Enchufable)',
 'transmission': 'manual',
 'trim': 'GLE 350 de 4MATIC (Hibrido Enchufable)',
 'vin': None,
 'year': 2022}
2026-03-26 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985164%27 HTTP/1.1" 200 None
2026-03-26 18:31:08 [ayvens.es] INFO: Saving data for 1985164: {'created_time': 1774549868.477402, 'last_price_update_time': 1774549868.477411, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985164') HTTP/1.1" 204 0
2026-03-26 18:31:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/958/09cb439f3406426fae72937fd9127e7d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/118/f3b8e2c049f84b6591b63f39dfa25a0a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/389/ab1290ac746f4f5bb2dc1276237d7d18/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:08 [ayvens.es] INFO: Found listing with ID: 1985174
2026-03-26 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985174%27 HTTP/1.1" 200 None
2026-03-26 18:31:08 [ayvens.es] INFO: Scrape type for 1985174: 1
2026-03-26 18:31:08 [ayvens.es] INFO: Extracting data for car ID: 1985174
2026-03-26 18:31:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 227bb277-b18c-5a03-a08d-0880486ae492 with identifier: 1985174
2026-03-26 18:31:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 227bb277-b18c-5a03-a08d-0880486ae492 with scrape type 1
2026-03-26 18:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 227bb277-b18c-5a03-a08d-0880486ae492
2026-03-26 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F518%252F899940dc33df46ce8212c967dd595405%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/518/899940dc33df46ce8212c967dd595405/images/large/1.jpg not downloaded yet
2026-03-26 18:31:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a283ee650>
2026-03-26 18:31:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87f9e348-15d3-5b38-827d-27a947d15580/87f9e348-15d3-5b38-827d-27a947d15580_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F269%252F85f2663b6e7d4a2f8e7c4cf1bbdb62c8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/269/85f2663b6e7d4a2f8e7c4cf1bbdb62c8/images/large/1.jpg saved to cache
2026-03-26 18:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 87f9e348-15d3-5b38-827d-27a947d15580
2026-03-26 18:31:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 87f9e348-15d3-5b38-827d-27a947d15580, skipping ID generation
2026-03-26 18:31:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87f9e348-15d3-5b38-827d-27a947d15580 with scrape type 1
2026-03-26 18:31:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 87f9e348-15d3-5b38-827d-27a947d15580 sending to next pipeline
2026-03-26 18:31:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 87f9e348-15d3-5b38-827d-27a947d15580, identifier: 1985165
2026-03-26 18:31:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/708/1995c3f318eb43e1ba17963b048595a3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:08 [ayvens.es] INFO: Found listing with ID: 1985175
2026-03-26 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985175%27 HTTP/1.1" 200 None
2026-03-26 18:31:08 [ayvens.es] INFO: Scrape type for 1985175: 1
2026-03-26 18:31:08 [ayvens.es] INFO: Extracting data for car ID: 1985175
2026-03-26 18:31:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6d0149f-8373-5127-8932-bf09ca1e11df with identifier: 1985175
2026-03-26 18:31:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6d0149f-8373-5127-8932-bf09ca1e11df with scrape type 1
2026-03-26 18:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e6d0149f-8373-5127-8932-bf09ca1e11df
2026-03-26 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F700%252F1431cb0ab0694669b5f8014d528d20f9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/700/1431cb0ab0694669b5f8014d528d20f9/images/large/1.jpg not downloaded yet
2026-03-26 18:31:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 87f9e348-15d3-5b38-827d-27a947d15580 with identifier: 1985165
2026-03-26 18:31:08 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:31:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 87f9e348-15d3-5b38-827d-27a947d15580 with identifier: 1985165
2026-03-26 18:31:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 87f9e348-15d3-5b38-827d-27a947d15580 with identifier: 1985165 to the API
2026-03-26 18:31:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/269/85f2663b6e7d4a2f8e7c4cf1bbdb62c8/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Skyline grey',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '87f9e348-15d3-5b38-827d-27a947d15580',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'JUKE',
 'odometer': 36497,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87f9e348-15d3-5b38-827d-27a947d15580/87f9e348-15d3-5b38-827d-27a947d15580_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 498645,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/269/85f2663b6e7d4a2f8e7c4cf1bbdb62c8/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN JUKE 1.6 Hybrid 105kW (145CV) N-Connecta',
 'transmission': 'manual',
 'trim': '1.6 Hybrid 105kW (145CV) N-Connecta',
 'vin': None,
 'year': 2023}
2026-03-26 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985165%27 HTTP/1.1" 200 None
2026-03-26 18:31:09 [ayvens.es] INFO: Saving data for 1985165: {'created_time': 1774549869.140182, 'last_price_update_time': 1774549869.140194, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985165') HTTP/1.1" 204 0
2026-03-26 18:31:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/899/303299766d314c60ba7d70844bb49603/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:09 [ayvens.es] INFO: Found listing with ID: 1985176
2026-03-26 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985176%27 HTTP/1.1" 200 None
2026-03-26 18:31:09 [ayvens.es] INFO: Scrape type for 1985176: 1
2026-03-26 18:31:09 [ayvens.es] INFO: Extracting data for car ID: 1985176
2026-03-26 18:31:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37a52069-4079-583e-b718-22811d018521 with identifier: 1985176
2026-03-26 18:31:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37a52069-4079-583e-b718-22811d018521 with scrape type 1
2026-03-26 18:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 37a52069-4079-583e-b718-22811d018521
2026-03-26 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F877%252F2c5321b028e34981aec9ab4c47c85487%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/877/2c5321b028e34981aec9ab4c47c85487/images/large/1.jpg not downloaded yet
2026-03-26 18:31:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c6c390>
2026-03-26 18:31:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_520129e3-f827-5ef9-a39b-2866ee22db7c/520129e3-f827-5ef9-a39b-2866ee22db7c_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F958%252F09cb439f3406426fae72937fd9127e7d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/958/09cb439f3406426fae72937fd9127e7d/images/large/1.jpg saved to cache
2026-03-26 18:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 520129e3-f827-5ef9-a39b-2866ee22db7c
2026-03-26 18:31:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 520129e3-f827-5ef9-a39b-2866ee22db7c, skipping ID generation
2026-03-26 18:31:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 520129e3-f827-5ef9-a39b-2866ee22db7c with scrape type 1
2026-03-26 18:31:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 520129e3-f827-5ef9-a39b-2866ee22db7c sending to next pipeline
2026-03-26 18:31:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 520129e3-f827-5ef9-a39b-2866ee22db7c, identifier: 1985166
2026-03-26 18:31:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28397810>
2026-03-26 18:31:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20e21d06-9f06-5084-92de-c7be078c1249/20e21d06-9f06-5084-92de-c7be078c1249_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F118%252Ff3b8e2c049f84b6591b63f39dfa25a0a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/118/f3b8e2c049f84b6591b63f39dfa25a0a/images/large/1.jpg saved to cache
2026-03-26 18:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 20e21d06-9f06-5084-92de-c7be078c1249
2026-03-26 18:31:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 20e21d06-9f06-5084-92de-c7be078c1249, skipping ID generation
2026-03-26 18:31:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20e21d06-9f06-5084-92de-c7be078c1249 with scrape type 1
2026-03-26 18:31:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 20e21d06-9f06-5084-92de-c7be078c1249 sending to next pipeline
2026-03-26 18:31:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 20e21d06-9f06-5084-92de-c7be078c1249, identifier: 1985168
2026-03-26 18:31:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28e6ef50>
2026-03-26 18:31:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebfef7c0-0f3b-5d31-95c7-3f99c2e44e9c/ebfef7c0-0f3b-5d31-95c7-3f99c2e44e9c_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F389%252Fab1290ac746f4f5bb2dc1276237d7d18%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/389/ab1290ac746f4f5bb2dc1276237d7d18/images/large/1.jpg saved to cache
2026-03-26 18:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ebfef7c0-0f3b-5d31-95c7-3f99c2e44e9c
2026-03-26 18:31:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ebfef7c0-0f3b-5d31-95c7-3f99c2e44e9c, skipping ID generation
2026-03-26 18:31:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebfef7c0-0f3b-5d31-95c7-3f99c2e44e9c with scrape type 1
2026-03-26 18:31:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ebfef7c0-0f3b-5d31-95c7-3f99c2e44e9c sending to next pipeline
2026-03-26 18:31:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ebfef7c0-0f3b-5d31-95c7-3f99c2e44e9c, identifier: 1985167
2026-03-26 18:31:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28232dd0>
2026-03-26 18:31:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09d23b40-c4c5-5a39-9c27-0ea2cd6806b2/09d23b40-c4c5-5a39-9c27-0ea2cd6806b2_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F708%252F1995c3f318eb43e1ba17963b048595a3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/708/1995c3f318eb43e1ba17963b048595a3/images/large/1.jpg saved to cache
2026-03-26 18:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 09d23b40-c4c5-5a39-9c27-0ea2cd6806b2
2026-03-26 18:31:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 09d23b40-c4c5-5a39-9c27-0ea2cd6806b2, skipping ID generation
2026-03-26 18:31:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09d23b40-c4c5-5a39-9c27-0ea2cd6806b2 with scrape type 1
2026-03-26 18:31:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 09d23b40-c4c5-5a39-9c27-0ea2cd6806b2 sending to next pipeline
2026-03-26 18:31:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 09d23b40-c4c5-5a39-9c27-0ea2cd6806b2, identifier: 1985169
2026-03-26 18:31:10 [ayvens.es] INFO: Found listing with ID: 1985177
2026-03-26 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985177%27 HTTP/1.1" 200 None
2026-03-26 18:31:10 [ayvens.es] INFO: Scrape type for 1985177: 1
2026-03-26 18:31:10 [ayvens.es] INFO: Extracting data for car ID: 1985177
2026-03-26 18:31:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6843a53-fc8c-5ed2-9f5c-93f1761c5e19 with identifier: 1985177
2026-03-26 18:31:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6843a53-fc8c-5ed2-9f5c-93f1761c5e19 with scrape type 1
2026-03-26 18:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d6843a53-fc8c-5ed2-9f5c-93f1761c5e19
2026-03-26 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F375%252Fccae0dc99a5f4051b4c4a25c231ddcda%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/375/ccae0dc99a5f4051b4c4a25c231ddcda/images/large/1.jpg not downloaded yet
2026-03-26 18:31:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 520129e3-f827-5ef9-a39b-2866ee22db7c with identifier: 1985166
2026-03-26 18:31:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 520129e3-f827-5ef9-a39b-2866ee22db7c with identifier: 1985166
2026-03-26 18:31:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 520129e3-f827-5ef9-a39b-2866ee22db7c with identifier: 1985166 to the API
2026-03-26 18:31:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/958/09cb439f3406426fae72937fd9127e7d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '520129e3-f827-5ef9-a39b-2866ee22db7c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'COROLLA',
 'odometer': 107008,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_520129e3-f827-5ef9-a39b-2866ee22db7c/520129e3-f827-5ef9-a39b-2866ee22db7c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 528593,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/958/09cb439f3406426fae72937fd9127e7d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA COROLLA 1.8 125H BUSINESS PLUS E-CVT',
 'transmission': 'manual',
 'trim': '1.8 125H BUSINESS PLUS E-CVT',
 'vin': None,
 'year': 2021}
2026-03-26 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985166%27 HTTP/1.1" 200 None
2026-03-26 18:31:10 [ayvens.es] INFO: Saving data for 1985166: {'created_time': 1774549870.474945, 'last_price_update_time': 1774549870.474954, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985166') HTTP/1.1" 204 0
2026-03-26 18:31:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 20e21d06-9f06-5084-92de-c7be078c1249 with identifier: 1985168
2026-03-26 18:31:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 20e21d06-9f06-5084-92de-c7be078c1249 with identifier: 1985168
2026-03-26 18:31:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 20e21d06-9f06-5084-92de-c7be078c1249 with identifier: 1985168 to the API
2026-03-26 18:31:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/118/f3b8e2c049f84b6591b63f39dfa25a0a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'electric',
 'id': '20e21d06-9f06-5084-92de-c7be078c1249',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 91465,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20e21d06-9f06-5084-92de-c7be078c1249/20e21d06-9f06-5084-92de-c7be078c1249_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 322381,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/118/f3b8e2c049f84b6591b63f39dfa25a0a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-28',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS Z.E.',
 'transmission': 'manual',
 'trim': 'Z.E.',
 'vin': None,
 'year': 2020}
2026-03-26 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985168%27 HTTP/1.1" 200 None
2026-03-26 18:31:10 [ayvens.es] INFO: Saving data for 1985168: {'created_time': 1774549870.782926, 'last_price_update_time': 1774549870.782937, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985168') HTTP/1.1" 204 0
2026-03-26 18:31:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ebfef7c0-0f3b-5d31-95c7-3f99c2e44e9c with identifier: 1985167
2026-03-26 18:31:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ebfef7c0-0f3b-5d31-95c7-3f99c2e44e9c with identifier: 1985167
2026-03-26 18:31:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ebfef7c0-0f3b-5d31-95c7-3f99c2e44e9c with identifier: 1985167 to the API
2026-03-26 18:31:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/389/ab1290ac746f4f5bb2dc1276237d7d18/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'ebfef7c0-0f3b-5d31-95c7-3f99c2e44e9c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'COROLLA',
 'odometer': 127773,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebfef7c0-0f3b-5d31-95c7-3f99c2e44e9c/ebfef7c0-0f3b-5d31-95c7-3f99c2e44e9c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 560949,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/389/ab1290ac746f4f5bb2dc1276237d7d18/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA COROLLA 1.8 125H STYLE E-CVT TOURING SPORT',
 'transmission': 'manual',
 'trim': '1.8 125H STYLE E-CVT TOURING SPORT',
 'vin': None,
 'year': 2021}
2026-03-26 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985167%27 HTTP/1.1" 200 None
2026-03-26 18:31:11 [ayvens.es] INFO: Saving data for 1985167: {'created_time': 1774549871.060691, 'last_price_update_time': 1774549871.060701, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985167') HTTP/1.1" 204 0
2026-03-26 18:31:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 09d23b40-c4c5-5a39-9c27-0ea2cd6806b2 with identifier: 1985169
2026-03-26 18:31:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 09d23b40-c4c5-5a39-9c27-0ea2cd6806b2 with identifier: 1985169
2026-03-26 18:31:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 09d23b40-c4c5-5a39-9c27-0ea2cd6806b2 with identifier: 1985169 to the API
2026-03-26 18:31:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/708/1995c3f318eb43e1ba17963b048595a3/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '09d23b40-c4c5-5a39-9c27-0ea2cd6806b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'COROLLA',
 'odometer': 131666,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09d23b40-c4c5-5a39-9c27-0ea2cd6806b2/09d23b40-c4c5-5a39-9c27-0ea2cd6806b2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 449131,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/708/1995c3f318eb43e1ba17963b048595a3/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA COROLLA 1.8 125H ACTIVE TECH E-CVT TOU SPORT',
 'transmission': 'manual',
 'trim': '1.8 125H ACTIVE TECH E-CVT TOU SPORT',
 'vin': None,
 'year': 2021}
2026-03-26 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985169%27 HTTP/1.1" 200 None
2026-03-26 18:31:11 [ayvens.es] INFO: Saving data for 1985169: {'created_time': 1774549871.384604, 'last_price_update_time': 1774549871.384618, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985169') HTTP/1.1" 204 0
2026-03-26 18:31:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/521/a079d1afc3424fb5881c1e7a1a395db1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/590/163f6051f2574a958e8e440f5ec21ae1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:11 [ayvens.es] INFO: Found listing with ID: 1985178
2026-03-26 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985178%27 HTTP/1.1" 200 None
2026-03-26 18:31:11 [ayvens.es] INFO: Scrape type for 1985178: 1
2026-03-26 18:31:11 [ayvens.es] INFO: Extracting data for car ID: 1985178
2026-03-26 18:31:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da8b7192-633b-5737-9f1d-32d78cf89f69 with identifier: 1985178
2026-03-26 18:31:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da8b7192-633b-5737-9f1d-32d78cf89f69 with scrape type 1
2026-03-26 18:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item da8b7192-633b-5737-9f1d-32d78cf89f69
2026-03-26 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F355%252F5e9a450c92594c08b60b1338c7c1d720%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/355/5e9a450c92594c08b60b1338c7c1d720/images/large/1.jpg not downloaded yet
2026-03-26 18:31:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28dd0b10>
2026-03-26 18:31:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_381bd381-91a2-58bc-9ea5-66e728730942/381bd381-91a2-58bc-9ea5-66e728730942_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F899%252F303299766d314c60ba7d70844bb49603%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/899/303299766d314c60ba7d70844bb49603/images/large/1.jpg saved to cache
2026-03-26 18:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 381bd381-91a2-58bc-9ea5-66e728730942
2026-03-26 18:31:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 381bd381-91a2-58bc-9ea5-66e728730942, skipping ID generation
2026-03-26 18:31:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 381bd381-91a2-58bc-9ea5-66e728730942 with scrape type 1
2026-03-26 18:31:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 381bd381-91a2-58bc-9ea5-66e728730942 sending to next pipeline
2026-03-26 18:31:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 381bd381-91a2-58bc-9ea5-66e728730942, identifier: 1985170
2026-03-26 18:31:11 [ayvens.es] INFO: Found listing with ID: 1985179
2026-03-26 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985179%27 HTTP/1.1" 200 None
2026-03-26 18:31:11 [ayvens.es] INFO: Scrape type for 1985179: 1
2026-03-26 18:31:11 [ayvens.es] INFO: Extracting data for car ID: 1985179
2026-03-26 18:31:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 343230b8-b1f3-526f-b865-719b1bb40234 with identifier: 1985179
2026-03-26 18:31:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 343230b8-b1f3-526f-b865-719b1bb40234 with scrape type 1
2026-03-26 18:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 343230b8-b1f3-526f-b865-719b1bb40234
2026-03-26 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F543%252F3bd73e02903e4fb18e3d8432ceaea608%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/543/3bd73e02903e4fb18e3d8432ceaea608/images/large/1.jpg not downloaded yet
2026-03-26 18:31:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 381bd381-91a2-58bc-9ea5-66e728730942 with identifier: 1985170
2026-03-26 18:31:11 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:31:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 381bd381-91a2-58bc-9ea5-66e728730942 with identifier: 1985170
2026-03-26 18:31:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 381bd381-91a2-58bc-9ea5-66e728730942 with identifier: 1985170 to the API
2026-03-26 18:31:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/899/303299766d314c60ba7d70844bb49603/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'Negro azabache',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '381bd381-91a2-58bc-9ea5-66e728730942',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'C-HR',
 'odometer': 84014,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_381bd381-91a2-58bc-9ea5-66e728730942/381bd381-91a2-58bc-9ea5-66e728730942_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 365177,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/899/303299766d314c60ba7d70844bb49603/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA C-HR 1.8 125H Advance',
 'transmission': 'manual',
 'trim': '1.8 125H Advance',
 'vin': None,
 'year': 2022}
2026-03-26 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985170%27 HTTP/1.1" 200 None
2026-03-26 18:31:11 [ayvens.es] INFO: Saving data for 1985170: {'created_time': 1774549871.941369, 'last_price_update_time': 1774549871.94138, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985170') HTTP/1.1" 204 0
2026-03-26 18:31:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/938/b318fd50027c43e3af02db01baeeb9c5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/518/899940dc33df46ce8212c967dd595405/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:12 [ayvens.es] INFO: Found listing with ID: 1985180
2026-03-26 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985180%27 HTTP/1.1" 200 None
2026-03-26 18:31:12 [ayvens.es] INFO: Scrape type for 1985180: 1
2026-03-26 18:31:12 [ayvens.es] INFO: Extracting data for car ID: 1985180
2026-03-26 18:31:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f2ad055-ad8f-514b-9d8f-d6f530e5cd16 with identifier: 1985180
2026-03-26 18:31:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f2ad055-ad8f-514b-9d8f-d6f530e5cd16 with scrape type 1
2026-03-26 18:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2f2ad055-ad8f-514b-9d8f-d6f530e5cd16
2026-03-26 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F424%252Fa92c9995b88440c186dd2cfc7cf331be%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/424/a92c9995b88440c186dd2cfc7cf331be/images/large/1.jpg not downloaded yet
2026-03-26 18:31:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a29055750>
2026-03-26 18:31:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59948686-fd9c-56d5-9a63-188a1a464b24/59948686-fd9c-56d5-9a63-188a1a464b24_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F521%252Fa079d1afc3424fb5881c1e7a1a395db1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/521/a079d1afc3424fb5881c1e7a1a395db1/images/large/1.jpg saved to cache
2026-03-26 18:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 59948686-fd9c-56d5-9a63-188a1a464b24
2026-03-26 18:31:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 59948686-fd9c-56d5-9a63-188a1a464b24, skipping ID generation
2026-03-26 18:31:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59948686-fd9c-56d5-9a63-188a1a464b24 with scrape type 1
2026-03-26 18:31:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 59948686-fd9c-56d5-9a63-188a1a464b24 sending to next pipeline
2026-03-26 18:31:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 59948686-fd9c-56d5-9a63-188a1a464b24, identifier: 1985171
2026-03-26 18:31:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c3e950>
2026-03-26 18:31:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b369788-d4eb-5689-8931-75faba6f2673/8b369788-d4eb-5689-8931-75faba6f2673_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F590%252F163f6051f2574a958e8e440f5ec21ae1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/590/163f6051f2574a958e8e440f5ec21ae1/images/large/1.jpg saved to cache
2026-03-26 18:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8b369788-d4eb-5689-8931-75faba6f2673
2026-03-26 18:31:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8b369788-d4eb-5689-8931-75faba6f2673, skipping ID generation
2026-03-26 18:31:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b369788-d4eb-5689-8931-75faba6f2673 with scrape type 1
2026-03-26 18:31:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8b369788-d4eb-5689-8931-75faba6f2673 sending to next pipeline
2026-03-26 18:31:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8b369788-d4eb-5689-8931-75faba6f2673, identifier: 1985172
2026-03-26 18:31:12 [ayvens.es] INFO: Found listing with ID: 1985181
2026-03-26 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985181%27 HTTP/1.1" 200 None
2026-03-26 18:31:12 [ayvens.es] INFO: Scrape type for 1985181: 1
2026-03-26 18:31:12 [ayvens.es] INFO: Extracting data for car ID: 1985181
2026-03-26 18:31:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 077f382c-a74c-5493-803d-bb4a8777f7dd with identifier: 1985181
2026-03-26 18:31:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 077f382c-a74c-5493-803d-bb4a8777f7dd with scrape type 1
2026-03-26 18:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 077f382c-a74c-5493-803d-bb4a8777f7dd
2026-03-26 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F620%252F22e67a1fa0144b358d8a5553ad76a5c4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/620/22e67a1fa0144b358d8a5553ad76a5c4/images/large/1.jpg not downloaded yet
2026-03-26 18:31:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 59948686-fd9c-56d5-9a63-188a1a464b24 with identifier: 1985171
2026-03-26 18:31:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 59948686-fd9c-56d5-9a63-188a1a464b24 with identifier: 1985171
2026-03-26 18:31:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 59948686-fd9c-56d5-9a63-188a1a464b24 with identifier: 1985171 to the API
2026-03-26 18:31:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/521/a079d1afc3424fb5881c1e7a1a395db1/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'color': 'Plata',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '59948686-fd9c-56d5-9a63-188a1a464b24',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'COROLLA',
 'odometer': 134136,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59948686-fd9c-56d5-9a63-188a1a464b24/59948686-fd9c-56d5-9a63-188a1a464b24_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 291198,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/521/a079d1afc3424fb5881c1e7a1a395db1/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA COROLLA 1.8 125H ACTIVE TECH E-CVT',
 'transmission': 'manual',
 'trim': '1.8 125H ACTIVE TECH E-CVT',
 'vin': None,
 'year': 2022}
2026-03-26 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985171%27 HTTP/1.1" 200 None
2026-03-26 18:31:12 [ayvens.es] INFO: Saving data for 1985171: {'created_time': 1774549872.706661, 'last_price_update_time': 1774549872.706672, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985171') HTTP/1.1" 204 0
2026-03-26 18:31:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8b369788-d4eb-5689-8931-75faba6f2673 with identifier: 1985172
2026-03-26 18:31:12 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:31:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8b369788-d4eb-5689-8931-75faba6f2673 with identifier: 1985172
2026-03-26 18:31:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8b369788-d4eb-5689-8931-75faba6f2673 with identifier: 1985172 to the API
2026-03-26 18:31:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/590/163f6051f2574a958e8e440f5ec21ae1/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'electric',
 'id': '8b369788-d4eb-5689-8931-75faba6f2673',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'MODEL S',
 'odometer': 99521,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b369788-d4eb-5689-8931-75faba6f2673/8b369788-d4eb-5689-8931-75faba6f2673_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 314148,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/590/163f6051f2574a958e8e440f5ec21ae1/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA MODEL S Gran Autonomia 4WD',
 'transmission': 'manual',
 'trim': 'Gran Autonomia 4WD',
 'vin': None,
 'year': 2019}
2026-03-26 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985172%27 HTTP/1.1" 200 None
2026-03-26 18:31:13 [ayvens.es] INFO: Saving data for 1985172: {'created_time': 1774549873.025384, 'last_price_update_time': 1774549873.025395, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985172') HTTP/1.1" 204 0
2026-03-26 18:31:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/877/2c5321b028e34981aec9ab4c47c85487/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:13 [ayvens.es] INFO: Found listing with ID: 1985182
2026-03-26 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985182%27 HTTP/1.1" 200 None
2026-03-26 18:31:13 [ayvens.es] INFO: Scrape type for 1985182: 1
2026-03-26 18:31:13 [ayvens.es] INFO: Extracting data for car ID: 1985182
2026-03-26 18:31:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6df8880f-0f10-5b18-b796-34f72ce901b3 with identifier: 1985182
2026-03-26 18:31:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6df8880f-0f10-5b18-b796-34f72ce901b3 with scrape type 1
2026-03-26 18:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6df8880f-0f10-5b18-b796-34f72ce901b3
2026-03-26 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F946%252Fb3d1335007d04f339f9f75deb4fe2930%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/946/b3d1335007d04f339f9f75deb4fe2930/images/large/1.jpg not downloaded yet
2026-03-26 18:31:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a29081950>
2026-03-26 18:31:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac7fe4d8-befd-554d-81a1-577326e0e094/ac7fe4d8-befd-554d-81a1-577326e0e094_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F938%252Fb318fd50027c43e3af02db01baeeb9c5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/938/b318fd50027c43e3af02db01baeeb9c5/images/large/1.jpg saved to cache
2026-03-26 18:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ac7fe4d8-befd-554d-81a1-577326e0e094
2026-03-26 18:31:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ac7fe4d8-befd-554d-81a1-577326e0e094, skipping ID generation
2026-03-26 18:31:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac7fe4d8-befd-554d-81a1-577326e0e094 with scrape type 1
2026-03-26 18:31:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ac7fe4d8-befd-554d-81a1-577326e0e094 sending to next pipeline
2026-03-26 18:31:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ac7fe4d8-befd-554d-81a1-577326e0e094, identifier: 1985173
2026-03-26 18:31:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28372290>
2026-03-26 18:31:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_227bb277-b18c-5a03-a08d-0880486ae492/227bb277-b18c-5a03-a08d-0880486ae492_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F518%252F899940dc33df46ce8212c967dd595405%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/518/899940dc33df46ce8212c967dd595405/images/large/1.jpg saved to cache
2026-03-26 18:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 227bb277-b18c-5a03-a08d-0880486ae492
2026-03-26 18:31:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 227bb277-b18c-5a03-a08d-0880486ae492, skipping ID generation
2026-03-26 18:31:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 227bb277-b18c-5a03-a08d-0880486ae492 with scrape type 1
2026-03-26 18:31:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 227bb277-b18c-5a03-a08d-0880486ae492 sending to next pipeline
2026-03-26 18:31:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 227bb277-b18c-5a03-a08d-0880486ae492, identifier: 1985174
2026-03-26 18:31:13 [ayvens.es] INFO: Found listing with ID: 1985183
2026-03-26 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985183%27 HTTP/1.1" 200 None
2026-03-26 18:31:13 [ayvens.es] INFO: Scrape type for 1985183: 1
2026-03-26 18:31:13 [ayvens.es] INFO: Extracting data for car ID: 1985183
2026-03-26 18:31:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 050145ec-56ee-59c6-8580-962278c39351 with identifier: 1985183
2026-03-26 18:31:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 050145ec-56ee-59c6-8580-962278c39351 with scrape type 1
2026-03-26 18:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 050145ec-56ee-59c6-8580-962278c39351
2026-03-26 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F073%252Fc4c562187b8b494fb3e4b648ac414de6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/073/c4c562187b8b494fb3e4b648ac414de6/images/large/1.jpg not downloaded yet
2026-03-26 18:31:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ac7fe4d8-befd-554d-81a1-577326e0e094 with identifier: 1985173
2026-03-26 18:31:13 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:31:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ac7fe4d8-befd-554d-81a1-577326e0e094 with identifier: 1985173
2026-03-26 18:31:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ac7fe4d8-befd-554d-81a1-577326e0e094 with identifier: 1985173 to the API
2026-03-26 18:31:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/938/b318fd50027c43e3af02db01baeeb9c5/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 44,
 'color': 'Sophistograu',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'ac7fe4d8-befd-554d-81a1-577326e0e094',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X3',
 'odometer': 73106,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac7fe4d8-befd-554d-81a1-577326e0e094/ac7fe4d8-befd-554d-81a1-577326e0e094_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 375598,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/938/b318fd50027c43e3af02db01baeeb9c5/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 xDrive30e',
 'transmission': 'manual',
 'trim': 'xDrive30e',
 'vin': None,
 'year': 2021}
2026-03-26 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985173%27 HTTP/1.1" 200 None
2026-03-26 18:31:13 [ayvens.es] INFO: Saving data for 1985173: {'created_time': 1774549873.713108, 'last_price_update_time': 1774549873.713118, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985173') HTTP/1.1" 204 0
2026-03-26 18:31:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 227bb277-b18c-5a03-a08d-0880486ae492 with identifier: 1985174
2026-03-26 18:31:13 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:31:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 227bb277-b18c-5a03-a08d-0880486ae492 with identifier: 1985174
2026-03-26 18:31:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 227bb277-b18c-5a03-a08d-0880486ae492 with identifier: 1985174 to the API
2026-03-26 18:31:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/518/899940dc33df46ce8212c967dd595405/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 45,
 'color': 'Gris grafito metaliz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '227bb277-b18c-5a03-a08d-0880486ae492',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLC-CLASS',
 'odometer': 60551,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_227bb277-b18c-5a03-a08d-0880486ae492/227bb277-b18c-5a03-a08d-0880486ae492_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 369263,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/518/899940dc33df46ce8212c967dd595405/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLC-CLASS GLC 300 e 4MATIC',
 'transmission': 'manual',
 'trim': 'GLC 300 e 4MATIC',
 'vin': None,
 'year': 2022}
2026-03-26 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985174%27 HTTP/1.1" 200 None
2026-03-26 18:31:14 [ayvens.es] INFO: Saving data for 1985174: {'created_time': 1774549874.025419, 'last_price_update_time': 1774549874.025429, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985174') HTTP/1.1" 204 0
2026-03-26 18:31:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/700/1431cb0ab0694669b5f8014d528d20f9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/355/5e9a450c92594c08b60b1338c7c1d720/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/375/ccae0dc99a5f4051b4c4a25c231ddcda/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:14 [ayvens.es] INFO: Found listing with ID: 1985184
2026-03-26 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985184%27 HTTP/1.1" 200 None
2026-03-26 18:31:14 [ayvens.es] INFO: Scrape type for 1985184: 1
2026-03-26 18:31:14 [ayvens.es] INFO: Extracting data for car ID: 1985184
2026-03-26 18:31:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 848c515c-7ae5-5481-900e-d71371c5a7f5 with identifier: 1985184
2026-03-26 18:31:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 848c515c-7ae5-5481-900e-d71371c5a7f5 with scrape type 1
2026-03-26 18:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 848c515c-7ae5-5481-900e-d71371c5a7f5
2026-03-26 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F335%252F3016b92ac2024ac999eda4441e01f3c8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/335/3016b92ac2024ac999eda4441e01f3c8/images/large/1.jpg not downloaded yet
2026-03-26 18:31:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a2833c8d0>
2026-03-26 18:31:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37a52069-4079-583e-b718-22811d018521/37a52069-4079-583e-b718-22811d018521_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F877%252F2c5321b028e34981aec9ab4c47c85487%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/877/2c5321b028e34981aec9ab4c47c85487/images/large/1.jpg saved to cache
2026-03-26 18:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 37a52069-4079-583e-b718-22811d018521
2026-03-26 18:31:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 37a52069-4079-583e-b718-22811d018521, skipping ID generation
2026-03-26 18:31:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37a52069-4079-583e-b718-22811d018521 with scrape type 1
2026-03-26 18:31:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 37a52069-4079-583e-b718-22811d018521 sending to next pipeline
2026-03-26 18:31:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 37a52069-4079-583e-b718-22811d018521, identifier: 1985176
2026-03-26 18:31:14 [ayvens.es] INFO: Found listing with ID: 1985185
2026-03-26 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985185%27 HTTP/1.1" 200 None
2026-03-26 18:31:14 [ayvens.es] INFO: Scrape type for 1985185: 1
2026-03-26 18:31:14 [ayvens.es] INFO: Extracting data for car ID: 1985185
2026-03-26 18:31:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 968eeb0f-81e1-5fe3-a609-166c9c952ed6 with identifier: 1985185
2026-03-26 18:31:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 968eeb0f-81e1-5fe3-a609-166c9c952ed6 with scrape type 1
2026-03-26 18:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 968eeb0f-81e1-5fe3-a609-166c9c952ed6
2026-03-26 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F274%252F0da207775cc94269b37551b5269d8ccc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/274/0da207775cc94269b37551b5269d8ccc/images/large/1.jpg not downloaded yet
2026-03-26 18:31:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 37a52069-4079-583e-b718-22811d018521 with identifier: 1985176
2026-03-26 18:31:14 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:31:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 37a52069-4079-583e-b718-22811d018521 with identifier: 1985176
2026-03-26 18:31:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 37a52069-4079-583e-b718-22811d018521 with identifier: 1985176 to the API
2026-03-26 18:31:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/877/2c5321b028e34981aec9ab4c47c85487/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 48,
 'color': 'Onix black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '37a52069-4079-583e-b718-22811d018521',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 41389,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37a52069-4079-583e-b718-22811d018521/37a52069-4079-583e-b718-22811d018521_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 349203,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/877/2c5321b028e34981aec9ab4c47c85487/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T4 Twin Recharge Plus Bright Auto',
 'transmission': 'manual',
 'trim': '1.5 T4 Twin Recharge Plus Bright Auto',
 'vin': None,
 'year': 2023}
2026-03-26 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985176%27 HTTP/1.1" 200 None
2026-03-26 18:31:14 [ayvens.es] INFO: Saving data for 1985176: {'created_time': 1774549874.603712, 'last_price_update_time': 1774549874.603723, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985176') HTTP/1.1" 204 0
2026-03-26 18:31:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/424/a92c9995b88440c186dd2cfc7cf331be/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:14 [ayvens.es] INFO: Found listing with ID: 1985186
2026-03-26 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985186%27 HTTP/1.1" 200 None
2026-03-26 18:31:14 [ayvens.es] INFO: Scrape type for 1985186: 1
2026-03-26 18:31:14 [ayvens.es] INFO: Extracting data for car ID: 1985186
2026-03-26 18:31:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d70a6e8-83e6-59f6-807c-96463a772a2b with identifier: 1985186
2026-03-26 18:31:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d70a6e8-83e6-59f6-807c-96463a772a2b with scrape type 1
2026-03-26 18:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7d70a6e8-83e6-59f6-807c-96463a772a2b
2026-03-26 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F092%252Fb3e7b2c739944ce497ce55c3c2371eff%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/092/b3e7b2c739944ce497ce55c3c2371eff/images/large/1.jpg not downloaded yet
2026-03-26 18:31:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c37790>
2026-03-26 18:31:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6d0149f-8373-5127-8932-bf09ca1e11df/e6d0149f-8373-5127-8932-bf09ca1e11df_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F700%252F1431cb0ab0694669b5f8014d528d20f9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/700/1431cb0ab0694669b5f8014d528d20f9/images/large/1.jpg saved to cache
2026-03-26 18:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e6d0149f-8373-5127-8932-bf09ca1e11df
2026-03-26 18:31:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e6d0149f-8373-5127-8932-bf09ca1e11df, skipping ID generation
2026-03-26 18:31:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6d0149f-8373-5127-8932-bf09ca1e11df with scrape type 1
2026-03-26 18:31:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e6d0149f-8373-5127-8932-bf09ca1e11df sending to next pipeline
2026-03-26 18:31:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e6d0149f-8373-5127-8932-bf09ca1e11df, identifier: 1985175
2026-03-26 18:31:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a29061390>
2026-03-26 18:31:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da8b7192-633b-5737-9f1d-32d78cf89f69/da8b7192-633b-5737-9f1d-32d78cf89f69_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F355%252F5e9a450c92594c08b60b1338c7c1d720%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/355/5e9a450c92594c08b60b1338c7c1d720/images/large/1.jpg saved to cache
2026-03-26 18:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item da8b7192-633b-5737-9f1d-32d78cf89f69
2026-03-26 18:31:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: da8b7192-633b-5737-9f1d-32d78cf89f69, skipping ID generation
2026-03-26 18:31:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da8b7192-633b-5737-9f1d-32d78cf89f69 with scrape type 1
2026-03-26 18:31:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item da8b7192-633b-5737-9f1d-32d78cf89f69 sending to next pipeline
2026-03-26 18:31:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: da8b7192-633b-5737-9f1d-32d78cf89f69, identifier: 1985178
2026-03-26 18:31:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a2833ee50>
2026-03-26 18:31:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6843a53-fc8c-5ed2-9f5c-93f1761c5e19/d6843a53-fc8c-5ed2-9f5c-93f1761c5e19_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F375%252Fccae0dc99a5f4051b4c4a25c231ddcda%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/375/ccae0dc99a5f4051b4c4a25c231ddcda/images/large/1.jpg saved to cache
2026-03-26 18:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d6843a53-fc8c-5ed2-9f5c-93f1761c5e19
2026-03-26 18:31:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d6843a53-fc8c-5ed2-9f5c-93f1761c5e19, skipping ID generation
2026-03-26 18:31:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6843a53-fc8c-5ed2-9f5c-93f1761c5e19 with scrape type 1
2026-03-26 18:31:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d6843a53-fc8c-5ed2-9f5c-93f1761c5e19 sending to next pipeline
2026-03-26 18:31:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d6843a53-fc8c-5ed2-9f5c-93f1761c5e19, identifier: 1985177
2026-03-26 18:31:15 [ayvens.es] INFO: Found listing with ID: 1985187
2026-03-26 18:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985187%27 HTTP/1.1" 200 None
2026-03-26 18:31:15 [ayvens.es] INFO: Scrape type for 1985187: 1
2026-03-26 18:31:15 [ayvens.es] INFO: Extracting data for car ID: 1985187
2026-03-26 18:31:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88d79502-982a-592c-885e-cbc6dccb22f6 with identifier: 1985187
2026-03-26 18:31:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88d79502-982a-592c-885e-cbc6dccb22f6 with scrape type 1
2026-03-26 18:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 88d79502-982a-592c-885e-cbc6dccb22f6
2026-03-26 18:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F977%252F08eb3c260e074af9897792d56d23bc3d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/977/08eb3c260e074af9897792d56d23bc3d/images/large/1.jpg not downloaded yet
2026-03-26 18:31:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e6d0149f-8373-5127-8932-bf09ca1e11df with identifier: 1985175
2026-03-26 18:31:15 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:31:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e6d0149f-8373-5127-8932-bf09ca1e11df with identifier: 1985175
2026-03-26 18:31:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e6d0149f-8373-5127-8932-bf09ca1e11df with identifier: 1985175 to the API
2026-03-26 18:31:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/700/1431cb0ab0694669b5f8014d528d20f9/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 21,
 'color': 'Gris monta',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.3L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'e6d0149f-8373-5127-8932-bf09ca1e11df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS',
 'odometer': 47400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6d0149f-8373-5127-8932-bf09ca1e11df/e6d0149f-8373-5127-8932-bf09ca1e11df_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 527423,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/700/1431cb0ab0694669b5f8014d528d20f9/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS Sedan A 250 e',
 'transmission': 'manual',
 'trim': 'Sedan A 250 e',
 'vin': None,
 'year': 2021}
2026-03-26 18:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985175%27 HTTP/1.1" 200 None
2026-03-26 18:31:16 [ayvens.es] INFO: Saving data for 1985175: {'created_time': 1774549876.341933, 'last_price_update_time': 1774549876.341944, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985175') HTTP/1.1" 204 0
2026-03-26 18:31:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: da8b7192-633b-5737-9f1d-32d78cf89f69 with identifier: 1985178
2026-03-26 18:31:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:31:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: da8b7192-633b-5737-9f1d-32d78cf89f69 with identifier: 1985178
2026-03-26 18:31:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: da8b7192-633b-5737-9f1d-32d78cf89f69 with identifier: 1985178 to the API
2026-03-26 18:31:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/355/5e9a450c92594c08b60b1338c7c1d720/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 63,
 'color': 'Denim blue metalizad',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'da8b7192-633b-5737-9f1d-32d78cf89f69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC90',
 'odometer': 162304,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da8b7192-633b-5737-9f1d-32d78cf89f69/da8b7192-633b-5737-9f1d-32d78cf89f69_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 360249,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/355/5e9a450c92594c08b60b1338c7c1d720/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-03',
 'seats_number': 7,
 'seller_name': None,
 'title': 'VOLVO XC90 2.0 T8 AWD Recharge R-Design Auto+++Revisar '
          'peritacion+++',
 'transmission': 'manual',
 'trim': '2.0 T8 AWD Recharge R-Design Auto+++Revisar peritacion+++',
 'vin': None,
 'year': 2022}
2026-03-26 18:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985178%27 HTTP/1.1" 200 None
2026-03-26 18:31:16 [ayvens.es] INFO: Saving data for 1985178: {'created_time': 1774549876.652093, 'last_price_update_time': 1774549876.652104, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985178') HTTP/1.1" 204 0
2026-03-26 18:31:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d6843a53-fc8c-5ed2-9f5c-93f1761c5e19 with identifier: 1985177
2026-03-26 18:31:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d6843a53-fc8c-5ed2-9f5c-93f1761c5e19 with identifier: 1985177
2026-03-26 18:31:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d6843a53-fc8c-5ed2-9f5c-93f1761c5e19 with identifier: 1985177 to the API
2026-03-26 18:31:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/375/ccae0dc99a5f4051b4c4a25c231ddcda/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'Blanco perlado icebe',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'd6843a53-fc8c-5ed2-9f5c-93f1761c5e19',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'C-HR',
 'odometer': 58798,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6843a53-fc8c-5ed2-9f5c-93f1761c5e19/d6843a53-fc8c-5ed2-9f5c-93f1761c5e19_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 331924,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/375/ccae0dc99a5f4051b4c4a25c231ddcda/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA C-HR 1.8 125H Advance',
 'transmission': 'manual',
 'trim': '1.8 125H Advance',
 'vin': None,
 'year': 2022}
2026-03-26 18:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985177%27 HTTP/1.1" 200 None
2026-03-26 18:31:17 [ayvens.es] INFO: Saving data for 1985177: {'created_time': 1774549877.065202, 'last_price_update_time': 1774549877.065214, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985177') HTTP/1.1" 204 0
2026-03-26 18:31:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/543/3bd73e02903e4fb18e3d8432ceaea608/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/620/22e67a1fa0144b358d8a5553ad76a5c4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/946/b3d1335007d04f339f9f75deb4fe2930/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:17 [ayvens.es] INFO: Found listing with ID: 1985188
2026-03-26 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985188%27 HTTP/1.1" 200 None
2026-03-26 18:31:17 [ayvens.es] INFO: Scrape type for 1985188: 1
2026-03-26 18:31:17 [ayvens.es] INFO: Extracting data for car ID: 1985188
2026-03-26 18:31:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e813ad4-9424-598a-bae1-dc651d76c157 with identifier: 1985188
2026-03-26 18:31:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e813ad4-9424-598a-bae1-dc651d76c157 with scrape type 1
2026-03-26 18:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5e813ad4-9424-598a-bae1-dc651d76c157
2026-03-26 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F418%252F98b9b9e90ea6473db27c4c6e780c4784%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/418/98b9b9e90ea6473db27c4c6e780c4784/images/large/1.jpg not downloaded yet
2026-03-26 18:31:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c3f710>
2026-03-26 18:31:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f2ad055-ad8f-514b-9d8f-d6f530e5cd16/2f2ad055-ad8f-514b-9d8f-d6f530e5cd16_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F424%252Fa92c9995b88440c186dd2cfc7cf331be%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/424/a92c9995b88440c186dd2cfc7cf331be/images/large/1.jpg saved to cache
2026-03-26 18:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2f2ad055-ad8f-514b-9d8f-d6f530e5cd16
2026-03-26 18:31:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2f2ad055-ad8f-514b-9d8f-d6f530e5cd16, skipping ID generation
2026-03-26 18:31:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f2ad055-ad8f-514b-9d8f-d6f530e5cd16 with scrape type 1
2026-03-26 18:31:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2f2ad055-ad8f-514b-9d8f-d6f530e5cd16 sending to next pipeline
2026-03-26 18:31:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2f2ad055-ad8f-514b-9d8f-d6f530e5cd16, identifier: 1985180
2026-03-26 18:31:17 [ayvens.es] INFO: Found listing with ID: 1985189
2026-03-26 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985189%27 HTTP/1.1" 200 None
2026-03-26 18:31:17 [ayvens.es] INFO: Scrape type for 1985189: 1
2026-03-26 18:31:17 [ayvens.es] INFO: Extracting data for car ID: 1985189
2026-03-26 18:31:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07b80158-4406-5ce0-9e54-dbba613e3566 with identifier: 1985189
2026-03-26 18:31:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07b80158-4406-5ce0-9e54-dbba613e3566 with scrape type 1
2026-03-26 18:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 07b80158-4406-5ce0-9e54-dbba613e3566
2026-03-26 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F211%252F1c1a3f04d9214962a63164cca828b525%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/211/1c1a3f04d9214962a63164cca828b525/images/large/1.jpg not downloaded yet
2026-03-26 18:31:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2f2ad055-ad8f-514b-9d8f-d6f530e5cd16 with identifier: 1985180
2026-03-26 18:31:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:31:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2f2ad055-ad8f-514b-9d8f-d6f530e5cd16 with identifier: 1985180
2026-03-26 18:31:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 2f2ad055-ad8f-514b-9d8f-d6f530e5cd16 with identifier: 1985180 to the API
2026-03-26 18:31:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/424/a92c9995b88440c186dd2cfc7cf331be/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'Blanco perlado',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '2f2ad055-ad8f-514b-9d8f-d6f530e5cd16',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'C-HR',
 'odometer': 126431,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f2ad055-ad8f-514b-9d8f-d6f530e5cd16/2f2ad055-ad8f-514b-9d8f-d6f530e5cd16_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 317549,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/424/a92c9995b88440c186dd2cfc7cf331be/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA C-HR 1.8 125H Advance',
 'transmission': 'manual',
 'trim': '1.8 125H Advance',
 'vin': None,
 'year': 2021}
2026-03-26 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985180%27 HTTP/1.1" 200 None
2026-03-26 18:31:17 [ayvens.es] INFO: Saving data for 1985180: {'created_time': 1774549877.654439, 'last_price_update_time': 1774549877.65445, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985180') HTTP/1.1" 204 0
2026-03-26 18:31:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/335/3016b92ac2024ac999eda4441e01f3c8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/073/c4c562187b8b494fb3e4b648ac414de6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:17 [ayvens.es] INFO: Found listing with ID: 1985190
2026-03-26 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985190%27 HTTP/1.1" 200 None
2026-03-26 18:31:17 [ayvens.es] INFO: Scrape type for 1985190: 1
2026-03-26 18:31:17 [ayvens.es] INFO: Extracting data for car ID: 1985190
2026-03-26 18:31:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43a9c81a-156c-52eb-804e-f4b00af0064b with identifier: 1985190
2026-03-26 18:31:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43a9c81a-156c-52eb-804e-f4b00af0064b with scrape type 1
2026-03-26 18:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 43a9c81a-156c-52eb-804e-f4b00af0064b
2026-03-26 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F479%252Fa8e0fbd957644941a87d179dc945624d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/479/a8e0fbd957644941a87d179dc945624d/images/large/1.jpg not downloaded yet
2026-03-26 18:31:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c39590>
2026-03-26 18:31:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_343230b8-b1f3-526f-b865-719b1bb40234/343230b8-b1f3-526f-b865-719b1bb40234_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F543%252F3bd73e02903e4fb18e3d8432ceaea608%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/543/3bd73e02903e4fb18e3d8432ceaea608/images/large/1.jpg saved to cache
2026-03-26 18:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 343230b8-b1f3-526f-b865-719b1bb40234
2026-03-26 18:31:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 343230b8-b1f3-526f-b865-719b1bb40234, skipping ID generation
2026-03-26 18:31:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 343230b8-b1f3-526f-b865-719b1bb40234 with scrape type 1
2026-03-26 18:31:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 343230b8-b1f3-526f-b865-719b1bb40234 sending to next pipeline
2026-03-26 18:31:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 343230b8-b1f3-526f-b865-719b1bb40234, identifier: 1985179
2026-03-26 18:31:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c29f90>
2026-03-26 18:31:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_077f382c-a74c-5493-803d-bb4a8777f7dd/077f382c-a74c-5493-803d-bb4a8777f7dd_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F620%252F22e67a1fa0144b358d8a5553ad76a5c4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/620/22e67a1fa0144b358d8a5553ad76a5c4/images/large/1.jpg saved to cache
2026-03-26 18:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 077f382c-a74c-5493-803d-bb4a8777f7dd
2026-03-26 18:31:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 077f382c-a74c-5493-803d-bb4a8777f7dd, skipping ID generation
2026-03-26 18:31:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 077f382c-a74c-5493-803d-bb4a8777f7dd with scrape type 1
2026-03-26 18:31:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 077f382c-a74c-5493-803d-bb4a8777f7dd sending to next pipeline
2026-03-26 18:31:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 077f382c-a74c-5493-803d-bb4a8777f7dd, identifier: 1985181
2026-03-26 18:31:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28e5de50>
2026-03-26 18:31:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6df8880f-0f10-5b18-b796-34f72ce901b3/6df8880f-0f10-5b18-b796-34f72ce901b3_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F946%252Fb3d1335007d04f339f9f75deb4fe2930%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/946/b3d1335007d04f339f9f75deb4fe2930/images/large/1.jpg saved to cache
2026-03-26 18:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6df8880f-0f10-5b18-b796-34f72ce901b3
2026-03-26 18:31:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6df8880f-0f10-5b18-b796-34f72ce901b3, skipping ID generation
2026-03-26 18:31:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6df8880f-0f10-5b18-b796-34f72ce901b3 with scrape type 1
2026-03-26 18:31:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6df8880f-0f10-5b18-b796-34f72ce901b3 sending to next pipeline
2026-03-26 18:31:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6df8880f-0f10-5b18-b796-34f72ce901b3, identifier: 1985182
2026-03-26 18:31:18 [ayvens.es] INFO: Found listing with ID: 1985191
2026-03-26 18:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985191%27 HTTP/1.1" 200 None
2026-03-26 18:31:18 [ayvens.es] INFO: Scrape type for 1985191: 1
2026-03-26 18:31:18 [ayvens.es] INFO: Extracting data for car ID: 1985191
2026-03-26 18:31:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e26db3d9-763b-5436-9d5d-71e3434cebcf with identifier: 1985191
2026-03-26 18:31:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e26db3d9-763b-5436-9d5d-71e3434cebcf with scrape type 1
2026-03-26 18:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e26db3d9-763b-5436-9d5d-71e3434cebcf
2026-03-26 18:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F698%252F14494c9dd7ee4d94a61f94bc00eac399%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/698/14494c9dd7ee4d94a61f94bc00eac399/images/large/1.jpg not downloaded yet
2026-03-26 18:31:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 343230b8-b1f3-526f-b865-719b1bb40234 with identifier: 1985179
2026-03-26 18:31:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:31:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 343230b8-b1f3-526f-b865-719b1bb40234 with identifier: 1985179
2026-03-26 18:31:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 343230b8-b1f3-526f-b865-719b1bb40234 with identifier: 1985179 to the API
2026-03-26 18:31:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/543/3bd73e02903e4fb18e3d8432ceaea608/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 42,
 'color': 'Gris osmium metaliza',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '343230b8-b1f3-526f-b865-719b1bb40234',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC60',
 'odometer': 104049,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343230b8-b1f3-526f-b865-719b1bb40234/343230b8-b1f3-526f-b865-719b1bb40234_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 536908,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/543/3bd73e02903e4fb18e3d8432ceaea608/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC60 (O) 2.0 T8 AWD Business Plus Auto',
 'transmission': 'manual',
 'trim': '(O) 2.0 T8 AWD Business Plus Auto',
 'vin': None,
 'year': 2020}
2026-03-26 18:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985179%27 HTTP/1.1" 200 None
2026-03-26 18:31:18 [ayvens.es] INFO: Saving data for 1985179: {'created_time': 1774549878.504962, 'last_price_update_time': 1774549878.504973, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985179') HTTP/1.1" 204 0
2026-03-26 18:31:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 077f382c-a74c-5493-803d-bb4a8777f7dd with identifier: 1985181
2026-03-26 18:31:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:31:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 077f382c-a74c-5493-803d-bb4a8777f7dd with identifier: 1985181
2026-03-26 18:31:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 077f382c-a74c-5493-803d-bb4a8777f7dd with identifier: 1985181 to the API
2026-03-26 18:31:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/620/22e67a1fa0144b358d8a5553ad76a5c4/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 48,
 'color': 'Silver dawn metaliza',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '077f382c-a74c-5493-803d-bb4a8777f7dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 184675,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_077f382c-a74c-5493-803d-bb4a8777f7dd/077f382c-a74c-5493-803d-bb4a8777f7dd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 361146,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/620/22e67a1fa0144b358d8a5553ad76a5c4/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T5 Recharge PHEV Plus Dark Auto',
 'transmission': 'manual',
 'trim': '1.5 T5 Recharge PHEV Plus Dark Auto',
 'vin': None,
 'year': 2023}
2026-03-26 18:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985181%27 HTTP/1.1" 200 None
2026-03-26 18:31:18 [ayvens.es] INFO: Saving data for 1985181: {'created_time': 1774549878.869305, 'last_price_update_time': 1774549878.869315, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985181') HTTP/1.1" 204 0
2026-03-26 18:31:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6df8880f-0f10-5b18-b796-34f72ce901b3 with identifier: 1985182
2026-03-26 18:31:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6df8880f-0f10-5b18-b796-34f72ce901b3 with identifier: 1985182
2026-03-26 18:31:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 6df8880f-0f10-5b18-b796-34f72ce901b3 with identifier: 1985182 to the API
2026-03-26 18:31:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/946/b3d1335007d04f339f9f75deb4fe2930/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Blanco perlado icebe',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '6df8880f-0f10-5b18-b796-34f72ce901b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'C-HR',
 'odometer': 150486,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6df8880f-0f10-5b18-b796-34f72ce901b3/6df8880f-0f10-5b18-b796-34f72ce901b3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 350110,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/946/b3d1335007d04f339f9f75deb4fe2930/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA C-HR 2.0 180H Advance',
 'transmission': 'manual',
 'trim': '2.0 180H Advance',
 'vin': None,
 'year': 2022}
2026-03-26 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985182%27 HTTP/1.1" 200 None
2026-03-26 18:31:19 [ayvens.es] INFO: Saving data for 1985182: {'created_time': 1774549879.255225, 'last_price_update_time': 1774549879.255235, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985182') HTTP/1.1" 204 0
2026-03-26 18:31:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/092/b3e7b2c739944ce497ce55c3c2371eff/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:19 [ayvens.es] INFO: Found listing with ID: 1985192
2026-03-26 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985192%27 HTTP/1.1" 200 None
2026-03-26 18:31:19 [ayvens.es] INFO: Scrape type for 1985192: 1
2026-03-26 18:31:19 [ayvens.es] INFO: Extracting data for car ID: 1985192
2026-03-26 18:31:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa3977e5-97e8-53ea-880a-3fa9eda9340c with identifier: 1985192
2026-03-26 18:31:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa3977e5-97e8-53ea-880a-3fa9eda9340c with scrape type 1
2026-03-26 18:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item aa3977e5-97e8-53ea-880a-3fa9eda9340c
2026-03-26 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F781%252F872e8d8610c24165b43932bc43000b81%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/781/872e8d8610c24165b43932bc43000b81/images/large/1.jpg not downloaded yet
2026-03-26 18:31:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a2a820590>
2026-03-26 18:31:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_848c515c-7ae5-5481-900e-d71371c5a7f5/848c515c-7ae5-5481-900e-d71371c5a7f5_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F335%252F3016b92ac2024ac999eda4441e01f3c8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/335/3016b92ac2024ac999eda4441e01f3c8/images/large/1.jpg saved to cache
2026-03-26 18:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 848c515c-7ae5-5481-900e-d71371c5a7f5
2026-03-26 18:31:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 848c515c-7ae5-5481-900e-d71371c5a7f5, skipping ID generation
2026-03-26 18:31:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 848c515c-7ae5-5481-900e-d71371c5a7f5 with scrape type 1
2026-03-26 18:31:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 848c515c-7ae5-5481-900e-d71371c5a7f5 sending to next pipeline
2026-03-26 18:31:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 848c515c-7ae5-5481-900e-d71371c5a7f5, identifier: 1985184
2026-03-26 18:31:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28317a50>
2026-03-26 18:31:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_050145ec-56ee-59c6-8580-962278c39351/050145ec-56ee-59c6-8580-962278c39351_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F073%252Fc4c562187b8b494fb3e4b648ac414de6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/073/c4c562187b8b494fb3e4b648ac414de6/images/large/1.jpg saved to cache
2026-03-26 18:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 050145ec-56ee-59c6-8580-962278c39351
2026-03-26 18:31:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 050145ec-56ee-59c6-8580-962278c39351, skipping ID generation
2026-03-26 18:31:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 050145ec-56ee-59c6-8580-962278c39351 with scrape type 1
2026-03-26 18:31:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 050145ec-56ee-59c6-8580-962278c39351 sending to next pipeline
2026-03-26 18:31:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 050145ec-56ee-59c6-8580-962278c39351, identifier: 1985183
2026-03-26 18:31:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/274/0da207775cc94269b37551b5269d8ccc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:20 [ayvens.es] INFO: Found listing with ID: 1985193
2026-03-26 18:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985193%27 HTTP/1.1" 200 None
2026-03-26 18:31:20 [ayvens.es] INFO: Scrape type for 1985193: 1
2026-03-26 18:31:20 [ayvens.es] INFO: Extracting data for car ID: 1985193
2026-03-26 18:31:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 599a5f8c-c03a-55cb-b915-546930e44681 with identifier: 1985193
2026-03-26 18:31:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 599a5f8c-c03a-55cb-b915-546930e44681 with scrape type 1
2026-03-26 18:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 599a5f8c-c03a-55cb-b915-546930e44681
2026-03-26 18:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F327%252F8cc4002b0c324ed5a14628c3805f3a0a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/327/8cc4002b0c324ed5a14628c3805f3a0a/images/large/1.jpg not downloaded yet
2026-03-26 18:31:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 848c515c-7ae5-5481-900e-d71371c5a7f5 with identifier: 1985184
2026-03-26 18:31:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:31:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 848c515c-7ae5-5481-900e-d71371c5a7f5 with identifier: 1985184
2026-03-26 18:31:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 848c515c-7ae5-5481-900e-d71371c5a7f5 with identifier: 1985184 to the API
2026-03-26 18:31:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/335/3016b92ac2024ac999eda4441e01f3c8/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 30,
 'color': 'Gris monta',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '848c515c-7ae5-5481-900e-d71371c5a7f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLA',
 'odometer': 176778,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_848c515c-7ae5-5481-900e-d71371c5a7f5/848c515c-7ae5-5481-900e-d71371c5a7f5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 374741,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/335/3016b92ac2024ac999eda4441e01f3c8/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLA GLA 250 e',
 'transmission': 'manual',
 'trim': 'GLA 250 e',
 'vin': None,
 'year': 2022}
2026-03-26 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985184%27 HTTP/1.1" 200 None
2026-03-26 18:31:21 [ayvens.es] INFO: Saving data for 1985184: {'created_time': 1774549881.333947, 'last_price_update_time': 1774549881.333957, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985184') HTTP/1.1" 204 0
2026-03-26 18:31:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 050145ec-56ee-59c6-8580-962278c39351 with identifier: 1985183
2026-03-26 18:31:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 050145ec-56ee-59c6-8580-962278c39351 with identifier: 1985183
2026-03-26 18:31:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 050145ec-56ee-59c6-8580-962278c39351 with identifier: 1985183 to the API
2026-03-26 18:31:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/073/c4c562187b8b494fb3e4b648ac414de6/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 35,
 'color': 'Cristal pearl',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '050145ec-56ee-59c6-8580-962278c39351',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS 7 CROSSBACK',
 'odometer': 63753,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_050145ec-56ee-59c6-8580-962278c39351/050145ec-56ee-59c6-8580-962278c39351_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 368723,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/073/c4c562187b8b494fb3e4b648ac414de6/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS 7 CROSSBACK 1.6 E-Tense 225 PERFORMANCE LINE Auto',
 'transmission': 'manual',
 'trim': '1.6 E-Tense 225 PERFORMANCE LINE Auto',
 'vin': None,
 'year': 2021}
2026-03-26 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985183%27 HTTP/1.1" 200 None
2026-03-26 18:31:21 [ayvens.es] INFO: Saving data for 1985183: {'created_time': 1774549881.670284, 'last_price_update_time': 1774549881.670295, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985183') HTTP/1.1" 204 0
2026-03-26 18:31:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/418/98b9b9e90ea6473db27c4c6e780c4784/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/977/08eb3c260e074af9897792d56d23bc3d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:21 [ayvens.es] INFO: Found listing with ID: 1985194
2026-03-26 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985194%27 HTTP/1.1" 200 None
2026-03-26 18:31:21 [ayvens.es] INFO: Scrape type for 1985194: 1
2026-03-26 18:31:21 [ayvens.es] INFO: Extracting data for car ID: 1985194
2026-03-26 18:31:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0bacce0e-5d2c-5ad1-8d97-3ca530c015cf with identifier: 1985194
2026-03-26 18:31:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0bacce0e-5d2c-5ad1-8d97-3ca530c015cf with scrape type 1
2026-03-26 18:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0bacce0e-5d2c-5ad1-8d97-3ca530c015cf
2026-03-26 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F381%252F2391d9bcf22d40ef801180b1437a3a46%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/381/2391d9bcf22d40ef801180b1437a3a46/images/large/1.jpg not downloaded yet
2026-03-26 18:31:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a29048d10>
2026-03-26 18:31:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d70a6e8-83e6-59f6-807c-96463a772a2b/7d70a6e8-83e6-59f6-807c-96463a772a2b_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F092%252Fb3e7b2c739944ce497ce55c3c2371eff%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/092/b3e7b2c739944ce497ce55c3c2371eff/images/large/1.jpg saved to cache
2026-03-26 18:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7d70a6e8-83e6-59f6-807c-96463a772a2b
2026-03-26 18:31:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7d70a6e8-83e6-59f6-807c-96463a772a2b, skipping ID generation
2026-03-26 18:31:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d70a6e8-83e6-59f6-807c-96463a772a2b with scrape type 1
2026-03-26 18:31:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7d70a6e8-83e6-59f6-807c-96463a772a2b sending to next pipeline
2026-03-26 18:31:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7d70a6e8-83e6-59f6-807c-96463a772a2b, identifier: 1985186
2026-03-26 18:31:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7d70a6e8-83e6-59f6-807c-96463a772a2b with identifier: 1985186
2026-03-26 18:31:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:31:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7d70a6e8-83e6-59f6-807c-96463a772a2b with identifier: 1985186
2026-03-26 18:31:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7d70a6e8-83e6-59f6-807c-96463a772a2b with identifier: 1985186 to the API
2026-03-26 18:31:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/092/b3e7b2c739944ce497ce55c3c2371eff/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 40,
 'color': 'Midnight black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '7d70a6e8-83e6-59f6-807c-96463a772a2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'COUNTRYMAN',
 'odometer': 62779,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d70a6e8-83e6-59f6-807c-96463a772a2b/7d70a6e8-83e6-59f6-807c-96463a772a2b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 387128,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/092/b3e7b2c739944ce497ce55c3c2371eff/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI COUNTRYMAN (E) Cooper S E ALL4',
 'transmission': 'manual',
 'trim': '(E) Cooper S E ALL4',
 'vin': None,
 'year': 2022}
2026-03-26 18:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985186%27 HTTP/1.1" 200 None
2026-03-26 18:31:22 [ayvens.es] INFO: Saving data for 1985186: {'created_time': 1774549882.363267, 'last_price_update_time': 1774549882.363277, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985186') HTTP/1.1" 204 0
2026-03-26 18:31:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a283d0b90>
2026-03-26 18:31:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_968eeb0f-81e1-5fe3-a609-166c9c952ed6/968eeb0f-81e1-5fe3-a609-166c9c952ed6_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F274%252F0da207775cc94269b37551b5269d8ccc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/274/0da207775cc94269b37551b5269d8ccc/images/large/1.jpg saved to cache
2026-03-26 18:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 968eeb0f-81e1-5fe3-a609-166c9c952ed6
2026-03-26 18:31:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 968eeb0f-81e1-5fe3-a609-166c9c952ed6, skipping ID generation
2026-03-26 18:31:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 968eeb0f-81e1-5fe3-a609-166c9c952ed6 with scrape type 1
2026-03-26 18:31:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 968eeb0f-81e1-5fe3-a609-166c9c952ed6 sending to next pipeline
2026-03-26 18:31:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 968eeb0f-81e1-5fe3-a609-166c9c952ed6, identifier: 1985185
2026-03-26 18:31:22 [ayvens.es] INFO: Found listing with ID: 1985195
2026-03-26 18:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985195%27 HTTP/1.1" 200 None
2026-03-26 18:31:22 [ayvens.es] INFO: Scrape type for 1985195: 1
2026-03-26 18:31:22 [ayvens.es] INFO: Extracting data for car ID: 1985195
2026-03-26 18:31:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a8bc584-0e34-5acc-be35-9936a5dd5c33 with identifier: 1985195
2026-03-26 18:31:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a8bc584-0e34-5acc-be35-9936a5dd5c33 with scrape type 1
2026-03-26 18:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2a8bc584-0e34-5acc-be35-9936a5dd5c33
2026-03-26 18:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F607%252Fe67b10deb964413399b4c666f7e65fd8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/607/e67b10deb964413399b4c666f7e65fd8/images/large/1.jpg not downloaded yet
2026-03-26 18:31:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 968eeb0f-81e1-5fe3-a609-166c9c952ed6 with identifier: 1985185
2026-03-26 18:31:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 968eeb0f-81e1-5fe3-a609-166c9c952ed6 with identifier: 1985185
2026-03-26 18:31:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 968eeb0f-81e1-5fe3-a609-166c9c952ed6 with identifier: 1985185 to the API
2026-03-26 18:31:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/274/0da207775cc94269b37551b5269d8ccc/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.4L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'gas',
 'id': '968eeb0f-81e1-5fe3-a609-166c9c952ed6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'DOBLO CARGO',
 'odometer': 160680,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_968eeb0f-81e1-5fe3-a609-166c9c952ed6/968eeb0f-81e1-5fe3-a609-166c9c952ed6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 481939,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/274/0da207775cc94269b37551b5269d8ccc/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-29',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FIAT DOBLO CARGO Cargo SX 1.4 T-Jet 88kW Natur Power CNG+++Revisar '
          'peritacion+++',
 'transmission': 'manual',
 'trim': 'Cargo SX 1.4 T-Jet 88kW Natur Power CNG+++Revisar peritacion+++',
 'vin': None,
 'year': 2019}
2026-03-26 18:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985185%27 HTTP/1.1" 200 None
2026-03-26 18:31:22 [ayvens.es] INFO: Saving data for 1985185: {'created_time': 1774549882.824893, 'last_price_update_time': 1774549882.824906, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985185') HTTP/1.1" 204 0
2026-03-26 18:31:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a284ed6d0>
2026-03-26 18:31:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e813ad4-9424-598a-bae1-dc651d76c157/5e813ad4-9424-598a-bae1-dc651d76c157_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F418%252F98b9b9e90ea6473db27c4c6e780c4784%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/418/98b9b9e90ea6473db27c4c6e780c4784/images/large/1.jpg saved to cache
2026-03-26 18:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5e813ad4-9424-598a-bae1-dc651d76c157
2026-03-26 18:31:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5e813ad4-9424-598a-bae1-dc651d76c157, skipping ID generation
2026-03-26 18:31:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e813ad4-9424-598a-bae1-dc651d76c157 with scrape type 1
2026-03-26 18:31:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5e813ad4-9424-598a-bae1-dc651d76c157 sending to next pipeline
2026-03-26 18:31:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5e813ad4-9424-598a-bae1-dc651d76c157, identifier: 1985188
2026-03-26 18:31:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a2832be10>
2026-03-26 18:31:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88d79502-982a-592c-885e-cbc6dccb22f6/88d79502-982a-592c-885e-cbc6dccb22f6_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F977%252F08eb3c260e074af9897792d56d23bc3d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/977/08eb3c260e074af9897792d56d23bc3d/images/large/1.jpg saved to cache
2026-03-26 18:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 88d79502-982a-592c-885e-cbc6dccb22f6
2026-03-26 18:31:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 88d79502-982a-592c-885e-cbc6dccb22f6, skipping ID generation
2026-03-26 18:31:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88d79502-982a-592c-885e-cbc6dccb22f6 with scrape type 1
2026-03-26 18:31:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 88d79502-982a-592c-885e-cbc6dccb22f6 sending to next pipeline
2026-03-26 18:31:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 88d79502-982a-592c-885e-cbc6dccb22f6, identifier: 1985187
2026-03-26 18:31:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/479/a8e0fbd957644941a87d179dc945624d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/211/1c1a3f04d9214962a63164cca828b525/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:23 [ayvens.es] INFO: Found listing with ID: 1985196
2026-03-26 18:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985196%27 HTTP/1.1" 200 None
2026-03-26 18:31:23 [ayvens.es] INFO: Scrape type for 1985196: 1
2026-03-26 18:31:23 [ayvens.es] INFO: Extracting data for car ID: 1985196
2026-03-26 18:31:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc452748-0b22-587b-b1c0-bc69e48452c8 with identifier: 1985196
2026-03-26 18:31:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc452748-0b22-587b-b1c0-bc69e48452c8 with scrape type 1
2026-03-26 18:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item fc452748-0b22-587b-b1c0-bc69e48452c8
2026-03-26 18:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F819%252Fb663c490555d4da7b3ebaa59759601c9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/819/b663c490555d4da7b3ebaa59759601c9/images/large/1.jpg not downloaded yet
2026-03-26 18:31:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5e813ad4-9424-598a-bae1-dc651d76c157 with identifier: 1985188
2026-03-26 18:31:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5e813ad4-9424-598a-bae1-dc651d76c157 with identifier: 1985188
2026-03-26 18:31:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5e813ad4-9424-598a-bae1-dc651d76c157 with identifier: 1985188 to the API
2026-03-26 18:31:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/418/98b9b9e90ea6473db27c4c6e780c4784/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'Polar white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '5e813ad4-9424-598a-bae1-dc651d76c157',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'TUCSON',
 'odometer': 65721,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e813ad4-9424-598a-bae1-dc651d76c157/5e813ad4-9424-598a-bae1-dc651d76c157_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 351605,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/418/98b9b9e90ea6473db27c4c6e780c4784/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI TUCSON 1.6 CRDI 100kW (136CV) 48V Maxx',
 'transmission': 'manual',
 'trim': '1.6 CRDI 100kW (136CV) 48V Maxx',
 'vin': None,
 'year': 2021}
2026-03-26 18:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985188%27 HTTP/1.1" 200 None
2026-03-26 18:31:23 [ayvens.es] INFO: Saving data for 1985188: {'created_time': 1774549883.664127, 'last_price_update_time': 1774549883.664138, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985188') HTTP/1.1" 204 0
2026-03-26 18:31:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 88d79502-982a-592c-885e-cbc6dccb22f6 with identifier: 1985187
2026-03-26 18:31:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 88d79502-982a-592c-885e-cbc6dccb22f6 with identifier: 1985187
2026-03-26 18:31:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 88d79502-982a-592c-885e-cbc6dccb22f6 with identifier: 1985187 to the API
2026-03-26 18:31:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/977/08eb3c260e074af9897792d56d23bc3d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '88d79502-982a-592c-885e-cbc6dccb22f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'IONIQ',
 'odometer': 121569,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88d79502-982a-592c-885e-cbc6dccb22f6/88d79502-982a-592c-885e-cbc6dccb22f6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 361256,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/977/08eb3c260e074af9897792d56d23bc3d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI IONIQ 1.6 GDI HEV Klass DCT',
 'transmission': 'manual',
 'trim': '1.6 GDI HEV Klass DCT',
 'vin': None,
 'year': 2021}
2026-03-26 18:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985187%27 HTTP/1.1" 200 None
2026-03-26 18:31:23 [ayvens.es] INFO: Saving data for 1985187: {'created_time': 1774549883.936754, 'last_price_update_time': 1774549883.936763, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985187') HTTP/1.1" 204 0
2026-03-26 18:31:23 [ayvens.es] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 100
2026-03-26 18:31:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/781/872e8d8610c24165b43932bc43000b81/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a284ed490>
2026-03-26 18:31:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43a9c81a-156c-52eb-804e-f4b00af0064b/43a9c81a-156c-52eb-804e-f4b00af0064b_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F479%252Fa8e0fbd957644941a87d179dc945624d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/479/a8e0fbd957644941a87d179dc945624d/images/large/1.jpg saved to cache
2026-03-26 18:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 43a9c81a-156c-52eb-804e-f4b00af0064b
2026-03-26 18:31:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 43a9c81a-156c-52eb-804e-f4b00af0064b, skipping ID generation
2026-03-26 18:31:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43a9c81a-156c-52eb-804e-f4b00af0064b with scrape type 1
2026-03-26 18:31:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 43a9c81a-156c-52eb-804e-f4b00af0064b sending to next pipeline
2026-03-26 18:31:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 43a9c81a-156c-52eb-804e-f4b00af0064b, identifier: 1985190
2026-03-26 18:31:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28328490>
2026-03-26 18:31:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07b80158-4406-5ce0-9e54-dbba613e3566/07b80158-4406-5ce0-9e54-dbba613e3566_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F211%252F1c1a3f04d9214962a63164cca828b525%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/211/1c1a3f04d9214962a63164cca828b525/images/large/1.jpg saved to cache
2026-03-26 18:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 07b80158-4406-5ce0-9e54-dbba613e3566
2026-03-26 18:31:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 07b80158-4406-5ce0-9e54-dbba613e3566, skipping ID generation
2026-03-26 18:31:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07b80158-4406-5ce0-9e54-dbba613e3566 with scrape type 1
2026-03-26 18:31:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 07b80158-4406-5ce0-9e54-dbba613e3566 sending to next pipeline
2026-03-26 18:31:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 07b80158-4406-5ce0-9e54-dbba613e3566, identifier: 1985189
2026-03-26 18:31:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 43a9c81a-156c-52eb-804e-f4b00af0064b with identifier: 1985190
2026-03-26 18:31:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:31:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 43a9c81a-156c-52eb-804e-f4b00af0064b with identifier: 1985190
2026-03-26 18:31:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 43a9c81a-156c-52eb-804e-f4b00af0064b with identifier: 1985190 to the API
2026-03-26 18:31:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/479/a8e0fbd957644941a87d179dc945624d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 48,
 'color': 'Denim blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '43a9c81a-156c-52eb-804e-f4b00af0064b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 81201,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43a9c81a-156c-52eb-804e-f4b00af0064b/43a9c81a-156c-52eb-804e-f4b00af0064b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 385773,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/479/a8e0fbd957644941a87d179dc945624d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T5 Twin Recharge Inscription Ex Auto',
 'transmission': 'manual',
 'trim': '1.5 T5 Twin Recharge Inscription Ex Auto',
 'vin': None,
 'year': 2022}
2026-03-26 18:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985190%27 HTTP/1.1" 200 None
2026-03-26 18:31:34 [ayvens.es] INFO: Saving data for 1985190: {'created_time': 1774549894.871244, 'last_price_update_time': 1774549894.871255, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985190') HTTP/1.1" 204 0
2026-03-26 18:31:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 07b80158-4406-5ce0-9e54-dbba613e3566 with identifier: 1985189
2026-03-26 18:31:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:31:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 07b80158-4406-5ce0-9e54-dbba613e3566 with identifier: 1985189
2026-03-26 18:31:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 07b80158-4406-5ce0-9e54-dbba613e3566 with identifier: 1985189 to the API
2026-03-26 18:31:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/211/1c1a3f04d9214962a63164cca828b525/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 30,
 'color': 'Gris manganeso',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.4L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '07b80158-4406-5ce0-9e54-dbba613e3566',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT',
 'odometer': 60522,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07b80158-4406-5ce0-9e54-dbba613e3566/07b80158-4406-5ce0-9e54-dbba613e3566_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 356616,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/211/1c1a3f04d9214962a63164cca828b525/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT GTE 1.4 TSI e-Power 115kW + 85kW DSG',
 'transmission': 'manual',
 'trim': 'GTE 1.4 TSI e-Power 115kW + 85kW DSG',
 'vin': None,
 'year': 2021}
2026-03-26 18:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985189%27 HTTP/1.1" 200 None
2026-03-26 18:31:35 [ayvens.es] INFO: Saving data for 1985189: {'created_time': 1774549895.165145, 'last_price_update_time': 1774549895.165154, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985189') HTTP/1.1" 204 0
2026-03-26 18:31:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/327/8cc4002b0c324ed5a14628c3805f3a0a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 18:31:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/698/14494c9dd7ee4d94a61f94bc00eac399/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/381/2391d9bcf22d40ef801180b1437a3a46/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28d30dd0>
2026-03-26 18:31:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa3977e5-97e8-53ea-880a-3fa9eda9340c/aa3977e5-97e8-53ea-880a-3fa9eda9340c_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F781%252F872e8d8610c24165b43932bc43000b81%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/781/872e8d8610c24165b43932bc43000b81/images/large/1.jpg saved to cache
2026-03-26 18:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aa3977e5-97e8-53ea-880a-3fa9eda9340c
2026-03-26 18:31:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aa3977e5-97e8-53ea-880a-3fa9eda9340c, skipping ID generation
2026-03-26 18:31:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa3977e5-97e8-53ea-880a-3fa9eda9340c with scrape type 1
2026-03-26 18:31:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aa3977e5-97e8-53ea-880a-3fa9eda9340c sending to next pipeline
2026-03-26 18:31:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: aa3977e5-97e8-53ea-880a-3fa9eda9340c, identifier: 1985192
2026-03-26 18:31:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: aa3977e5-97e8-53ea-880a-3fa9eda9340c with identifier: 1985192
2026-03-26 18:31:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: aa3977e5-97e8-53ea-880a-3fa9eda9340c with identifier: 1985192
2026-03-26 18:31:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: aa3977e5-97e8-53ea-880a-3fa9eda9340c with identifier: 1985192 to the API
2026-03-26 18:31:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/781/872e8d8610c24165b43932bc43000b81/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 98,
 'color': 'Gris plata metalizad',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'gas',
 'id': 'aa3977e5-97e8-53ea-880a-3fa9eda9340c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 129577,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa3977e5-97e8-53ea-880a-3fa9eda9340c/aa3977e5-97e8-53ea-880a-3fa9eda9340c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 372476,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/781/872e8d8610c24165b43932bc43000b81/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON 1.5 TGI 96kW St&Sp Xcellence',
 'transmission': 'manual',
 'trim': '1.5 TGI 96kW St&Sp Xcellence',
 'vin': None,
 'year': 2020}
2026-03-26 18:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985192%27 HTTP/1.1" 200 None
2026-03-26 18:31:35 [ayvens.es] INFO: Saving data for 1985192: {'created_time': 1774549895.628793, 'last_price_update_time': 1774549895.628804, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985192') HTTP/1.1" 204 0
2026-03-26 18:31:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c46910>
2026-03-26 18:31:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_599a5f8c-c03a-55cb-b915-546930e44681/599a5f8c-c03a-55cb-b915-546930e44681_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F327%252F8cc4002b0c324ed5a14628c3805f3a0a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/327/8cc4002b0c324ed5a14628c3805f3a0a/images/large/1.jpg saved to cache
2026-03-26 18:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 599a5f8c-c03a-55cb-b915-546930e44681
2026-03-26 18:31:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 599a5f8c-c03a-55cb-b915-546930e44681, skipping ID generation
2026-03-26 18:31:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 599a5f8c-c03a-55cb-b915-546930e44681 with scrape type 1
2026-03-26 18:31:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 599a5f8c-c03a-55cb-b915-546930e44681 sending to next pipeline
2026-03-26 18:31:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 599a5f8c-c03a-55cb-b915-546930e44681, identifier: 1985193
2026-03-26 18:31:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c76f50>
2026-03-26 18:31:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e26db3d9-763b-5436-9d5d-71e3434cebcf/e26db3d9-763b-5436-9d5d-71e3434cebcf_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F698%252F14494c9dd7ee4d94a61f94bc00eac399%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/698/14494c9dd7ee4d94a61f94bc00eac399/images/large/1.jpg saved to cache
2026-03-26 18:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e26db3d9-763b-5436-9d5d-71e3434cebcf
2026-03-26 18:31:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e26db3d9-763b-5436-9d5d-71e3434cebcf, skipping ID generation
2026-03-26 18:31:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e26db3d9-763b-5436-9d5d-71e3434cebcf with scrape type 1
2026-03-26 18:31:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e26db3d9-763b-5436-9d5d-71e3434cebcf sending to next pipeline
2026-03-26 18:31:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e26db3d9-763b-5436-9d5d-71e3434cebcf, identifier: 1985191
2026-03-26 18:31:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c23790>
2026-03-26 18:31:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0bacce0e-5d2c-5ad1-8d97-3ca530c015cf/0bacce0e-5d2c-5ad1-8d97-3ca530c015cf_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F381%252F2391d9bcf22d40ef801180b1437a3a46%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/381/2391d9bcf22d40ef801180b1437a3a46/images/large/1.jpg saved to cache
2026-03-26 18:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0bacce0e-5d2c-5ad1-8d97-3ca530c015cf
2026-03-26 18:31:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0bacce0e-5d2c-5ad1-8d97-3ca530c015cf, skipping ID generation
2026-03-26 18:31:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0bacce0e-5d2c-5ad1-8d97-3ca530c015cf with scrape type 1
2026-03-26 18:31:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0bacce0e-5d2c-5ad1-8d97-3ca530c015cf sending to next pipeline
2026-03-26 18:31:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0bacce0e-5d2c-5ad1-8d97-3ca530c015cf, identifier: 1985194
2026-03-26 18:31:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/819/b663c490555d4da7b3ebaa59759601c9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 599a5f8c-c03a-55cb-b915-546930e44681 with identifier: 1985193
2026-03-26 18:31:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 599a5f8c-c03a-55cb-b915-546930e44681 with identifier: 1985193
2026-03-26 18:31:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 599a5f8c-c03a-55cb-b915-546930e44681 with identifier: 1985193 to the API
2026-03-26 18:31:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/327/8cc4002b0c324ed5a14628c3805f3a0a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'electric',
 'id': '599a5f8c-c03a-55cb-b915-546930e44681',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'ZOE',
 'odometer': 69105,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_599a5f8c-c03a-55cb-b915-546930e44681/599a5f8c-c03a-55cb-b915-546930e44681_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 343466,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/327/8cc4002b0c324ed5a14628c3805f3a0a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT ZOE Life 40 R90 Flexi***BATERIA EN REGIMEN DE ALQUILER***',
 'transmission': 'manual',
 'trim': 'Life 40 R90 Flexi***BATERIA EN REGIMEN DE ALQUILER***',
 'vin': None,
 'year': 2019}
2026-03-26 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985193%27 HTTP/1.1" 200 None
2026-03-26 18:31:36 [ayvens.es] INFO: Saving data for 1985193: {'created_time': 1774549896.443492, 'last_price_update_time': 1774549896.443505, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985193') HTTP/1.1" 204 0
2026-03-26 18:31:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e26db3d9-763b-5436-9d5d-71e3434cebcf with identifier: 1985191
2026-03-26 18:31:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e26db3d9-763b-5436-9d5d-71e3434cebcf with identifier: 1985191
2026-03-26 18:31:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e26db3d9-763b-5436-9d5d-71e3434cebcf with identifier: 1985191 to the API
2026-03-26 18:31:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/698/14494c9dd7ee4d94a61f94bc00eac399/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'electric',
 'id': 'e26db3d9-763b-5436-9d5d-71e3434cebcf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'MODEL 3',
 'odometer': 130067,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e26db3d9-763b-5436-9d5d-71e3434cebcf/e26db3d9-763b-5436-9d5d-71e3434cebcf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 637975,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/698/14494c9dd7ee4d94a61f94bc00eac399/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA MODEL 3 Gran Autonomia AWD',
 'transmission': 'manual',
 'trim': 'Gran Autonomia AWD',
 'vin': None,
 'year': 2020}
2026-03-26 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985191%27 HTTP/1.1" 200 None
2026-03-26 18:31:36 [ayvens.es] INFO: Saving data for 1985191: {'created_time': 1774549896.741728, 'last_price_update_time': 1774549896.741738, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985191') HTTP/1.1" 204 0
2026-03-26 18:31:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0bacce0e-5d2c-5ad1-8d97-3ca530c015cf with identifier: 1985194
2026-03-26 18:31:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0bacce0e-5d2c-5ad1-8d97-3ca530c015cf with identifier: 1985194
2026-03-26 18:31:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0bacce0e-5d2c-5ad1-8d97-3ca530c015cf with identifier: 1985194 to the API
2026-03-26 18:31:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/381/2391d9bcf22d40ef801180b1437a3a46/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '0bacce0e-5d2c-5ad1-8d97-3ca530c015cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'KONA',
 'odometer': 37704,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0bacce0e-5d2c-5ad1-8d97-3ca530c015cf/0bacce0e-5d2c-5ad1-8d97-3ca530c015cf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 352266,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/381/2391d9bcf22d40ef801180b1437a3a46/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI KONA 1.6 GDI HEV Klass DCT',
 'transmission': 'manual',
 'trim': '1.6 GDI HEV Klass DCT',
 'vin': None,
 'year': 2021}
2026-03-26 18:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985194%27 HTTP/1.1" 200 None
2026-03-26 18:31:37 [ayvens.es] INFO: Saving data for 1985194: {'created_time': 1774549897.045124, 'last_price_update_time': 1774549897.045133, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985194') HTTP/1.1" 204 0
2026-03-26 18:31:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/607/e67b10deb964413399b4c666f7e65fd8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a283ca210>
2026-03-26 18:31:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc452748-0b22-587b-b1c0-bc69e48452c8/fc452748-0b22-587b-b1c0-bc69e48452c8_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F819%252Fb663c490555d4da7b3ebaa59759601c9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/819/b663c490555d4da7b3ebaa59759601c9/images/large/1.jpg saved to cache
2026-03-26 18:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fc452748-0b22-587b-b1c0-bc69e48452c8
2026-03-26 18:31:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fc452748-0b22-587b-b1c0-bc69e48452c8, skipping ID generation
2026-03-26 18:31:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc452748-0b22-587b-b1c0-bc69e48452c8 with scrape type 1
2026-03-26 18:31:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fc452748-0b22-587b-b1c0-bc69e48452c8 sending to next pipeline
2026-03-26 18:31:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: fc452748-0b22-587b-b1c0-bc69e48452c8, identifier: 1985196
2026-03-26 18:31:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: fc452748-0b22-587b-b1c0-bc69e48452c8 with identifier: 1985196
2026-03-26 18:31:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: fc452748-0b22-587b-b1c0-bc69e48452c8 with identifier: 1985196
2026-03-26 18:31:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: fc452748-0b22-587b-b1c0-bc69e48452c8 with identifier: 1985196 to the API
2026-03-26 18:31:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/819/b663c490555d4da7b3ebaa59759601c9/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 100,
 'color': 'Gris plata metalizad',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'gas',
 'id': 'fc452748-0b22-587b-b1c0-bc69e48452c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 68413,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc452748-0b22-587b-b1c0-bc69e48452c8/fc452748-0b22-587b-b1c0-bc69e48452c8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 380300,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/819/b663c490555d4da7b3ebaa59759601c9/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON ST 1.5 TGI 96kW S&S Xcellence',
 'transmission': 'manual',
 'trim': 'ST 1.5 TGI 96kW S&S Xcellence',
 'vin': None,
 'year': 2020}
2026-03-26 18:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985196%27 HTTP/1.1" 200 None
2026-03-26 18:31:37 [ayvens.es] INFO: Saving data for 1985196: {'created_time': 1774549897.528999, 'last_price_update_time': 1774549897.529013, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985196') HTTP/1.1" 204 0
2026-03-26 18:31:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a29056710>
2026-03-26 18:31:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a8bc584-0e34-5acc-be35-9936a5dd5c33/2a8bc584-0e34-5acc-be35-9936a5dd5c33_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F607%252Fe67b10deb964413399b4c666f7e65fd8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/607/e67b10deb964413399b4c666f7e65fd8/images/large/1.jpg saved to cache
2026-03-26 18:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2a8bc584-0e34-5acc-be35-9936a5dd5c33
2026-03-26 18:31:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2a8bc584-0e34-5acc-be35-9936a5dd5c33, skipping ID generation
2026-03-26 18:31:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a8bc584-0e34-5acc-be35-9936a5dd5c33 with scrape type 1
2026-03-26 18:31:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2a8bc584-0e34-5acc-be35-9936a5dd5c33 sending to next pipeline
2026-03-26 18:31:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2a8bc584-0e34-5acc-be35-9936a5dd5c33, identifier: 1985195
2026-03-26 18:31:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2a8bc584-0e34-5acc-be35-9936a5dd5c33 with identifier: 1985195
2026-03-26 18:31:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2a8bc584-0e34-5acc-be35-9936a5dd5c33 with identifier: 1985195
2026-03-26 18:31:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 2a8bc584-0e34-5acc-be35-9936a5dd5c33 with identifier: 1985195 to the API
2026-03-26 18:31:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/607/e67b10deb964413399b4c666f7e65fd8/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Blanco glaciar',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'electric',
 'id': '2a8bc584-0e34-5acc-be35-9936a5dd5c33',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'ZOE',
 'odometer': 2054,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a8bc584-0e34-5acc-be35-9936a5dd5c33/2a8bc584-0e34-5acc-be35-9936a5dd5c33_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 634803,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/607/e67b10deb964413399b4c666f7e65fd8/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT ZOE Intens 80 kW R110 Bateria 50kWh',
 'transmission': 'manual',
 'trim': 'Intens 80 kW R110 Bateria 50kWh',
 'vin': None,
 'year': 2022}
2026-03-26 18:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985195%27 HTTP/1.1" 200 None
2026-03-26 18:31:38 [ayvens.es] INFO: Saving data for 1985195: {'created_time': 1774549898.118539, 'last_price_update_time': 1774549898.118549, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985195') HTTP/1.1" 204 0
2026-03-26 18:31:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-26 18:31:39 [ayvens.es] INFO: Found listing with ID: 1985197
2026-03-26 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985197%27 HTTP/1.1" 200 None
2026-03-26 18:31:39 [ayvens.es] INFO: Scrape type for 1985197: 1
2026-03-26 18:31:39 [ayvens.es] INFO: Extracting data for car ID: 1985197
2026-03-26 18:31:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e20f061-a4f0-5bd0-9865-6c66ec93b95d with identifier: 1985197
2026-03-26 18:31:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e20f061-a4f0-5bd0-9865-6c66ec93b95d with scrape type 1
2026-03-26 18:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1e20f061-a4f0-5bd0-9865-6c66ec93b95d
2026-03-26 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F102%252F6452523af56a417f81faec4b87ef0411%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/102/6452523af56a417f81faec4b87ef0411/images/large/1.jpg not downloaded yet
2026-03-26 18:31:39 [ayvens.es] INFO: Found listing with ID: 1985198
2026-03-26 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985198%27 HTTP/1.1" 200 None
2026-03-26 18:31:39 [ayvens.es] INFO: Scrape type for 1985198: 1
2026-03-26 18:31:39 [ayvens.es] INFO: Extracting data for car ID: 1985198
2026-03-26 18:31:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79fd5015-32f8-51e3-827c-7178500aecac with identifier: 1985198
2026-03-26 18:31:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79fd5015-32f8-51e3-827c-7178500aecac with scrape type 1
2026-03-26 18:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 79fd5015-32f8-51e3-827c-7178500aecac
2026-03-26 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F748%252Fc7052c341dcd4718a8078f24f09a584a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/748/c7052c341dcd4718a8078f24f09a584a/images/large/1.jpg not downloaded yet
2026-03-26 18:31:39 [ayvens.es] INFO: Found listing with ID: 1985199
2026-03-26 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985199%27 HTTP/1.1" 200 None
2026-03-26 18:31:39 [ayvens.es] INFO: Scrape type for 1985199: 1
2026-03-26 18:31:39 [ayvens.es] INFO: Extracting data for car ID: 1985199
2026-03-26 18:31:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1af94db8-8c43-5128-a4f8-0aa1bb20f6ea with identifier: 1985199
2026-03-26 18:31:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1af94db8-8c43-5128-a4f8-0aa1bb20f6ea with scrape type 1
2026-03-26 18:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1af94db8-8c43-5128-a4f8-0aa1bb20f6ea
2026-03-26 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F371%252Fe7132af7ae844a7bb52cf1262f833657%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/371/e7132af7ae844a7bb52cf1262f833657/images/large/1.jpg not downloaded yet
2026-03-26 18:31:39 [ayvens.es] INFO: Found listing with ID: 1985200
2026-03-26 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985200%27 HTTP/1.1" 200 None
2026-03-26 18:31:39 [ayvens.es] INFO: Scrape type for 1985200: 1
2026-03-26 18:31:39 [ayvens.es] INFO: Extracting data for car ID: 1985200
2026-03-26 18:31:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9fed9ad1-36a0-500b-af90-f92cff60bd6f with identifier: 1985200
2026-03-26 18:31:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9fed9ad1-36a0-500b-af90-f92cff60bd6f with scrape type 1
2026-03-26 18:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9fed9ad1-36a0-500b-af90-f92cff60bd6f
2026-03-26 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F921%252F7b0ca2c5d6e64b618a6e9bce60d108af%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/921/7b0ca2c5d6e64b618a6e9bce60d108af/images/large/1.jpg not downloaded yet
2026-03-26 18:31:39 [ayvens.es] INFO: Found listing with ID: 1985201
2026-03-26 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985201%27 HTTP/1.1" 200 None
2026-03-26 18:31:39 [ayvens.es] INFO: Scrape type for 1985201: 1
2026-03-26 18:31:39 [ayvens.es] INFO: Extracting data for car ID: 1985201
2026-03-26 18:31:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88e13dc8-0fa9-579a-82cf-568aaa1c0033 with identifier: 1985201
2026-03-26 18:31:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88e13dc8-0fa9-579a-82cf-568aaa1c0033 with scrape type 1
2026-03-26 18:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 88e13dc8-0fa9-579a-82cf-568aaa1c0033
2026-03-26 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F947%252Feb922e34734f42c88760dcc300e49516%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/947/eb922e34734f42c88760dcc300e49516/images/large/1.jpg not downloaded yet
2026-03-26 18:31:39 [ayvens.es] INFO: Found listing with ID: 1985202
2026-03-26 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985202%27 HTTP/1.1" 200 None
2026-03-26 18:31:39 [ayvens.es] INFO: Scrape type for 1985202: 1
2026-03-26 18:31:39 [ayvens.es] INFO: Extracting data for car ID: 1985202
2026-03-26 18:31:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8a0e396-6e94-5f47-bd16-6d3c4ea14606 with identifier: 1985202
2026-03-26 18:31:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8a0e396-6e94-5f47-bd16-6d3c4ea14606 with scrape type 1
2026-03-26 18:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b8a0e396-6e94-5f47-bd16-6d3c4ea14606
2026-03-26 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F045%252Fdfbd915417084c2ab09cd30037b5005e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/045/dfbd915417084c2ab09cd30037b5005e/images/large/1.jpg not downloaded yet
2026-03-26 18:31:39 [ayvens.es] INFO: Found listing with ID: 1985203
2026-03-26 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985203%27 HTTP/1.1" 200 None
2026-03-26 18:31:39 [ayvens.es] INFO: Scrape type for 1985203: 1
2026-03-26 18:31:39 [ayvens.es] INFO: Extracting data for car ID: 1985203
2026-03-26 18:31:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9df4cf14-416a-5cd1-9949-dcbedc0575dc with identifier: 1985203
2026-03-26 18:31:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9df4cf14-416a-5cd1-9949-dcbedc0575dc with scrape type 1
2026-03-26 18:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9df4cf14-416a-5cd1-9949-dcbedc0575dc
2026-03-26 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F502%252Fe93f238c795348a786d2eecfa5c62208%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/502/e93f238c795348a786d2eecfa5c62208/images/large/1.jpg not downloaded yet
2026-03-26 18:31:39 [ayvens.es] INFO: Found listing with ID: 1985204
2026-03-26 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985204%27 HTTP/1.1" 200 None
2026-03-26 18:31:39 [ayvens.es] INFO: Scrape type for 1985204: 1
2026-03-26 18:31:39 [ayvens.es] INFO: Extracting data for car ID: 1985204
2026-03-26 18:31:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6633572e-4d3c-5c80-8af8-3bbcd921054c with identifier: 1985204
2026-03-26 18:31:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6633572e-4d3c-5c80-8af8-3bbcd921054c with scrape type 1
2026-03-26 18:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6633572e-4d3c-5c80-8af8-3bbcd921054c
2026-03-26 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F179%252F9b163d7a48074a56ad3460911ff98d83%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/179/9b163d7a48074a56ad3460911ff98d83/images/large/1.jpg not downloaded yet
2026-03-26 18:31:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/748/c7052c341dcd4718a8078f24f09a584a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:39 [ayvens.es] INFO: Found listing with ID: 1985205
2026-03-26 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985205%27 HTTP/1.1" 200 None
2026-03-26 18:31:39 [ayvens.es] INFO: Scrape type for 1985205: 1
2026-03-26 18:31:39 [ayvens.es] INFO: Extracting data for car ID: 1985205
2026-03-26 18:31:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17480154-3836-51d6-9448-45d2f2888894 with identifier: 1985205
2026-03-26 18:31:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17480154-3836-51d6-9448-45d2f2888894 with scrape type 1
2026-03-26 18:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 17480154-3836-51d6-9448-45d2f2888894
2026-03-26 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F681%252F34b6d60385254d82a5f5d52704f1f32b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/681/34b6d60385254d82a5f5d52704f1f32b/images/large/1.jpg not downloaded yet
2026-03-26 18:31:39 [ayvens.es] INFO: Found listing with ID: 1985206
2026-03-26 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985206%27 HTTP/1.1" 200 None
2026-03-26 18:31:39 [ayvens.es] INFO: Scrape type for 1985206: 1
2026-03-26 18:31:39 [ayvens.es] INFO: Extracting data for car ID: 1985206
2026-03-26 18:31:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9c7a634-b2c0-5e43-9516-ec73e6d4d32d with identifier: 1985206
2026-03-26 18:31:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9c7a634-b2c0-5e43-9516-ec73e6d4d32d with scrape type 1
2026-03-26 18:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c9c7a634-b2c0-5e43-9516-ec73e6d4d32d
2026-03-26 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F963%252F742914552c8a462d8a1617f2d4125b85%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/963/742914552c8a462d8a1617f2d4125b85/images/large/1.jpg not downloaded yet
2026-03-26 18:31:39 [ayvens.es] INFO: Found listing with ID: 1985207
2026-03-26 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985207%27 HTTP/1.1" 200 None
2026-03-26 18:31:39 [ayvens.es] INFO: Scrape type for 1985207: 1
2026-03-26 18:31:39 [ayvens.es] INFO: Extracting data for car ID: 1985207
2026-03-26 18:31:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e084e1de-f0ca-5deb-8c1e-9ae50dc26712 with identifier: 1985207
2026-03-26 18:31:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e084e1de-f0ca-5deb-8c1e-9ae50dc26712 with scrape type 1
2026-03-26 18:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e084e1de-f0ca-5deb-8c1e-9ae50dc26712
2026-03-26 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F846%252F29a095ce12f740f39043c4033415effc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/846/29a095ce12f740f39043c4033415effc/images/large/1.jpg not downloaded yet
2026-03-26 18:31:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/102/6452523af56a417f81faec4b87ef0411/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/371/e7132af7ae844a7bb52cf1262f833657/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:39 [ayvens.es] INFO: Found listing with ID: 1985208
2026-03-26 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985208%27 HTTP/1.1" 200 None
2026-03-26 18:31:39 [ayvens.es] INFO: Scrape type for 1985208: 1
2026-03-26 18:31:39 [ayvens.es] INFO: Extracting data for car ID: 1985208
2026-03-26 18:31:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ebbeefa-76a8-5f54-ae93-b62d12f85916 with identifier: 1985208
2026-03-26 18:31:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ebbeefa-76a8-5f54-ae93-b62d12f85916 with scrape type 1
2026-03-26 18:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6ebbeefa-76a8-5f54-ae93-b62d12f85916
2026-03-26 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F597%252Fcd9d1e741f9d48669f7dee386308d7b7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/597/cd9d1e741f9d48669f7dee386308d7b7/images/large/1.jpg not downloaded yet
2026-03-26 18:31:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/947/eb922e34734f42c88760dcc300e49516/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:39 [ayvens.es] INFO: Found listing with ID: 1985209
2026-03-26 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985209%27 HTTP/1.1" 200 None
2026-03-26 18:31:39 [ayvens.es] INFO: Scrape type for 1985209: 1
2026-03-26 18:31:39 [ayvens.es] INFO: Extracting data for car ID: 1985209
2026-03-26 18:31:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8535ebdc-e7ee-5a8b-88b7-fe9ac25f8ee9 with identifier: 1985209
2026-03-26 18:31:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8535ebdc-e7ee-5a8b-88b7-fe9ac25f8ee9 with scrape type 1
2026-03-26 18:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8535ebdc-e7ee-5a8b-88b7-fe9ac25f8ee9
2026-03-26 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F000%252Fc6ec2402485f4a909f599049edca76d7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/000/c6ec2402485f4a909f599049edca76d7/images/large/1.jpg not downloaded yet
2026-03-26 18:31:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/921/7b0ca2c5d6e64b618a6e9bce60d108af/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c20b90>
2026-03-26 18:31:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79fd5015-32f8-51e3-827c-7178500aecac/79fd5015-32f8-51e3-827c-7178500aecac_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F748%252Fc7052c341dcd4718a8078f24f09a584a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/748/c7052c341dcd4718a8078f24f09a584a/images/large/1.jpg saved to cache
2026-03-26 18:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 79fd5015-32f8-51e3-827c-7178500aecac
2026-03-26 18:31:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 79fd5015-32f8-51e3-827c-7178500aecac, skipping ID generation
2026-03-26 18:31:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79fd5015-32f8-51e3-827c-7178500aecac with scrape type 1
2026-03-26 18:31:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 79fd5015-32f8-51e3-827c-7178500aecac sending to next pipeline
2026-03-26 18:31:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 79fd5015-32f8-51e3-827c-7178500aecac, identifier: 1985198
2026-03-26 18:31:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/045/dfbd915417084c2ab09cd30037b5005e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:40 [ayvens.es] INFO: Found listing with ID: 1985210
2026-03-26 18:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985210%27 HTTP/1.1" 200 None
2026-03-26 18:31:40 [ayvens.es] INFO: Scrape type for 1985210: 1
2026-03-26 18:31:40 [ayvens.es] INFO: Extracting data for car ID: 1985210
2026-03-26 18:31:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac369495-ea63-5174-a1fd-53f078eb85a6 with identifier: 1985210
2026-03-26 18:31:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac369495-ea63-5174-a1fd-53f078eb85a6 with scrape type 1
2026-03-26 18:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ac369495-ea63-5174-a1fd-53f078eb85a6
2026-03-26 18:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F244%252F9e9ddfd01b1b48839372baa1ac0ff594%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/244/9e9ddfd01b1b48839372baa1ac0ff594/images/large/1.jpg not downloaded yet
2026-03-26 18:31:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 79fd5015-32f8-51e3-827c-7178500aecac with identifier: 1985198
2026-03-26 18:31:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 79fd5015-32f8-51e3-827c-7178500aecac with identifier: 1985198
2026-03-26 18:31:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 79fd5015-32f8-51e3-827c-7178500aecac with identifier: 1985198 to the API
2026-03-26 18:31:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/748/c7052c341dcd4718a8078f24f09a584a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 96,
 'color': 'Gris plata metalizad',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'gas',
 'id': '79fd5015-32f8-51e3-827c-7178500aecac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 181468,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79fd5015-32f8-51e3-827c-7178500aecac/79fd5015-32f8-51e3-827c-7178500aecac_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332070,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/748/c7052c341dcd4718a8078f24f09a584a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON ST 1.5 TGI 96kW DSG-7 S&S Xcellence',
 'transmission': 'manual',
 'trim': 'ST 1.5 TGI 96kW DSG-7 S&S Xcellence',
 'vin': None,
 'year': 2020}
2026-03-26 18:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985198%27 HTTP/1.1" 200 None
2026-03-26 18:31:40 [ayvens.es] INFO: Saving data for 1985198: {'created_time': 1774549900.479674, 'last_price_update_time': 1774549900.479685, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985198') HTTP/1.1" 204 0
2026-03-26 18:31:40 [ayvens.es] INFO: Found listing with ID: 1985211
2026-03-26 18:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985211%27 HTTP/1.1" 200 None
2026-03-26 18:31:40 [ayvens.es] INFO: Scrape type for 1985211: 1
2026-03-26 18:31:40 [ayvens.es] INFO: Extracting data for car ID: 1985211
2026-03-26 18:31:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1fdef47-1e31-5916-8913-713e6abe244f with identifier: 1985211
2026-03-26 18:31:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1fdef47-1e31-5916-8913-713e6abe244f with scrape type 1
2026-03-26 18:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item d1fdef47-1e31-5916-8913-713e6abe244f
2026-03-26 18:31:40 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item d1fdef47-1e31-5916-8913-713e6abe244f
2026-03-26 18:31:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d1fdef47-1e31-5916-8913-713e6abe244f, identifier: 1985211
2026-03-26 18:31:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d1fdef47-1e31-5916-8913-713e6abe244f with identifier: 1985211
2026-03-26 18:31:40 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:31:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d1fdef47-1e31-5916-8913-713e6abe244f with identifier: 1985211
2026-03-26 18:31:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d1fdef47-1e31-5916-8913-713e6abe244f with identifier: 1985211 to the API
2026-03-26 18:31:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'Gris magnetic',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'd1fdef47-1e31-5916-8913-713e6abe244f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'KUGA',
 'odometer': 93261,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-01-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD KUGA ST-Line 2.5 Duratec FHEV 140kW Auto',
 'transmission': 'manual',
 'trim': 'ST-Line 2.5 Duratec FHEV 140kW Auto',
 'vin': None,
 'year': 2024}
2026-03-26 18:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985211%27 HTTP/1.1" 200 None
2026-03-26 18:31:40 [ayvens.es] INFO: Saving data for 1985211: {'created_time': 1774549900.959347, 'last_price_update_time': 1774549900.959356, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985211') HTTP/1.1" 204 0
2026-03-26 18:31:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a29080bd0>
2026-03-26 18:31:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e20f061-a4f0-5bd0-9865-6c66ec93b95d/1e20f061-a4f0-5bd0-9865-6c66ec93b95d_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F102%252F6452523af56a417f81faec4b87ef0411%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/102/6452523af56a417f81faec4b87ef0411/images/large/1.jpg saved to cache
2026-03-26 18:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1e20f061-a4f0-5bd0-9865-6c66ec93b95d
2026-03-26 18:31:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1e20f061-a4f0-5bd0-9865-6c66ec93b95d, skipping ID generation
2026-03-26 18:31:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e20f061-a4f0-5bd0-9865-6c66ec93b95d with scrape type 1
2026-03-26 18:31:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1e20f061-a4f0-5bd0-9865-6c66ec93b95d sending to next pipeline
2026-03-26 18:31:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1e20f061-a4f0-5bd0-9865-6c66ec93b95d, identifier: 1985197
2026-03-26 18:31:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28371950>
2026-03-26 18:31:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1af94db8-8c43-5128-a4f8-0aa1bb20f6ea/1af94db8-8c43-5128-a4f8-0aa1bb20f6ea_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F371%252Fe7132af7ae844a7bb52cf1262f833657%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/371/e7132af7ae844a7bb52cf1262f833657/images/large/1.jpg saved to cache
2026-03-26 18:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1af94db8-8c43-5128-a4f8-0aa1bb20f6ea
2026-03-26 18:31:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1af94db8-8c43-5128-a4f8-0aa1bb20f6ea, skipping ID generation
2026-03-26 18:31:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1af94db8-8c43-5128-a4f8-0aa1bb20f6ea with scrape type 1
2026-03-26 18:31:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1af94db8-8c43-5128-a4f8-0aa1bb20f6ea sending to next pipeline
2026-03-26 18:31:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1af94db8-8c43-5128-a4f8-0aa1bb20f6ea, identifier: 1985199
2026-03-26 18:31:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28d30810>
2026-03-26 18:31:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88e13dc8-0fa9-579a-82cf-568aaa1c0033/88e13dc8-0fa9-579a-82cf-568aaa1c0033_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F947%252Feb922e34734f42c88760dcc300e49516%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/947/eb922e34734f42c88760dcc300e49516/images/large/1.jpg saved to cache
2026-03-26 18:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 88e13dc8-0fa9-579a-82cf-568aaa1c0033
2026-03-26 18:31:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 88e13dc8-0fa9-579a-82cf-568aaa1c0033, skipping ID generation
2026-03-26 18:31:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88e13dc8-0fa9-579a-82cf-568aaa1c0033 with scrape type 1
2026-03-26 18:31:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 88e13dc8-0fa9-579a-82cf-568aaa1c0033 sending to next pipeline
2026-03-26 18:31:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 88e13dc8-0fa9-579a-82cf-568aaa1c0033, identifier: 1985201
2026-03-26 18:31:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28eb7f50>
2026-03-26 18:31:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fed9ad1-36a0-500b-af90-f92cff60bd6f/9fed9ad1-36a0-500b-af90-f92cff60bd6f_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F921%252F7b0ca2c5d6e64b618a6e9bce60d108af%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/921/7b0ca2c5d6e64b618a6e9bce60d108af/images/large/1.jpg saved to cache
2026-03-26 18:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9fed9ad1-36a0-500b-af90-f92cff60bd6f
2026-03-26 18:31:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9fed9ad1-36a0-500b-af90-f92cff60bd6f, skipping ID generation
2026-03-26 18:31:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9fed9ad1-36a0-500b-af90-f92cff60bd6f with scrape type 1
2026-03-26 18:31:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9fed9ad1-36a0-500b-af90-f92cff60bd6f sending to next pipeline
2026-03-26 18:31:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9fed9ad1-36a0-500b-af90-f92cff60bd6f, identifier: 1985200
2026-03-26 18:31:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a290a4690>
2026-03-26 18:31:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8a0e396-6e94-5f47-bd16-6d3c4ea14606/b8a0e396-6e94-5f47-bd16-6d3c4ea14606_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F045%252Fdfbd915417084c2ab09cd30037b5005e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/045/dfbd915417084c2ab09cd30037b5005e/images/large/1.jpg saved to cache
2026-03-26 18:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b8a0e396-6e94-5f47-bd16-6d3c4ea14606
2026-03-26 18:31:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b8a0e396-6e94-5f47-bd16-6d3c4ea14606, skipping ID generation
2026-03-26 18:31:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8a0e396-6e94-5f47-bd16-6d3c4ea14606 with scrape type 1
2026-03-26 18:31:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b8a0e396-6e94-5f47-bd16-6d3c4ea14606 sending to next pipeline
2026-03-26 18:31:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b8a0e396-6e94-5f47-bd16-6d3c4ea14606, identifier: 1985202
2026-03-26 18:31:41 [ayvens.es] INFO: Found listing with ID: 1985212
2026-03-26 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985212%27 HTTP/1.1" 200 None
2026-03-26 18:31:41 [ayvens.es] INFO: Scrape type for 1985212: 1
2026-03-26 18:31:41 [ayvens.es] INFO: Extracting data for car ID: 1985212
2026-03-26 18:31:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eebec010-ddc3-5baa-b1ac-21eb5febd652 with identifier: 1985212
2026-03-26 18:31:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eebec010-ddc3-5baa-b1ac-21eb5febd652 with scrape type 1
2026-03-26 18:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item eebec010-ddc3-5baa-b1ac-21eb5febd652
2026-03-26 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F806%252F14755c318c0d454b9d25196383435770%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/806/14755c318c0d454b9d25196383435770/images/large/1.jpg not downloaded yet
2026-03-26 18:31:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1e20f061-a4f0-5bd0-9865-6c66ec93b95d with identifier: 1985197
2026-03-26 18:31:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1e20f061-a4f0-5bd0-9865-6c66ec93b95d with identifier: 1985197
2026-03-26 18:31:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1e20f061-a4f0-5bd0-9865-6c66ec93b95d with identifier: 1985197 to the API
2026-03-26 18:31:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/102/6452523af56a417f81faec4b87ef0411/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '1e20f061-a4f0-5bd0-9865-6c66ec93b95d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 105789,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e20f061-a4f0-5bd0-9865-6c66ec93b95d/1e20f061-a4f0-5bd0-9865-6c66ec93b95d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354127,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/102/6452523af56a417f81faec4b87ef0411/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO Intens E-Tech Hibrido 104 kW (140CV)',
 'transmission': 'manual',
 'trim': 'Intens E-Tech Hibrido 104 kW (140CV)',
 'vin': None,
 'year': 2021}
2026-03-26 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985197%27 HTTP/1.1" 200 None
2026-03-26 18:31:42 [ayvens.es] INFO: Saving data for 1985197: {'created_time': 1774549902.188018, 'last_price_update_time': 1774549902.188028, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985197') HTTP/1.1" 204 0
2026-03-26 18:31:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1af94db8-8c43-5128-a4f8-0aa1bb20f6ea with identifier: 1985199
2026-03-26 18:31:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1af94db8-8c43-5128-a4f8-0aa1bb20f6ea with identifier: 1985199
2026-03-26 18:31:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1af94db8-8c43-5128-a4f8-0aa1bb20f6ea with identifier: 1985199 to the API
2026-03-26 18:31:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/371/e7132af7ae844a7bb52cf1262f833657/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'gas',
 'id': '1af94db8-8c43-5128-a4f8-0aa1bb20f6ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 78641,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1af94db8-8c43-5128-a4f8-0aa1bb20f6ea/1af94db8-8c43-5128-a4f8-0aa1bb20f6ea_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340951,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/371/e7132af7ae844a7bb52cf1262f833657/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON 1.5 TGI 96kW S&S Style',
 'transmission': 'manual',
 'trim': '1.5 TGI 96kW S&S Style',
 'vin': None,
 'year': 2022}
2026-03-26 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985199%27 HTTP/1.1" 200 None
2026-03-26 18:31:42 [ayvens.es] INFO: Saving data for 1985199: {'created_time': 1774549902.491973, 'last_price_update_time': 1774549902.491984, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985199') HTTP/1.1" 204 0
2026-03-26 18:31:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 88e13dc8-0fa9-579a-82cf-568aaa1c0033 with identifier: 1985201
2026-03-26 18:31:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 88e13dc8-0fa9-579a-82cf-568aaa1c0033 with identifier: 1985201
2026-03-26 18:31:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 88e13dc8-0fa9-579a-82cf-568aaa1c0033 with identifier: 1985201 to the API
2026-03-26 18:31:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/947/eb922e34734f42c88760dcc300e49516/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 46,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.4L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '88e13dc8-0fa9-579a-82cf-568aaa1c0033',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'MITSUBISHI',
 'model': 'OUTLANDER',
 'odometer': 157349,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88e13dc8-0fa9-579a-82cf-568aaa1c0033/88e13dc8-0fa9-579a-82cf-568aaa1c0033_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 352175,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/947/eb922e34734f42c88760dcc300e49516/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MITSUBISHI OUTLANDER 2.4 PHEV Motion Auto 4WD',
 'transmission': 'manual',
 'trim': '2.4 PHEV Motion Auto 4WD',
 'vin': None,
 'year': 2019}
2026-03-26 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985201%27 HTTP/1.1" 200 None
2026-03-26 18:31:42 [ayvens.es] INFO: Saving data for 1985201: {'created_time': 1774549902.770469, 'last_price_update_time': 1774549902.77048, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985201') HTTP/1.1" 204 0
2026-03-26 18:31:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9fed9ad1-36a0-500b-af90-f92cff60bd6f with identifier: 1985200
2026-03-26 18:31:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9fed9ad1-36a0-500b-af90-f92cff60bd6f with identifier: 1985200
2026-03-26 18:31:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9fed9ad1-36a0-500b-af90-f92cff60bd6f with identifier: 1985200 to the API
2026-03-26 18:31:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/921/7b0ca2c5d6e64b618a6e9bce60d108af/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'Blanco perlado',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '9fed9ad1-36a0-500b-af90-f92cff60bd6f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'RAV4',
 'odometer': 176485,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fed9ad1-36a0-500b-af90-f92cff60bd6f/9fed9ad1-36a0-500b-af90-f92cff60bd6f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 482278,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/921/7b0ca2c5d6e64b618a6e9bce60d108af/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA RAV4 2.5l 220H Advance',
 'transmission': 'manual',
 'trim': '2.5l 220H Advance',
 'vin': None,
 'year': 2021}
2026-03-26 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985200%27 HTTP/1.1" 200 None
2026-03-26 18:31:43 [ayvens.es] INFO: Saving data for 1985200: {'created_time': 1774549903.061085, 'last_price_update_time': 1774549903.061095, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985200') HTTP/1.1" 204 0
2026-03-26 18:31:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b8a0e396-6e94-5f47-bd16-6d3c4ea14606 with identifier: 1985202
2026-03-26 18:31:43 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:31:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b8a0e396-6e94-5f47-bd16-6d3c4ea14606 with identifier: 1985202
2026-03-26 18:31:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b8a0e396-6e94-5f47-bd16-6d3c4ea14606 with identifier: 1985202 to the API
2026-03-26 18:31:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/045/dfbd915417084c2ab09cd30037b5005e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Blanco puro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'electric',
 'id': 'b8a0e396-6e94-5f47-bd16-6d3c4ea14606',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF',
 'odometer': 75249,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8a0e396-6e94-5f47-bd16-6d3c4ea14606/b8a0e396-6e94-5f47-bd16-6d3c4ea14606_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 326978,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/045/dfbd915417084c2ab09cd30037b5005e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF (O) e-Golf ePower 100 kW (136CV)',
 'transmission': 'manual',
 'trim': '(O) e-Golf ePower 100 kW (136CV)',
 'vin': None,
 'year': 2020}
2026-03-26 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985202%27 HTTP/1.1" 200 None
2026-03-26 18:31:43 [ayvens.es] INFO: Saving data for 1985202: {'created_time': 1774549903.38822, 'last_price_update_time': 1774549903.388231, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985202') HTTP/1.1" 204 0
2026-03-26 18:31:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/963/742914552c8a462d8a1617f2d4125b85/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/502/e93f238c795348a786d2eecfa5c62208/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/846/29a095ce12f740f39043c4033415effc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:43 [ayvens.es] INFO: Found listing with ID: 1985213
2026-03-26 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985213%27 HTTP/1.1" 200 None
2026-03-26 18:31:43 [ayvens.es] INFO: Scrape type for 1985213: 1
2026-03-26 18:31:43 [ayvens.es] INFO: Extracting data for car ID: 1985213
2026-03-26 18:31:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3612dd97-9556-5778-abc1-f40504da3817 with identifier: 1985213
2026-03-26 18:31:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3612dd97-9556-5778-abc1-f40504da3817 with scrape type 1
2026-03-26 18:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3612dd97-9556-5778-abc1-f40504da3817
2026-03-26 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F930%252F3c3cfca4ac70410fa1766dbfbab65387%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/930/3c3cfca4ac70410fa1766dbfbab65387/images/large/1.jpg not downloaded yet
2026-03-26 18:31:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/681/34b6d60385254d82a5f5d52704f1f32b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/179/9b163d7a48074a56ad3460911ff98d83/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:43 [ayvens.es] INFO: Found listing with ID: 1985214
2026-03-26 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985214%27 HTTP/1.1" 200 None
2026-03-26 18:31:43 [ayvens.es] INFO: Scrape type for 1985214: 1
2026-03-26 18:31:43 [ayvens.es] INFO: Extracting data for car ID: 1985214
2026-03-26 18:31:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 662f48b5-67b4-5d5d-9fcc-280ba769cf3a with identifier: 1985214
2026-03-26 18:31:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 662f48b5-67b4-5d5d-9fcc-280ba769cf3a with scrape type 1
2026-03-26 18:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 662f48b5-67b4-5d5d-9fcc-280ba769cf3a
2026-03-26 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F362%252F0368f045434f4beabcc7596d14cb0082%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/362/0368f045434f4beabcc7596d14cb0082/images/large/1.jpg not downloaded yet
2026-03-26 18:31:43 [ayvens.es] INFO: Found listing with ID: 1985215
2026-03-26 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985215%27 HTTP/1.1" 200 None
2026-03-26 18:31:43 [ayvens.es] INFO: Scrape type for 1985215: 1
2026-03-26 18:31:43 [ayvens.es] INFO: Extracting data for car ID: 1985215
2026-03-26 18:31:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a39be2f-4177-5c37-baf9-1d389265b6c2 with identifier: 1985215
2026-03-26 18:31:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a39be2f-4177-5c37-baf9-1d389265b6c2 with scrape type 1
2026-03-26 18:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3a39be2f-4177-5c37-baf9-1d389265b6c2
2026-03-26 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F723%252F10f635fd5c654892aad51123dc74f604%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/723/10f635fd5c654892aad51123dc74f604/images/large/1.jpg not downloaded yet
2026-03-26 18:31:43 [ayvens.es] INFO: Found listing with ID: 1985216
2026-03-26 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985216%27 HTTP/1.1" 200 None
2026-03-26 18:31:43 [ayvens.es] INFO: Scrape type for 1985216: 1
2026-03-26 18:31:43 [ayvens.es] INFO: Extracting data for car ID: 1985216
2026-03-26 18:31:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d7c22ed-fb4c-5db3-aec4-814e3e0e3fd6 with identifier: 1985216
2026-03-26 18:31:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d7c22ed-fb4c-5db3-aec4-814e3e0e3fd6 with scrape type 1
2026-03-26 18:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0d7c22ed-fb4c-5db3-aec4-814e3e0e3fd6
2026-03-26 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F080%252F166b6f41d2434eba8d6f80ed8c0e73cc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/080/166b6f41d2434eba8d6f80ed8c0e73cc/images/large/1.jpg not downloaded yet
2026-03-26 18:31:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28ab9910>
2026-03-26 18:31:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9c7a634-b2c0-5e43-9516-ec73e6d4d32d/c9c7a634-b2c0-5e43-9516-ec73e6d4d32d_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F963%252F742914552c8a462d8a1617f2d4125b85%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/963/742914552c8a462d8a1617f2d4125b85/images/large/1.jpg saved to cache
2026-03-26 18:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c9c7a634-b2c0-5e43-9516-ec73e6d4d32d
2026-03-26 18:31:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c9c7a634-b2c0-5e43-9516-ec73e6d4d32d, skipping ID generation
2026-03-26 18:31:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9c7a634-b2c0-5e43-9516-ec73e6d4d32d with scrape type 1
2026-03-26 18:31:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c9c7a634-b2c0-5e43-9516-ec73e6d4d32d sending to next pipeline
2026-03-26 18:31:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c9c7a634-b2c0-5e43-9516-ec73e6d4d32d, identifier: 1985206
2026-03-26 18:31:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28324050>
2026-03-26 18:31:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9df4cf14-416a-5cd1-9949-dcbedc0575dc/9df4cf14-416a-5cd1-9949-dcbedc0575dc_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F502%252Fe93f238c795348a786d2eecfa5c62208%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/502/e93f238c795348a786d2eecfa5c62208/images/large/1.jpg saved to cache
2026-03-26 18:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9df4cf14-416a-5cd1-9949-dcbedc0575dc
2026-03-26 18:31:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9df4cf14-416a-5cd1-9949-dcbedc0575dc, skipping ID generation
2026-03-26 18:31:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9df4cf14-416a-5cd1-9949-dcbedc0575dc with scrape type 1
2026-03-26 18:31:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9df4cf14-416a-5cd1-9949-dcbedc0575dc sending to next pipeline
2026-03-26 18:31:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9df4cf14-416a-5cd1-9949-dcbedc0575dc, identifier: 1985203
2026-03-26 18:31:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28396bd0>
2026-03-26 18:31:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e084e1de-f0ca-5deb-8c1e-9ae50dc26712/e084e1de-f0ca-5deb-8c1e-9ae50dc26712_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F846%252F29a095ce12f740f39043c4033415effc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/846/29a095ce12f740f39043c4033415effc/images/large/1.jpg saved to cache
2026-03-26 18:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e084e1de-f0ca-5deb-8c1e-9ae50dc26712
2026-03-26 18:31:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e084e1de-f0ca-5deb-8c1e-9ae50dc26712, skipping ID generation
2026-03-26 18:31:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e084e1de-f0ca-5deb-8c1e-9ae50dc26712 with scrape type 1
2026-03-26 18:31:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e084e1de-f0ca-5deb-8c1e-9ae50dc26712 sending to next pipeline
2026-03-26 18:31:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e084e1de-f0ca-5deb-8c1e-9ae50dc26712, identifier: 1985207
2026-03-26 18:31:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a282fc210>
2026-03-26 18:31:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17480154-3836-51d6-9448-45d2f2888894/17480154-3836-51d6-9448-45d2f2888894_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F681%252F34b6d60385254d82a5f5d52704f1f32b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/681/34b6d60385254d82a5f5d52704f1f32b/images/large/1.jpg saved to cache
2026-03-26 18:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 17480154-3836-51d6-9448-45d2f2888894
2026-03-26 18:31:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 17480154-3836-51d6-9448-45d2f2888894, skipping ID generation
2026-03-26 18:31:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17480154-3836-51d6-9448-45d2f2888894 with scrape type 1
2026-03-26 18:31:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 17480154-3836-51d6-9448-45d2f2888894 sending to next pipeline
2026-03-26 18:31:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 17480154-3836-51d6-9448-45d2f2888894, identifier: 1985205
2026-03-26 18:31:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/000/c6ec2402485f4a909f599049edca76d7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:44 [ayvens.es] INFO: Found listing with ID: 1985217
2026-03-26 18:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985217%27 HTTP/1.1" 200 None
2026-03-26 18:31:44 [ayvens.es] INFO: Scrape type for 1985217: 1
2026-03-26 18:31:44 [ayvens.es] INFO: Extracting data for car ID: 1985217
2026-03-26 18:31:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7e36ae8-062c-590e-b3af-0d219fb287d4 with identifier: 1985217
2026-03-26 18:31:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7e36ae8-062c-590e-b3af-0d219fb287d4 with scrape type 1
2026-03-26 18:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a7e36ae8-062c-590e-b3af-0d219fb287d4
2026-03-26 18:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F078%252F353df1837cfa4b29955f2abae6b246fd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/078/353df1837cfa4b29955f2abae6b246fd/images/large/1.jpg not downloaded yet
2026-03-26 18:31:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c9c7a634-b2c0-5e43-9516-ec73e6d4d32d with identifier: 1985206
2026-03-26 18:31:44 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:31:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c9c7a634-b2c0-5e43-9516-ec73e6d4d32d with identifier: 1985206
2026-03-26 18:31:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c9c7a634-b2c0-5e43-9516-ec73e6d4d32d with identifier: 1985206 to the API
2026-03-26 18:31:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/963/742914552c8a462d8a1617f2d4125b85/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Azul dusk metalizado',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'electric',
 'id': 'c9c7a634-b2c0-5e43-9516-ec73e6d4d32d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'ID.4',
 'odometer': 44898,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9c7a634-b2c0-5e43-9516-ec73e6d4d32d/c9c7a634-b2c0-5e43-9516-ec73e6d4d32d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 359688,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/963/742914552c8a462d8a1617f2d4125b85/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN ID.4 Pro 128kW (174CV) Automatico',
 'transmission': 'manual',
 'trim': 'Pro 128kW (174CV) Automatico',
 'vin': None,
 'year': 2023}
2026-03-26 18:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985206%27 HTTP/1.1" 200 None
2026-03-26 18:31:44 [ayvens.es] INFO: Saving data for 1985206: {'created_time': 1774549904.526176, 'last_price_update_time': 1774549904.526189, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985206') HTTP/1.1" 204 0
2026-03-26 18:31:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9df4cf14-416a-5cd1-9949-dcbedc0575dc with identifier: 1985203
2026-03-26 18:31:44 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:31:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9df4cf14-416a-5cd1-9949-dcbedc0575dc with identifier: 1985203
2026-03-26 18:31:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9df4cf14-416a-5cd1-9949-dcbedc0575dc with identifier: 1985203 to the API
2026-03-26 18:31:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/502/e93f238c795348a786d2eecfa5c62208/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Blanco glaciar metal',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'electric',
 'id': '9df4cf14-416a-5cd1-9949-dcbedc0575dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'ID.4',
 'odometer': 59678,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9df4cf14-416a-5cd1-9949-dcbedc0575dc/9df4cf14-416a-5cd1-9949-dcbedc0575dc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 360404,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/502/e93f238c795348a786d2eecfa5c62208/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN ID.4 Pro 128kW (174CV) Automatico',
 'transmission': 'manual',
 'trim': 'Pro 128kW (174CV) Automatico',
 'vin': None,
 'year': 2023}
2026-03-26 18:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985203%27 HTTP/1.1" 200 None
2026-03-26 18:31:44 [ayvens.es] INFO: Saving data for 1985203: {'created_time': 1774549904.839104, 'last_price_update_time': 1774549904.839117, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985203') HTTP/1.1" 204 0
2026-03-26 18:31:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e084e1de-f0ca-5deb-8c1e-9ae50dc26712 with identifier: 1985207
2026-03-26 18:31:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e084e1de-f0ca-5deb-8c1e-9ae50dc26712 with identifier: 1985207
2026-03-26 18:31:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e084e1de-f0ca-5deb-8c1e-9ae50dc26712 with identifier: 1985207 to the API
2026-03-26 18:31:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/846/29a095ce12f740f39043c4033415effc/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 92,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'gas',
 'id': 'e084e1de-f0ca-5deb-8c1e-9ae50dc26712',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'IBIZA',
 'odometer': 139348,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e084e1de-f0ca-5deb-8c1e-9ae50dc26712/e084e1de-f0ca-5deb-8c1e-9ae50dc26712_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332747,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/846/29a095ce12f740f39043c4033415effc/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT IBIZA 1.0 TGI 66kW (90CV) Reference Plus',
 'transmission': 'manual',
 'trim': '1.0 TGI 66kW (90CV) Reference Plus',
 'vin': None,
 'year': 2019}
2026-03-26 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985207%27 HTTP/1.1" 200 None
2026-03-26 18:31:45 [ayvens.es] INFO: Saving data for 1985207: {'created_time': 1774549905.629514, 'last_price_update_time': 1774549905.629528, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985207') HTTP/1.1" 204 0
2026-03-26 18:31:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 17480154-3836-51d6-9448-45d2f2888894 with identifier: 1985205
2026-03-26 18:31:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:31:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 17480154-3836-51d6-9448-45d2f2888894 with identifier: 1985205
2026-03-26 18:31:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 17480154-3836-51d6-9448-45d2f2888894 with identifier: 1985205 to the API
2026-03-26 18:31:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/681/34b6d60385254d82a5f5d52704f1f32b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 35,
 'color': 'Chrystal pearl',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '17480154-3836-51d6-9448-45d2f2888894',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS 7 CROSSBACK',
 'odometer': 51108,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17480154-3836-51d6-9448-45d2f2888894/17480154-3836-51d6-9448-45d2f2888894_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 360814,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/681/34b6d60385254d82a5f5d52704f1f32b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS 7 CROSSBACK 1.6 E-Tense 225 GRAND CHIC Auto',
 'transmission': 'manual',
 'trim': '1.6 E-Tense 225 GRAND CHIC Auto',
 'vin': None,
 'year': 2020}
2026-03-26 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985205%27 HTTP/1.1" 200 None
2026-03-26 18:31:45 [ayvens.es] INFO: Saving data for 1985205: {'created_time': 1774549905.941012, 'last_price_update_time': 1774549905.941026, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985205') HTTP/1.1" 204 0
2026-03-26 18:31:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a29004150>
2026-03-26 18:31:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6633572e-4d3c-5c80-8af8-3bbcd921054c/6633572e-4d3c-5c80-8af8-3bbcd921054c_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F179%252F9b163d7a48074a56ad3460911ff98d83%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/179/9b163d7a48074a56ad3460911ff98d83/images/large/1.jpg saved to cache
2026-03-26 18:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6633572e-4d3c-5c80-8af8-3bbcd921054c
2026-03-26 18:31:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6633572e-4d3c-5c80-8af8-3bbcd921054c, skipping ID generation
2026-03-26 18:31:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6633572e-4d3c-5c80-8af8-3bbcd921054c with scrape type 1
2026-03-26 18:31:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6633572e-4d3c-5c80-8af8-3bbcd921054c sending to next pipeline
2026-03-26 18:31:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6633572e-4d3c-5c80-8af8-3bbcd921054c, identifier: 1985204
2026-03-26 18:31:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/597/cd9d1e741f9d48669f7dee386308d7b7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:46 [ayvens.es] INFO: Found listing with ID: 1985218
2026-03-26 18:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985218%27 HTTP/1.1" 200 None
2026-03-26 18:31:46 [ayvens.es] INFO: Scrape type for 1985218: 1
2026-03-26 18:31:46 [ayvens.es] INFO: Extracting data for car ID: 1985218
2026-03-26 18:31:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe6c2483-40cf-54a2-91c7-d98bb8595802 with identifier: 1985218
2026-03-26 18:31:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe6c2483-40cf-54a2-91c7-d98bb8595802 with scrape type 1
2026-03-26 18:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item fe6c2483-40cf-54a2-91c7-d98bb8595802
2026-03-26 18:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F103%252F0f7f8b41b1a5423db869233bf8026c63%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/103/0f7f8b41b1a5423db869233bf8026c63/images/large/1.jpg not downloaded yet
2026-03-26 18:31:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6633572e-4d3c-5c80-8af8-3bbcd921054c with identifier: 1985204
2026-03-26 18:31:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6633572e-4d3c-5c80-8af8-3bbcd921054c with identifier: 1985204
2026-03-26 18:31:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 6633572e-4d3c-5c80-8af8-3bbcd921054c with identifier: 1985204 to the API
2026-03-26 18:31:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/179/9b163d7a48074a56ad3460911ff98d83/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Blanco neutro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'gas',
 'id': '6633572e-4d3c-5c80-8af8-3bbcd921054c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CAPTUR',
 'odometer': 75882,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6633572e-4d3c-5c80-8af8-3bbcd921054c/6633572e-4d3c-5c80-8af8-3bbcd921054c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 512257,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/179/9b163d7a48074a56ad3460911ff98d83/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CAPTUR Intens TCe 74kW (100CV) GLP',
 'transmission': 'manual',
 'trim': 'Intens TCe 74kW (100CV) GLP',
 'vin': None,
 'year': 2021}
2026-03-26 18:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985204%27 HTTP/1.1" 200 None
2026-03-26 18:31:46 [ayvens.es] INFO: Saving data for 1985204: {'created_time': 1774549906.451111, 'last_price_update_time': 1774549906.451121, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985204') HTTP/1.1" 204 0
2026-03-26 18:31:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c28110>
2026-03-26 18:31:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8535ebdc-e7ee-5a8b-88b7-fe9ac25f8ee9/8535ebdc-e7ee-5a8b-88b7-fe9ac25f8ee9_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F000%252Fc6ec2402485f4a909f599049edca76d7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/000/c6ec2402485f4a909f599049edca76d7/images/large/1.jpg saved to cache
2026-03-26 18:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8535ebdc-e7ee-5a8b-88b7-fe9ac25f8ee9
2026-03-26 18:31:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8535ebdc-e7ee-5a8b-88b7-fe9ac25f8ee9, skipping ID generation
2026-03-26 18:31:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8535ebdc-e7ee-5a8b-88b7-fe9ac25f8ee9 with scrape type 1
2026-03-26 18:31:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8535ebdc-e7ee-5a8b-88b7-fe9ac25f8ee9 sending to next pipeline
2026-03-26 18:31:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8535ebdc-e7ee-5a8b-88b7-fe9ac25f8ee9, identifier: 1985209
2026-03-26 18:31:46 [ayvens.es] INFO: Found listing with ID: 1985219
2026-03-26 18:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985219%27 HTTP/1.1" 200 None
2026-03-26 18:31:46 [ayvens.es] INFO: Scrape type for 1985219: 1
2026-03-26 18:31:46 [ayvens.es] INFO: Extracting data for car ID: 1985219
2026-03-26 18:31:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9f2f229-7257-5fc4-9b95-85ac62cceb94 with identifier: 1985219
2026-03-26 18:31:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9f2f229-7257-5fc4-9b95-85ac62cceb94 with scrape type 1
2026-03-26 18:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c9f2f229-7257-5fc4-9b95-85ac62cceb94
2026-03-26 18:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F847%252F41552535da364a67a21242222a356476%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/847/41552535da364a67a21242222a356476/images/large/1.jpg not downloaded yet
2026-03-26 18:31:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8535ebdc-e7ee-5a8b-88b7-fe9ac25f8ee9 with identifier: 1985209
2026-03-26 18:31:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:31:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8535ebdc-e7ee-5a8b-88b7-fe9ac25f8ee9 with identifier: 1985209
2026-03-26 18:31:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8535ebdc-e7ee-5a8b-88b7-fe9ac25f8ee9 with identifier: 1985209 to the API
2026-03-26 18:31:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/000/c6ec2402485f4a909f599049edca76d7/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Blanco glaciar',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'electric',
 'id': '8535ebdc-e7ee-5a8b-88b7-fe9ac25f8ee9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'ID.4',
 'odometer': 59565,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8535ebdc-e7ee-5a8b-88b7-fe9ac25f8ee9/8535ebdc-e7ee-5a8b-88b7-fe9ac25f8ee9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 623077,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/000/c6ec2402485f4a909f599049edca76d7/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN ID.4 Pure 109kW (149CV) Automatico',
 'transmission': 'manual',
 'trim': 'Pure 109kW (149CV) Automatico',
 'vin': None,
 'year': 2022}
2026-03-26 18:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985209%27 HTTP/1.1" 200 None
2026-03-26 18:31:47 [ayvens.es] INFO: Saving data for 1985209: {'created_time': 1774549907.069577, 'last_price_update_time': 1774549907.069588, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985209') HTTP/1.1" 204 0
2026-03-26 18:31:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/806/14755c318c0d454b9d25196383435770/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/244/9e9ddfd01b1b48839372baa1ac0ff594/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c30ad0>
2026-03-26 18:31:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ebbeefa-76a8-5f54-ae93-b62d12f85916/6ebbeefa-76a8-5f54-ae93-b62d12f85916_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F597%252Fcd9d1e741f9d48669f7dee386308d7b7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/597/cd9d1e741f9d48669f7dee386308d7b7/images/large/1.jpg saved to cache
2026-03-26 18:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6ebbeefa-76a8-5f54-ae93-b62d12f85916
2026-03-26 18:31:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6ebbeefa-76a8-5f54-ae93-b62d12f85916, skipping ID generation
2026-03-26 18:31:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ebbeefa-76a8-5f54-ae93-b62d12f85916 with scrape type 1
2026-03-26 18:31:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6ebbeefa-76a8-5f54-ae93-b62d12f85916 sending to next pipeline
2026-03-26 18:31:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6ebbeefa-76a8-5f54-ae93-b62d12f85916, identifier: 1985208
2026-03-26 18:31:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/930/3c3cfca4ac70410fa1766dbfbab65387/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/362/0368f045434f4beabcc7596d14cb0082/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/723/10f635fd5c654892aad51123dc74f604/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:47 [ayvens.es] INFO: Found listing with ID: 1985220
2026-03-26 18:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985220%27 HTTP/1.1" 200 None
2026-03-26 18:31:47 [ayvens.es] INFO: Scrape type for 1985220: 1
2026-03-26 18:31:47 [ayvens.es] INFO: Extracting data for car ID: 1985220
2026-03-26 18:31:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7826b2a4-bb05-5c19-947a-38e4645405c3 with identifier: 1985220
2026-03-26 18:31:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7826b2a4-bb05-5c19-947a-38e4645405c3 with scrape type 1
2026-03-26 18:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7826b2a4-bb05-5c19-947a-38e4645405c3
2026-03-26 18:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F642%252F63b62a77be6c4b6ea94d3fccb655335a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/642/63b62a77be6c4b6ea94d3fccb655335a/images/large/1.jpg not downloaded yet
2026-03-26 18:31:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6ebbeefa-76a8-5f54-ae93-b62d12f85916 with identifier: 1985208
2026-03-26 18:31:47 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:31:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6ebbeefa-76a8-5f54-ae93-b62d12f85916 with identifier: 1985208
2026-03-26 18:31:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 6ebbeefa-76a8-5f54-ae93-b62d12f85916 with identifier: 1985208 to the API
2026-03-26 18:31:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/597/cd9d1e741f9d48669f7dee386308d7b7/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Azul dusk',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'electric',
 'id': '6ebbeefa-76a8-5f54-ae93-b62d12f85916',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'ID.4',
 'odometer': 57178,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ebbeefa-76a8-5f54-ae93-b62d12f85916/6ebbeefa-76a8-5f54-ae93-b62d12f85916_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722495,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/597/cd9d1e741f9d48669f7dee386308d7b7/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN ID.4 Pro 128kW (174CV) Automatico',
 'transmission': 'manual',
 'trim': 'Pro 128kW (174CV) Automatico',
 'vin': None,
 'year': 2023}
2026-03-26 18:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985208%27 HTTP/1.1" 200 None
2026-03-26 18:31:47 [ayvens.es] INFO: Saving data for 1985208: {'created_time': 1774549907.564851, 'last_price_update_time': 1774549907.564861, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985208') HTTP/1.1" 204 0
2026-03-26 18:31:47 [ayvens.es] INFO: Found listing with ID: 1985221
2026-03-26 18:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985221%27 HTTP/1.1" 200 None
2026-03-26 18:31:47 [ayvens.es] INFO: Scrape type for 1985221: 1
2026-03-26 18:31:47 [ayvens.es] INFO: Extracting data for car ID: 1985221
2026-03-26 18:31:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 439d2d2d-8502-550b-a2d9-2e746538e4bd with identifier: 1985221
2026-03-26 18:31:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 439d2d2d-8502-550b-a2d9-2e746538e4bd with scrape type 1
2026-03-26 18:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 439d2d2d-8502-550b-a2d9-2e746538e4bd
2026-03-26 18:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F112%252Fe481b3fd7a8a4ee588c4a428c46a5e80%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/112/e481b3fd7a8a4ee588c4a428c46a5e80/images/large/1.jpg not downloaded yet
2026-03-26 18:31:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c18d90>
2026-03-26 18:31:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eebec010-ddc3-5baa-b1ac-21eb5febd652/eebec010-ddc3-5baa-b1ac-21eb5febd652_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F806%252F14755c318c0d454b9d25196383435770%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/806/14755c318c0d454b9d25196383435770/images/large/1.jpg saved to cache
2026-03-26 18:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eebec010-ddc3-5baa-b1ac-21eb5febd652
2026-03-26 18:31:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eebec010-ddc3-5baa-b1ac-21eb5febd652, skipping ID generation
2026-03-26 18:31:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eebec010-ddc3-5baa-b1ac-21eb5febd652 with scrape type 1
2026-03-26 18:31:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eebec010-ddc3-5baa-b1ac-21eb5febd652 sending to next pipeline
2026-03-26 18:31:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: eebec010-ddc3-5baa-b1ac-21eb5febd652, identifier: 1985212
2026-03-26 18:31:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a281fc850>
2026-03-26 18:31:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac369495-ea63-5174-a1fd-53f078eb85a6/ac369495-ea63-5174-a1fd-53f078eb85a6_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F244%252F9e9ddfd01b1b48839372baa1ac0ff594%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/244/9e9ddfd01b1b48839372baa1ac0ff594/images/large/1.jpg saved to cache
2026-03-26 18:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ac369495-ea63-5174-a1fd-53f078eb85a6
2026-03-26 18:31:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ac369495-ea63-5174-a1fd-53f078eb85a6, skipping ID generation
2026-03-26 18:31:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac369495-ea63-5174-a1fd-53f078eb85a6 with scrape type 1
2026-03-26 18:31:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ac369495-ea63-5174-a1fd-53f078eb85a6 sending to next pipeline
2026-03-26 18:31:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ac369495-ea63-5174-a1fd-53f078eb85a6, identifier: 1985210
2026-03-26 18:31:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c1ce50>
2026-03-26 18:31:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3612dd97-9556-5778-abc1-f40504da3817/3612dd97-9556-5778-abc1-f40504da3817_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F930%252F3c3cfca4ac70410fa1766dbfbab65387%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/930/3c3cfca4ac70410fa1766dbfbab65387/images/large/1.jpg saved to cache
2026-03-26 18:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3612dd97-9556-5778-abc1-f40504da3817
2026-03-26 18:31:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3612dd97-9556-5778-abc1-f40504da3817, skipping ID generation
2026-03-26 18:31:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3612dd97-9556-5778-abc1-f40504da3817 with scrape type 1
2026-03-26 18:31:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3612dd97-9556-5778-abc1-f40504da3817 sending to next pipeline
2026-03-26 18:31:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3612dd97-9556-5778-abc1-f40504da3817, identifier: 1985213
2026-03-26 18:31:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28230b90>
2026-03-26 18:31:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_662f48b5-67b4-5d5d-9fcc-280ba769cf3a/662f48b5-67b4-5d5d-9fcc-280ba769cf3a_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F362%252F0368f045434f4beabcc7596d14cb0082%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/362/0368f045434f4beabcc7596d14cb0082/images/large/1.jpg saved to cache
2026-03-26 18:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 662f48b5-67b4-5d5d-9fcc-280ba769cf3a
2026-03-26 18:31:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 662f48b5-67b4-5d5d-9fcc-280ba769cf3a, skipping ID generation
2026-03-26 18:31:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 662f48b5-67b4-5d5d-9fcc-280ba769cf3a with scrape type 1
2026-03-26 18:31:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 662f48b5-67b4-5d5d-9fcc-280ba769cf3a sending to next pipeline
2026-03-26 18:31:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 662f48b5-67b4-5d5d-9fcc-280ba769cf3a, identifier: 1985214
2026-03-26 18:31:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28ab9cd0>
2026-03-26 18:31:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a39be2f-4177-5c37-baf9-1d389265b6c2/3a39be2f-4177-5c37-baf9-1d389265b6c2_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F723%252F10f635fd5c654892aad51123dc74f604%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/723/10f635fd5c654892aad51123dc74f604/images/large/1.jpg saved to cache
2026-03-26 18:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3a39be2f-4177-5c37-baf9-1d389265b6c2
2026-03-26 18:31:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3a39be2f-4177-5c37-baf9-1d389265b6c2, skipping ID generation
2026-03-26 18:31:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a39be2f-4177-5c37-baf9-1d389265b6c2 with scrape type 1
2026-03-26 18:31:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3a39be2f-4177-5c37-baf9-1d389265b6c2 sending to next pipeline
2026-03-26 18:31:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3a39be2f-4177-5c37-baf9-1d389265b6c2, identifier: 1985215
2026-03-26 18:31:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/080/166b6f41d2434eba8d6f80ed8c0e73cc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:48 [ayvens.es] INFO: Found listing with ID: 1985222
2026-03-26 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985222%27 HTTP/1.1" 200 None
2026-03-26 18:31:48 [ayvens.es] INFO: Scrape type for 1985222: 1
2026-03-26 18:31:48 [ayvens.es] INFO: Extracting data for car ID: 1985222
2026-03-26 18:31:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2c607a8-fd12-5a15-ba17-191198776f07 with identifier: 1985222
2026-03-26 18:31:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2c607a8-fd12-5a15-ba17-191198776f07 with scrape type 1
2026-03-26 18:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f2c607a8-fd12-5a15-ba17-191198776f07
2026-03-26 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F486%252F72ce30568302478e952faecc5c368d01%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/486/72ce30568302478e952faecc5c368d01/images/large/1.jpg not downloaded yet
2026-03-26 18:31:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: eebec010-ddc3-5baa-b1ac-21eb5febd652 with identifier: 1985212
2026-03-26 18:31:48 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:31:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: eebec010-ddc3-5baa-b1ac-21eb5febd652 with identifier: 1985212
2026-03-26 18:31:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: eebec010-ddc3-5baa-b1ac-21eb5febd652 with identifier: 1985212 to the API
2026-03-26 18:31:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/806/14755c318c0d454b9d25196383435770/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'Negro agata',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'eebec010-ddc3-5baa-b1ac-21eb5febd652',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'KUGA',
 'odometer': 67437,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eebec010-ddc3-5baa-b1ac-21eb5febd652/eebec010-ddc3-5baa-b1ac-21eb5febd652_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 375379,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/806/14755c318c0d454b9d25196383435770/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD KUGA ST-Line X 2.5 Duratec FHEV Auto',
 'transmission': 'manual',
 'trim': 'ST-Line X 2.5 Duratec FHEV Auto',
 'vin': None,
 'year': 2022}
2026-03-26 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985212%27 HTTP/1.1" 200 None
2026-03-26 18:31:49 [ayvens.es] INFO: Saving data for 1985212: {'created_time': 1774549909.343369, 'last_price_update_time': 1774549909.343381, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985212') HTTP/1.1" 204 0
2026-03-26 18:31:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ac369495-ea63-5174-a1fd-53f078eb85a6 with identifier: 1985210
2026-03-26 18:31:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ac369495-ea63-5174-a1fd-53f078eb85a6 with identifier: 1985210
2026-03-26 18:31:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ac369495-ea63-5174-a1fd-53f078eb85a6 with identifier: 1985210 to the API
2026-03-26 18:31:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/244/9e9ddfd01b1b48839372baa1ac0ff594/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'color': 'Blanco glaciar',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'gas',
 'id': 'ac369495-ea63-5174-a1fd-53f078eb85a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 79264,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac369495-ea63-5174-a1fd-53f078eb85a6/ac369495-ea63-5174-a1fd-53f078eb85a6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 345290,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/244/9e9ddfd01b1b48839372baa1ac0ff594/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO Business TCe 74 kW (100CV) GLP',
 'transmission': 'manual',
 'trim': 'Business TCe 74 kW (100CV) GLP',
 'vin': None,
 'year': 2021}
2026-03-26 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985210%27 HTTP/1.1" 200 None
2026-03-26 18:31:49 [ayvens.es] INFO: Saving data for 1985210: {'created_time': 1774549909.726939, 'last_price_update_time': 1774549909.726948, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985210') HTTP/1.1" 204 0
2026-03-26 18:31:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3612dd97-9556-5778-abc1-f40504da3817 with identifier: 1985213
2026-03-26 18:31:49 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:31:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3612dd97-9556-5778-abc1-f40504da3817 with identifier: 1985213
2026-03-26 18:31:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3612dd97-9556-5778-abc1-f40504da3817 with identifier: 1985213 to the API
2026-03-26 18:31:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/930/3c3cfca4ac70410fa1766dbfbab65387/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'Deep cerulean blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '3612dd97-9556-5778-abc1-f40504da3817',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'NIRO',
 'odometer': 19611,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3612dd97-9556-5778-abc1-f40504da3817/3612dd97-9556-5778-abc1-f40504da3817_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 370239,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/930/3c3cfca4ac70410fa1766dbfbab65387/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA NIRO 1.6 GDi HEV 104kW (141CV) Drive',
 'transmission': 'manual',
 'trim': '1.6 GDi HEV 104kW (141CV) Drive',
 'vin': None,
 'year': 2021}
2026-03-26 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985213%27 HTTP/1.1" 200 None
2026-03-26 18:31:50 [ayvens.es] INFO: Saving data for 1985213: {'created_time': 1774549910.018135, 'last_price_update_time': 1774549910.018146, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985213') HTTP/1.1" 204 0
2026-03-26 18:31:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 662f48b5-67b4-5d5d-9fcc-280ba769cf3a with identifier: 1985214
2026-03-26 18:31:50 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:31:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 662f48b5-67b4-5d5d-9fcc-280ba769cf3a with identifier: 1985214
2026-03-26 18:31:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 662f48b5-67b4-5d5d-9fcc-280ba769cf3a with identifier: 1985214 to the API
2026-03-26 18:31:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/362/0368f045434f4beabcc7596d14cb0082/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Blanco sapporo',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'electric',
 'id': '662f48b5-67b4-5d5d-9fcc-280ba769cf3a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'LEAF',
 'odometer': 64639,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_662f48b5-67b4-5d5d-9fcc-280ba769cf3a/662f48b5-67b4-5d5d-9fcc-280ba769cf3a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329768,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/362/0368f045434f4beabcc7596d14cb0082/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN LEAF 40kWh Acenta',
 'transmission': 'manual',
 'trim': '40kWh Acenta',
 'vin': None,
 'year': 2022}
2026-03-26 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985214%27 HTTP/1.1" 200 None
2026-03-26 18:31:50 [ayvens.es] INFO: Saving data for 1985214: {'created_time': 1774549910.32456, 'last_price_update_time': 1774549910.32457, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985214') HTTP/1.1" 204 0
2026-03-26 18:31:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3a39be2f-4177-5c37-baf9-1d389265b6c2 with identifier: 1985215
2026-03-26 18:31:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3a39be2f-4177-5c37-baf9-1d389265b6c2 with identifier: 1985215
2026-03-26 18:31:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3a39be2f-4177-5c37-baf9-1d389265b6c2 with identifier: 1985215 to the API
2026-03-26 18:31:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/723/10f635fd5c654892aad51123dc74f604/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.6L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'gas',
 'id': '3a39be2f-4177-5c37-baf9-1d389265b6c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'DACIA',
 'model': 'DOKKER',
 'odometer': 177479,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a39be2f-4177-5c37-baf9-1d389265b6c2/3a39be2f-4177-5c37-baf9-1d389265b6c2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 315546,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/723/10f635fd5c654892aad51123dc74f604/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-22',
 'seats_number': 2,
 'seller_name': None,
 'title': 'DACIA DOKKER Van Essential 1.6 80kW (110CV) GLP+++Revisar '
          'peritacion+++',
 'transmission': 'manual',
 'trim': 'Van Essential 1.6 80kW (110CV) GLP+++Revisar peritacion+++',
 'vin': None,
 'year': 2020}
2026-03-26 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985215%27 HTTP/1.1" 200 None
2026-03-26 18:31:50 [ayvens.es] INFO: Saving data for 1985215: {'created_time': 1774549910.632155, 'last_price_update_time': 1774549910.632166, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985215') HTTP/1.1" 204 0
2026-03-26 18:31:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/078/353df1837cfa4b29955f2abae6b246fd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:50 [ayvens.es] INFO: Found listing with ID: 1985223
2026-03-26 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985223%27 HTTP/1.1" 200 None
2026-03-26 18:31:50 [ayvens.es] INFO: Scrape type for 1985223: 1
2026-03-26 18:31:50 [ayvens.es] INFO: Extracting data for car ID: 1985223
2026-03-26 18:31:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a2e24e8-0564-5264-9de1-d338837cbbb2 with identifier: 1985223
2026-03-26 18:31:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a2e24e8-0564-5264-9de1-d338837cbbb2 with scrape type 1
2026-03-26 18:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7a2e24e8-0564-5264-9de1-d338837cbbb2
2026-03-26 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F123%252Fb100a8aa60974f1d836f0f01ab4285b6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/123/b100a8aa60974f1d836f0f01ab4285b6/images/large/1.jpg not downloaded yet
2026-03-26 18:31:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/103/0f7f8b41b1a5423db869233bf8026c63/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a283dc5d0>
2026-03-26 18:31:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d7c22ed-fb4c-5db3-aec4-814e3e0e3fd6/0d7c22ed-fb4c-5db3-aec4-814e3e0e3fd6_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F080%252F166b6f41d2434eba8d6f80ed8c0e73cc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/080/166b6f41d2434eba8d6f80ed8c0e73cc/images/large/1.jpg saved to cache
2026-03-26 18:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0d7c22ed-fb4c-5db3-aec4-814e3e0e3fd6
2026-03-26 18:31:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0d7c22ed-fb4c-5db3-aec4-814e3e0e3fd6, skipping ID generation
2026-03-26 18:31:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d7c22ed-fb4c-5db3-aec4-814e3e0e3fd6 with scrape type 1
2026-03-26 18:31:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0d7c22ed-fb4c-5db3-aec4-814e3e0e3fd6 sending to next pipeline
2026-03-26 18:31:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0d7c22ed-fb4c-5db3-aec4-814e3e0e3fd6, identifier: 1985216
2026-03-26 18:31:50 [ayvens.es] INFO: Found listing with ID: 1985224
2026-03-26 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985224%27 HTTP/1.1" 200 None
2026-03-26 18:31:50 [ayvens.es] INFO: Scrape type for 1985224: 1
2026-03-26 18:31:50 [ayvens.es] INFO: Extracting data for car ID: 1985224
2026-03-26 18:31:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f01f338-4f6c-58a0-833d-fa000b04374b with identifier: 1985224
2026-03-26 18:31:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f01f338-4f6c-58a0-833d-fa000b04374b with scrape type 1
2026-03-26 18:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3f01f338-4f6c-58a0-833d-fa000b04374b
2026-03-26 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F243%252Fb3f9f735158f44968311cdd1e51f607f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/243/b3f9f735158f44968311cdd1e51f607f/images/large/1.jpg not downloaded yet
2026-03-26 18:31:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0d7c22ed-fb4c-5db3-aec4-814e3e0e3fd6 with identifier: 1985216
2026-03-26 18:31:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0d7c22ed-fb4c-5db3-aec4-814e3e0e3fd6 with identifier: 1985216
2026-03-26 18:31:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0d7c22ed-fb4c-5db3-aec4-814e3e0e3fd6 with identifier: 1985216 to the API
2026-03-26 18:31:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/080/166b6f41d2434eba8d6f80ed8c0e73cc/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Plata',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '0d7c22ed-fb4c-5db3-aec4-814e3e0e3fd6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'PRIUS+',
 'odometer': 38629,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d7c22ed-fb4c-5db3-aec4-814e3e0e3fd6/0d7c22ed-fb4c-5db3-aec4-814e3e0e3fd6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 361203,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/080/166b6f41d2434eba8d6f80ed8c0e73cc/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-01',
 'seats_number': 7,
 'seller_name': None,
 'title': 'TOYOTA PRIUS+ Advance+++Revisar peritacion+++',
 'transmission': 'manual',
 'trim': 'Advance+++Revisar peritacion+++',
 'vin': None,
 'year': 2020}
2026-03-26 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985216%27 HTTP/1.1" 200 None
2026-03-26 18:31:51 [ayvens.es] INFO: Saving data for 1985216: {'created_time': 1774549911.250136, 'last_price_update_time': 1774549911.250145, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985216') HTTP/1.1" 204 0
2026-03-26 18:31:51 [ayvens.es] INFO: Found listing with ID: 1985225
2026-03-26 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985225%27 HTTP/1.1" 200 None
2026-03-26 18:31:51 [ayvens.es] INFO: Scrape type for 1985225: 1
2026-03-26 18:31:51 [ayvens.es] INFO: Extracting data for car ID: 1985225
2026-03-26 18:31:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0314e08-c837-50d6-9839-5825c30361cd with identifier: 1985225
2026-03-26 18:31:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0314e08-c837-50d6-9839-5825c30361cd with scrape type 1
2026-03-26 18:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e0314e08-c837-50d6-9839-5825c30361cd
2026-03-26 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F365%252F8c4bae20da7f4716b63c664a81753b3d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/365/8c4bae20da7f4716b63c664a81753b3d/images/large/1.jpg not downloaded yet
2026-03-26 18:31:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a2820f390>
2026-03-26 18:31:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7e36ae8-062c-590e-b3af-0d219fb287d4/a7e36ae8-062c-590e-b3af-0d219fb287d4_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F078%252F353df1837cfa4b29955f2abae6b246fd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/078/353df1837cfa4b29955f2abae6b246fd/images/large/1.jpg saved to cache
2026-03-26 18:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a7e36ae8-062c-590e-b3af-0d219fb287d4
2026-03-26 18:31:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a7e36ae8-062c-590e-b3af-0d219fb287d4, skipping ID generation
2026-03-26 18:31:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7e36ae8-062c-590e-b3af-0d219fb287d4 with scrape type 1
2026-03-26 18:31:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a7e36ae8-062c-590e-b3af-0d219fb287d4 sending to next pipeline
2026-03-26 18:31:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a7e36ae8-062c-590e-b3af-0d219fb287d4, identifier: 1985217
2026-03-26 18:31:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c3e790>
2026-03-26 18:31:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe6c2483-40cf-54a2-91c7-d98bb8595802/fe6c2483-40cf-54a2-91c7-d98bb8595802_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F103%252F0f7f8b41b1a5423db869233bf8026c63%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/103/0f7f8b41b1a5423db869233bf8026c63/images/large/1.jpg saved to cache
2026-03-26 18:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fe6c2483-40cf-54a2-91c7-d98bb8595802
2026-03-26 18:31:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fe6c2483-40cf-54a2-91c7-d98bb8595802, skipping ID generation
2026-03-26 18:31:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe6c2483-40cf-54a2-91c7-d98bb8595802 with scrape type 1
2026-03-26 18:31:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fe6c2483-40cf-54a2-91c7-d98bb8595802 sending to next pipeline
2026-03-26 18:31:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: fe6c2483-40cf-54a2-91c7-d98bb8595802, identifier: 1985218
2026-03-26 18:31:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/642/63b62a77be6c4b6ea94d3fccb655335a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a7e36ae8-062c-590e-b3af-0d219fb287d4 with identifier: 1985217
2026-03-26 18:31:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a7e36ae8-062c-590e-b3af-0d219fb287d4 with identifier: 1985217
2026-03-26 18:31:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a7e36ae8-062c-590e-b3af-0d219fb287d4 with identifier: 1985217 to the API
2026-03-26 18:31:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/078/353df1837cfa4b29955f2abae6b246fd/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Plata',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'a7e36ae8-062c-590e-b3af-0d219fb287d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'PRIUS+',
 'odometer': 31897,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7e36ae8-062c-590e-b3af-0d219fb287d4/a7e36ae8-062c-590e-b3af-0d219fb287d4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 361635,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/078/353df1837cfa4b29955f2abae6b246fd/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-01',
 'seats_number': 7,
 'seller_name': None,
 'title': 'TOYOTA PRIUS+ Advance+++Revisar peritacion+++',
 'transmission': 'manual',
 'trim': 'Advance+++Revisar peritacion+++',
 'vin': None,
 'year': 2020}
2026-03-26 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985217%27 HTTP/1.1" 200 None
2026-03-26 18:31:51 [ayvens.es] INFO: Saving data for 1985217: {'created_time': 1774549911.95763, 'last_price_update_time': 1774549911.95764, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985217') HTTP/1.1" 204 0
2026-03-26 18:31:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: fe6c2483-40cf-54a2-91c7-d98bb8595802 with identifier: 1985218
2026-03-26 18:31:51 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:31:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: fe6c2483-40cf-54a2-91c7-d98bb8595802 with identifier: 1985218
2026-03-26 18:31:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: fe6c2483-40cf-54a2-91c7-d98bb8595802 with identifier: 1985218 to the API
2026-03-26 18:31:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/103/0f7f8b41b1a5423db869233bf8026c63/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'Rojo s',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.4L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'gas',
 'id': 'fe6c2483-40cf-54a2-91c7-d98bb8595802',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'FIORINO',
 'odometer': 173056,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe6c2483-40cf-54a2-91c7-d98bb8595802/fe6c2483-40cf-54a2-91c7-d98bb8595802_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 375093,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/103/0f7f8b41b1a5423db869233bf8026c63/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-02',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FIAT FIORINO Cargo Base 1.4 Natural Power 51kW (70CV)+++Revisar '
          'peritacion+++',
 'transmission': 'manual',
 'trim': 'Cargo Base 1.4 Natural Power 51kW (70CV)+++Revisar peritacion+++',
 'vin': None,
 'year': 2019}
2026-03-26 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985218%27 HTTP/1.1" 200 None
2026-03-26 18:31:52 [ayvens.es] INFO: Saving data for 1985218: {'created_time': 1774549912.278242, 'last_price_update_time': 1774549912.278253, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985218') HTTP/1.1" 204 0
2026-03-26 18:31:52 [ayvens.es] INFO: Found listing with ID: 1985226
2026-03-26 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985226%27 HTTP/1.1" 200 None
2026-03-26 18:31:52 [ayvens.es] INFO: Scrape type for 1985226: 1
2026-03-26 18:31:52 [ayvens.es] INFO: Extracting data for car ID: 1985226
2026-03-26 18:31:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05dadd5a-a202-509d-8650-627610c55d3e with identifier: 1985226
2026-03-26 18:31:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05dadd5a-a202-509d-8650-627610c55d3e with scrape type 1
2026-03-26 18:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 05dadd5a-a202-509d-8650-627610c55d3e
2026-03-26 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F844%252Ff690353191674a9db5d4b0f07f1c7228%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/844/f690353191674a9db5d4b0f07f1c7228/images/large/1.jpg not downloaded yet
2026-03-26 18:31:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/847/41552535da364a67a21242222a356476/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/112/e481b3fd7a8a4ee588c4a428c46a5e80/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:52 [ayvens.es] INFO: Found listing with ID: 1985227
2026-03-26 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985227%27 HTTP/1.1" 200 None
2026-03-26 18:31:52 [ayvens.es] INFO: Scrape type for 1985227: 1
2026-03-26 18:31:52 [ayvens.es] INFO: Extracting data for car ID: 1985227
2026-03-26 18:31:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 952eb965-dce7-51b1-9e46-673dfc38c910 with identifier: 1985227
2026-03-26 18:31:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 952eb965-dce7-51b1-9e46-673dfc38c910 with scrape type 1
2026-03-26 18:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 952eb965-dce7-51b1-9e46-673dfc38c910
2026-03-26 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F596%252F12ec8a131d9c41f38fb1f670f50b5cdd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/596/12ec8a131d9c41f38fb1f670f50b5cdd/images/large/1.jpg not downloaded yet
2026-03-26 18:31:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28347dd0>
2026-03-26 18:31:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7826b2a4-bb05-5c19-947a-38e4645405c3/7826b2a4-bb05-5c19-947a-38e4645405c3_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F642%252F63b62a77be6c4b6ea94d3fccb655335a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/642/63b62a77be6c4b6ea94d3fccb655335a/images/large/1.jpg saved to cache
2026-03-26 18:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7826b2a4-bb05-5c19-947a-38e4645405c3
2026-03-26 18:31:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7826b2a4-bb05-5c19-947a-38e4645405c3, skipping ID generation
2026-03-26 18:31:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7826b2a4-bb05-5c19-947a-38e4645405c3 with scrape type 1
2026-03-26 18:31:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7826b2a4-bb05-5c19-947a-38e4645405c3 sending to next pipeline
2026-03-26 18:31:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7826b2a4-bb05-5c19-947a-38e4645405c3, identifier: 1985220
2026-03-26 18:31:52 [ayvens.es] INFO: Found listing with ID: 1985228
2026-03-26 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985228%27 HTTP/1.1" 200 None
2026-03-26 18:31:52 [ayvens.es] INFO: Scrape type for 1985228: 1
2026-03-26 18:31:52 [ayvens.es] INFO: Extracting data for car ID: 1985228
2026-03-26 18:31:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17f36c9e-9525-5903-b565-e9a39b21aa83 with identifier: 1985228
2026-03-26 18:31:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17f36c9e-9525-5903-b565-e9a39b21aa83 with scrape type 1
2026-03-26 18:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 17f36c9e-9525-5903-b565-e9a39b21aa83
2026-03-26 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F924%252F76dc13dd690545f4adca216ba95a66f4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/924/76dc13dd690545f4adca216ba95a66f4/images/large/1.jpg not downloaded yet
2026-03-26 18:31:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7826b2a4-bb05-5c19-947a-38e4645405c3 with identifier: 1985220
2026-03-26 18:31:52 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:31:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7826b2a4-bb05-5c19-947a-38e4645405c3 with identifier: 1985220
2026-03-26 18:31:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7826b2a4-bb05-5c19-947a-38e4645405c3 with identifier: 1985220 to the API
2026-03-26 18:31:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/642/63b62a77be6c4b6ea94d3fccb655335a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Negro granadilla met',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'electric',
 'id': '7826b2a4-bb05-5c19-947a-38e4645405c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'ID.4',
 'odometer': 98817,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7826b2a4-bb05-5c19-947a-38e4645405c3/7826b2a4-bb05-5c19-947a-38e4645405c3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353112,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/642/63b62a77be6c4b6ea94d3fccb655335a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN ID.4 GTX 220kW (299CV) Automatico',
 'transmission': 'manual',
 'trim': 'GTX 220kW (299CV) Automatico',
 'vin': None,
 'year': 2023}
2026-03-26 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985220%27 HTTP/1.1" 200 None
2026-03-26 18:31:52 [ayvens.es] INFO: Saving data for 1985220: {'created_time': 1774549912.925047, 'last_price_update_time': 1774549912.925061, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985220') HTTP/1.1" 204 0
2026-03-26 18:31:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/123/b100a8aa60974f1d836f0f01ab4285b6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/486/72ce30568302478e952faecc5c368d01/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:52 [ayvens.es] INFO: Found listing with ID: 1985229
2026-03-26 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985229%27 HTTP/1.1" 200 None
2026-03-26 18:31:52 [ayvens.es] INFO: Scrape type for 1985229: 1
2026-03-26 18:31:52 [ayvens.es] INFO: Extracting data for car ID: 1985229
2026-03-26 18:31:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50a6426d-d5e8-5885-a5b4-3bbe2b9a8f8e with identifier: 1985229
2026-03-26 18:31:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50a6426d-d5e8-5885-a5b4-3bbe2b9a8f8e with scrape type 1
2026-03-26 18:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 50a6426d-d5e8-5885-a5b4-3bbe2b9a8f8e
2026-03-26 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F122%252Fa1e761945e0d443e8826c6e9b7af5875%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/122/a1e761945e0d443e8826c6e9b7af5875/images/large/1.jpg not downloaded yet
2026-03-26 18:31:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a29030610>
2026-03-26 18:31:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9f2f229-7257-5fc4-9b95-85ac62cceb94/c9f2f229-7257-5fc4-9b95-85ac62cceb94_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F847%252F41552535da364a67a21242222a356476%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/847/41552535da364a67a21242222a356476/images/large/1.jpg saved to cache
2026-03-26 18:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c9f2f229-7257-5fc4-9b95-85ac62cceb94
2026-03-26 18:31:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c9f2f229-7257-5fc4-9b95-85ac62cceb94, skipping ID generation
2026-03-26 18:31:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9f2f229-7257-5fc4-9b95-85ac62cceb94 with scrape type 1
2026-03-26 18:31:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c9f2f229-7257-5fc4-9b95-85ac62cceb94 sending to next pipeline
2026-03-26 18:31:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c9f2f229-7257-5fc4-9b95-85ac62cceb94, identifier: 1985219
2026-03-26 18:31:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28326a90>
2026-03-26 18:31:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_439d2d2d-8502-550b-a2d9-2e746538e4bd/439d2d2d-8502-550b-a2d9-2e746538e4bd_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F112%252Fe481b3fd7a8a4ee588c4a428c46a5e80%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/112/e481b3fd7a8a4ee588c4a428c46a5e80/images/large/1.jpg saved to cache
2026-03-26 18:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 439d2d2d-8502-550b-a2d9-2e746538e4bd
2026-03-26 18:31:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 439d2d2d-8502-550b-a2d9-2e746538e4bd, skipping ID generation
2026-03-26 18:31:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 439d2d2d-8502-550b-a2d9-2e746538e4bd with scrape type 1
2026-03-26 18:31:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 439d2d2d-8502-550b-a2d9-2e746538e4bd sending to next pipeline
2026-03-26 18:31:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 439d2d2d-8502-550b-a2d9-2e746538e4bd, identifier: 1985221
2026-03-26 18:31:53 [ayvens.es] INFO: Found listing with ID: 1985230
2026-03-26 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985230%27 HTTP/1.1" 200 None
2026-03-26 18:31:53 [ayvens.es] INFO: Scrape type for 1985230: 1
2026-03-26 18:31:53 [ayvens.es] INFO: Extracting data for car ID: 1985230
2026-03-26 18:31:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e63ebf3-ed7b-5968-9cd3-fb1bca1dd365 with identifier: 1985230
2026-03-26 18:31:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e63ebf3-ed7b-5968-9cd3-fb1bca1dd365 with scrape type 1
2026-03-26 18:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6e63ebf3-ed7b-5968-9cd3-fb1bca1dd365
2026-03-26 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F193%252F9ce0e61292f44c67b94cad367049f0bf%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/193/9ce0e61292f44c67b94cad367049f0bf/images/large/1.jpg not downloaded yet
2026-03-26 18:31:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c9f2f229-7257-5fc4-9b95-85ac62cceb94 with identifier: 1985219
2026-03-26 18:31:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c9f2f229-7257-5fc4-9b95-85ac62cceb94 with identifier: 1985219
2026-03-26 18:31:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c9f2f229-7257-5fc4-9b95-85ac62cceb94 with identifier: 1985219 to the API
2026-03-26 18:31:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/847/41552535da364a67a21242222a356476/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 30,
 'color': 'Gris artense',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'c9f2f229-7257-5fc4-9b95-85ac62cceb94',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 105186,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9f2f229-7257-5fc4-9b95-85ac62cceb94/c9f2f229-7257-5fc4-9b95-85ac62cceb94_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 558800,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/847/41552535da364a67a21242222a356476/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 300 e-EAT8 GT+++Revisar peritacion+++',
 'transmission': 'manual',
 'trim': '300 e-EAT8 GT+++Revisar peritacion+++',
 'vin': None,
 'year': 2022}
2026-03-26 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985219%27 HTTP/1.1" 200 None
2026-03-26 18:31:53 [ayvens.es] INFO: Saving data for 1985219: {'created_time': 1774549913.71565, 'last_price_update_time': 1774549913.715661, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985219') HTTP/1.1" 204 0
2026-03-26 18:31:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 439d2d2d-8502-550b-a2d9-2e746538e4bd with identifier: 1985221
2026-03-26 18:31:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 439d2d2d-8502-550b-a2d9-2e746538e4bd with identifier: 1985221
2026-03-26 18:31:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 439d2d2d-8502-550b-a2d9-2e746538e4bd with identifier: 1985221 to the API
2026-03-26 18:31:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/112/e481b3fd7a8a4ee588c4a428c46a5e80/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'Rojo s',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.4L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'gas',
 'id': '439d2d2d-8502-550b-a2d9-2e746538e4bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'FIORINO',
 'odometer': 142694,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_439d2d2d-8502-550b-a2d9-2e746538e4bd/439d2d2d-8502-550b-a2d9-2e746538e4bd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 355105,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/112/e481b3fd7a8a4ee588c4a428c46a5e80/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-02',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FIAT FIORINO Cargo Base 1.4 Natural Power 51kW (70CV)',
 'transmission': 'manual',
 'trim': 'Cargo Base 1.4 Natural Power 51kW (70CV)',
 'vin': None,
 'year': 2019}
2026-03-26 18:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985221%27 HTTP/1.1" 200 None
2026-03-26 18:31:54 [ayvens.es] INFO: Saving data for 1985221: {'created_time': 1774549914.040352, 'last_price_update_time': 1774549914.040362, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985221') HTTP/1.1" 204 0
2026-03-26 18:31:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/243/b3f9f735158f44968311cdd1e51f607f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:54 [ayvens.es] INFO: Found listing with ID: 1985231
2026-03-26 18:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985231%27 HTTP/1.1" 200 None
2026-03-26 18:31:54 [ayvens.es] INFO: Scrape type for 1985231: 1
2026-03-26 18:31:54 [ayvens.es] INFO: Extracting data for car ID: 1985231
2026-03-26 18:31:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a295b77b-797a-5183-8297-97711347456c with identifier: 1985231
2026-03-26 18:31:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a295b77b-797a-5183-8297-97711347456c with scrape type 1
2026-03-26 18:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a295b77b-797a-5183-8297-97711347456c
2026-03-26 18:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F466%252F71d42d525f154db4b7921e4537c78167%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/466/71d42d525f154db4b7921e4537c78167/images/large/1.jpg not downloaded yet
2026-03-26 18:31:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a29062ad0>
2026-03-26 18:31:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a2e24e8-0564-5264-9de1-d338837cbbb2/7a2e24e8-0564-5264-9de1-d338837cbbb2_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F123%252Fb100a8aa60974f1d836f0f01ab4285b6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/123/b100a8aa60974f1d836f0f01ab4285b6/images/large/1.jpg saved to cache
2026-03-26 18:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7a2e24e8-0564-5264-9de1-d338837cbbb2
2026-03-26 18:31:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7a2e24e8-0564-5264-9de1-d338837cbbb2, skipping ID generation
2026-03-26 18:31:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a2e24e8-0564-5264-9de1-d338837cbbb2 with scrape type 1
2026-03-26 18:31:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7a2e24e8-0564-5264-9de1-d338837cbbb2 sending to next pipeline
2026-03-26 18:31:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7a2e24e8-0564-5264-9de1-d338837cbbb2, identifier: 1985223
2026-03-26 18:31:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a282fe510>
2026-03-26 18:31:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2c607a8-fd12-5a15-ba17-191198776f07/f2c607a8-fd12-5a15-ba17-191198776f07_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F486%252F72ce30568302478e952faecc5c368d01%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/486/72ce30568302478e952faecc5c368d01/images/large/1.jpg saved to cache
2026-03-26 18:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f2c607a8-fd12-5a15-ba17-191198776f07
2026-03-26 18:31:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f2c607a8-fd12-5a15-ba17-191198776f07, skipping ID generation
2026-03-26 18:31:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2c607a8-fd12-5a15-ba17-191198776f07 with scrape type 1
2026-03-26 18:31:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f2c607a8-fd12-5a15-ba17-191198776f07 sending to next pipeline
2026-03-26 18:31:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f2c607a8-fd12-5a15-ba17-191198776f07, identifier: 1985222
2026-03-26 18:31:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/365/8c4bae20da7f4716b63c664a81753b3d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:54 [ayvens.es] INFO: Found listing with ID: 1985232
2026-03-26 18:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985232%27 HTTP/1.1" 200 None
2026-03-26 18:31:54 [ayvens.es] INFO: Scrape type for 1985232: 1
2026-03-26 18:31:54 [ayvens.es] INFO: Extracting data for car ID: 1985232
2026-03-26 18:31:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8be744e8-15fc-5d8b-b649-c57f35e37d86 with identifier: 1985232
2026-03-26 18:31:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8be744e8-15fc-5d8b-b649-c57f35e37d86 with scrape type 1
2026-03-26 18:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8be744e8-15fc-5d8b-b649-c57f35e37d86
2026-03-26 18:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F434%252F99734278b098458e9295bc2f466b5901%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/434/99734278b098458e9295bc2f466b5901/images/large/1.jpg not downloaded yet
2026-03-26 18:31:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7a2e24e8-0564-5264-9de1-d338837cbbb2 with identifier: 1985223
2026-03-26 18:31:54 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:31:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7a2e24e8-0564-5264-9de1-d338837cbbb2 with identifier: 1985223
2026-03-26 18:31:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7a2e24e8-0564-5264-9de1-d338837cbbb2 with identifier: 1985223 to the API
2026-03-26 18:31:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/123/b100a8aa60974f1d836f0f01ab4285b6/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Blanco nacarado',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'gas',
 'id': '7a2e24e8-0564-5264-9de1-d338837cbbb2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CAPTUR',
 'odometer': 104673,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a2e24e8-0564-5264-9de1-d338837cbbb2/7a2e24e8-0564-5264-9de1-d338837cbbb2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 341960,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/123/b100a8aa60974f1d836f0f01ab4285b6/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CAPTUR Intens TCe 74kW (100CV) GLP',
 'transmission': 'manual',
 'trim': 'Intens TCe 74kW (100CV) GLP',
 'vin': None,
 'year': 2022}
2026-03-26 18:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985223%27 HTTP/1.1" 200 None
2026-03-26 18:31:54 [ayvens.es] INFO: Saving data for 1985223: {'created_time': 1774549914.856642, 'last_price_update_time': 1774549914.856651, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985223') HTTP/1.1" 204 0
2026-03-26 18:31:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f2c607a8-fd12-5a15-ba17-191198776f07 with identifier: 1985222
2026-03-26 18:31:54 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:31:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f2c607a8-fd12-5a15-ba17-191198776f07 with identifier: 1985222
2026-03-26 18:31:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f2c607a8-fd12-5a15-ba17-191198776f07 with identifier: 1985222 to the API
2026-03-26 18:31:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/486/72ce30568302478e952faecc5c368d01/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 49,
 'color': 'Portofino blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'f2c607a8-fd12-5a15-ba17-191198776f07',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'JAGUAR',
 'model': 'F-PACE',
 'odometer': 97985,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2c607a8-fd12-5a15-ba17-191198776f07/f2c607a8-fd12-5a15-ba17-191198776f07_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 392509,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/486/72ce30568302478e952faecc5c368d01/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'JAGUAR F-PACE 2.0 I4 PHEV 404PS AWD Auto Standard S',
 'transmission': 'manual',
 'trim': '2.0 I4 PHEV 404PS AWD Auto Standard S',
 'vin': None,
 'year': 2022}
2026-03-26 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985222%27 HTTP/1.1" 200 None
2026-03-26 18:31:55 [ayvens.es] INFO: Saving data for 1985222: {'created_time': 1774549915.184576, 'last_price_update_time': 1774549915.184586, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985222') HTTP/1.1" 204 0
2026-03-26 18:31:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/596/12ec8a131d9c41f38fb1f670f50b5cdd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:55 [ayvens.es] INFO: Found listing with ID: 1985233
2026-03-26 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985233%27 HTTP/1.1" 200 None
2026-03-26 18:31:55 [ayvens.es] INFO: Scrape type for 1985233: 1
2026-03-26 18:31:55 [ayvens.es] INFO: Extracting data for car ID: 1985233
2026-03-26 18:31:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45574acf-e6b6-5188-989f-51a3a70cd466 with identifier: 1985233
2026-03-26 18:31:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45574acf-e6b6-5188-989f-51a3a70cd466 with scrape type 1
2026-03-26 18:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 45574acf-e6b6-5188-989f-51a3a70cd466
2026-03-26 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F039%252F9f31f4322c8f4ca3b00ee72e26fdf794%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/039/9f31f4322c8f4ca3b00ee72e26fdf794/images/large/1.jpg not downloaded yet
2026-03-26 18:31:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/844/f690353191674a9db5d4b0f07f1c7228/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/924/76dc13dd690545f4adca216ba95a66f4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a283e1e90>
2026-03-26 18:31:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f01f338-4f6c-58a0-833d-fa000b04374b/3f01f338-4f6c-58a0-833d-fa000b04374b_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F243%252Fb3f9f735158f44968311cdd1e51f607f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/243/b3f9f735158f44968311cdd1e51f607f/images/large/1.jpg saved to cache
2026-03-26 18:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3f01f338-4f6c-58a0-833d-fa000b04374b
2026-03-26 18:31:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3f01f338-4f6c-58a0-833d-fa000b04374b, skipping ID generation
2026-03-26 18:31:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f01f338-4f6c-58a0-833d-fa000b04374b with scrape type 1
2026-03-26 18:31:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3f01f338-4f6c-58a0-833d-fa000b04374b sending to next pipeline
2026-03-26 18:31:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3f01f338-4f6c-58a0-833d-fa000b04374b, identifier: 1985224
2026-03-26 18:31:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a283cbc90>
2026-03-26 18:31:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0314e08-c837-50d6-9839-5825c30361cd/e0314e08-c837-50d6-9839-5825c30361cd_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F365%252F8c4bae20da7f4716b63c664a81753b3d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/365/8c4bae20da7f4716b63c664a81753b3d/images/large/1.jpg saved to cache
2026-03-26 18:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e0314e08-c837-50d6-9839-5825c30361cd
2026-03-26 18:31:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e0314e08-c837-50d6-9839-5825c30361cd, skipping ID generation
2026-03-26 18:31:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0314e08-c837-50d6-9839-5825c30361cd with scrape type 1
2026-03-26 18:31:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e0314e08-c837-50d6-9839-5825c30361cd sending to next pipeline
2026-03-26 18:31:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e0314e08-c837-50d6-9839-5825c30361cd, identifier: 1985225
2026-03-26 18:31:55 [ayvens.es] INFO: Found listing with ID: 1985234
2026-03-26 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985234%27 HTTP/1.1" 200 None
2026-03-26 18:31:55 [ayvens.es] INFO: Scrape type for 1985234: 1
2026-03-26 18:31:55 [ayvens.es] INFO: Extracting data for car ID: 1985234
2026-03-26 18:31:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b03975ea-196c-57ba-b490-a8f47e8bbfe6 with identifier: 1985234
2026-03-26 18:31:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b03975ea-196c-57ba-b490-a8f47e8bbfe6 with scrape type 1
2026-03-26 18:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b03975ea-196c-57ba-b490-a8f47e8bbfe6
2026-03-26 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F234%252F6300b5437e634dddbd7a53ef821f9493%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/234/6300b5437e634dddbd7a53ef821f9493/images/large/1.jpg not downloaded yet
2026-03-26 18:31:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3f01f338-4f6c-58a0-833d-fa000b04374b with identifier: 1985224
2026-03-26 18:31:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3f01f338-4f6c-58a0-833d-fa000b04374b with identifier: 1985224
2026-03-26 18:31:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3f01f338-4f6c-58a0-833d-fa000b04374b with identifier: 1985224 to the API
2026-03-26 18:31:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/243/b3f9f735158f44968311cdd1e51f607f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'color': 'Blanco glaciar',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'gas',
 'id': '3f01f338-4f6c-58a0-833d-fa000b04374b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 136204,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f01f338-4f6c-58a0-833d-fa000b04374b/3f01f338-4f6c-58a0-833d-fa000b04374b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 360646,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/243/b3f9f735158f44968311cdd1e51f607f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO Business TCe 74 kW (100CV) GLP',
 'transmission': 'manual',
 'trim': 'Business TCe 74 kW (100CV) GLP',
 'vin': None,
 'year': 2021}
2026-03-26 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985224%27 HTTP/1.1" 200 None
2026-03-26 18:31:55 [ayvens.es] INFO: Saving data for 1985224: {'created_time': 1774549915.97207, 'last_price_update_time': 1774549915.972082, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985224') HTTP/1.1" 204 0
2026-03-26 18:31:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e0314e08-c837-50d6-9839-5825c30361cd with identifier: 1985225
2026-03-26 18:31:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e0314e08-c837-50d6-9839-5825c30361cd with identifier: 1985225
2026-03-26 18:31:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e0314e08-c837-50d6-9839-5825c30361cd with identifier: 1985225 to the API
2026-03-26 18:31:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/365/8c4bae20da7f4716b63c664a81753b3d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Blanco puro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'electric',
 'id': 'e0314e08-c837-50d6-9839-5825c30361cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF',
 'odometer': 37998,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0314e08-c837-50d6-9839-5825c30361cd/e0314e08-c837-50d6-9839-5825c30361cd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 453330,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/365/8c4bae20da7f4716b63c664a81753b3d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF (O) e-Golf ePower 100 kW (136CV)',
 'transmission': 'manual',
 'trim': '(O) e-Golf ePower 100 kW (136CV)',
 'vin': None,
 'year': 2020}
2026-03-26 18:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985225%27 HTTP/1.1" 200 None
2026-03-26 18:31:56 [ayvens.es] INFO: Saving data for 1985225: {'created_time': 1774549916.407771, 'last_price_update_time': 1774549916.407782, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985225') HTTP/1.1" 204 0
2026-03-26 18:31:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/122/a1e761945e0d443e8826c6e9b7af5875/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:56 [ayvens.es] INFO: Found listing with ID: 1985235
2026-03-26 18:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985235%27 HTTP/1.1" 200 None
2026-03-26 18:31:56 [ayvens.es] INFO: Scrape type for 1985235: 1
2026-03-26 18:31:56 [ayvens.es] INFO: Extracting data for car ID: 1985235
2026-03-26 18:31:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e44e9013-d0d5-59df-8586-c0514ce0fa8f with identifier: 1985235
2026-03-26 18:31:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e44e9013-d0d5-59df-8586-c0514ce0fa8f with scrape type 1
2026-03-26 18:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e44e9013-d0d5-59df-8586-c0514ce0fa8f
2026-03-26 18:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F384%252Ff16fc5386bd44fd9925b46f5ae87f845%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/384/f16fc5386bd44fd9925b46f5ae87f845/images/large/1.jpg not downloaded yet
2026-03-26 18:31:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a281f8d90>
2026-03-26 18:31:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_952eb965-dce7-51b1-9e46-673dfc38c910/952eb965-dce7-51b1-9e46-673dfc38c910_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F596%252F12ec8a131d9c41f38fb1f670f50b5cdd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/596/12ec8a131d9c41f38fb1f670f50b5cdd/images/large/1.jpg saved to cache
2026-03-26 18:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 952eb965-dce7-51b1-9e46-673dfc38c910
2026-03-26 18:31:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 952eb965-dce7-51b1-9e46-673dfc38c910, skipping ID generation
2026-03-26 18:31:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 952eb965-dce7-51b1-9e46-673dfc38c910 with scrape type 1
2026-03-26 18:31:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 952eb965-dce7-51b1-9e46-673dfc38c910 sending to next pipeline
2026-03-26 18:31:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 952eb965-dce7-51b1-9e46-673dfc38c910, identifier: 1985227
2026-03-26 18:31:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c18610>
2026-03-26 18:31:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05dadd5a-a202-509d-8650-627610c55d3e/05dadd5a-a202-509d-8650-627610c55d3e_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F844%252Ff690353191674a9db5d4b0f07f1c7228%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/844/f690353191674a9db5d4b0f07f1c7228/images/large/1.jpg saved to cache
2026-03-26 18:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 05dadd5a-a202-509d-8650-627610c55d3e
2026-03-26 18:31:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 05dadd5a-a202-509d-8650-627610c55d3e, skipping ID generation
2026-03-26 18:31:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05dadd5a-a202-509d-8650-627610c55d3e with scrape type 1
2026-03-26 18:31:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 05dadd5a-a202-509d-8650-627610c55d3e sending to next pipeline
2026-03-26 18:31:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 05dadd5a-a202-509d-8650-627610c55d3e, identifier: 1985226
2026-03-26 18:31:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28d1c810>
2026-03-26 18:31:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17f36c9e-9525-5903-b565-e9a39b21aa83/17f36c9e-9525-5903-b565-e9a39b21aa83_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F924%252F76dc13dd690545f4adca216ba95a66f4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/924/76dc13dd690545f4adca216ba95a66f4/images/large/1.jpg saved to cache
2026-03-26 18:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 17f36c9e-9525-5903-b565-e9a39b21aa83
2026-03-26 18:31:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 17f36c9e-9525-5903-b565-e9a39b21aa83, skipping ID generation
2026-03-26 18:31:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17f36c9e-9525-5903-b565-e9a39b21aa83 with scrape type 1
2026-03-26 18:31:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 17f36c9e-9525-5903-b565-e9a39b21aa83 sending to next pipeline
2026-03-26 18:31:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 17f36c9e-9525-5903-b565-e9a39b21aa83, identifier: 1985228
2026-03-26 18:31:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 952eb965-dce7-51b1-9e46-673dfc38c910 with identifier: 1985227
2026-03-26 18:31:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 952eb965-dce7-51b1-9e46-673dfc38c910 with identifier: 1985227
2026-03-26 18:31:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 952eb965-dce7-51b1-9e46-673dfc38c910 with identifier: 1985227 to the API
2026-03-26 18:31:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/596/12ec8a131d9c41f38fb1f670f50b5cdd/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Gris himalaya',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'electric',
 'id': '952eb965-dce7-51b1-9e46-673dfc38c910',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'MOKKA',
 'odometer': 73506,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_952eb965-dce7-51b1-9e46-673dfc38c910/952eb965-dce7-51b1-9e46-673dfc38c910_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 373211,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/596/12ec8a131d9c41f38fb1f670f50b5cdd/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL MOKKA BEV 50kWh Business Elegance',
 'transmission': 'manual',
 'trim': 'BEV 50kWh Business Elegance',
 'vin': None,
 'year': 2022}
2026-03-26 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985227%27 HTTP/1.1" 200 None
2026-03-26 18:31:57 [ayvens.es] INFO: Saving data for 1985227: {'created_time': 1774549917.453238, 'last_price_update_time': 1774549917.453249, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985227') HTTP/1.1" 204 0
2026-03-26 18:31:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 05dadd5a-a202-509d-8650-627610c55d3e with identifier: 1985226
2026-03-26 18:31:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:31:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 05dadd5a-a202-509d-8650-627610c55d3e with identifier: 1985226
2026-03-26 18:31:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 05dadd5a-a202-509d-8650-627610c55d3e with identifier: 1985226 to the API
2026-03-26 18:31:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/844/f690353191674a9db5d4b0f07f1c7228/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Gri metalizado',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '05dadd5a-a202-509d-8650-627610c55d3e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'CAMRY',
 'odometer': 202924,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05dadd5a-a202-509d-8650-627610c55d3e/05dadd5a-a202-509d-8650-627610c55d3e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 609741,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/844/f690353191674a9db5d4b0f07f1c7228/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA CAMRY 2.5 220H Luxury',
 'transmission': 'manual',
 'trim': '2.5 220H Luxury',
 'vin': None,
 'year': 2022}
2026-03-26 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985226%27 HTTP/1.1" 200 None
2026-03-26 18:31:57 [ayvens.es] INFO: Saving data for 1985226: {'created_time': 1774549917.799264, 'last_price_update_time': 1774549917.799273, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985226') HTTP/1.1" 204 0
2026-03-26 18:31:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 17f36c9e-9525-5903-b565-e9a39b21aa83 with identifier: 1985228
2026-03-26 18:31:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:31:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 17f36c9e-9525-5903-b565-e9a39b21aa83 with identifier: 1985228
2026-03-26 18:31:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 17f36c9e-9525-5903-b565-e9a39b21aa83 with identifier: 1985228 to the API
2026-03-26 18:31:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/924/76dc13dd690545f4adca216ba95a66f4/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 96,
 'color': 'Blanco suave',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'gas',
 'id': '17f36c9e-9525-5903-b565-e9a39b21aa83',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 229415,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17f36c9e-9525-5903-b565-e9a39b21aa83/17f36c9e-9525-5903-b565-e9a39b21aa83_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 348040,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/924/76dc13dd690545f4adca216ba95a66f4/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON 1.4 TGI GNC St&Sp Reference',
 'transmission': 'manual',
 'trim': '1.4 TGI GNC St&Sp Reference',
 'vin': None,
 'year': 2016}
2026-03-26 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985228%27 HTTP/1.1" 200 None
2026-03-26 18:31:58 [ayvens.es] INFO: Saving data for 1985228: {'created_time': 1774549918.257449, 'last_price_update_time': 1774549918.257459, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985228') HTTP/1.1" 204 0
2026-03-26 18:31:58 [ayvens.es] INFO: Found listing with ID: 1985236
2026-03-26 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985236%27 HTTP/1.1" 200 None
2026-03-26 18:31:58 [ayvens.es] INFO: Scrape type for 1985236: 1
2026-03-26 18:31:58 [ayvens.es] INFO: Extracting data for car ID: 1985236
2026-03-26 18:31:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2a76b71-dbd4-59bd-b006-433a4233fa70 with identifier: 1985236
2026-03-26 18:31:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2a76b71-dbd4-59bd-b006-433a4233fa70 with scrape type 1
2026-03-26 18:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a2a76b71-dbd4-59bd-b006-433a4233fa70
2026-03-26 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F541%252F9c50b5313ece47998e4557a2b3c4a73b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/541/9c50b5313ece47998e4557a2b3c4a73b/images/large/1.jpg not downloaded yet
2026-03-26 18:31:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28ae1910>
2026-03-26 18:31:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50a6426d-d5e8-5885-a5b4-3bbe2b9a8f8e/50a6426d-d5e8-5885-a5b4-3bbe2b9a8f8e_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F122%252Fa1e761945e0d443e8826c6e9b7af5875%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/122/a1e761945e0d443e8826c6e9b7af5875/images/large/1.jpg saved to cache
2026-03-26 18:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 50a6426d-d5e8-5885-a5b4-3bbe2b9a8f8e
2026-03-26 18:31:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 50a6426d-d5e8-5885-a5b4-3bbe2b9a8f8e, skipping ID generation
2026-03-26 18:31:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50a6426d-d5e8-5885-a5b4-3bbe2b9a8f8e with scrape type 1
2026-03-26 18:31:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 50a6426d-d5e8-5885-a5b4-3bbe2b9a8f8e sending to next pipeline
2026-03-26 18:31:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 50a6426d-d5e8-5885-a5b4-3bbe2b9a8f8e, identifier: 1985229
2026-03-26 18:31:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/193/9ce0e61292f44c67b94cad367049f0bf/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/466/71d42d525f154db4b7921e4537c78167/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:58 [ayvens.es] INFO: Found listing with ID: 1985237
2026-03-26 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985237%27 HTTP/1.1" 200 None
2026-03-26 18:31:58 [ayvens.es] INFO: Scrape type for 1985237: 1
2026-03-26 18:31:58 [ayvens.es] INFO: Extracting data for car ID: 1985237
2026-03-26 18:31:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44103a05-4ec1-5da7-8a66-7791ebc1ff3f with identifier: 1985237
2026-03-26 18:31:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44103a05-4ec1-5da7-8a66-7791ebc1ff3f with scrape type 1
2026-03-26 18:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 44103a05-4ec1-5da7-8a66-7791ebc1ff3f
2026-03-26 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F049%252F84c08d3e57764ce1b1e3482492ba8d1d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/049/84c08d3e57764ce1b1e3482492ba8d1d/images/large/1.jpg not downloaded yet
2026-03-26 18:31:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 50a6426d-d5e8-5885-a5b4-3bbe2b9a8f8e with identifier: 1985229
2026-03-26 18:31:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 50a6426d-d5e8-5885-a5b4-3bbe2b9a8f8e with identifier: 1985229
2026-03-26 18:31:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 50a6426d-d5e8-5885-a5b4-3bbe2b9a8f8e with identifier: 1985229 to the API
2026-03-26 18:31:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/122/a1e761945e0d443e8826c6e9b7af5875/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Blanco nacarado',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'gas',
 'id': '50a6426d-d5e8-5885-a5b4-3bbe2b9a8f8e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CAPTUR',
 'odometer': 63092,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50a6426d-d5e8-5885-a5b4-3bbe2b9a8f8e/50a6426d-d5e8-5885-a5b4-3bbe2b9a8f8e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 356387,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/122/a1e761945e0d443e8826c6e9b7af5875/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CAPTUR Intens TCe 74kW (100CV) GLP',
 'transmission': 'manual',
 'trim': 'Intens TCe 74kW (100CV) GLP',
 'vin': None,
 'year': 2022}
2026-03-26 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985229%27 HTTP/1.1" 200 None
2026-03-26 18:31:59 [ayvens.es] INFO: Saving data for 1985229: {'created_time': 1774549919.03972, 'last_price_update_time': 1774549919.039732, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985229') HTTP/1.1" 204 0
2026-03-26 18:31:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/039/9f31f4322c8f4ca3b00ee72e26fdf794/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:59 [ayvens.es] INFO: Found listing with ID: 1985238
2026-03-26 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985238%27 HTTP/1.1" 200 None
2026-03-26 18:31:59 [ayvens.es] INFO: Scrape type for 1985238: 1
2026-03-26 18:31:59 [ayvens.es] INFO: Extracting data for car ID: 1985238
2026-03-26 18:31:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7173c43-639d-55f6-aad4-74690b35d58d with identifier: 1985238
2026-03-26 18:31:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7173c43-639d-55f6-aad4-74690b35d58d with scrape type 1
2026-03-26 18:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b7173c43-639d-55f6-aad4-74690b35d58d
2026-03-26 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F316%252F019d5aac257e440584d1eac6de08f1ff%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/316/019d5aac257e440584d1eac6de08f1ff/images/large/1.jpg not downloaded yet
2026-03-26 18:31:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/434/99734278b098458e9295bc2f466b5901/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:31:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a2820c650>
2026-03-26 18:31:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e63ebf3-ed7b-5968-9cd3-fb1bca1dd365/6e63ebf3-ed7b-5968-9cd3-fb1bca1dd365_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F193%252F9ce0e61292f44c67b94cad367049f0bf%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/193/9ce0e61292f44c67b94cad367049f0bf/images/large/1.jpg saved to cache
2026-03-26 18:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6e63ebf3-ed7b-5968-9cd3-fb1bca1dd365
2026-03-26 18:31:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6e63ebf3-ed7b-5968-9cd3-fb1bca1dd365, skipping ID generation
2026-03-26 18:31:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e63ebf3-ed7b-5968-9cd3-fb1bca1dd365 with scrape type 1
2026-03-26 18:31:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6e63ebf3-ed7b-5968-9cd3-fb1bca1dd365 sending to next pipeline
2026-03-26 18:31:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6e63ebf3-ed7b-5968-9cd3-fb1bca1dd365, identifier: 1985230
2026-03-26 18:31:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:31:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28e78e50>
2026-03-26 18:31:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:31:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:31:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:31:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a295b77b-797a-5183-8297-97711347456c/a295b77b-797a-5183-8297-97711347456c_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F466%252F71d42d525f154db4b7921e4537c78167%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/466/71d42d525f154db4b7921e4537c78167/images/large/1.jpg saved to cache
2026-03-26 18:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a295b77b-797a-5183-8297-97711347456c
2026-03-26 18:31:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a295b77b-797a-5183-8297-97711347456c, skipping ID generation
2026-03-26 18:31:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a295b77b-797a-5183-8297-97711347456c with scrape type 1
2026-03-26 18:31:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a295b77b-797a-5183-8297-97711347456c sending to next pipeline
2026-03-26 18:31:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a295b77b-797a-5183-8297-97711347456c, identifier: 1985231
2026-03-26 18:31:59 [ayvens.es] INFO: Found listing with ID: 1985239
2026-03-26 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985239%27 HTTP/1.1" 200 None
2026-03-26 18:31:59 [ayvens.es] INFO: Scrape type for 1985239: 1
2026-03-26 18:31:59 [ayvens.es] INFO: Extracting data for car ID: 1985239
2026-03-26 18:31:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef3e5e4a-b075-5921-86d9-bdb9a4ba3bd5 with identifier: 1985239
2026-03-26 18:31:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef3e5e4a-b075-5921-86d9-bdb9a4ba3bd5 with scrape type 1
2026-03-26 18:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ef3e5e4a-b075-5921-86d9-bdb9a4ba3bd5
2026-03-26 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F692%252F351b5f11e09845ef9f49eb0c51cb38e9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/692/351b5f11e09845ef9f49eb0c51cb38e9/images/large/1.jpg not downloaded yet
2026-03-26 18:31:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6e63ebf3-ed7b-5968-9cd3-fb1bca1dd365 with identifier: 1985230
2026-03-26 18:31:59 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:31:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6e63ebf3-ed7b-5968-9cd3-fb1bca1dd365 with identifier: 1985230
2026-03-26 18:31:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 6e63ebf3-ed7b-5968-9cd3-fb1bca1dd365 with identifier: 1985230 to the API
2026-03-26 18:31:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:31:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:31:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/193/9ce0e61292f44c67b94cad367049f0bf/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 27,
 'color': 'Gris magnetic',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '6e63ebf3-ed7b-5968-9cd3-fb1bca1dd365',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 54715,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e63ebf3-ed7b-5968-9cd3-fb1bca1dd365/6e63ebf3-ed7b-5968-9cd3-fb1bca1dd365_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 345668,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/193/9ce0e61292f44c67b94cad367049f0bf/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON 1.4 e-Hybrid DSG-6 S&S Xcellence Go L',
 'transmission': 'manual',
 'trim': '1.4 e-Hybrid DSG-6 S&S Xcellence Go L',
 'vin': None,
 'year': 2021}
2026-03-26 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985230%27 HTTP/1.1" 200 None
2026-03-26 18:31:59 [ayvens.es] INFO: Saving data for 1985230: {'created_time': 1774549919.772924, 'last_price_update_time': 1774549919.772936, 'auction_closing_time': 1774612800.0}
2026-03-26 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985230') HTTP/1.1" 204 0
2026-03-26 18:31:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a295b77b-797a-5183-8297-97711347456c with identifier: 1985231
2026-03-26 18:31:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a295b77b-797a-5183-8297-97711347456c with identifier: 1985231
2026-03-26 18:31:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a295b77b-797a-5183-8297-97711347456c with identifier: 1985231 to the API
2026-03-26 18:31:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/466/71d42d525f154db4b7921e4537c78167/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'Blanco glaciar',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '0.9L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'gas',
 'id': 'a295b77b-797a-5183-8297-97711347456c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 74059,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a295b77b-797a-5183-8297-97711347456c/a295b77b-797a-5183-8297-97711347456c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347882,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/466/71d42d525f154db4b7921e4537c78167/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO Business TCe 66kW (90CV) GLP -18',
 'transmission': 'manual',
 'trim': 'Business TCe 66kW (90CV) GLP -18',
 'vin': None,
 'year': 2020}
2026-03-26 18:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985231%27 HTTP/1.1" 200 None
2026-03-26 18:32:00 [ayvens.es] INFO: Saving data for 1985231: {'created_time': 1774549920.132751, 'last_price_update_time': 1774549920.132761, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985231') HTTP/1.1" 204 0
2026-03-26 18:32:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/234/6300b5437e634dddbd7a53ef821f9493/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:00 [ayvens.es] INFO: Found listing with ID: 1985240
2026-03-26 18:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985240%27 HTTP/1.1" 200 None
2026-03-26 18:32:00 [ayvens.es] INFO: Scrape type for 1985240: 1
2026-03-26 18:32:00 [ayvens.es] INFO: Extracting data for car ID: 1985240
2026-03-26 18:32:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cfb78139-d822-518d-90a1-cc00ab8f6ca3 with identifier: 1985240
2026-03-26 18:32:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfb78139-d822-518d-90a1-cc00ab8f6ca3 with scrape type 1
2026-03-26 18:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item cfb78139-d822-518d-90a1-cc00ab8f6ca3
2026-03-26 18:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F638%252F53c3a2433b5e48c5b0f5c62816d0a3aa%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/638/53c3a2433b5e48c5b0f5c62816d0a3aa/images/large/1.jpg not downloaded yet
2026-03-26 18:32:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/384/f16fc5386bd44fd9925b46f5ae87f845/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c45610>
2026-03-26 18:32:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45574acf-e6b6-5188-989f-51a3a70cd466/45574acf-e6b6-5188-989f-51a3a70cd466_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F039%252F9f31f4322c8f4ca3b00ee72e26fdf794%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/039/9f31f4322c8f4ca3b00ee72e26fdf794/images/large/1.jpg saved to cache
2026-03-26 18:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 45574acf-e6b6-5188-989f-51a3a70cd466
2026-03-26 18:32:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 45574acf-e6b6-5188-989f-51a3a70cd466, skipping ID generation
2026-03-26 18:32:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45574acf-e6b6-5188-989f-51a3a70cd466 with scrape type 1
2026-03-26 18:32:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 45574acf-e6b6-5188-989f-51a3a70cd466 sending to next pipeline
2026-03-26 18:32:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 45574acf-e6b6-5188-989f-51a3a70cd466, identifier: 1985233
2026-03-26 18:32:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a29055250>
2026-03-26 18:32:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8be744e8-15fc-5d8b-b649-c57f35e37d86/8be744e8-15fc-5d8b-b649-c57f35e37d86_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F434%252F99734278b098458e9295bc2f466b5901%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/434/99734278b098458e9295bc2f466b5901/images/large/1.jpg saved to cache
2026-03-26 18:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8be744e8-15fc-5d8b-b649-c57f35e37d86
2026-03-26 18:32:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8be744e8-15fc-5d8b-b649-c57f35e37d86, skipping ID generation
2026-03-26 18:32:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8be744e8-15fc-5d8b-b649-c57f35e37d86 with scrape type 1
2026-03-26 18:32:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8be744e8-15fc-5d8b-b649-c57f35e37d86 sending to next pipeline
2026-03-26 18:32:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8be744e8-15fc-5d8b-b649-c57f35e37d86, identifier: 1985232
2026-03-26 18:32:00 [ayvens.es] INFO: Found listing with ID: 1985241
2026-03-26 18:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985241%27 HTTP/1.1" 200 None
2026-03-26 18:32:00 [ayvens.es] INFO: Scrape type for 1985241: 1
2026-03-26 18:32:00 [ayvens.es] INFO: Extracting data for car ID: 1985241
2026-03-26 18:32:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c89dc8aa-18ad-536e-a247-383d089ec0fa with identifier: 1985241
2026-03-26 18:32:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c89dc8aa-18ad-536e-a247-383d089ec0fa with scrape type 1
2026-03-26 18:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c89dc8aa-18ad-536e-a247-383d089ec0fa
2026-03-26 18:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F975%252Fec6f176a72c645d1bbed5c23030d8d14%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/975/ec6f176a72c645d1bbed5c23030d8d14/images/large/1.jpg not downloaded yet
2026-03-26 18:32:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 45574acf-e6b6-5188-989f-51a3a70cd466 with identifier: 1985233
2026-03-26 18:32:00 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:32:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 45574acf-e6b6-5188-989f-51a3a70cd466 with identifier: 1985233
2026-03-26 18:32:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 45574acf-e6b6-5188-989f-51a3a70cd466 with identifier: 1985233 to the API
2026-03-26 18:32:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/039/9f31f4322c8f4ca3b00ee72e26fdf794/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 44,
 'color': 'Alpinweib',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '45574acf-e6b6-5188-989f-51a3a70cd466',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X3',
 'odometer': 76542,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45574acf-e6b6-5188-989f-51a3a70cd466/45574acf-e6b6-5188-989f-51a3a70cd466_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270724,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/039/9f31f4322c8f4ca3b00ee72e26fdf794/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 (O) xDrive30e',
 'transmission': 'manual',
 'trim': '(O) xDrive30e',
 'vin': None,
 'year': 2021}
2026-03-26 18:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985233%27 HTTP/1.1" 200 None
2026-03-26 18:32:00 [ayvens.es] INFO: Saving data for 1985233: {'created_time': 1774549920.871893, 'last_price_update_time': 1774549920.871903, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985233') HTTP/1.1" 204 0
2026-03-26 18:32:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8be744e8-15fc-5d8b-b649-c57f35e37d86 with identifier: 1985232
2026-03-26 18:32:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8be744e8-15fc-5d8b-b649-c57f35e37d86 with identifier: 1985232
2026-03-26 18:32:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8be744e8-15fc-5d8b-b649-c57f35e37d86 with identifier: 1985232 to the API
2026-03-26 18:32:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/434/99734278b098458e9295bc2f466b5901/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Blanco nacarado',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'gas',
 'id': '8be744e8-15fc-5d8b-b649-c57f35e37d86',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CAPTUR',
 'odometer': 56942,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8be744e8-15fc-5d8b-b649-c57f35e37d86/8be744e8-15fc-5d8b-b649-c57f35e37d86_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 327444,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/434/99734278b098458e9295bc2f466b5901/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CAPTUR equilibre TCe 74 kW (100CV) GLP',
 'transmission': 'manual',
 'trim': 'equilibre TCe 74 kW (100CV) GLP',
 'vin': None,
 'year': 2023}
2026-03-26 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985232%27 HTTP/1.1" 200 None
2026-03-26 18:32:01 [ayvens.es] INFO: Saving data for 1985232: {'created_time': 1774549921.173128, 'last_price_update_time': 1774549921.173138, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985232') HTTP/1.1" 204 0
2026-03-26 18:32:01 [ayvens.es] INFO: Found listing with ID: 1985242
2026-03-26 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985242%27 HTTP/1.1" 200 None
2026-03-26 18:32:01 [ayvens.es] INFO: Scrape type for 1985242: 1
2026-03-26 18:32:01 [ayvens.es] INFO: Extracting data for car ID: 1985242
2026-03-26 18:32:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: affd005b-8cee-581d-ba21-24bd80ce35da with identifier: 1985242
2026-03-26 18:32:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item affd005b-8cee-581d-ba21-24bd80ce35da with scrape type 1
2026-03-26 18:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item affd005b-8cee-581d-ba21-24bd80ce35da
2026-03-26 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F422%252Fd282e75349ca48449733fd9060924178%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/422/d282e75349ca48449733fd9060924178/images/large/1.jpg not downloaded yet
2026-03-26 18:32:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/049/84c08d3e57764ce1b1e3482492ba8d1d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28ae3710>
2026-03-26 18:32:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b03975ea-196c-57ba-b490-a8f47e8bbfe6/b03975ea-196c-57ba-b490-a8f47e8bbfe6_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F234%252F6300b5437e634dddbd7a53ef821f9493%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/234/6300b5437e634dddbd7a53ef821f9493/images/large/1.jpg saved to cache
2026-03-26 18:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b03975ea-196c-57ba-b490-a8f47e8bbfe6
2026-03-26 18:32:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b03975ea-196c-57ba-b490-a8f47e8bbfe6, skipping ID generation
2026-03-26 18:32:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b03975ea-196c-57ba-b490-a8f47e8bbfe6 with scrape type 1
2026-03-26 18:32:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b03975ea-196c-57ba-b490-a8f47e8bbfe6 sending to next pipeline
2026-03-26 18:32:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b03975ea-196c-57ba-b490-a8f47e8bbfe6, identifier: 1985234
2026-03-26 18:32:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a2ab0c3d0>
2026-03-26 18:32:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e44e9013-d0d5-59df-8586-c0514ce0fa8f/e44e9013-d0d5-59df-8586-c0514ce0fa8f_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F384%252Ff16fc5386bd44fd9925b46f5ae87f845%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/384/f16fc5386bd44fd9925b46f5ae87f845/images/large/1.jpg saved to cache
2026-03-26 18:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e44e9013-d0d5-59df-8586-c0514ce0fa8f
2026-03-26 18:32:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e44e9013-d0d5-59df-8586-c0514ce0fa8f, skipping ID generation
2026-03-26 18:32:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e44e9013-d0d5-59df-8586-c0514ce0fa8f with scrape type 1
2026-03-26 18:32:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e44e9013-d0d5-59df-8586-c0514ce0fa8f sending to next pipeline
2026-03-26 18:32:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e44e9013-d0d5-59df-8586-c0514ce0fa8f, identifier: 1985235
2026-03-26 18:32:01 [ayvens.es] INFO: Found listing with ID: 1985243
2026-03-26 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985243%27 HTTP/1.1" 200 None
2026-03-26 18:32:01 [ayvens.es] INFO: Scrape type for 1985243: 1
2026-03-26 18:32:01 [ayvens.es] INFO: Extracting data for car ID: 1985243
2026-03-26 18:32:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53e6c011-1197-5f05-acb2-f793312e31aa with identifier: 1985243
2026-03-26 18:32:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53e6c011-1197-5f05-acb2-f793312e31aa with scrape type 1
2026-03-26 18:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 53e6c011-1197-5f05-acb2-f793312e31aa
2026-03-26 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F330%252F57c07637d20d45499c1dcb16df9fa65a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/330/57c07637d20d45499c1dcb16df9fa65a/images/large/1.jpg not downloaded yet
2026-03-26 18:32:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b03975ea-196c-57ba-b490-a8f47e8bbfe6 with identifier: 1985234
2026-03-26 18:32:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b03975ea-196c-57ba-b490-a8f47e8bbfe6 with identifier: 1985234
2026-03-26 18:32:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b03975ea-196c-57ba-b490-a8f47e8bbfe6 with identifier: 1985234 to the API
2026-03-26 18:32:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/234/6300b5437e634dddbd7a53ef821f9493/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'color': 'Blanco glaciar',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'gas',
 'id': 'b03975ea-196c-57ba-b490-a8f47e8bbfe6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 123026,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b03975ea-196c-57ba-b490-a8f47e8bbfe6/b03975ea-196c-57ba-b490-a8f47e8bbfe6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340472,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/234/6300b5437e634dddbd7a53ef821f9493/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO Business TCe 74 kW (100CV) GLP',
 'transmission': 'manual',
 'trim': 'Business TCe 74 kW (100CV) GLP',
 'vin': None,
 'year': 2021}
2026-03-26 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985234%27 HTTP/1.1" 200 None
2026-03-26 18:32:02 [ayvens.es] INFO: Saving data for 1985234: {'created_time': 1774549922.433868, 'last_price_update_time': 1774549922.433881, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985234') HTTP/1.1" 204 0
2026-03-26 18:32:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e44e9013-d0d5-59df-8586-c0514ce0fa8f with identifier: 1985235
2026-03-26 18:32:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:32:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e44e9013-d0d5-59df-8586-c0514ce0fa8f with identifier: 1985235
2026-03-26 18:32:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e44e9013-d0d5-59df-8586-c0514ce0fa8f with identifier: 1985235 to the API
2026-03-26 18:32:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/384/f16fc5386bd44fd9925b46f5ae87f845/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'Titanium',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'e44e9013-d0d5-59df-8586-c0514ce0fa8f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'LEXUS',
 'model': 'NX',
 'odometer': 76158,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e44e9013-d0d5-59df-8586-c0514ce0fa8f/e44e9013-d0d5-59df-8586-c0514ce0fa8f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 374529,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/384/f16fc5386bd44fd9925b46f5ae87f845/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LEXUS NX 350h Business 2WD',
 'transmission': 'manual',
 'trim': '350h Business 2WD',
 'vin': None,
 'year': 2022}
2026-03-26 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985235%27 HTTP/1.1" 200 None
2026-03-26 18:32:02 [ayvens.es] INFO: Saving data for 1985235: {'created_time': 1774549922.890139, 'last_price_update_time': 1774549922.89015, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985235') HTTP/1.1" 204 0
2026-03-26 18:32:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/541/9c50b5313ece47998e4557a2b3c4a73b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/316/019d5aac257e440584d1eac6de08f1ff/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:02 [ayvens.es] INFO: Found listing with ID: 1985244
2026-03-26 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985244%27 HTTP/1.1" 200 None
2026-03-26 18:32:02 [ayvens.es] INFO: Scrape type for 1985244: 1
2026-03-26 18:32:02 [ayvens.es] INFO: Extracting data for car ID: 1985244
2026-03-26 18:32:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a52d46ec-8b50-5465-abf1-99d332736696 with identifier: 1985244
2026-03-26 18:32:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a52d46ec-8b50-5465-abf1-99d332736696 with scrape type 1
2026-03-26 18:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a52d46ec-8b50-5465-abf1-99d332736696
2026-03-26 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F938%252F4e214bea121040e68d9e4aad4c1cdf78%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/938/4e214bea121040e68d9e4aad4c1cdf78/images/large/1.jpg not downloaded yet
2026-03-26 18:32:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28e65990>
2026-03-26 18:32:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44103a05-4ec1-5da7-8a66-7791ebc1ff3f/44103a05-4ec1-5da7-8a66-7791ebc1ff3f_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F049%252F84c08d3e57764ce1b1e3482492ba8d1d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/049/84c08d3e57764ce1b1e3482492ba8d1d/images/large/1.jpg saved to cache
2026-03-26 18:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 44103a05-4ec1-5da7-8a66-7791ebc1ff3f
2026-03-26 18:32:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 44103a05-4ec1-5da7-8a66-7791ebc1ff3f, skipping ID generation
2026-03-26 18:32:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44103a05-4ec1-5da7-8a66-7791ebc1ff3f with scrape type 1
2026-03-26 18:32:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 44103a05-4ec1-5da7-8a66-7791ebc1ff3f sending to next pipeline
2026-03-26 18:32:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 44103a05-4ec1-5da7-8a66-7791ebc1ff3f, identifier: 1985237
2026-03-26 18:32:03 [ayvens.es] INFO: Found listing with ID: 1985692
2026-03-26 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985692%27 HTTP/1.1" 200 None
2026-03-26 18:32:03 [ayvens.es] INFO: Scrape type for 1985692: 1
2026-03-26 18:32:03 [ayvens.es] INFO: Extracting data for car ID: 1985692
2026-03-26 18:32:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 586014a6-8b70-5e90-9f4c-54bf23cf0de6 with identifier: 1985692
2026-03-26 18:32:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 586014a6-8b70-5e90-9f4c-54bf23cf0de6 with scrape type 1
2026-03-26 18:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 586014a6-8b70-5e90-9f4c-54bf23cf0de6
2026-03-26 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F313%252F233d4a991b5f4da19a274b724141976a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/313/233d4a991b5f4da19a274b724141976a/images/large/1.jpg not downloaded yet
2026-03-26 18:32:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 44103a05-4ec1-5da7-8a66-7791ebc1ff3f with identifier: 1985237
2026-03-26 18:32:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 44103a05-4ec1-5da7-8a66-7791ebc1ff3f with identifier: 1985237
2026-03-26 18:32:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 44103a05-4ec1-5da7-8a66-7791ebc1ff3f with identifier: 1985237 to the API
2026-03-26 18:32:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/049/84c08d3e57764ce1b1e3482492ba8d1d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '44103a05-4ec1-5da7-8a66-7791ebc1ff3f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'TUCSON',
 'odometer': 142325,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44103a05-4ec1-5da7-8a66-7791ebc1ff3f/44103a05-4ec1-5da7-8a66-7791ebc1ff3f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353142,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/049/84c08d3e57764ce1b1e3482492ba8d1d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI TUCSON 1.6 TGDI 169kW HEV Tecno Auto 2C',
 'transmission': 'manual',
 'trim': '1.6 TGDI 169kW HEV Tecno Auto 2C',
 'vin': None,
 'year': 2022}
2026-03-26 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985237%27 HTTP/1.1" 200 None
2026-03-26 18:32:03 [ayvens.es] INFO: Saving data for 1985237: {'created_time': 1774549923.732343, 'last_price_update_time': 1774549923.732353, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985237') HTTP/1.1" 204 0
2026-03-26 18:32:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/692/351b5f11e09845ef9f49eb0c51cb38e9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/638/53c3a2433b5e48c5b0f5c62816d0a3aa/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:03 [ayvens.es] INFO: Found listing with ID: 1985693
2026-03-26 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985693%27 HTTP/1.1" 200 None
2026-03-26 18:32:03 [ayvens.es] INFO: Scrape type for 1985693: 1
2026-03-26 18:32:03 [ayvens.es] INFO: Extracting data for car ID: 1985693
2026-03-26 18:32:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3927c8eb-d5de-5611-a8f6-565554dabfd4 with identifier: 1985693
2026-03-26 18:32:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3927c8eb-d5de-5611-a8f6-565554dabfd4 with scrape type 1
2026-03-26 18:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3927c8eb-d5de-5611-a8f6-565554dabfd4
2026-03-26 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F857%252Ff32473f75285495da86abeda50d88674%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/857/f32473f75285495da86abeda50d88674/images/large/1.jpg not downloaded yet
2026-03-26 18:32:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28d81050>
2026-03-26 18:32:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2a76b71-dbd4-59bd-b006-433a4233fa70/a2a76b71-dbd4-59bd-b006-433a4233fa70_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F541%252F9c50b5313ece47998e4557a2b3c4a73b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/541/9c50b5313ece47998e4557a2b3c4a73b/images/large/1.jpg saved to cache
2026-03-26 18:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a2a76b71-dbd4-59bd-b006-433a4233fa70
2026-03-26 18:32:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a2a76b71-dbd4-59bd-b006-433a4233fa70, skipping ID generation
2026-03-26 18:32:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2a76b71-dbd4-59bd-b006-433a4233fa70 with scrape type 1
2026-03-26 18:32:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a2a76b71-dbd4-59bd-b006-433a4233fa70 sending to next pipeline
2026-03-26 18:32:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a2a76b71-dbd4-59bd-b006-433a4233fa70, identifier: 1985236
2026-03-26 18:32:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28e5c910>
2026-03-26 18:32:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7173c43-639d-55f6-aad4-74690b35d58d/b7173c43-639d-55f6-aad4-74690b35d58d_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F316%252F019d5aac257e440584d1eac6de08f1ff%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/316/019d5aac257e440584d1eac6de08f1ff/images/large/1.jpg saved to cache
2026-03-26 18:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b7173c43-639d-55f6-aad4-74690b35d58d
2026-03-26 18:32:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b7173c43-639d-55f6-aad4-74690b35d58d, skipping ID generation
2026-03-26 18:32:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7173c43-639d-55f6-aad4-74690b35d58d with scrape type 1
2026-03-26 18:32:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b7173c43-639d-55f6-aad4-74690b35d58d sending to next pipeline
2026-03-26 18:32:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b7173c43-639d-55f6-aad4-74690b35d58d, identifier: 1985238
2026-03-26 18:32:04 [ayvens.es] INFO: Found listing with ID: 1985694
2026-03-26 18:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985694%27 HTTP/1.1" 200 None
2026-03-26 18:32:04 [ayvens.es] INFO: Scrape type for 1985694: 1
2026-03-26 18:32:04 [ayvens.es] INFO: Extracting data for car ID: 1985694
2026-03-26 18:32:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f70c008-2023-52b6-b069-7f3d42f8506f with identifier: 1985694
2026-03-26 18:32:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f70c008-2023-52b6-b069-7f3d42f8506f with scrape type 1
2026-03-26 18:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1f70c008-2023-52b6-b069-7f3d42f8506f
2026-03-26 18:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F840%252Fe870e175accc48c59d2a52e3c744fb4c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/840/e870e175accc48c59d2a52e3c744fb4c/images/large/1.jpg not downloaded yet
2026-03-26 18:32:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a2a76b71-dbd4-59bd-b006-433a4233fa70 with identifier: 1985236
2026-03-26 18:32:04 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:32:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a2a76b71-dbd4-59bd-b006-433a4233fa70 with identifier: 1985236
2026-03-26 18:32:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a2a76b71-dbd4-59bd-b006-433a4233fa70 with identifier: 1985236 to the API
2026-03-26 18:32:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/541/9c50b5313ece47998e4557a2b3c4a73b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Negro noche',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'electric',
 'id': 'a2a76b71-dbd4-59bd-b006-433a4233fa70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'EQB',
 'odometer': 140281,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2a76b71-dbd4-59bd-b006-433a4233fa70/a2a76b71-dbd4-59bd-b006-433a4233fa70_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 599851,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/541/9c50b5313ece47998e4557a2b3c4a73b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ EQB EQB 250',
 'transmission': 'manual',
 'trim': 'EQB 250',
 'vin': None,
 'year': 2022}
2026-03-26 18:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985236%27 HTTP/1.1" 200 None
2026-03-26 18:32:04 [ayvens.es] INFO: Saving data for 1985236: {'created_time': 1774549924.722058, 'last_price_update_time': 1774549924.722068, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985236') HTTP/1.1" 204 0
2026-03-26 18:32:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b7173c43-639d-55f6-aad4-74690b35d58d with identifier: 1985238
2026-03-26 18:32:04 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:32:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b7173c43-639d-55f6-aad4-74690b35d58d with identifier: 1985238
2026-03-26 18:32:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b7173c43-639d-55f6-aad4-74690b35d58d with identifier: 1985238 to the API
2026-03-26 18:32:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/316/019d5aac257e440584d1eac6de08f1ff/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 73,
 'color': 'Carpathian grey',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'b7173c43-639d-55f6-aad4-74690b35d58d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER SPORT',
 'odometer': 121635,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7173c43-639d-55f6-aad4-74690b35d58d/b7173c43-639d-55f6-aad4-74690b35d58d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347477,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/316/019d5aac257e440584d1eac6de08f1ff/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER RANGE ROVER SPORT 2.0 Si4 PHEV 297kW (404CV) HSE',
 'transmission': 'manual',
 'trim': '2.0 Si4 PHEV 297kW (404CV) HSE',
 'vin': None,
 'year': 2019}
2026-03-26 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985238%27 HTTP/1.1" 200 None
2026-03-26 18:32:05 [ayvens.es] INFO: Saving data for 1985238: {'created_time': 1774549925.075755, 'last_price_update_time': 1774549925.07577, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985238') HTTP/1.1" 204 0
2026-03-26 18:32:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/975/ec6f176a72c645d1bbed5c23030d8d14/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:05 [ayvens.es] INFO: Found listing with ID: 1985695
2026-03-26 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985695%27 HTTP/1.1" 200 None
2026-03-26 18:32:05 [ayvens.es] INFO: Scrape type for 1985695: 1
2026-03-26 18:32:05 [ayvens.es] INFO: Extracting data for car ID: 1985695
2026-03-26 18:32:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ab832fc-27b7-5910-bfc7-b8f1e5dc2a70 with identifier: 1985695
2026-03-26 18:32:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ab832fc-27b7-5910-bfc7-b8f1e5dc2a70 with scrape type 1
2026-03-26 18:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6ab832fc-27b7-5910-bfc7-b8f1e5dc2a70
2026-03-26 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F651%252F70a1c438c5bb4292abef983148ae46c6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/651/70a1c438c5bb4292abef983148ae46c6/images/large/1.jpg not downloaded yet
2026-03-26 18:32:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/330/57c07637d20d45499c1dcb16df9fa65a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a290afcd0>
2026-03-26 18:32:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef3e5e4a-b075-5921-86d9-bdb9a4ba3bd5/ef3e5e4a-b075-5921-86d9-bdb9a4ba3bd5_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F692%252F351b5f11e09845ef9f49eb0c51cb38e9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/692/351b5f11e09845ef9f49eb0c51cb38e9/images/large/1.jpg saved to cache
2026-03-26 18:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ef3e5e4a-b075-5921-86d9-bdb9a4ba3bd5
2026-03-26 18:32:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ef3e5e4a-b075-5921-86d9-bdb9a4ba3bd5, skipping ID generation
2026-03-26 18:32:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef3e5e4a-b075-5921-86d9-bdb9a4ba3bd5 with scrape type 1
2026-03-26 18:32:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ef3e5e4a-b075-5921-86d9-bdb9a4ba3bd5 sending to next pipeline
2026-03-26 18:32:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ef3e5e4a-b075-5921-86d9-bdb9a4ba3bd5, identifier: 1985239
2026-03-26 18:32:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28eb68d0>
2026-03-26 18:32:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfb78139-d822-518d-90a1-cc00ab8f6ca3/cfb78139-d822-518d-90a1-cc00ab8f6ca3_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F638%252F53c3a2433b5e48c5b0f5c62816d0a3aa%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/638/53c3a2433b5e48c5b0f5c62816d0a3aa/images/large/1.jpg saved to cache
2026-03-26 18:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cfb78139-d822-518d-90a1-cc00ab8f6ca3
2026-03-26 18:32:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cfb78139-d822-518d-90a1-cc00ab8f6ca3, skipping ID generation
2026-03-26 18:32:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfb78139-d822-518d-90a1-cc00ab8f6ca3 with scrape type 1
2026-03-26 18:32:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cfb78139-d822-518d-90a1-cc00ab8f6ca3 sending to next pipeline
2026-03-26 18:32:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: cfb78139-d822-518d-90a1-cc00ab8f6ca3, identifier: 1985240
2026-03-26 18:32:05 [ayvens.es] INFO: Found listing with ID: 1985696
2026-03-26 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985696%27 HTTP/1.1" 200 None
2026-03-26 18:32:05 [ayvens.es] INFO: Scrape type for 1985696: 1
2026-03-26 18:32:05 [ayvens.es] INFO: Extracting data for car ID: 1985696
2026-03-26 18:32:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef2a98b7-d8f9-538a-af9a-71db86c18ed7 with identifier: 1985696
2026-03-26 18:32:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef2a98b7-d8f9-538a-af9a-71db86c18ed7 with scrape type 1
2026-03-26 18:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ef2a98b7-d8f9-538a-af9a-71db86c18ed7
2026-03-26 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F247%252Fa845418791bb44f88ea24c0505358e0f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/247/a845418791bb44f88ea24c0505358e0f/images/large/1.jpg not downloaded yet
2026-03-26 18:32:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ef3e5e4a-b075-5921-86d9-bdb9a4ba3bd5 with identifier: 1985239
2026-03-26 18:32:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ef3e5e4a-b075-5921-86d9-bdb9a4ba3bd5 with identifier: 1985239
2026-03-26 18:32:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ef3e5e4a-b075-5921-86d9-bdb9a4ba3bd5 with identifier: 1985239 to the API
2026-03-26 18:32:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/692/351b5f11e09845ef9f49eb0c51cb38e9/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'gas',
 'id': 'ef3e5e4a-b075-5921-86d9-bdb9a4ba3bd5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CAPTUR',
 'odometer': 44419,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef3e5e4a-b075-5921-86d9-bdb9a4ba3bd5/ef3e5e4a-b075-5921-86d9-bdb9a4ba3bd5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 497278,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/692/351b5f11e09845ef9f49eb0c51cb38e9/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CAPTUR Intens TCe 74kW (100CV) GLP',
 'transmission': 'manual',
 'trim': 'Intens TCe 74kW (100CV) GLP',
 'vin': None,
 'year': 2021}
2026-03-26 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985239%27 HTTP/1.1" 200 None
2026-03-26 18:32:05 [ayvens.es] INFO: Saving data for 1985239: {'created_time': 1774549925.868676, 'last_price_update_time': 1774549925.868688, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985239') HTTP/1.1" 204 0
2026-03-26 18:32:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: cfb78139-d822-518d-90a1-cc00ab8f6ca3 with identifier: 1985240
2026-03-26 18:32:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: cfb78139-d822-518d-90a1-cc00ab8f6ca3 with identifier: 1985240
2026-03-26 18:32:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: cfb78139-d822-518d-90a1-cc00ab8f6ca3 with identifier: 1985240 to the API
2026-03-26 18:32:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/638/53c3a2433b5e48c5b0f5c62816d0a3aa/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Plata solar',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'cfb78139-d822-518d-90a1-cc00ab8f6ca3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'KUGA',
 'odometer': 74714,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfb78139-d822-518d-90a1-cc00ab8f6ca3/cfb78139-d822-518d-90a1-cc00ab8f6ca3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 339602,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/638/53c3a2433b5e48c5b0f5c62816d0a3aa/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD KUGA Titanium 2.5 Duratec FHEV 140kW Auto',
 'transmission': 'manual',
 'trim': 'Titanium 2.5 Duratec FHEV 140kW Auto',
 'vin': None,
 'year': 2022}
2026-03-26 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985240%27 HTTP/1.1" 200 None
2026-03-26 18:32:06 [ayvens.es] INFO: Saving data for 1985240: {'created_time': 1774549926.386702, 'last_price_update_time': 1774549926.386713, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985240') HTTP/1.1" 204 0
2026-03-26 18:32:06 [scrapy.extensions.logstats] INFO: Crawled 5 pages (at 2 pages/min), scraped 144 items (at 79 items/min)
2026-03-26 18:32:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 177MiB
2026-03-26 18:32:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/422/d282e75349ca48449733fd9060924178/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/938/4e214bea121040e68d9e4aad4c1cdf78/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:06 [ayvens.es] INFO: Found listing with ID: 1985697
2026-03-26 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985697%27 HTTP/1.1" 200 None
2026-03-26 18:32:06 [ayvens.es] INFO: Scrape type for 1985697: 1
2026-03-26 18:32:06 [ayvens.es] INFO: Extracting data for car ID: 1985697
2026-03-26 18:32:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94b7bfcb-57b8-56da-9573-6c3e840a72a4 with identifier: 1985697
2026-03-26 18:32:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94b7bfcb-57b8-56da-9573-6c3e840a72a4 with scrape type 1
2026-03-26 18:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 94b7bfcb-57b8-56da-9573-6c3e840a72a4
2026-03-26 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F192%252Fc9d971b458e14783bc111fee29b918a7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/192/c9d971b458e14783bc111fee29b918a7/images/large/1.jpg not downloaded yet
2026-03-26 18:32:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28e65550>
2026-03-26 18:32:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c89dc8aa-18ad-536e-a247-383d089ec0fa/c89dc8aa-18ad-536e-a247-383d089ec0fa_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F975%252Fec6f176a72c645d1bbed5c23030d8d14%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/975/ec6f176a72c645d1bbed5c23030d8d14/images/large/1.jpg saved to cache
2026-03-26 18:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c89dc8aa-18ad-536e-a247-383d089ec0fa
2026-03-26 18:32:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c89dc8aa-18ad-536e-a247-383d089ec0fa, skipping ID generation
2026-03-26 18:32:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c89dc8aa-18ad-536e-a247-383d089ec0fa with scrape type 1
2026-03-26 18:32:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c89dc8aa-18ad-536e-a247-383d089ec0fa sending to next pipeline
2026-03-26 18:32:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c89dc8aa-18ad-536e-a247-383d089ec0fa, identifier: 1985241
2026-03-26 18:32:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c22d90>
2026-03-26 18:32:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53e6c011-1197-5f05-acb2-f793312e31aa/53e6c011-1197-5f05-acb2-f793312e31aa_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F330%252F57c07637d20d45499c1dcb16df9fa65a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/330/57c07637d20d45499c1dcb16df9fa65a/images/large/1.jpg saved to cache
2026-03-26 18:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 53e6c011-1197-5f05-acb2-f793312e31aa
2026-03-26 18:32:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 53e6c011-1197-5f05-acb2-f793312e31aa, skipping ID generation
2026-03-26 18:32:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53e6c011-1197-5f05-acb2-f793312e31aa with scrape type 1
2026-03-26 18:32:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 53e6c011-1197-5f05-acb2-f793312e31aa sending to next pipeline
2026-03-26 18:32:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 53e6c011-1197-5f05-acb2-f793312e31aa, identifier: 1985243
2026-03-26 18:32:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c89dc8aa-18ad-536e-a247-383d089ec0fa with identifier: 1985241
2026-03-26 18:32:06 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:32:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c89dc8aa-18ad-536e-a247-383d089ec0fa with identifier: 1985241
2026-03-26 18:32:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c89dc8aa-18ad-536e-a247-383d089ec0fa with identifier: 1985241 to the API
2026-03-26 18:32:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/975/ec6f176a72c645d1bbed5c23030d8d14/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 45,
 'color': 'Azul brillante metal',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'c89dc8aa-18ad-536e-a247-383d089ec0fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLC-CLASS',
 'odometer': 169983,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c89dc8aa-18ad-536e-a247-383d089ec0fa/c89dc8aa-18ad-536e-a247-383d089ec0fa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 548505,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/975/ec6f176a72c645d1bbed5c23030d8d14/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLC-CLASS GLC 300 de 4MATIC',
 'transmission': 'manual',
 'trim': 'GLC 300 de 4MATIC',
 'vin': None,
 'year': 2021}
2026-03-26 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985241%27 HTTP/1.1" 200 None
2026-03-26 18:32:07 [ayvens.es] INFO: Saving data for 1985241: {'created_time': 1774549927.110498, 'last_price_update_time': 1774549927.110507, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985241') HTTP/1.1" 204 0
2026-03-26 18:32:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 53e6c011-1197-5f05-acb2-f793312e31aa with identifier: 1985243
2026-03-26 18:32:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 53e6c011-1197-5f05-acb2-f793312e31aa with identifier: 1985243
2026-03-26 18:32:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 53e6c011-1197-5f05-acb2-f793312e31aa with identifier: 1985243 to the API
2026-03-26 18:32:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/330/57c07637d20d45499c1dcb16df9fa65a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '53e6c011-1197-5f05-acb2-f793312e31aa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'IONIQ',
 'odometer': 176903,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53e6c011-1197-5f05-acb2-f793312e31aa/53e6c011-1197-5f05-acb2-f793312e31aa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336385,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/330/57c07637d20d45499c1dcb16df9fa65a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI IONIQ 1.6 GDI HEV Klass DCT',
 'transmission': 'manual',
 'trim': '1.6 GDI HEV Klass DCT',
 'vin': None,
 'year': 2021}
2026-03-26 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985243%27 HTTP/1.1" 200 None
2026-03-26 18:32:07 [ayvens.es] INFO: Saving data for 1985243: {'created_time': 1774549927.442895, 'last_price_update_time': 1774549927.442905, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985243') HTTP/1.1" 204 0
2026-03-26 18:32:07 [ayvens.es] INFO: Found listing with ID: 1985698
2026-03-26 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985698%27 HTTP/1.1" 200 None
2026-03-26 18:32:07 [ayvens.es] INFO: Scrape type for 1985698: 1
2026-03-26 18:32:07 [ayvens.es] INFO: Extracting data for car ID: 1985698
2026-03-26 18:32:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6d62bdd-18b7-5645-bfab-780d1c00700e with identifier: 1985698
2026-03-26 18:32:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6d62bdd-18b7-5645-bfab-780d1c00700e with scrape type 1
2026-03-26 18:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d6d62bdd-18b7-5645-bfab-780d1c00700e
2026-03-26 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F613%252F28c2cb3dc07147b1854dd7993d59b151%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/613/28c2cb3dc07147b1854dd7993d59b151/images/large/1.jpg not downloaded yet
2026-03-26 18:32:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/857/f32473f75285495da86abeda50d88674/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a2832ad90>
2026-03-26 18:32:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_affd005b-8cee-581d-ba21-24bd80ce35da/affd005b-8cee-581d-ba21-24bd80ce35da_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F422%252Fd282e75349ca48449733fd9060924178%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/422/d282e75349ca48449733fd9060924178/images/large/1.jpg saved to cache
2026-03-26 18:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item affd005b-8cee-581d-ba21-24bd80ce35da
2026-03-26 18:32:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: affd005b-8cee-581d-ba21-24bd80ce35da, skipping ID generation
2026-03-26 18:32:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item affd005b-8cee-581d-ba21-24bd80ce35da with scrape type 1
2026-03-26 18:32:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item affd005b-8cee-581d-ba21-24bd80ce35da sending to next pipeline
2026-03-26 18:32:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: affd005b-8cee-581d-ba21-24bd80ce35da, identifier: 1985242
2026-03-26 18:32:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c9ec10>
2026-03-26 18:32:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a52d46ec-8b50-5465-abf1-99d332736696/a52d46ec-8b50-5465-abf1-99d332736696_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F938%252F4e214bea121040e68d9e4aad4c1cdf78%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/938/4e214bea121040e68d9e4aad4c1cdf78/images/large/1.jpg saved to cache
2026-03-26 18:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a52d46ec-8b50-5465-abf1-99d332736696
2026-03-26 18:32:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a52d46ec-8b50-5465-abf1-99d332736696, skipping ID generation
2026-03-26 18:32:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a52d46ec-8b50-5465-abf1-99d332736696 with scrape type 1
2026-03-26 18:32:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a52d46ec-8b50-5465-abf1-99d332736696 sending to next pipeline
2026-03-26 18:32:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a52d46ec-8b50-5465-abf1-99d332736696, identifier: 1985244
2026-03-26 18:32:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/313/233d4a991b5f4da19a274b724141976a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:07 [ayvens.es] INFO: Found listing with ID: 1985699
2026-03-26 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985699%27 HTTP/1.1" 200 None
2026-03-26 18:32:07 [ayvens.es] INFO: Scrape type for 1985699: 1
2026-03-26 18:32:07 [ayvens.es] INFO: Extracting data for car ID: 1985699
2026-03-26 18:32:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43e931b0-6084-54e9-abf8-a75e834a4020 with identifier: 1985699
2026-03-26 18:32:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43e931b0-6084-54e9-abf8-a75e834a4020 with scrape type 1
2026-03-26 18:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 43e931b0-6084-54e9-abf8-a75e834a4020
2026-03-26 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F128%252Fda7665ba819e4996b1abe014a6209403%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/128/da7665ba819e4996b1abe014a6209403/images/large/1.jpg not downloaded yet
2026-03-26 18:32:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: affd005b-8cee-581d-ba21-24bd80ce35da with identifier: 1985242
2026-03-26 18:32:07 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:32:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: affd005b-8cee-581d-ba21-24bd80ce35da with identifier: 1985242
2026-03-26 18:32:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: affd005b-8cee-581d-ba21-24bd80ce35da with identifier: 1985242 to the API
2026-03-26 18:32:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/422/d282e75349ca48449733fd9060924178/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 44,
 'color': 'Fuji white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'affd005b-8cee-581d-ba21-24bd80ce35da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER EVOQUE',
 'odometer': 108711,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_affd005b-8cee-581d-ba21-24bd80ce35da/affd005b-8cee-581d-ba21-24bd80ce35da_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 628342,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/422/d282e75349ca48449733fd9060924178/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER RANGE ROVER EVOQUE 1.5 P300e R-Dynamic S AUTO 4WD PHEV',
 'transmission': 'manual',
 'trim': '1.5 P300e R-Dynamic S AUTO 4WD PHEV',
 'vin': None,
 'year': 2022}
2026-03-26 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985242%27 HTTP/1.1" 200 None
2026-03-26 18:32:08 [ayvens.es] INFO: Saving data for 1985242: {'created_time': 1774549928.213024, 'last_price_update_time': 1774549928.213036, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985242') HTTP/1.1" 204 0
2026-03-26 18:32:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a52d46ec-8b50-5465-abf1-99d332736696 with identifier: 1985244
2026-03-26 18:32:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a52d46ec-8b50-5465-abf1-99d332736696 with identifier: 1985244
2026-03-26 18:32:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a52d46ec-8b50-5465-abf1-99d332736696 with identifier: 1985244 to the API
2026-03-26 18:32:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/938/4e214bea121040e68d9e4aad4c1cdf78/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 35,
 'color': 'Cristal pearl',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'a52d46ec-8b50-5465-abf1-99d332736696',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41069',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS 7 CROSSBACK',
 'odometer': 62959,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a52d46ec-8b50-5465-abf1-99d332736696/a52d46ec-8b50-5465-abf1-99d332736696_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332228,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/938/4e214bea121040e68d9e4aad4c1cdf78/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS 7 CROSSBACK 1.6 E-Tense 225 PERFORMANCE LINE Auto',
 'transmission': 'manual',
 'trim': '1.6 E-Tense 225 PERFORMANCE LINE Auto',
 'vin': None,
 'year': 2021}
2026-03-26 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985244%27 HTTP/1.1" 200 None
2026-03-26 18:32:08 [ayvens.es] INFO: Saving data for 1985244: {'created_time': 1774549928.540129, 'last_price_update_time': 1774549928.540139, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985244') HTTP/1.1" 204 0
2026-03-26 18:32:08 [ayvens.es] INFO: Found listing with ID: 1985700
2026-03-26 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985700%27 HTTP/1.1" 200 None
2026-03-26 18:32:08 [ayvens.es] INFO: Scrape type for 1985700: 1
2026-03-26 18:32:08 [ayvens.es] INFO: Extracting data for car ID: 1985700
2026-03-26 18:32:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e993d71-0fea-5c85-bbc8-4823c7c2f9e8 with identifier: 1985700
2026-03-26 18:32:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e993d71-0fea-5c85-bbc8-4823c7c2f9e8 with scrape type 1
2026-03-26 18:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7e993d71-0fea-5c85-bbc8-4823c7c2f9e8
2026-03-26 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F342%252Ff0cb286f40964e7e80deb03c1fbc5962%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/342/f0cb286f40964e7e80deb03c1fbc5962/images/large/1.jpg not downloaded yet
2026-03-26 18:32:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/840/e870e175accc48c59d2a52e3c744fb4c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a281f92d0>
2026-03-26 18:32:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3927c8eb-d5de-5611-a8f6-565554dabfd4/3927c8eb-d5de-5611-a8f6-565554dabfd4_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F857%252Ff32473f75285495da86abeda50d88674%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/857/f32473f75285495da86abeda50d88674/images/large/1.jpg saved to cache
2026-03-26 18:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3927c8eb-d5de-5611-a8f6-565554dabfd4
2026-03-26 18:32:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3927c8eb-d5de-5611-a8f6-565554dabfd4, skipping ID generation
2026-03-26 18:32:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3927c8eb-d5de-5611-a8f6-565554dabfd4 with scrape type 1
2026-03-26 18:32:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3927c8eb-d5de-5611-a8f6-565554dabfd4 sending to next pipeline
2026-03-26 18:32:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3927c8eb-d5de-5611-a8f6-565554dabfd4, identifier: 1985693
2026-03-26 18:32:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28e78090>
2026-03-26 18:32:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_586014a6-8b70-5e90-9f4c-54bf23cf0de6/586014a6-8b70-5e90-9f4c-54bf23cf0de6_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F313%252F233d4a991b5f4da19a274b724141976a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/313/233d4a991b5f4da19a274b724141976a/images/large/1.jpg saved to cache
2026-03-26 18:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 586014a6-8b70-5e90-9f4c-54bf23cf0de6
2026-03-26 18:32:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 586014a6-8b70-5e90-9f4c-54bf23cf0de6, skipping ID generation
2026-03-26 18:32:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 586014a6-8b70-5e90-9f4c-54bf23cf0de6 with scrape type 1
2026-03-26 18:32:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 586014a6-8b70-5e90-9f4c-54bf23cf0de6 sending to next pipeline
2026-03-26 18:32:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 586014a6-8b70-5e90-9f4c-54bf23cf0de6, identifier: 1985692
2026-03-26 18:32:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/651/70a1c438c5bb4292abef983148ae46c6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:08 [ayvens.es] INFO: Found listing with ID: 1985701
2026-03-26 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985701%27 HTTP/1.1" 200 None
2026-03-26 18:32:08 [ayvens.es] INFO: Scrape type for 1985701: 1
2026-03-26 18:32:08 [ayvens.es] INFO: Extracting data for car ID: 1985701
2026-03-26 18:32:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 553cb826-5232-5663-a306-f409491bca25 with identifier: 1985701
2026-03-26 18:32:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 553cb826-5232-5663-a306-f409491bca25 with scrape type 1
2026-03-26 18:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 553cb826-5232-5663-a306-f409491bca25
2026-03-26 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F363%252Feecc8dfb0264451a895314d17a61eef8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/363/eecc8dfb0264451a895314d17a61eef8/images/large/1.jpg not downloaded yet
2026-03-26 18:32:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3927c8eb-d5de-5611-a8f6-565554dabfd4 with identifier: 1985693
2026-03-26 18:32:08 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:32:08 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:32:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3927c8eb-d5de-5611-a8f6-565554dabfd4 with identifier: 1985693
2026-03-26 18:32:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3927c8eb-d5de-5611-a8f6-565554dabfd4 with identifier: 1985693 to the API
2026-03-26 18:32:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/857/f32473f75285495da86abeda50d88674/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Gris platinum',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '3927c8eb-d5de-5611-a8f6-565554dabfd4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 97423,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3927c8eb-d5de-5611-a8f6-565554dabfd4/3927c8eb-d5de-5611-a8f6-565554dabfd4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 307905,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/857/f32473f75285495da86abeda50d88674/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.5 BlueHDi 96kW (130CV) S&S Active Pack',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi 96kW (130CV) S&S Active Pack',
 'vin': None,
 'year': 2021}
2026-03-26 18:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985693%27 HTTP/1.1" 200 None
2026-03-26 18:32:09 [ayvens.es] INFO: Saving data for 1985693: {'created_time': 1774549929.275907, 'last_price_update_time': 1774549929.275918, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985693') HTTP/1.1" 204 0
2026-03-26 18:32:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 586014a6-8b70-5e90-9f4c-54bf23cf0de6 with identifier: 1985692
2026-03-26 18:32:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 586014a6-8b70-5e90-9f4c-54bf23cf0de6 with identifier: 1985692
2026-03-26 18:32:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 586014a6-8b70-5e90-9f4c-54bf23cf0de6 with identifier: 1985692 to the API
2026-03-26 18:32:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/313/233d4a991b5f4da19a274b724141976a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '586014a6-8b70-5e90-9f4c-54bf23cf0de6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'MONDEO',
 'odometer': 321602,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_586014a6-8b70-5e90-9f4c-54bf23cf0de6/586014a6-8b70-5e90-9f4c-54bf23cf0de6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 355554,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/313/233d4a991b5f4da19a274b724141976a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD MONDEO 2.0 TDCi 110kW (150CV) Titanium',
 'transmission': 'manual',
 'trim': '2.0 TDCi 110kW (150CV) Titanium',
 'vin': None,
 'year': 2021}
2026-03-26 18:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985692%27 HTTP/1.1" 200 None
2026-03-26 18:32:09 [ayvens.es] INFO: Saving data for 1985692: {'created_time': 1774549929.595534, 'last_price_update_time': 1774549929.595544, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985692') HTTP/1.1" 204 0
2026-03-26 18:32:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/247/a845418791bb44f88ea24c0505358e0f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:09 [ayvens.es] INFO: Found listing with ID: 1985702
2026-03-26 18:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985702%27 HTTP/1.1" 200 None
2026-03-26 18:32:09 [ayvens.es] INFO: Scrape type for 1985702: 1
2026-03-26 18:32:09 [ayvens.es] INFO: Extracting data for car ID: 1985702
2026-03-26 18:32:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33dda148-e54d-5a28-b1f9-9d8038482032 with identifier: 1985702
2026-03-26 18:32:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33dda148-e54d-5a28-b1f9-9d8038482032 with scrape type 1
2026-03-26 18:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 33dda148-e54d-5a28-b1f9-9d8038482032
2026-03-26 18:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F426%252Fcefe591c2f18464bafc35d3a34b61aa4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/426/cefe591c2f18464bafc35d3a34b61aa4/images/large/1.jpg not downloaded yet
2026-03-26 18:32:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/192/c9d971b458e14783bc111fee29b918a7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a2833cb50>
2026-03-26 18:32:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f70c008-2023-52b6-b069-7f3d42f8506f/1f70c008-2023-52b6-b069-7f3d42f8506f_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F840%252Fe870e175accc48c59d2a52e3c744fb4c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/840/e870e175accc48c59d2a52e3c744fb4c/images/large/1.jpg saved to cache
2026-03-26 18:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1f70c008-2023-52b6-b069-7f3d42f8506f
2026-03-26 18:32:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1f70c008-2023-52b6-b069-7f3d42f8506f, skipping ID generation
2026-03-26 18:32:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f70c008-2023-52b6-b069-7f3d42f8506f with scrape type 1
2026-03-26 18:32:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1f70c008-2023-52b6-b069-7f3d42f8506f sending to next pipeline
2026-03-26 18:32:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1f70c008-2023-52b6-b069-7f3d42f8506f, identifier: 1985694
2026-03-26 18:32:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a284ee690>
2026-03-26 18:32:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ab832fc-27b7-5910-bfc7-b8f1e5dc2a70/6ab832fc-27b7-5910-bfc7-b8f1e5dc2a70_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F651%252F70a1c438c5bb4292abef983148ae46c6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/651/70a1c438c5bb4292abef983148ae46c6/images/large/1.jpg saved to cache
2026-03-26 18:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6ab832fc-27b7-5910-bfc7-b8f1e5dc2a70
2026-03-26 18:32:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6ab832fc-27b7-5910-bfc7-b8f1e5dc2a70, skipping ID generation
2026-03-26 18:32:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ab832fc-27b7-5910-bfc7-b8f1e5dc2a70 with scrape type 1
2026-03-26 18:32:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6ab832fc-27b7-5910-bfc7-b8f1e5dc2a70 sending to next pipeline
2026-03-26 18:32:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6ab832fc-27b7-5910-bfc7-b8f1e5dc2a70, identifier: 1985695
2026-03-26 18:32:10 [ayvens.es] INFO: Found listing with ID: 1985703
2026-03-26 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985703%27 HTTP/1.1" 200 None
2026-03-26 18:32:10 [ayvens.es] INFO: Scrape type for 1985703: 1
2026-03-26 18:32:10 [ayvens.es] INFO: Extracting data for car ID: 1985703
2026-03-26 18:32:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e007108a-01ae-5e98-8828-6f68ea7c52c8 with identifier: 1985703
2026-03-26 18:32:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e007108a-01ae-5e98-8828-6f68ea7c52c8 with scrape type 1
2026-03-26 18:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e007108a-01ae-5e98-8828-6f68ea7c52c8
2026-03-26 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F301%252F1789596417b84bb7a6c9b76aa645850d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/301/1789596417b84bb7a6c9b76aa645850d/images/large/1.jpg not downloaded yet
2026-03-26 18:32:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1f70c008-2023-52b6-b069-7f3d42f8506f with identifier: 1985694
2026-03-26 18:32:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:32:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1f70c008-2023-52b6-b069-7f3d42f8506f with identifier: 1985694
2026-03-26 18:32:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1f70c008-2023-52b6-b069-7f3d42f8506f with identifier: 1985694 to the API
2026-03-26 18:32:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/840/e870e175accc48c59d2a52e3c744fb4c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'color': 'Blanco solido',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.7L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '1f70c008-2023-52b6-b069-7f3d42f8506f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 219488,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f70c008-2023-52b6-b069-7f3d42f8506f/1f70c008-2023-52b6-b069-7f3d42f8506f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347310,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/840/e870e175accc48c59d2a52e3c744fb4c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI dCi 150CV (110kW) 4WD ACENTA',
 'transmission': 'manual',
 'trim': 'dCi 150CV (110kW) 4WD ACENTA',
 'vin': None,
 'year': 2020}
2026-03-26 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985694%27 HTTP/1.1" 200 None
2026-03-26 18:32:10 [ayvens.es] INFO: Saving data for 1985694: {'created_time': 1774549930.345534, 'last_price_update_time': 1774549930.345548, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985694') HTTP/1.1" 204 0
2026-03-26 18:32:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6ab832fc-27b7-5910-bfc7-b8f1e5dc2a70 with identifier: 1985695
2026-03-26 18:32:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6ab832fc-27b7-5910-bfc7-b8f1e5dc2a70 with identifier: 1985695
2026-03-26 18:32:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 6ab832fc-27b7-5910-bfc7-b8f1e5dc2a70 with identifier: 1985695 to the API
2026-03-26 18:32:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/651/70a1c438c5bb4292abef983148ae46c6/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.2L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '6ab832fc-27b7-5910-bfc7-b8f1e5dc2a70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'FIORINO',
 'odometer': 126956,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ab832fc-27b7-5910-bfc7-b8f1e5dc2a70/6ab832fc-27b7-5910-bfc7-b8f1e5dc2a70_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 414723,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/651/70a1c438c5bb4292abef983148ae46c6/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-23',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FIAT FIORINO Cargo Base 1.3 Mjet 75cv E5+ Clase 2',
 'transmission': 'manual',
 'trim': 'Cargo Base 1.3 Mjet 75cv E5+ Clase 2',
 'vin': None,
 'year': 2017}
2026-03-26 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985695%27 HTTP/1.1" 200 None
2026-03-26 18:32:10 [ayvens.es] INFO: Saving data for 1985695: {'created_time': 1774549930.732968, 'last_price_update_time': 1774549930.732978, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985695') HTTP/1.1" 204 0
2026-03-26 18:32:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/613/28c2cb3dc07147b1854dd7993d59b151/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:10 [ayvens.es] INFO: Found listing with ID: 1985704
2026-03-26 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985704%27 HTTP/1.1" 200 None
2026-03-26 18:32:10 [ayvens.es] INFO: Scrape type for 1985704: 1
2026-03-26 18:32:10 [ayvens.es] INFO: Extracting data for car ID: 1985704
2026-03-26 18:32:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf6fd490-7526-505f-9ec0-407c8e277878 with identifier: 1985704
2026-03-26 18:32:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf6fd490-7526-505f-9ec0-407c8e277878 with scrape type 1
2026-03-26 18:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item cf6fd490-7526-505f-9ec0-407c8e277878
2026-03-26 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F301%252Fc03918f7529d4090983c122dcb3e1662%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/301/c03918f7529d4090983c122dcb3e1662/images/large/1.jpg not downloaded yet
2026-03-26 18:32:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/128/da7665ba819e4996b1abe014a6209403/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c31610>
2026-03-26 18:32:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef2a98b7-d8f9-538a-af9a-71db86c18ed7/ef2a98b7-d8f9-538a-af9a-71db86c18ed7_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F247%252Fa845418791bb44f88ea24c0505358e0f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/247/a845418791bb44f88ea24c0505358e0f/images/large/1.jpg saved to cache
2026-03-26 18:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ef2a98b7-d8f9-538a-af9a-71db86c18ed7
2026-03-26 18:32:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ef2a98b7-d8f9-538a-af9a-71db86c18ed7, skipping ID generation
2026-03-26 18:32:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef2a98b7-d8f9-538a-af9a-71db86c18ed7 with scrape type 1
2026-03-26 18:32:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ef2a98b7-d8f9-538a-af9a-71db86c18ed7 sending to next pipeline
2026-03-26 18:32:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ef2a98b7-d8f9-538a-af9a-71db86c18ed7, identifier: 1985696
2026-03-26 18:32:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28e85190>
2026-03-26 18:32:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94b7bfcb-57b8-56da-9573-6c3e840a72a4/94b7bfcb-57b8-56da-9573-6c3e840a72a4_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F192%252Fc9d971b458e14783bc111fee29b918a7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/192/c9d971b458e14783bc111fee29b918a7/images/large/1.jpg saved to cache
2026-03-26 18:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 94b7bfcb-57b8-56da-9573-6c3e840a72a4
2026-03-26 18:32:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 94b7bfcb-57b8-56da-9573-6c3e840a72a4, skipping ID generation
2026-03-26 18:32:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94b7bfcb-57b8-56da-9573-6c3e840a72a4 with scrape type 1
2026-03-26 18:32:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 94b7bfcb-57b8-56da-9573-6c3e840a72a4 sending to next pipeline
2026-03-26 18:32:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 94b7bfcb-57b8-56da-9573-6c3e840a72a4, identifier: 1985697
2026-03-26 18:32:11 [ayvens.es] INFO: Found listing with ID: 1985705
2026-03-26 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985705%27 HTTP/1.1" 200 None
2026-03-26 18:32:11 [ayvens.es] INFO: Scrape type for 1985705: 1
2026-03-26 18:32:11 [ayvens.es] INFO: Extracting data for car ID: 1985705
2026-03-26 18:32:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a01caaf-9b60-5dfa-8125-c98bcd899d1d with identifier: 1985705
2026-03-26 18:32:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a01caaf-9b60-5dfa-8125-c98bcd899d1d with scrape type 1
2026-03-26 18:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6a01caaf-9b60-5dfa-8125-c98bcd899d1d
2026-03-26 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F669%252F89b8100feee74f069edf8cd1cc0bf065%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/669/89b8100feee74f069edf8cd1cc0bf065/images/large/1.jpg not downloaded yet
2026-03-26 18:32:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ef2a98b7-d8f9-538a-af9a-71db86c18ed7 with identifier: 1985696
2026-03-26 18:32:11 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:32:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ef2a98b7-d8f9-538a-af9a-71db86c18ed7 with identifier: 1985696
2026-03-26 18:32:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ef2a98b7-d8f9-538a-af9a-71db86c18ed7 with identifier: 1985696 to the API
2026-03-26 18:32:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/247/a845418791bb44f88ea24c0505358e0f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Azul',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ef2a98b7-d8f9-538a-af9a-71db86c18ed7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS 3 CROSSBACK',
 'odometer': 124784,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef2a98b7-d8f9-538a-af9a-71db86c18ed7/ef2a98b7-d8f9-538a-af9a-71db86c18ed7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 361516,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/247/a845418791bb44f88ea24c0505358e0f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS 3 CROSSBACK BlueHDi 96 kW Auto Ines de la '
          'Fressange',
 'transmission': 'manual',
 'trim': 'BlueHDi 96 kW Auto Ines de la Fressange',
 'vin': None,
 'year': 2021}
2026-03-26 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985696%27 HTTP/1.1" 200 None
2026-03-26 18:32:11 [ayvens.es] INFO: Saving data for 1985696: {'created_time': 1774549931.417253, 'last_price_update_time': 1774549931.417265, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985696') HTTP/1.1" 204 0
2026-03-26 18:32:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 94b7bfcb-57b8-56da-9573-6c3e840a72a4 with identifier: 1985697
2026-03-26 18:32:11 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:32:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 94b7bfcb-57b8-56da-9573-6c3e840a72a4 with identifier: 1985697
2026-03-26 18:32:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 94b7bfcb-57b8-56da-9573-6c3e840a72a4 with identifier: 1985697 to the API
2026-03-26 18:32:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/192/c9d971b458e14783bc111fee29b918a7/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '94b7bfcb-57b8-56da-9573-6c3e840a72a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'KONA',
 'odometer': 114521,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94b7bfcb-57b8-56da-9573-6c3e840a72a4/94b7bfcb-57b8-56da-9573-6c3e840a72a4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 366463,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/192/c9d971b458e14783bc111fee29b918a7/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI KONA 1.0 TGDI Maxx 4X2',
 'transmission': 'manual',
 'trim': '1.0 TGDI Maxx 4X2',
 'vin': None,
 'year': 2022}
2026-03-26 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985697%27 HTTP/1.1" 200 None
2026-03-26 18:32:11 [ayvens.es] INFO: Saving data for 1985697: {'created_time': 1774549931.724255, 'last_price_update_time': 1774549931.724265, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985697') HTTP/1.1" 204 0
2026-03-26 18:32:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/363/eecc8dfb0264451a895314d17a61eef8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:11 [ayvens.es] INFO: Found listing with ID: 1985706
2026-03-26 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985706%27 HTTP/1.1" 200 None
2026-03-26 18:32:11 [ayvens.es] INFO: Scrape type for 1985706: 1
2026-03-26 18:32:11 [ayvens.es] INFO: Extracting data for car ID: 1985706
2026-03-26 18:32:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d471a84-e2fa-513f-a5bf-34dacdf4cac5 with identifier: 1985706
2026-03-26 18:32:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d471a84-e2fa-513f-a5bf-34dacdf4cac5 with scrape type 1
2026-03-26 18:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1d471a84-e2fa-513f-a5bf-34dacdf4cac5
2026-03-26 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F474%252F48e09efdc28045c7b031bd45f124e7bf%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/474/48e09efdc28045c7b031bd45f124e7bf/images/large/1.jpg not downloaded yet
2026-03-26 18:32:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a290af290>
2026-03-26 18:32:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6d62bdd-18b7-5645-bfab-780d1c00700e/d6d62bdd-18b7-5645-bfab-780d1c00700e_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F613%252F28c2cb3dc07147b1854dd7993d59b151%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/613/28c2cb3dc07147b1854dd7993d59b151/images/large/1.jpg saved to cache
2026-03-26 18:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d6d62bdd-18b7-5645-bfab-780d1c00700e
2026-03-26 18:32:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d6d62bdd-18b7-5645-bfab-780d1c00700e, skipping ID generation
2026-03-26 18:32:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6d62bdd-18b7-5645-bfab-780d1c00700e with scrape type 1
2026-03-26 18:32:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d6d62bdd-18b7-5645-bfab-780d1c00700e sending to next pipeline
2026-03-26 18:32:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d6d62bdd-18b7-5645-bfab-780d1c00700e, identifier: 1985698
2026-03-26 18:32:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a283bb090>
2026-03-26 18:32:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43e931b0-6084-54e9-abf8-a75e834a4020/43e931b0-6084-54e9-abf8-a75e834a4020_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F128%252Fda7665ba819e4996b1abe014a6209403%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/128/da7665ba819e4996b1abe014a6209403/images/large/1.jpg saved to cache
2026-03-26 18:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 43e931b0-6084-54e9-abf8-a75e834a4020
2026-03-26 18:32:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 43e931b0-6084-54e9-abf8-a75e834a4020, skipping ID generation
2026-03-26 18:32:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43e931b0-6084-54e9-abf8-a75e834a4020 with scrape type 1
2026-03-26 18:32:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 43e931b0-6084-54e9-abf8-a75e834a4020 sending to next pipeline
2026-03-26 18:32:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 43e931b0-6084-54e9-abf8-a75e834a4020, identifier: 1985699
2026-03-26 18:32:12 [ayvens.es] INFO: Found listing with ID: 1985707
2026-03-26 18:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985707%27 HTTP/1.1" 200 None
2026-03-26 18:32:12 [ayvens.es] INFO: Scrape type for 1985707: 1
2026-03-26 18:32:12 [ayvens.es] INFO: Extracting data for car ID: 1985707
2026-03-26 18:32:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2065a08-b765-5a2c-a1c1-9441b54dd62d with identifier: 1985707
2026-03-26 18:32:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2065a08-b765-5a2c-a1c1-9441b54dd62d with scrape type 1
2026-03-26 18:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b2065a08-b765-5a2c-a1c1-9441b54dd62d
2026-03-26 18:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F531%252Fee8f8cb782f14036b113668c86a7d55e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/531/ee8f8cb782f14036b113668c86a7d55e/images/large/1.jpg not downloaded yet
2026-03-26 18:32:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d6d62bdd-18b7-5645-bfab-780d1c00700e with identifier: 1985698
2026-03-26 18:32:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d6d62bdd-18b7-5645-bfab-780d1c00700e with identifier: 1985698
2026-03-26 18:32:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d6d62bdd-18b7-5645-bfab-780d1c00700e with identifier: 1985698 to the API
2026-03-26 18:32:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/613/28c2cb3dc07147b1854dd7993d59b151/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.6L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd6d62bdd-18b7-5645-bfab-780d1c00700e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'DOBLO CARGO',
 'odometer': 152507,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6d62bdd-18b7-5645-bfab-780d1c00700e/d6d62bdd-18b7-5645-bfab-780d1c00700e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 310877,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/613/28c2cb3dc07147b1854dd7993d59b151/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-28',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FIAT DOBLO CARGO Cargo SX 1.6 Mjet 77kW (105CV)',
 'transmission': 'manual',
 'trim': 'Cargo SX 1.6 Mjet 77kW (105CV)',
 'vin': None,
 'year': 2021}
2026-03-26 18:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985698%27 HTTP/1.1" 200 None
2026-03-26 18:32:12 [ayvens.es] INFO: Saving data for 1985698: {'created_time': 1774549932.514363, 'last_price_update_time': 1774549932.514373, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985698') HTTP/1.1" 204 0
2026-03-26 18:32:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 43e931b0-6084-54e9-abf8-a75e834a4020 with identifier: 1985699
2026-03-26 18:32:12 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:32:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 43e931b0-6084-54e9-abf8-a75e834a4020 with identifier: 1985699
2026-03-26 18:32:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 43e931b0-6084-54e9-abf8-a75e834a4020 with identifier: 1985699 to the API
2026-03-26 18:32:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/128/da7665ba819e4996b1abe014a6209403/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'color': 'Negro cosmos',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '43e931b0-6084-54e9-abf8-a75e834a4020',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'B-CLASS',
 'odometer': 144633,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43e931b0-6084-54e9-abf8-a75e834a4020/43e931b0-6084-54e9-abf8-a75e834a4020_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 334444,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/128/da7665ba819e4996b1abe014a6209403/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ B-CLASS B 180 d',
 'transmission': 'manual',
 'trim': 'B 180 d',
 'vin': None,
 'year': 2022}
2026-03-26 18:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985699%27 HTTP/1.1" 200 None
2026-03-26 18:32:12 [ayvens.es] INFO: Saving data for 1985699: {'created_time': 1774549932.838602, 'last_price_update_time': 1774549932.838613, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985699') HTTP/1.1" 204 0
2026-03-26 18:32:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/342/f0cb286f40964e7e80deb03c1fbc5962/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/426/cefe591c2f18464bafc35d3a34b61aa4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:12 [ayvens.es] INFO: Found listing with ID: 1985708
2026-03-26 18:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985708%27 HTTP/1.1" 200 None
2026-03-26 18:32:12 [ayvens.es] INFO: Scrape type for 1985708: 1
2026-03-26 18:32:12 [ayvens.es] INFO: Extracting data for car ID: 1985708
2026-03-26 18:32:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70d845e5-af97-5e04-9b24-7482c4e60e58 with identifier: 1985708
2026-03-26 18:32:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70d845e5-af97-5e04-9b24-7482c4e60e58 with scrape type 1
2026-03-26 18:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 70d845e5-af97-5e04-9b24-7482c4e60e58
2026-03-26 18:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F355%252F7257bd6810bc40f1bf161e5180ca514c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/355/7257bd6810bc40f1bf161e5180ca514c/images/large/1.jpg not downloaded yet
2026-03-26 18:32:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a29048350>
2026-03-26 18:32:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_553cb826-5232-5663-a306-f409491bca25/553cb826-5232-5663-a306-f409491bca25_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F363%252Feecc8dfb0264451a895314d17a61eef8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/363/eecc8dfb0264451a895314d17a61eef8/images/large/1.jpg saved to cache
2026-03-26 18:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 553cb826-5232-5663-a306-f409491bca25
2026-03-26 18:32:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 553cb826-5232-5663-a306-f409491bca25, skipping ID generation
2026-03-26 18:32:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 553cb826-5232-5663-a306-f409491bca25 with scrape type 1
2026-03-26 18:32:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 553cb826-5232-5663-a306-f409491bca25 sending to next pipeline
2026-03-26 18:32:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 553cb826-5232-5663-a306-f409491bca25, identifier: 1985701
2026-03-26 18:32:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/301/1789596417b84bb7a6c9b76aa645850d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:13 [ayvens.es] INFO: Found listing with ID: 1985709
2026-03-26 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985709%27 HTTP/1.1" 200 None
2026-03-26 18:32:13 [ayvens.es] INFO: Scrape type for 1985709: 1
2026-03-26 18:32:13 [ayvens.es] INFO: Extracting data for car ID: 1985709
2026-03-26 18:32:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa1e186d-ad91-59d0-a579-d53f6124d560 with identifier: 1985709
2026-03-26 18:32:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa1e186d-ad91-59d0-a579-d53f6124d560 with scrape type 1
2026-03-26 18:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item fa1e186d-ad91-59d0-a579-d53f6124d560
2026-03-26 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F996%252F978665ce41df4147afacabd4e5047cc2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/996/978665ce41df4147afacabd4e5047cc2/images/large/1.jpg not downloaded yet
2026-03-26 18:32:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 553cb826-5232-5663-a306-f409491bca25 with identifier: 1985701
2026-03-26 18:32:13 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:32:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 553cb826-5232-5663-a306-f409491bca25 with identifier: 1985701
2026-03-26 18:32:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 553cb826-5232-5663-a306-f409491bca25 with identifier: 1985701 to the API
2026-03-26 18:32:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/363/eecc8dfb0264451a895314d17a61eef8/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 174,
 'color': 'Plata perla',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '553cb826-5232-5663-a306-f409491bca25',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'C-MAX',
 'odometer': 101227,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_553cb826-5232-5663-a306-f409491bca25/553cb826-5232-5663-a306-f409491bca25_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 326146,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/363/eecc8dfb0264451a895314d17a61eef8/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD C-MAX (O) 1.5 EcoBoost 110kW (150CV) Trend+ Auto **REVISAR '
          'PERITACION**',
 'transmission': 'manual',
 'trim': '(O) 1.5 EcoBoost 110kW (150CV) Trend+ Auto **REVISAR PERITACION**',
 'vin': None,
 'year': 2019}
2026-03-26 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985701%27 HTTP/1.1" 200 None
2026-03-26 18:32:13 [ayvens.es] INFO: Saving data for 1985701: {'created_time': 1774549933.45558, 'last_price_update_time': 1774549933.455589, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985701') HTTP/1.1" 204 0
2026-03-26 18:32:13 [ayvens.es] INFO: Found listing with ID: 1985710
2026-03-26 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985710%27 HTTP/1.1" 200 None
2026-03-26 18:32:13 [ayvens.es] INFO: Scrape type for 1985710: 1
2026-03-26 18:32:13 [ayvens.es] INFO: Extracting data for car ID: 1985710
2026-03-26 18:32:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 701736a7-8a18-59cb-af86-0eab0d5edb3a with identifier: 1985710
2026-03-26 18:32:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 701736a7-8a18-59cb-af86-0eab0d5edb3a with scrape type 1
2026-03-26 18:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 701736a7-8a18-59cb-af86-0eab0d5edb3a
2026-03-26 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F543%252F543f5a16a6a84c94aaf80e3d62d39e16%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/543/543f5a16a6a84c94aaf80e3d62d39e16/images/large/1.jpg not downloaded yet
2026-03-26 18:32:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/669/89b8100feee74f069edf8cd1cc0bf065/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28328110>
2026-03-26 18:32:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e993d71-0fea-5c85-bbc8-4823c7c2f9e8/7e993d71-0fea-5c85-bbc8-4823c7c2f9e8_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F342%252Ff0cb286f40964e7e80deb03c1fbc5962%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/342/f0cb286f40964e7e80deb03c1fbc5962/images/large/1.jpg saved to cache
2026-03-26 18:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7e993d71-0fea-5c85-bbc8-4823c7c2f9e8
2026-03-26 18:32:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7e993d71-0fea-5c85-bbc8-4823c7c2f9e8, skipping ID generation
2026-03-26 18:32:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e993d71-0fea-5c85-bbc8-4823c7c2f9e8 with scrape type 1
2026-03-26 18:32:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7e993d71-0fea-5c85-bbc8-4823c7c2f9e8 sending to next pipeline
2026-03-26 18:32:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7e993d71-0fea-5c85-bbc8-4823c7c2f9e8, identifier: 1985700
2026-03-26 18:32:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c2df50>
2026-03-26 18:32:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33dda148-e54d-5a28-b1f9-9d8038482032/33dda148-e54d-5a28-b1f9-9d8038482032_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F426%252Fcefe591c2f18464bafc35d3a34b61aa4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/426/cefe591c2f18464bafc35d3a34b61aa4/images/large/1.jpg saved to cache
2026-03-26 18:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 33dda148-e54d-5a28-b1f9-9d8038482032
2026-03-26 18:32:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 33dda148-e54d-5a28-b1f9-9d8038482032, skipping ID generation
2026-03-26 18:32:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33dda148-e54d-5a28-b1f9-9d8038482032 with scrape type 1
2026-03-26 18:32:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 33dda148-e54d-5a28-b1f9-9d8038482032 sending to next pipeline
2026-03-26 18:32:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 33dda148-e54d-5a28-b1f9-9d8038482032, identifier: 1985702
2026-03-26 18:32:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c245d0>
2026-03-26 18:32:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e007108a-01ae-5e98-8828-6f68ea7c52c8/e007108a-01ae-5e98-8828-6f68ea7c52c8_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F301%252F1789596417b84bb7a6c9b76aa645850d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/301/1789596417b84bb7a6c9b76aa645850d/images/large/1.jpg saved to cache
2026-03-26 18:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e007108a-01ae-5e98-8828-6f68ea7c52c8
2026-03-26 18:32:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e007108a-01ae-5e98-8828-6f68ea7c52c8, skipping ID generation
2026-03-26 18:32:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e007108a-01ae-5e98-8828-6f68ea7c52c8 with scrape type 1
2026-03-26 18:32:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e007108a-01ae-5e98-8828-6f68ea7c52c8 sending to next pipeline
2026-03-26 18:32:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e007108a-01ae-5e98-8828-6f68ea7c52c8, identifier: 1985703
2026-03-26 18:32:13 [ayvens.es] INFO: Found listing with ID: 1985711
2026-03-26 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985711%27 HTTP/1.1" 200 None
2026-03-26 18:32:14 [ayvens.es] INFO: Scrape type for 1985711: 1
2026-03-26 18:32:14 [ayvens.es] INFO: Extracting data for car ID: 1985711
2026-03-26 18:32:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d14a953b-2c02-5028-8555-b52851b196dd with identifier: 1985711
2026-03-26 18:32:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d14a953b-2c02-5028-8555-b52851b196dd with scrape type 1
2026-03-26 18:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d14a953b-2c02-5028-8555-b52851b196dd
2026-03-26 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F972%252Fd4690e4aeff64c119ad4f22aad46b133%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/972/d4690e4aeff64c119ad4f22aad46b133/images/large/1.jpg not downloaded yet
2026-03-26 18:32:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7e993d71-0fea-5c85-bbc8-4823c7c2f9e8 with identifier: 1985700
2026-03-26 18:32:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7e993d71-0fea-5c85-bbc8-4823c7c2f9e8 with identifier: 1985700
2026-03-26 18:32:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7e993d71-0fea-5c85-bbc8-4823c7c2f9e8 with identifier: 1985700 to the API
2026-03-26 18:32:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/342/f0cb286f40964e7e80deb03c1fbc5962/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '7e993d71-0fea-5c85-bbc8-4823c7c2f9e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'MICRA',
 'odometer': 31989,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e993d71-0fea-5c85-bbc8-4823c7c2f9e8/7e993d71-0fea-5c85-bbc8-4823c7c2f9e8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643088,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/342/f0cb286f40964e7e80deb03c1fbc5962/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN MICRA IG-T 68 kW (92 CV) E6D-F Acenta Sprint',
 'transmission': 'manual',
 'trim': 'IG-T 68 kW (92 CV) E6D-F Acenta Sprint',
 'vin': None,
 'year': 2023}
2026-03-26 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985700%27 HTTP/1.1" 200 None
2026-03-26 18:32:14 [ayvens.es] INFO: Saving data for 1985700: {'created_time': 1774549934.290407, 'last_price_update_time': 1774549934.290418, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985700') HTTP/1.1" 204 0
2026-03-26 18:32:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 33dda148-e54d-5a28-b1f9-9d8038482032 with identifier: 1985702
2026-03-26 18:32:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 33dda148-e54d-5a28-b1f9-9d8038482032 with identifier: 1985702
2026-03-26 18:32:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 33dda148-e54d-5a28-b1f9-9d8038482032 with identifier: 1985702 to the API
2026-03-26 18:32:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/426/cefe591c2f18464bafc35d3a34b61aa4/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 174,
 'color': 'Plata perla',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '33dda148-e54d-5a28-b1f9-9d8038482032',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'C-MAX',
 'odometer': 102359,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33dda148-e54d-5a28-b1f9-9d8038482032/33dda148-e54d-5a28-b1f9-9d8038482032_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329321,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/426/cefe591c2f18464bafc35d3a34b61aa4/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD C-MAX (O) 1.5 EcoBoost 110kW (150CV) Trend+ Auto **REVISAR '
          'PERITACION**',
 'transmission': 'manual',
 'trim': '(O) 1.5 EcoBoost 110kW (150CV) Trend+ Auto **REVISAR PERITACION**',
 'vin': None,
 'year': 2019}
2026-03-26 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985702%27 HTTP/1.1" 200 None
2026-03-26 18:32:14 [ayvens.es] INFO: Saving data for 1985702: {'created_time': 1774549934.603807, 'last_price_update_time': 1774549934.603816, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985702') HTTP/1.1" 204 0
2026-03-26 18:32:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e007108a-01ae-5e98-8828-6f68ea7c52c8 with identifier: 1985703
2026-03-26 18:32:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e007108a-01ae-5e98-8828-6f68ea7c52c8 with identifier: 1985703
2026-03-26 18:32:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e007108a-01ae-5e98-8828-6f68ea7c52c8 with identifier: 1985703 to the API
2026-03-26 18:32:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/301/1789596417b84bb7a6c9b76aa645850d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 206,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '2.1L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e007108a-01ae-5e98-8828-6f68ea7c52c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'SPRINTER',
 'odometer': 276188,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e007108a-01ae-5e98-8828-6f68ea7c52c8/e007108a-01ae-5e98-8828-6f68ea7c52c8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 436543,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/301/1789596417b84bb7a6c9b76aa645850d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-21',
 'seats_number': 3,
 'seller_name': None,
 'title': 'MERCEDES-BENZ SPRINTER 314 CDI MEDIO 3.5T **REVISAR PERITACION**',
 'transmission': 'manual',
 'trim': '314 CDI MEDIO 3.5T **REVISAR PERITACION**',
 'vin': None,
 'year': 2019}
2026-03-26 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985703%27 HTTP/1.1" 200 None
2026-03-26 18:32:14 [ayvens.es] INFO: Saving data for 1985703: {'created_time': 1774549934.915233, 'last_price_update_time': 1774549934.915244, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985703') HTTP/1.1" 204 0
2026-03-26 18:32:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/301/c03918f7529d4090983c122dcb3e1662/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/474/48e09efdc28045c7b031bd45f124e7bf/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:14 [ayvens.es] INFO: Found listing with ID: 1985712
2026-03-26 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985712%27 HTTP/1.1" 200 None
2026-03-26 18:32:14 [ayvens.es] INFO: Scrape type for 1985712: 1
2026-03-26 18:32:14 [ayvens.es] INFO: Extracting data for car ID: 1985712
2026-03-26 18:32:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f60e9c0f-10fc-5274-8c05-0a26a334eb91 with identifier: 1985712
2026-03-26 18:32:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f60e9c0f-10fc-5274-8c05-0a26a334eb91 with scrape type 1
2026-03-26 18:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f60e9c0f-10fc-5274-8c05-0a26a334eb91
2026-03-26 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F479%252Fc107fca100ae49838e4ea68d3ba17f53%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/479/c107fca100ae49838e4ea68d3ba17f53/images/large/1.jpg not downloaded yet
2026-03-26 18:32:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28ca6910>
2026-03-26 18:32:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a01caaf-9b60-5dfa-8125-c98bcd899d1d/6a01caaf-9b60-5dfa-8125-c98bcd899d1d_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F669%252F89b8100feee74f069edf8cd1cc0bf065%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/669/89b8100feee74f069edf8cd1cc0bf065/images/large/1.jpg saved to cache
2026-03-26 18:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6a01caaf-9b60-5dfa-8125-c98bcd899d1d
2026-03-26 18:32:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6a01caaf-9b60-5dfa-8125-c98bcd899d1d, skipping ID generation
2026-03-26 18:32:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a01caaf-9b60-5dfa-8125-c98bcd899d1d with scrape type 1
2026-03-26 18:32:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6a01caaf-9b60-5dfa-8125-c98bcd899d1d sending to next pipeline
2026-03-26 18:32:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6a01caaf-9b60-5dfa-8125-c98bcd899d1d, identifier: 1985705
2026-03-26 18:32:15 [ayvens.es] INFO: Found listing with ID: 1985713
2026-03-26 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985713%27 HTTP/1.1" 200 None
2026-03-26 18:32:15 [ayvens.es] INFO: Scrape type for 1985713: 1
2026-03-26 18:32:15 [ayvens.es] INFO: Extracting data for car ID: 1985713
2026-03-26 18:32:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ff2566e-f8c8-5f08-870d-240ba8005edb with identifier: 1985713
2026-03-26 18:32:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ff2566e-f8c8-5f08-870d-240ba8005edb with scrape type 1
2026-03-26 18:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9ff2566e-f8c8-5f08-870d-240ba8005edb
2026-03-26 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F204%252F1e0168b1528c434c936fddcc84259091%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/204/1e0168b1528c434c936fddcc84259091/images/large/1.jpg not downloaded yet
2026-03-26 18:32:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6a01caaf-9b60-5dfa-8125-c98bcd899d1d with identifier: 1985705
2026-03-26 18:32:15 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:32:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6a01caaf-9b60-5dfa-8125-c98bcd899d1d with identifier: 1985705
2026-03-26 18:32:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 6a01caaf-9b60-5dfa-8125-c98bcd899d1d with identifier: 1985705 to the API
2026-03-26 18:32:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/669/89b8100feee74f069edf8cd1cc0bf065/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'Gris platinum',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '6a01caaf-9b60-5dfa-8125-c98bcd899d1d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 99619,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a01caaf-9b60-5dfa-8125-c98bcd899d1d/6a01caaf-9b60-5dfa-8125-c98bcd899d1d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 381103,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/669/89b8100feee74f069edf8cd1cc0bf065/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.5 BlueHDi 96kW (130CV) S&S Active Pack',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi 96kW (130CV) S&S Active Pack',
 'vin': None,
 'year': 2021}
2026-03-26 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985705%27 HTTP/1.1" 200 None
2026-03-26 18:32:15 [ayvens.es] INFO: Saving data for 1985705: {'created_time': 1774549935.559458, 'last_price_update_time': 1774549935.559469, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985705') HTTP/1.1" 204 0
2026-03-26 18:32:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/355/7257bd6810bc40f1bf161e5180ca514c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:15 [ayvens.es] INFO: Found listing with ID: 1985714
2026-03-26 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985714%27 HTTP/1.1" 200 None
2026-03-26 18:32:15 [ayvens.es] INFO: Scrape type for 1985714: 1
2026-03-26 18:32:15 [ayvens.es] INFO: Extracting data for car ID: 1985714
2026-03-26 18:32:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a481262-8a12-5a10-b357-0fd22e1d589a with identifier: 1985714
2026-03-26 18:32:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a481262-8a12-5a10-b357-0fd22e1d589a with scrape type 1
2026-03-26 18:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9a481262-8a12-5a10-b357-0fd22e1d589a
2026-03-26 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F962%252F00f3309f46834a2889d94b8a29c66d82%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/962/00f3309f46834a2889d94b8a29c66d82/images/large/1.jpg not downloaded yet
2026-03-26 18:32:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a283473d0>
2026-03-26 18:32:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf6fd490-7526-505f-9ec0-407c8e277878/cf6fd490-7526-505f-9ec0-407c8e277878_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F301%252Fc03918f7529d4090983c122dcb3e1662%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/301/c03918f7529d4090983c122dcb3e1662/images/large/1.jpg saved to cache
2026-03-26 18:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cf6fd490-7526-505f-9ec0-407c8e277878
2026-03-26 18:32:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cf6fd490-7526-505f-9ec0-407c8e277878, skipping ID generation
2026-03-26 18:32:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf6fd490-7526-505f-9ec0-407c8e277878 with scrape type 1
2026-03-26 18:32:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cf6fd490-7526-505f-9ec0-407c8e277878 sending to next pipeline
2026-03-26 18:32:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: cf6fd490-7526-505f-9ec0-407c8e277878, identifier: 1985704
2026-03-26 18:32:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28233410>
2026-03-26 18:32:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d471a84-e2fa-513f-a5bf-34dacdf4cac5/1d471a84-e2fa-513f-a5bf-34dacdf4cac5_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F474%252F48e09efdc28045c7b031bd45f124e7bf%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/474/48e09efdc28045c7b031bd45f124e7bf/images/large/1.jpg saved to cache
2026-03-26 18:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1d471a84-e2fa-513f-a5bf-34dacdf4cac5
2026-03-26 18:32:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1d471a84-e2fa-513f-a5bf-34dacdf4cac5, skipping ID generation
2026-03-26 18:32:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d471a84-e2fa-513f-a5bf-34dacdf4cac5 with scrape type 1
2026-03-26 18:32:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1d471a84-e2fa-513f-a5bf-34dacdf4cac5 sending to next pipeline
2026-03-26 18:32:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1d471a84-e2fa-513f-a5bf-34dacdf4cac5, identifier: 1985706
2026-03-26 18:32:16 [ayvens.es] INFO: Found listing with ID: 1985715
2026-03-26 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985715%27 HTTP/1.1" 200 None
2026-03-26 18:32:16 [ayvens.es] INFO: Scrape type for 1985715: 1
2026-03-26 18:32:16 [ayvens.es] INFO: Extracting data for car ID: 1985715
2026-03-26 18:32:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b43098c7-96d2-51ff-b01b-b43200cd6323 with identifier: 1985715
2026-03-26 18:32:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b43098c7-96d2-51ff-b01b-b43200cd6323 with scrape type 1
2026-03-26 18:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b43098c7-96d2-51ff-b01b-b43200cd6323
2026-03-26 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F505%252F5d7dc67b50184e6ea18e387f9a5f7526%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/505/5d7dc67b50184e6ea18e387f9a5f7526/images/large/1.jpg not downloaded yet
2026-03-26 18:32:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: cf6fd490-7526-505f-9ec0-407c8e277878 with identifier: 1985704
2026-03-26 18:32:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: cf6fd490-7526-505f-9ec0-407c8e277878 with identifier: 1985704
2026-03-26 18:32:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: cf6fd490-7526-505f-9ec0-407c8e277878 with identifier: 1985704 to the API
2026-03-26 18:32:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/301/c03918f7529d4090983c122dcb3e1662/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 206,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '2.1L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'cf6fd490-7526-505f-9ec0-407c8e277878',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'SPRINTER',
 'odometer': 266224,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf6fd490-7526-505f-9ec0-407c8e277878/cf6fd490-7526-505f-9ec0-407c8e277878_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 531579,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/301/c03918f7529d4090983c122dcb3e1662/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-21',
 'seats_number': 3,
 'seller_name': None,
 'title': 'MERCEDES-BENZ SPRINTER 314 CDI MEDIO 3.5T',
 'transmission': 'manual',
 'trim': '314 CDI MEDIO 3.5T',
 'vin': None,
 'year': 2019}
2026-03-26 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985704%27 HTTP/1.1" 200 None
2026-03-26 18:32:16 [ayvens.es] INFO: Saving data for 1985704: {'created_time': 1774549936.481292, 'last_price_update_time': 1774549936.481301, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985704') HTTP/1.1" 204 0
2026-03-26 18:32:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1d471a84-e2fa-513f-a5bf-34dacdf4cac5 with identifier: 1985706
2026-03-26 18:32:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:32:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1d471a84-e2fa-513f-a5bf-34dacdf4cac5 with identifier: 1985706
2026-03-26 18:32:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1d471a84-e2fa-513f-a5bf-34dacdf4cac5 with identifier: 1985706 to the API
2026-03-26 18:32:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/474/48e09efdc28045c7b031bd45f124e7bf/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Verde vaillant ral',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '1d471a84-e2fa-513f-a5bf-34dacdf4cac5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT CONNECT',
 'odometer': 234090,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d471a84-e2fa-513f-a5bf-34dacdf4cac5/1d471a84-e2fa-513f-a5bf-34dacdf4cac5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354452,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/474/48e09efdc28045c7b031bd45f124e7bf/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-17',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT CONNECT Van 1.5 TDCi 55kW Trend 200 L1',
 'transmission': 'manual',
 'trim': 'Van 1.5 TDCi 55kW Trend 200 L1',
 'vin': None,
 'year': 2019}
2026-03-26 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985706%27 HTTP/1.1" 200 None
2026-03-26 18:32:16 [ayvens.es] INFO: Saving data for 1985706: {'created_time': 1774549936.892515, 'last_price_update_time': 1774549936.892525, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985706') HTTP/1.1" 204 0
2026-03-26 18:32:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/531/ee8f8cb782f14036b113668c86a7d55e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:16 [ayvens.es] INFO: Found listing with ID: 1985716
2026-03-26 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985716%27 HTTP/1.1" 200 None
2026-03-26 18:32:16 [ayvens.es] INFO: Scrape type for 1985716: 1
2026-03-26 18:32:16 [ayvens.es] INFO: Extracting data for car ID: 1985716
2026-03-26 18:32:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 980d3445-d6eb-53a7-b5c7-79cf2629ccf7 with identifier: 1985716
2026-03-26 18:32:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 980d3445-d6eb-53a7-b5c7-79cf2629ccf7 with scrape type 1
2026-03-26 18:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 980d3445-d6eb-53a7-b5c7-79cf2629ccf7
2026-03-26 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F736%252Fe9d578885d094911ba90206befe16ff5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/736/e9d578885d094911ba90206befe16ff5/images/large/1.jpg not downloaded yet
2026-03-26 18:32:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/543/543f5a16a6a84c94aaf80e3d62d39e16/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c33290>
2026-03-26 18:32:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70d845e5-af97-5e04-9b24-7482c4e60e58/70d845e5-af97-5e04-9b24-7482c4e60e58_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F355%252F7257bd6810bc40f1bf161e5180ca514c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/355/7257bd6810bc40f1bf161e5180ca514c/images/large/1.jpg saved to cache
2026-03-26 18:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 70d845e5-af97-5e04-9b24-7482c4e60e58
2026-03-26 18:32:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 70d845e5-af97-5e04-9b24-7482c4e60e58, skipping ID generation
2026-03-26 18:32:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70d845e5-af97-5e04-9b24-7482c4e60e58 with scrape type 1
2026-03-26 18:32:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 70d845e5-af97-5e04-9b24-7482c4e60e58 sending to next pipeline
2026-03-26 18:32:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 70d845e5-af97-5e04-9b24-7482c4e60e58, identifier: 1985708
2026-03-26 18:32:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/996/978665ce41df4147afacabd4e5047cc2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:17 [ayvens.es] INFO: Found listing with ID: 1985717
2026-03-26 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985717%27 HTTP/1.1" 200 None
2026-03-26 18:32:17 [ayvens.es] INFO: Scrape type for 1985717: 1
2026-03-26 18:32:17 [ayvens.es] INFO: Extracting data for car ID: 1985717
2026-03-26 18:32:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b583024a-c62e-543a-aaf3-d25c0397c473 with identifier: 1985717
2026-03-26 18:32:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b583024a-c62e-543a-aaf3-d25c0397c473 with scrape type 1
2026-03-26 18:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b583024a-c62e-543a-aaf3-d25c0397c473
2026-03-26 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F792%252Fbf9fb494caad4a298f99b162d94a72f0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/792/bf9fb494caad4a298f99b162d94a72f0/images/large/1.jpg not downloaded yet
2026-03-26 18:32:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 70d845e5-af97-5e04-9b24-7482c4e60e58 with identifier: 1985708
2026-03-26 18:32:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 70d845e5-af97-5e04-9b24-7482c4e60e58 with identifier: 1985708
2026-03-26 18:32:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 70d845e5-af97-5e04-9b24-7482c4e60e58 with identifier: 1985708 to the API
2026-03-26 18:32:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/355/7257bd6810bc40f1bf161e5180ca514c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '70d845e5-af97-5e04-9b24-7482c4e60e58',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'CORSA',
 'odometer': 77634,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d845e5-af97-5e04-9b24-7482c4e60e58/70d845e5-af97-5e04-9b24-7482c4e60e58_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 339372,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/355/7257bd6810bc40f1bf161e5180ca514c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL CORSA 1.2T XHL 74kW (100CV) Edition',
 'transmission': 'manual',
 'trim': '1.2T XHL 74kW (100CV) Edition',
 'vin': None,
 'year': 2021}
2026-03-26 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985708%27 HTTP/1.1" 200 None
2026-03-26 18:32:17 [ayvens.es] INFO: Saving data for 1985708: {'created_time': 1774549937.507713, 'last_price_update_time': 1774549937.507724, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985708') HTTP/1.1" 204 0
2026-03-26 18:32:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/479/c107fca100ae49838e4ea68d3ba17f53/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:17 [ayvens.es] INFO: Found listing with ID: 1985718
2026-03-26 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985718%27 HTTP/1.1" 200 None
2026-03-26 18:32:17 [ayvens.es] INFO: Scrape type for 1985718: 1
2026-03-26 18:32:17 [ayvens.es] INFO: Extracting data for car ID: 1985718
2026-03-26 18:32:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 573b135e-d676-57cd-b1d8-c4ba93b01726 with identifier: 1985718
2026-03-26 18:32:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 573b135e-d676-57cd-b1d8-c4ba93b01726 with scrape type 1
2026-03-26 18:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 573b135e-d676-57cd-b1d8-c4ba93b01726
2026-03-26 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F247%252Ffa8d15a8cfa549bc8f3bbf7aace275d2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/247/fa8d15a8cfa549bc8f3bbf7aace275d2/images/large/1.jpg not downloaded yet
2026-03-26 18:32:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28372250>
2026-03-26 18:32:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2065a08-b765-5a2c-a1c1-9441b54dd62d/b2065a08-b765-5a2c-a1c1-9441b54dd62d_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F531%252Fee8f8cb782f14036b113668c86a7d55e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/531/ee8f8cb782f14036b113668c86a7d55e/images/large/1.jpg saved to cache
2026-03-26 18:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b2065a08-b765-5a2c-a1c1-9441b54dd62d
2026-03-26 18:32:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b2065a08-b765-5a2c-a1c1-9441b54dd62d, skipping ID generation
2026-03-26 18:32:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2065a08-b765-5a2c-a1c1-9441b54dd62d with scrape type 1
2026-03-26 18:32:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b2065a08-b765-5a2c-a1c1-9441b54dd62d sending to next pipeline
2026-03-26 18:32:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b2065a08-b765-5a2c-a1c1-9441b54dd62d, identifier: 1985707
2026-03-26 18:32:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c22d50>
2026-03-26 18:32:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_701736a7-8a18-59cb-af86-0eab0d5edb3a/701736a7-8a18-59cb-af86-0eab0d5edb3a_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F543%252F543f5a16a6a84c94aaf80e3d62d39e16%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/543/543f5a16a6a84c94aaf80e3d62d39e16/images/large/1.jpg saved to cache
2026-03-26 18:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 701736a7-8a18-59cb-af86-0eab0d5edb3a
2026-03-26 18:32:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 701736a7-8a18-59cb-af86-0eab0d5edb3a, skipping ID generation
2026-03-26 18:32:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 701736a7-8a18-59cb-af86-0eab0d5edb3a with scrape type 1
2026-03-26 18:32:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 701736a7-8a18-59cb-af86-0eab0d5edb3a sending to next pipeline
2026-03-26 18:32:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 701736a7-8a18-59cb-af86-0eab0d5edb3a, identifier: 1985710
2026-03-26 18:32:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28bcaf90>
2026-03-26 18:32:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa1e186d-ad91-59d0-a579-d53f6124d560/fa1e186d-ad91-59d0-a579-d53f6124d560_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F996%252F978665ce41df4147afacabd4e5047cc2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/996/978665ce41df4147afacabd4e5047cc2/images/large/1.jpg saved to cache
2026-03-26 18:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fa1e186d-ad91-59d0-a579-d53f6124d560
2026-03-26 18:32:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fa1e186d-ad91-59d0-a579-d53f6124d560, skipping ID generation
2026-03-26 18:32:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa1e186d-ad91-59d0-a579-d53f6124d560 with scrape type 1
2026-03-26 18:32:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fa1e186d-ad91-59d0-a579-d53f6124d560 sending to next pipeline
2026-03-26 18:32:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: fa1e186d-ad91-59d0-a579-d53f6124d560, identifier: 1985709
2026-03-26 18:32:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/972/d4690e4aeff64c119ad4f22aad46b133/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:18 [ayvens.es] INFO: Found listing with ID: 1985719
2026-03-26 18:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985719%27 HTTP/1.1" 200 None
2026-03-26 18:32:18 [ayvens.es] INFO: Scrape type for 1985719: 1
2026-03-26 18:32:18 [ayvens.es] INFO: Extracting data for car ID: 1985719
2026-03-26 18:32:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e42879ed-87df-5183-a6ac-7b1711dfa501 with identifier: 1985719
2026-03-26 18:32:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e42879ed-87df-5183-a6ac-7b1711dfa501 with scrape type 1
2026-03-26 18:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e42879ed-87df-5183-a6ac-7b1711dfa501
2026-03-26 18:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F653%252Ff4ad40db4063478783e4135fc7534969%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/653/f4ad40db4063478783e4135fc7534969/images/large/1.jpg not downloaded yet
2026-03-26 18:32:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b2065a08-b765-5a2c-a1c1-9441b54dd62d with identifier: 1985707
2026-03-26 18:32:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:32:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b2065a08-b765-5a2c-a1c1-9441b54dd62d with identifier: 1985707
2026-03-26 18:32:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b2065a08-b765-5a2c-a1c1-9441b54dd62d with identifier: 1985707 to the API
2026-03-26 18:32:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/531/ee8f8cb782f14036b113668c86a7d55e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'Plata perla moondust',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b2065a08-b765-5a2c-a1c1-9441b54dd62d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': 60005,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2065a08-b765-5a2c-a1c1-9441b54dd62d/b2065a08-b765-5a2c-a1c1-9441b54dd62d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 539495,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/531/ee8f8cb782f14036b113668c86a7d55e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FOCUS 1.0 Ecoboost MHEV 92kW Trend+',
 'transmission': 'manual',
 'trim': '1.0 Ecoboost MHEV 92kW Trend+',
 'vin': None,
 'year': 2021}
2026-03-26 18:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985707%27 HTTP/1.1" 200 None
2026-03-26 18:32:18 [ayvens.es] INFO: Saving data for 1985707: {'created_time': 1774549938.504415, 'last_price_update_time': 1774549938.504426, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985707') HTTP/1.1" 204 0
2026-03-26 18:32:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 701736a7-8a18-59cb-af86-0eab0d5edb3a with identifier: 1985710
2026-03-26 18:32:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:32:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 701736a7-8a18-59cb-af86-0eab0d5edb3a with identifier: 1985710
2026-03-26 18:32:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 701736a7-8a18-59cb-af86-0eab0d5edb3a with identifier: 1985710 to the API
2026-03-26 18:32:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/543/543f5a16a6a84c94aaf80e3d62d39e16/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'color': 'Grafito',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '701736a7-8a18-59cb-af86-0eab0d5edb3a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLC-CLASS',
 'odometer': 100909,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_701736a7-8a18-59cb-af86-0eab0d5edb3a/701736a7-8a18-59cb-af86-0eab0d5edb3a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 352923,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/543/543f5a16a6a84c94aaf80e3d62d39e16/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLC-CLASS GLC 220 d 4MATIC',
 'transmission': 'manual',
 'trim': 'GLC 220 d 4MATIC',
 'vin': None,
 'year': 2021}
2026-03-26 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985710%27 HTTP/1.1" 200 None
2026-03-26 18:32:19 [ayvens.es] INFO: Saving data for 1985710: {'created_time': 1774549939.46451, 'last_price_update_time': 1774549939.464519, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985710') HTTP/1.1" 204 0
2026-03-26 18:32:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: fa1e186d-ad91-59d0-a579-d53f6124d560 with identifier: 1985709
2026-03-26 18:32:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: fa1e186d-ad91-59d0-a579-d53f6124d560 with identifier: 1985709
2026-03-26 18:32:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: fa1e186d-ad91-59d0-a579-d53f6124d560 with identifier: 1985709 to the API
2026-03-26 18:32:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/996/978665ce41df4147afacabd4e5047cc2/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 206,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '2.1L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'fa1e186d-ad91-59d0-a579-d53f6124d560',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'SPRINTER',
 'odometer': 195653,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa1e186d-ad91-59d0-a579-d53f6124d560/fa1e186d-ad91-59d0-a579-d53f6124d560_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 504180,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/996/978665ce41df4147afacabd4e5047cc2/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-21',
 'seats_number': 3,
 'seller_name': None,
 'title': 'MERCEDES-BENZ SPRINTER 314 CDI MEDIO 3.5T',
 'transmission': 'manual',
 'trim': '314 CDI MEDIO 3.5T',
 'vin': None,
 'year': 2020}
2026-03-26 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985709%27 HTTP/1.1" 200 None
2026-03-26 18:32:19 [ayvens.es] INFO: Saving data for 1985709: {'created_time': 1774549939.762362, 'last_price_update_time': 1774549939.762372, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985709') HTTP/1.1" 204 0
2026-03-26 18:32:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/204/1e0168b1528c434c936fddcc84259091/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:19 [ayvens.es] INFO: Found listing with ID: 1985720
2026-03-26 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985720%27 HTTP/1.1" 200 None
2026-03-26 18:32:19 [ayvens.es] INFO: Scrape type for 1985720: 1
2026-03-26 18:32:19 [ayvens.es] INFO: Extracting data for car ID: 1985720
2026-03-26 18:32:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af79901b-e417-59cb-ac68-74b390473166 with identifier: 1985720
2026-03-26 18:32:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af79901b-e417-59cb-ac68-74b390473166 with scrape type 1
2026-03-26 18:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item af79901b-e417-59cb-ac68-74b390473166
2026-03-26 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F871%252F981659ea24a94b3990adcb0bbae65331%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/871/981659ea24a94b3990adcb0bbae65331/images/large/1.jpg not downloaded yet
2026-03-26 18:32:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28ca7f90>
2026-03-26 18:32:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f60e9c0f-10fc-5274-8c05-0a26a334eb91/f60e9c0f-10fc-5274-8c05-0a26a334eb91_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F479%252Fc107fca100ae49838e4ea68d3ba17f53%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/479/c107fca100ae49838e4ea68d3ba17f53/images/large/1.jpg saved to cache
2026-03-26 18:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f60e9c0f-10fc-5274-8c05-0a26a334eb91
2026-03-26 18:32:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f60e9c0f-10fc-5274-8c05-0a26a334eb91, skipping ID generation
2026-03-26 18:32:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f60e9c0f-10fc-5274-8c05-0a26a334eb91 with scrape type 1
2026-03-26 18:32:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f60e9c0f-10fc-5274-8c05-0a26a334eb91 sending to next pipeline
2026-03-26 18:32:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f60e9c0f-10fc-5274-8c05-0a26a334eb91, identifier: 1985712
2026-03-26 18:32:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a2833db10>
2026-03-26 18:32:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d14a953b-2c02-5028-8555-b52851b196dd/d14a953b-2c02-5028-8555-b52851b196dd_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F972%252Fd4690e4aeff64c119ad4f22aad46b133%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/972/d4690e4aeff64c119ad4f22aad46b133/images/large/1.jpg saved to cache
2026-03-26 18:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d14a953b-2c02-5028-8555-b52851b196dd
2026-03-26 18:32:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d14a953b-2c02-5028-8555-b52851b196dd, skipping ID generation
2026-03-26 18:32:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d14a953b-2c02-5028-8555-b52851b196dd with scrape type 1
2026-03-26 18:32:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d14a953b-2c02-5028-8555-b52851b196dd sending to next pipeline
2026-03-26 18:32:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d14a953b-2c02-5028-8555-b52851b196dd, identifier: 1985711
2026-03-26 18:32:20 [ayvens.es] INFO: Found listing with ID: 1985721
2026-03-26 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985721%27 HTTP/1.1" 200 None
2026-03-26 18:32:20 [ayvens.es] INFO: Scrape type for 1985721: 1
2026-03-26 18:32:20 [ayvens.es] INFO: Extracting data for car ID: 1985721
2026-03-26 18:32:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89ec6bbc-1aa1-5380-b25a-338417e9c526 with identifier: 1985721
2026-03-26 18:32:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89ec6bbc-1aa1-5380-b25a-338417e9c526 with scrape type 1
2026-03-26 18:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 89ec6bbc-1aa1-5380-b25a-338417e9c526
2026-03-26 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F122%252Faa2f0903fe234c4b86d2002e4d1f5a2b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/122/aa2f0903fe234c4b86d2002e4d1f5a2b/images/large/1.jpg not downloaded yet
2026-03-26 18:32:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f60e9c0f-10fc-5274-8c05-0a26a334eb91 with identifier: 1985712
2026-03-26 18:32:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f60e9c0f-10fc-5274-8c05-0a26a334eb91 with identifier: 1985712
2026-03-26 18:32:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f60e9c0f-10fc-5274-8c05-0a26a334eb91 with identifier: 1985712 to the API
2026-03-26 18:32:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/479/c107fca100ae49838e4ea68d3ba17f53/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.2L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f60e9c0f-10fc-5274-8c05-0a26a334eb91',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'FIORINO',
 'odometer': 134357,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f60e9c0f-10fc-5274-8c05-0a26a334eb91/f60e9c0f-10fc-5274-8c05-0a26a334eb91_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 318776,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/479/c107fca100ae49838e4ea68d3ba17f53/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-05',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FIAT FIORINO Cargo Base 1.3 Mjet 59kW (80CV) E6',
 'transmission': 'manual',
 'trim': 'Cargo Base 1.3 Mjet 59kW (80CV) E6',
 'vin': None,
 'year': 2017}
2026-03-26 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985712%27 HTTP/1.1" 200 None
2026-03-26 18:32:20 [ayvens.es] INFO: Saving data for 1985712: {'created_time': 1774549940.552045, 'last_price_update_time': 1774549940.552054, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985712') HTTP/1.1" 204 0
2026-03-26 18:32:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d14a953b-2c02-5028-8555-b52851b196dd with identifier: 1985711
2026-03-26 18:32:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:32:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d14a953b-2c02-5028-8555-b52851b196dd with identifier: 1985711
2026-03-26 18:32:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d14a953b-2c02-5028-8555-b52851b196dd with identifier: 1985711 to the API
2026-03-26 18:32:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/972/d4690e4aeff64c119ad4f22aad46b133/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'Blanco everest',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'd14a953b-2c02-5028-8555-b52851b196dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'JUKE',
 'odometer': 46565,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d14a953b-2c02-5028-8555-b52851b196dd/d14a953b-2c02-5028-8555-b52851b196dd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 502000,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/972/d4690e4aeff64c119ad4f22aad46b133/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN JUKE DIG-T 84 kW (114 CV) 6M/T Acenta',
 'transmission': 'manual',
 'trim': 'DIG-T 84 kW (114 CV) 6M/T Acenta',
 'vin': None,
 'year': 2021}
2026-03-26 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985711%27 HTTP/1.1" 200 None
2026-03-26 18:32:20 [ayvens.es] INFO: Saving data for 1985711: {'created_time': 1774549940.878701, 'last_price_update_time': 1774549940.878711, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985711') HTTP/1.1" 204 0
2026-03-26 18:32:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/962/00f3309f46834a2889d94b8a29c66d82/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/736/e9d578885d094911ba90206befe16ff5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:20 [ayvens.es] INFO: Found listing with ID: 1985722
2026-03-26 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985722%27 HTTP/1.1" 200 None
2026-03-26 18:32:20 [ayvens.es] INFO: Scrape type for 1985722: 1
2026-03-26 18:32:20 [ayvens.es] INFO: Extracting data for car ID: 1985722
2026-03-26 18:32:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1341a483-ffb8-5b83-973f-8a61a5f2c672 with identifier: 1985722
2026-03-26 18:32:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1341a483-ffb8-5b83-973f-8a61a5f2c672 with scrape type 1
2026-03-26 18:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1341a483-ffb8-5b83-973f-8a61a5f2c672
2026-03-26 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F006%252F549c4232bb904465ae8afc33d480af1f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/006/549c4232bb904465ae8afc33d480af1f/images/large/1.jpg not downloaded yet
2026-03-26 18:32:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a2ab03d90>
2026-03-26 18:32:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ff2566e-f8c8-5f08-870d-240ba8005edb/9ff2566e-f8c8-5f08-870d-240ba8005edb_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F204%252F1e0168b1528c434c936fddcc84259091%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/204/1e0168b1528c434c936fddcc84259091/images/large/1.jpg saved to cache
2026-03-26 18:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9ff2566e-f8c8-5f08-870d-240ba8005edb
2026-03-26 18:32:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9ff2566e-f8c8-5f08-870d-240ba8005edb, skipping ID generation
2026-03-26 18:32:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ff2566e-f8c8-5f08-870d-240ba8005edb with scrape type 1
2026-03-26 18:32:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9ff2566e-f8c8-5f08-870d-240ba8005edb sending to next pipeline
2026-03-26 18:32:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9ff2566e-f8c8-5f08-870d-240ba8005edb, identifier: 1985713
2026-03-26 18:32:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/505/5d7dc67b50184e6ea18e387f9a5f7526/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:21 [ayvens.es] INFO: Found listing with ID: 1985723
2026-03-26 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985723%27 HTTP/1.1" 200 None
2026-03-26 18:32:21 [ayvens.es] INFO: Scrape type for 1985723: 1
2026-03-26 18:32:21 [ayvens.es] INFO: Extracting data for car ID: 1985723
2026-03-26 18:32:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4719a2f1-8cde-5d96-b39c-ad94eb3b55ce with identifier: 1985723
2026-03-26 18:32:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4719a2f1-8cde-5d96-b39c-ad94eb3b55ce with scrape type 1
2026-03-26 18:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4719a2f1-8cde-5d96-b39c-ad94eb3b55ce
2026-03-26 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F416%252F76d0ececcce04c6e8a4ac27c936c1d86%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/416/76d0ececcce04c6e8a4ac27c936c1d86/images/large/1.jpg not downloaded yet
2026-03-26 18:32:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9ff2566e-f8c8-5f08-870d-240ba8005edb with identifier: 1985713
2026-03-26 18:32:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9ff2566e-f8c8-5f08-870d-240ba8005edb with identifier: 1985713
2026-03-26 18:32:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9ff2566e-f8c8-5f08-870d-240ba8005edb with identifier: 1985713 to the API
2026-03-26 18:32:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/204/1e0168b1528c434c936fddcc84259091/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Gris monta',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.9L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '9ff2566e-f8c8-5f08-870d-240ba8005edb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA',
 'odometer': 51218,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ff2566e-f8c8-5f08-870d-240ba8005edb/9ff2566e-f8c8-5f08-870d-240ba8005edb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 361906,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/204/1e0168b1528c434c936fddcc84259091/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA CLA 220 D DCT',
 'transmission': 'manual',
 'trim': 'CLA 220 D DCT',
 'vin': None,
 'year': 2021}
2026-03-26 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985713%27 HTTP/1.1" 200 None
2026-03-26 18:32:21 [ayvens.es] INFO: Saving data for 1985713: {'created_time': 1774549941.410026, 'last_price_update_time': 1774549941.410037, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985713') HTTP/1.1" 204 0
2026-03-26 18:32:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/247/fa8d15a8cfa549bc8f3bbf7aace275d2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/792/bf9fb494caad4a298f99b162d94a72f0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:21 [ayvens.es] INFO: Found listing with ID: 1985724
2026-03-26 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985724%27 HTTP/1.1" 200 None
2026-03-26 18:32:21 [ayvens.es] INFO: Scrape type for 1985724: 1
2026-03-26 18:32:21 [ayvens.es] INFO: Extracting data for car ID: 1985724
2026-03-26 18:32:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6501096-8d2d-5a9e-a24e-5d9e46da4f95 with identifier: 1985724
2026-03-26 18:32:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6501096-8d2d-5a9e-a24e-5d9e46da4f95 with scrape type 1
2026-03-26 18:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d6501096-8d2d-5a9e-a24e-5d9e46da4f95
2026-03-26 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F456%252F90eb7a0f0f124532a520a878cd46d82c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/456/90eb7a0f0f124532a520a878cd46d82c/images/large/1.jpg not downloaded yet
2026-03-26 18:32:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a284ee450>
2026-03-26 18:32:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a481262-8a12-5a10-b357-0fd22e1d589a/9a481262-8a12-5a10-b357-0fd22e1d589a_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F962%252F00f3309f46834a2889d94b8a29c66d82%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/962/00f3309f46834a2889d94b8a29c66d82/images/large/1.jpg saved to cache
2026-03-26 18:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9a481262-8a12-5a10-b357-0fd22e1d589a
2026-03-26 18:32:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9a481262-8a12-5a10-b357-0fd22e1d589a, skipping ID generation
2026-03-26 18:32:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a481262-8a12-5a10-b357-0fd22e1d589a with scrape type 1
2026-03-26 18:32:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9a481262-8a12-5a10-b357-0fd22e1d589a sending to next pipeline
2026-03-26 18:32:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9a481262-8a12-5a10-b357-0fd22e1d589a, identifier: 1985714
2026-03-26 18:32:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28e65990>
2026-03-26 18:32:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_980d3445-d6eb-53a7-b5c7-79cf2629ccf7/980d3445-d6eb-53a7-b5c7-79cf2629ccf7_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F736%252Fe9d578885d094911ba90206befe16ff5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/736/e9d578885d094911ba90206befe16ff5/images/large/1.jpg saved to cache
2026-03-26 18:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 980d3445-d6eb-53a7-b5c7-79cf2629ccf7
2026-03-26 18:32:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 980d3445-d6eb-53a7-b5c7-79cf2629ccf7, skipping ID generation
2026-03-26 18:32:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 980d3445-d6eb-53a7-b5c7-79cf2629ccf7 with scrape type 1
2026-03-26 18:32:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 980d3445-d6eb-53a7-b5c7-79cf2629ccf7 sending to next pipeline
2026-03-26 18:32:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 980d3445-d6eb-53a7-b5c7-79cf2629ccf7, identifier: 1985716
2026-03-26 18:32:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28bcad50>
2026-03-26 18:32:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b43098c7-96d2-51ff-b01b-b43200cd6323/b43098c7-96d2-51ff-b01b-b43200cd6323_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F505%252F5d7dc67b50184e6ea18e387f9a5f7526%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/505/5d7dc67b50184e6ea18e387f9a5f7526/images/large/1.jpg saved to cache
2026-03-26 18:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b43098c7-96d2-51ff-b01b-b43200cd6323
2026-03-26 18:32:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b43098c7-96d2-51ff-b01b-b43200cd6323, skipping ID generation
2026-03-26 18:32:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b43098c7-96d2-51ff-b01b-b43200cd6323 with scrape type 1
2026-03-26 18:32:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b43098c7-96d2-51ff-b01b-b43200cd6323 sending to next pipeline
2026-03-26 18:32:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b43098c7-96d2-51ff-b01b-b43200cd6323, identifier: 1985715
2026-03-26 18:32:22 [ayvens.es] INFO: Found listing with ID: 1985725
2026-03-26 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985725%27 HTTP/1.1" 200 None
2026-03-26 18:32:22 [ayvens.es] INFO: Scrape type for 1985725: 1
2026-03-26 18:32:22 [ayvens.es] INFO: Extracting data for car ID: 1985725
2026-03-26 18:32:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ae3d295-d273-5b26-a8f3-ecb9ced4d2ca with identifier: 1985725
2026-03-26 18:32:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ae3d295-d273-5b26-a8f3-ecb9ced4d2ca with scrape type 1
2026-03-26 18:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3ae3d295-d273-5b26-a8f3-ecb9ced4d2ca
2026-03-26 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F945%252F36955d1f897f414fb70c65f5f7f46bed%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/945/36955d1f897f414fb70c65f5f7f46bed/images/large/1.jpg not downloaded yet
2026-03-26 18:32:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9a481262-8a12-5a10-b357-0fd22e1d589a with identifier: 1985714
2026-03-26 18:32:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:32:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9a481262-8a12-5a10-b357-0fd22e1d589a with identifier: 1985714
2026-03-26 18:32:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9a481262-8a12-5a10-b357-0fd22e1d589a with identifier: 1985714 to the API
2026-03-26 18:32:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/962/00f3309f46834a2889d94b8a29c66d82/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 151,
 'color': 'Phytonic blau metali',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '9a481262-8a12-5a10-b357-0fd22e1d589a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X4',
 'odometer': 97551,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a481262-8a12-5a10-b357-0fd22e1d589a/9a481262-8a12-5a10-b357-0fd22e1d589a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 648053,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/962/00f3309f46834a2889d94b8a29c66d82/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X4 xDrive20i',
 'transmission': 'manual',
 'trim': 'xDrive20i',
 'vin': None,
 'year': 2020}
2026-03-26 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985714%27 HTTP/1.1" 200 None
2026-03-26 18:32:22 [ayvens.es] INFO: Saving data for 1985714: {'created_time': 1774549942.350673, 'last_price_update_time': 1774549942.350684, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985714') HTTP/1.1" 204 0
2026-03-26 18:32:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 980d3445-d6eb-53a7-b5c7-79cf2629ccf7 with identifier: 1985716
2026-03-26 18:32:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 980d3445-d6eb-53a7-b5c7-79cf2629ccf7 with identifier: 1985716
2026-03-26 18:32:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 980d3445-d6eb-53a7-b5c7-79cf2629ccf7 with identifier: 1985716 to the API
2026-03-26 18:32:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/736/e9d578885d094911ba90206befe16ff5/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '980d3445-d6eb-53a7-b5c7-79cf2629ccf7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508',
 'odometer': 87498,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_980d3445-d6eb-53a7-b5c7-79cf2629ccf7/980d3445-d6eb-53a7-b5c7-79cf2629ccf7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329075,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/736/e9d578885d094911ba90206befe16ff5/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 5P Active Pack BlueHDi 130 S&S EAT8',
 'transmission': 'manual',
 'trim': '5P Active Pack BlueHDi 130 S&S EAT8',
 'vin': None,
 'year': 2022}
2026-03-26 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985716%27 HTTP/1.1" 200 None
2026-03-26 18:32:22 [ayvens.es] INFO: Saving data for 1985716: {'created_time': 1774549942.666865, 'last_price_update_time': 1774549942.666876, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985716') HTTP/1.1" 204 0
2026-03-26 18:32:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b43098c7-96d2-51ff-b01b-b43200cd6323 with identifier: 1985715
2026-03-26 18:32:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b43098c7-96d2-51ff-b01b-b43200cd6323 with identifier: 1985715
2026-03-26 18:32:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b43098c7-96d2-51ff-b01b-b43200cd6323 with identifier: 1985715 to the API
2026-03-26 18:32:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/505/5d7dc67b50184e6ea18e387f9a5f7526/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'color': 'Gris monta',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b43098c7-96d2-51ff-b01b-b43200cd6323',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLA',
 'odometer': 47524,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b43098c7-96d2-51ff-b01b-b43200cd6323/b43098c7-96d2-51ff-b01b-b43200cd6323_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 464058,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/505/5d7dc67b50184e6ea18e387f9a5f7526/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLA GLA 200 D',
 'transmission': 'manual',
 'trim': 'GLA 200 D',
 'vin': None,
 'year': 2022}
2026-03-26 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985715%27 HTTP/1.1" 200 None
2026-03-26 18:32:22 [ayvens.es] INFO: Saving data for 1985715: {'created_time': 1774549942.978184, 'last_price_update_time': 1774549942.978196, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985715') HTTP/1.1" 204 0
2026-03-26 18:32:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/871/981659ea24a94b3990adcb0bbae65331/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/653/f4ad40db4063478783e4135fc7534969/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:23 [ayvens.es] INFO: Found listing with ID: 1985726
2026-03-26 18:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985726%27 HTTP/1.1" 200 None
2026-03-26 18:32:23 [ayvens.es] INFO: Scrape type for 1985726: 1
2026-03-26 18:32:23 [ayvens.es] INFO: Extracting data for car ID: 1985726
2026-03-26 18:32:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ec5cad9-010b-53ea-88ef-ed98e091075c with identifier: 1985726
2026-03-26 18:32:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ec5cad9-010b-53ea-88ef-ed98e091075c with scrape type 1
2026-03-26 18:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2ec5cad9-010b-53ea-88ef-ed98e091075c
2026-03-26 18:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F548%252F53e80ab1df934a1a94a3b04ce6b42a8e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/548/53e80ab1df934a1a94a3b04ce6b42a8e/images/large/1.jpg not downloaded yet
2026-03-26 18:32:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a2ab0c650>
2026-03-26 18:32:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_573b135e-d676-57cd-b1d8-c4ba93b01726/573b135e-d676-57cd-b1d8-c4ba93b01726_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F247%252Ffa8d15a8cfa549bc8f3bbf7aace275d2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/247/fa8d15a8cfa549bc8f3bbf7aace275d2/images/large/1.jpg saved to cache
2026-03-26 18:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 573b135e-d676-57cd-b1d8-c4ba93b01726
2026-03-26 18:32:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 573b135e-d676-57cd-b1d8-c4ba93b01726, skipping ID generation
2026-03-26 18:32:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 573b135e-d676-57cd-b1d8-c4ba93b01726 with scrape type 1
2026-03-26 18:32:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 573b135e-d676-57cd-b1d8-c4ba93b01726 sending to next pipeline
2026-03-26 18:32:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 573b135e-d676-57cd-b1d8-c4ba93b01726, identifier: 1985718
2026-03-26 18:32:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28ea2290>
2026-03-26 18:32:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b583024a-c62e-543a-aaf3-d25c0397c473/b583024a-c62e-543a-aaf3-d25c0397c473_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F792%252Fbf9fb494caad4a298f99b162d94a72f0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/792/bf9fb494caad4a298f99b162d94a72f0/images/large/1.jpg saved to cache
2026-03-26 18:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b583024a-c62e-543a-aaf3-d25c0397c473
2026-03-26 18:32:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b583024a-c62e-543a-aaf3-d25c0397c473, skipping ID generation
2026-03-26 18:32:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b583024a-c62e-543a-aaf3-d25c0397c473 with scrape type 1
2026-03-26 18:32:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b583024a-c62e-543a-aaf3-d25c0397c473 sending to next pipeline
2026-03-26 18:32:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b583024a-c62e-543a-aaf3-d25c0397c473, identifier: 1985717
2026-03-26 18:32:23 [ayvens.es] INFO: Found listing with ID: 1985727
2026-03-26 18:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985727%27 HTTP/1.1" 200 None
2026-03-26 18:32:23 [ayvens.es] INFO: Scrape type for 1985727: 1
2026-03-26 18:32:23 [ayvens.es] INFO: Extracting data for car ID: 1985727
2026-03-26 18:32:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f9722e8-b53d-58d3-8373-fb3aff38239d with identifier: 1985727
2026-03-26 18:32:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f9722e8-b53d-58d3-8373-fb3aff38239d with scrape type 1
2026-03-26 18:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1f9722e8-b53d-58d3-8373-fb3aff38239d
2026-03-26 18:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F856%252F6bdeedc8652d4f17be9a8d4acf0d5261%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/856/6bdeedc8652d4f17be9a8d4acf0d5261/images/large/1.jpg not downloaded yet
2026-03-26 18:32:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 573b135e-d676-57cd-b1d8-c4ba93b01726 with identifier: 1985718
2026-03-26 18:32:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 573b135e-d676-57cd-b1d8-c4ba93b01726 with identifier: 1985718
2026-03-26 18:32:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 573b135e-d676-57cd-b1d8-c4ba93b01726 with identifier: 1985718 to the API
2026-03-26 18:32:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/247/fa8d15a8cfa549bc8f3bbf7aace275d2/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'color': 'Blanco everest',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.7L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '573b135e-d676-57cd-b1d8-c4ba93b01726',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 182844,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_573b135e-d676-57cd-b1d8-c4ba93b01726/573b135e-d676-57cd-b1d8-c4ba93b01726_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 326220,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/247/fa8d15a8cfa549bc8f3bbf7aace275d2/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI dCi 150CV (110kW) 4x4-i N-CONNECTA',
 'transmission': 'manual',
 'trim': 'dCi 150CV (110kW) 4x4-i N-CONNECTA',
 'vin': None,
 'year': 2019}
2026-03-26 18:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985718%27 HTTP/1.1" 200 None
2026-03-26 18:32:23 [ayvens.es] INFO: Saving data for 1985718: {'created_time': 1774549943.727483, 'last_price_update_time': 1774549943.727493, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985718') HTTP/1.1" 204 0
2026-03-26 18:32:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b583024a-c62e-543a-aaf3-d25c0397c473 with identifier: 1985717
2026-03-26 18:32:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b583024a-c62e-543a-aaf3-d25c0397c473 with identifier: 1985717
2026-03-26 18:32:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b583024a-c62e-543a-aaf3-d25c0397c473 with identifier: 1985717 to the API
2026-03-26 18:32:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/792/bf9fb494caad4a298f99b162d94a72f0/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b583024a-c62e-543a-aaf3-d25c0397c473',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008',
 'odometer': 94506,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b583024a-c62e-543a-aaf3-d25c0397c473/b583024a-c62e-543a-aaf3-d25c0397c473_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 326869,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/792/bf9fb494caad4a298f99b162d94a72f0/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-09',
 'seats_number': 7,
 'seller_name': None,
 'title': 'PEUGEOT 5008 Allure 1.5L BlueHDi 96kW (130CV) S&S',
 'transmission': 'manual',
 'trim': 'Allure 1.5L BlueHDi 96kW (130CV) S&S',
 'vin': None,
 'year': 2020}
2026-03-26 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985717%27 HTTP/1.1" 200 None
2026-03-26 18:32:24 [ayvens.es] INFO: Saving data for 1985717: {'created_time': 1774549944.099539, 'last_price_update_time': 1774549944.099548, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985717') HTTP/1.1" 204 0
2026-03-26 18:32:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/006/549c4232bb904465ae8afc33d480af1f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:24 [ayvens.es] INFO: Found listing with ID: 1985728
2026-03-26 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985728%27 HTTP/1.1" 200 None
2026-03-26 18:32:24 [ayvens.es] INFO: Scrape type for 1985728: 1
2026-03-26 18:32:24 [ayvens.es] INFO: Extracting data for car ID: 1985728
2026-03-26 18:32:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ad92e02-c68f-5c66-a2a6-99a773672f51 with identifier: 1985728
2026-03-26 18:32:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ad92e02-c68f-5c66-a2a6-99a773672f51 with scrape type 1
2026-03-26 18:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8ad92e02-c68f-5c66-a2a6-99a773672f51
2026-03-26 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F371%252F5fdc140cc2454f1b8e42f7d9ec3ecabb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/371/5fdc140cc2454f1b8e42f7d9ec3ecabb/images/large/1.jpg not downloaded yet
2026-03-26 18:32:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c6ff90>
2026-03-26 18:32:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af79901b-e417-59cb-ac68-74b390473166/af79901b-e417-59cb-ac68-74b390473166_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F871%252F981659ea24a94b3990adcb0bbae65331%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/871/981659ea24a94b3990adcb0bbae65331/images/large/1.jpg saved to cache
2026-03-26 18:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item af79901b-e417-59cb-ac68-74b390473166
2026-03-26 18:32:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: af79901b-e417-59cb-ac68-74b390473166, skipping ID generation
2026-03-26 18:32:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af79901b-e417-59cb-ac68-74b390473166 with scrape type 1
2026-03-26 18:32:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item af79901b-e417-59cb-ac68-74b390473166 sending to next pipeline
2026-03-26 18:32:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: af79901b-e417-59cb-ac68-74b390473166, identifier: 1985720
2026-03-26 18:32:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a2830e410>
2026-03-26 18:32:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e42879ed-87df-5183-a6ac-7b1711dfa501/e42879ed-87df-5183-a6ac-7b1711dfa501_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F653%252Ff4ad40db4063478783e4135fc7534969%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/653/f4ad40db4063478783e4135fc7534969/images/large/1.jpg saved to cache
2026-03-26 18:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e42879ed-87df-5183-a6ac-7b1711dfa501
2026-03-26 18:32:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e42879ed-87df-5183-a6ac-7b1711dfa501, skipping ID generation
2026-03-26 18:32:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e42879ed-87df-5183-a6ac-7b1711dfa501 with scrape type 1
2026-03-26 18:32:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e42879ed-87df-5183-a6ac-7b1711dfa501 sending to next pipeline
2026-03-26 18:32:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e42879ed-87df-5183-a6ac-7b1711dfa501, identifier: 1985719
2026-03-26 18:32:24 [ayvens.es] INFO: Found listing with ID: 1985729
2026-03-26 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985729%27 HTTP/1.1" 200 None
2026-03-26 18:32:24 [ayvens.es] INFO: Scrape type for 1985729: 1
2026-03-26 18:32:24 [ayvens.es] INFO: Extracting data for car ID: 1985729
2026-03-26 18:32:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36bd9482-6f5f-55ae-960f-b24ae95022e3 with identifier: 1985729
2026-03-26 18:32:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36bd9482-6f5f-55ae-960f-b24ae95022e3 with scrape type 1
2026-03-26 18:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 36bd9482-6f5f-55ae-960f-b24ae95022e3
2026-03-26 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F885%252F98751014134c42a8b326bba545bcde9d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/885/98751014134c42a8b326bba545bcde9d/images/large/1.jpg not downloaded yet
2026-03-26 18:32:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: af79901b-e417-59cb-ac68-74b390473166 with identifier: 1985720
2026-03-26 18:32:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:32:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: af79901b-e417-59cb-ac68-74b390473166 with identifier: 1985720
2026-03-26 18:32:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: af79901b-e417-59cb-ac68-74b390473166 with identifier: 1985720 to the API
2026-03-26 18:32:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/871/981659ea24a94b3990adcb0bbae65331/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'color': 'Gris selenita metali',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'af79901b-e417-59cb-ac68-74b390473166',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLC-CLASS',
 'odometer': 161554,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af79901b-e417-59cb-ac68-74b390473166/af79901b-e417-59cb-ac68-74b390473166_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342725,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/871/981659ea24a94b3990adcb0bbae65331/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLC-CLASS GLC 200 d 4MATIC',
 'transmission': 'manual',
 'trim': 'GLC 200 d 4MATIC',
 'vin': None,
 'year': 2021}
2026-03-26 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985720%27 HTTP/1.1" 200 None
2026-03-26 18:32:24 [ayvens.es] INFO: Saving data for 1985720: {'created_time': 1774549944.781774, 'last_price_update_time': 1774549944.781784, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985720') HTTP/1.1" 204 0
2026-03-26 18:32:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e42879ed-87df-5183-a6ac-7b1711dfa501 with identifier: 1985719
2026-03-26 18:32:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e42879ed-87df-5183-a6ac-7b1711dfa501 with identifier: 1985719
2026-03-26 18:32:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e42879ed-87df-5183-a6ac-7b1711dfa501 with identifier: 1985719 to the API
2026-03-26 18:32:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/653/f4ad40db4063478783e4135fc7534969/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'Gris artense',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e42879ed-87df-5183-a6ac-7b1711dfa501',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS 3 CROSSBACK',
 'odometer': 49360,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e42879ed-87df-5183-a6ac-7b1711dfa501/e42879ed-87df-5183-a6ac-7b1711dfa501_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 350956,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/653/f4ad40db4063478783e4135fc7534969/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS 3 CROSSBACK BlueHDi 96 kW Auto PERFORMANCE LINE+',
 'transmission': 'manual',
 'trim': 'BlueHDi 96 kW Auto PERFORMANCE LINE+',
 'vin': None,
 'year': 2022}
2026-03-26 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985719%27 HTTP/1.1" 200 None
2026-03-26 18:32:25 [ayvens.es] INFO: Saving data for 1985719: {'created_time': 1774549945.093675, 'last_price_update_time': 1774549945.093685, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985719') HTTP/1.1" 204 0
2026-03-26 18:32:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/122/aa2f0903fe234c4b86d2002e4d1f5a2b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/416/76d0ececcce04c6e8a4ac27c936c1d86/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:25 [ayvens.es] INFO: Found listing with ID: 1985730
2026-03-26 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985730%27 HTTP/1.1" 200 None
2026-03-26 18:32:25 [ayvens.es] INFO: Scrape type for 1985730: 1
2026-03-26 18:32:25 [ayvens.es] INFO: Extracting data for car ID: 1985730
2026-03-26 18:32:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2656dd08-f094-5372-bac0-f298a89f9f2d with identifier: 1985730
2026-03-26 18:32:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2656dd08-f094-5372-bac0-f298a89f9f2d with scrape type 1
2026-03-26 18:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2656dd08-f094-5372-bac0-f298a89f9f2d
2026-03-26 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F697%252F5f0f43fe5d6e4e5f87c4e60cd9be9386%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/697/5f0f43fe5d6e4e5f87c4e60cd9be9386/images/large/1.jpg not downloaded yet
2026-03-26 18:32:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/456/90eb7a0f0f124532a520a878cd46d82c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28d3e750>
2026-03-26 18:32:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1341a483-ffb8-5b83-973f-8a61a5f2c672/1341a483-ffb8-5b83-973f-8a61a5f2c672_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F006%252F549c4232bb904465ae8afc33d480af1f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/006/549c4232bb904465ae8afc33d480af1f/images/large/1.jpg saved to cache
2026-03-26 18:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1341a483-ffb8-5b83-973f-8a61a5f2c672
2026-03-26 18:32:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1341a483-ffb8-5b83-973f-8a61a5f2c672, skipping ID generation
2026-03-26 18:32:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1341a483-ffb8-5b83-973f-8a61a5f2c672 with scrape type 1
2026-03-26 18:32:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1341a483-ffb8-5b83-973f-8a61a5f2c672 sending to next pipeline
2026-03-26 18:32:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1341a483-ffb8-5b83-973f-8a61a5f2c672, identifier: 1985722
2026-03-26 18:32:25 [ayvens.es] INFO: Found listing with ID: 1985731
2026-03-26 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985731%27 HTTP/1.1" 200 None
2026-03-26 18:32:25 [ayvens.es] INFO: Scrape type for 1985731: 1
2026-03-26 18:32:25 [ayvens.es] INFO: Extracting data for car ID: 1985731
2026-03-26 18:32:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 870219e4-51b4-5a4b-8bab-3e4280b35813 with identifier: 1985731
2026-03-26 18:32:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 870219e4-51b4-5a4b-8bab-3e4280b35813 with scrape type 1
2026-03-26 18:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 870219e4-51b4-5a4b-8bab-3e4280b35813
2026-03-26 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F774%252F43c048ddea324482b2eaff50d9e7086c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/774/43c048ddea324482b2eaff50d9e7086c/images/large/1.jpg not downloaded yet
2026-03-26 18:32:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1341a483-ffb8-5b83-973f-8a61a5f2c672 with identifier: 1985722
2026-03-26 18:32:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:32:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1341a483-ffb8-5b83-973f-8a61a5f2c672 with identifier: 1985722
2026-03-26 18:32:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1341a483-ffb8-5b83-973f-8a61a5f2c672 with identifier: 1985722 to the API
2026-03-26 18:32:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/006/549c4232bb904465ae8afc33d480af1f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '1341a483-ffb8-5b83-973f-8a61a5f2c672',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'GRANDLAND X',
 'odometer': 133113,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1341a483-ffb8-5b83-973f-8a61a5f2c672/1341a483-ffb8-5b83-973f-8a61a5f2c672_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 333695,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/006/549c4232bb904465ae8afc33d480af1f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL GRANDLAND X 1.5 CDTi 120 Aniversario',
 'transmission': 'manual',
 'trim': '1.5 CDTi 120 Aniversario',
 'vin': None,
 'year': 2020}
2026-03-26 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985722%27 HTTP/1.1" 200 None
2026-03-26 18:32:25 [ayvens.es] INFO: Saving data for 1985722: {'created_time': 1774549945.662676, 'last_price_update_time': 1774549945.662687, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985722') HTTP/1.1" 204 0
2026-03-26 18:32:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/945/36955d1f897f414fb70c65f5f7f46bed/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/548/53e80ab1df934a1a94a3b04ce6b42a8e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:25 [ayvens.es] INFO: Found listing with ID: 1985732
2026-03-26 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985732%27 HTTP/1.1" 200 None
2026-03-26 18:32:25 [ayvens.es] INFO: Scrape type for 1985732: 1
2026-03-26 18:32:25 [ayvens.es] INFO: Extracting data for car ID: 1985732
2026-03-26 18:32:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22c02a2a-c01f-516d-8946-9c445a6c7707 with identifier: 1985732
2026-03-26 18:32:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22c02a2a-c01f-516d-8946-9c445a6c7707 with scrape type 1
2026-03-26 18:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 22c02a2a-c01f-516d-8946-9c445a6c7707
2026-03-26 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F012%252F9c327c59586549cbac6b322208bb9eb4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/012/9c327c59586549cbac6b322208bb9eb4/images/large/1.jpg not downloaded yet
2026-03-26 18:32:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28310050>
2026-03-26 18:32:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89ec6bbc-1aa1-5380-b25a-338417e9c526/89ec6bbc-1aa1-5380-b25a-338417e9c526_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F122%252Faa2f0903fe234c4b86d2002e4d1f5a2b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/122/aa2f0903fe234c4b86d2002e4d1f5a2b/images/large/1.jpg saved to cache
2026-03-26 18:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 89ec6bbc-1aa1-5380-b25a-338417e9c526
2026-03-26 18:32:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 89ec6bbc-1aa1-5380-b25a-338417e9c526, skipping ID generation
2026-03-26 18:32:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89ec6bbc-1aa1-5380-b25a-338417e9c526 with scrape type 1
2026-03-26 18:32:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 89ec6bbc-1aa1-5380-b25a-338417e9c526 sending to next pipeline
2026-03-26 18:32:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 89ec6bbc-1aa1-5380-b25a-338417e9c526, identifier: 1985721
2026-03-26 18:32:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a2b85ce50>
2026-03-26 18:32:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4719a2f1-8cde-5d96-b39c-ad94eb3b55ce/4719a2f1-8cde-5d96-b39c-ad94eb3b55ce_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F416%252F76d0ececcce04c6e8a4ac27c936c1d86%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/416/76d0ececcce04c6e8a4ac27c936c1d86/images/large/1.jpg saved to cache
2026-03-26 18:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4719a2f1-8cde-5d96-b39c-ad94eb3b55ce
2026-03-26 18:32:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4719a2f1-8cde-5d96-b39c-ad94eb3b55ce, skipping ID generation
2026-03-26 18:32:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4719a2f1-8cde-5d96-b39c-ad94eb3b55ce with scrape type 1
2026-03-26 18:32:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4719a2f1-8cde-5d96-b39c-ad94eb3b55ce sending to next pipeline
2026-03-26 18:32:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4719a2f1-8cde-5d96-b39c-ad94eb3b55ce, identifier: 1985723
2026-03-26 18:32:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a2820c7d0>
2026-03-26 18:32:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6501096-8d2d-5a9e-a24e-5d9e46da4f95/d6501096-8d2d-5a9e-a24e-5d9e46da4f95_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F456%252F90eb7a0f0f124532a520a878cd46d82c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/456/90eb7a0f0f124532a520a878cd46d82c/images/large/1.jpg saved to cache
2026-03-26 18:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d6501096-8d2d-5a9e-a24e-5d9e46da4f95
2026-03-26 18:32:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d6501096-8d2d-5a9e-a24e-5d9e46da4f95, skipping ID generation
2026-03-26 18:32:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6501096-8d2d-5a9e-a24e-5d9e46da4f95 with scrape type 1
2026-03-26 18:32:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d6501096-8d2d-5a9e-a24e-5d9e46da4f95 sending to next pipeline
2026-03-26 18:32:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d6501096-8d2d-5a9e-a24e-5d9e46da4f95, identifier: 1985724
2026-03-26 18:32:26 [ayvens.es] INFO: Found listing with ID: 1985733
2026-03-26 18:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985733%27 HTTP/1.1" 200 None
2026-03-26 18:32:26 [ayvens.es] INFO: Scrape type for 1985733: 1
2026-03-26 18:32:26 [ayvens.es] INFO: Extracting data for car ID: 1985733
2026-03-26 18:32:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 097d0039-1580-5c4e-a3f2-63cd7060c6e6 with identifier: 1985733
2026-03-26 18:32:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 097d0039-1580-5c4e-a3f2-63cd7060c6e6 with scrape type 1
2026-03-26 18:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 097d0039-1580-5c4e-a3f2-63cd7060c6e6
2026-03-26 18:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F329%252Fcce245bb8c1f4641ab64a911ed8c8411%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/329/cce245bb8c1f4641ab64a911ed8c8411/images/large/1.jpg not downloaded yet
2026-03-26 18:32:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 89ec6bbc-1aa1-5380-b25a-338417e9c526 with identifier: 1985721
2026-03-26 18:32:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:32:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 89ec6bbc-1aa1-5380-b25a-338417e9c526 with identifier: 1985721
2026-03-26 18:32:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 89ec6bbc-1aa1-5380-b25a-338417e9c526 with identifier: 1985721 to the API
2026-03-26 18:32:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/122/aa2f0903fe234c4b86d2002e4d1f5a2b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Plata iridio metal',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '89ec6bbc-1aa1-5380-b25a-338417e9c526',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLA',
 'odometer': 109509,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89ec6bbc-1aa1-5380-b25a-338417e9c526/89ec6bbc-1aa1-5380-b25a-338417e9c526_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 569952,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/122/aa2f0903fe234c4b86d2002e4d1f5a2b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLA GLA 220 D 4MATIC',
 'transmission': 'manual',
 'trim': 'GLA 220 D 4MATIC',
 'vin': None,
 'year': 2022}
2026-03-26 18:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985721%27 HTTP/1.1" 200 None
2026-03-26 18:32:26 [ayvens.es] INFO: Saving data for 1985721: {'created_time': 1774549946.462716, 'last_price_update_time': 1774549946.462726, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985721') HTTP/1.1" 204 0
2026-03-26 18:32:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4719a2f1-8cde-5d96-b39c-ad94eb3b55ce with identifier: 1985723
2026-03-26 18:32:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4719a2f1-8cde-5d96-b39c-ad94eb3b55ce with identifier: 1985723
2026-03-26 18:32:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 4719a2f1-8cde-5d96-b39c-ad94eb3b55ce with identifier: 1985723 to the API
2026-03-26 18:32:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/416/76d0ececcce04c6e8a4ac27c936c1d86/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 170,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '4719a2f1-8cde-5d96-b39c-ad94eb3b55ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'VIVARO',
 'odometer': 57857,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4719a2f1-8cde-5d96-b39c-ad94eb3b55ce/4719a2f1-8cde-5d96-b39c-ad94eb3b55ce_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 327179,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/416/76d0ececcce04c6e8a4ac27c936c1d86/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-25',
 'seats_number': 3,
 'seller_name': None,
 'title': 'OPEL VIVARO 1.5 BlueHDi 74kW (100CV) M Std',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi 74kW (100CV) M Std',
 'vin': None,
 'year': 2022}
2026-03-26 18:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985723%27 HTTP/1.1" 200 None
2026-03-26 18:32:26 [ayvens.es] INFO: Saving data for 1985723: {'created_time': 1774549946.771639, 'last_price_update_time': 1774549946.77165, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985723') HTTP/1.1" 204 0
2026-03-26 18:32:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d6501096-8d2d-5a9e-a24e-5d9e46da4f95 with identifier: 1985724
2026-03-26 18:32:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d6501096-8d2d-5a9e-a24e-5d9e46da4f95 with identifier: 1985724
2026-03-26 18:32:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d6501096-8d2d-5a9e-a24e-5d9e46da4f95 with identifier: 1985724 to the API
2026-03-26 18:32:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/456/90eb7a0f0f124532a520a878cd46d82c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'Gris platinum',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd6501096-8d2d-5a9e-a24e-5d9e46da4f95',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008',
 'odometer': 87538,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6501096-8d2d-5a9e-a24e-5d9e46da4f95/d6501096-8d2d-5a9e-a24e-5d9e46da4f95_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 374879,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/456/90eb7a0f0f124532a520a878cd46d82c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-23',
 'seats_number': 7,
 'seller_name': None,
 'title': 'PEUGEOT 5008 1.5 BlueHDi 96kW (130CV) S&S Allure',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi 96kW (130CV) S&S Allure',
 'vin': None,
 'year': 2021}
2026-03-26 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985724%27 HTTP/1.1" 200 None
2026-03-26 18:32:27 [ayvens.es] INFO: Saving data for 1985724: {'created_time': 1774549947.09341, 'last_price_update_time': 1774549947.09342, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985724') HTTP/1.1" 204 0
2026-03-26 18:32:27 [ayvens.es] INFO: Found listing with ID: 1985734
2026-03-26 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985734%27 HTTP/1.1" 200 None
2026-03-26 18:32:27 [ayvens.es] INFO: Scrape type for 1985734: 1
2026-03-26 18:32:27 [ayvens.es] INFO: Extracting data for car ID: 1985734
2026-03-26 18:32:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97efd7d7-5f81-56b2-a04c-2358ab71f1d1 with identifier: 1985734
2026-03-26 18:32:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97efd7d7-5f81-56b2-a04c-2358ab71f1d1 with scrape type 1
2026-03-26 18:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 97efd7d7-5f81-56b2-a04c-2358ab71f1d1
2026-03-26 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F816%252Ff8539b804b394dc5a5f898ac8672beed%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/816/f8539b804b394dc5a5f898ac8672beed/images/large/1.jpg not downloaded yet
2026-03-26 18:32:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/856/6bdeedc8652d4f17be9a8d4acf0d5261/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a2832b790>
2026-03-26 18:32:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ae3d295-d273-5b26-a8f3-ecb9ced4d2ca/3ae3d295-d273-5b26-a8f3-ecb9ced4d2ca_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F945%252F36955d1f897f414fb70c65f5f7f46bed%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/945/36955d1f897f414fb70c65f5f7f46bed/images/large/1.jpg saved to cache
2026-03-26 18:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3ae3d295-d273-5b26-a8f3-ecb9ced4d2ca
2026-03-26 18:32:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3ae3d295-d273-5b26-a8f3-ecb9ced4d2ca, skipping ID generation
2026-03-26 18:32:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ae3d295-d273-5b26-a8f3-ecb9ced4d2ca with scrape type 1
2026-03-26 18:32:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3ae3d295-d273-5b26-a8f3-ecb9ced4d2ca sending to next pipeline
2026-03-26 18:32:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3ae3d295-d273-5b26-a8f3-ecb9ced4d2ca, identifier: 1985725
2026-03-26 18:32:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c23490>
2026-03-26 18:32:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ec5cad9-010b-53ea-88ef-ed98e091075c/2ec5cad9-010b-53ea-88ef-ed98e091075c_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F548%252F53e80ab1df934a1a94a3b04ce6b42a8e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/548/53e80ab1df934a1a94a3b04ce6b42a8e/images/large/1.jpg saved to cache
2026-03-26 18:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2ec5cad9-010b-53ea-88ef-ed98e091075c
2026-03-26 18:32:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2ec5cad9-010b-53ea-88ef-ed98e091075c, skipping ID generation
2026-03-26 18:32:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ec5cad9-010b-53ea-88ef-ed98e091075c with scrape type 1
2026-03-26 18:32:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2ec5cad9-010b-53ea-88ef-ed98e091075c sending to next pipeline
2026-03-26 18:32:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2ec5cad9-010b-53ea-88ef-ed98e091075c, identifier: 1985726
2026-03-26 18:32:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/371/5fdc140cc2454f1b8e42f7d9ec3ecabb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:27 [ayvens.es] INFO: Found listing with ID: 1985735
2026-03-26 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985735%27 HTTP/1.1" 200 None
2026-03-26 18:32:27 [ayvens.es] INFO: Scrape type for 1985735: 1
2026-03-26 18:32:27 [ayvens.es] INFO: Extracting data for car ID: 1985735
2026-03-26 18:32:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 772ccc08-4770-55a8-9a32-53a52f27b854 with identifier: 1985735
2026-03-26 18:32:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 772ccc08-4770-55a8-9a32-53a52f27b854 with scrape type 1
2026-03-26 18:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 772ccc08-4770-55a8-9a32-53a52f27b854
2026-03-26 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F951%252F3f1026d58eb94a0196eb602300ba414d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/951/3f1026d58eb94a0196eb602300ba414d/images/large/1.jpg not downloaded yet
2026-03-26 18:32:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3ae3d295-d273-5b26-a8f3-ecb9ced4d2ca with identifier: 1985725
2026-03-26 18:32:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:32:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3ae3d295-d273-5b26-a8f3-ecb9ced4d2ca with identifier: 1985725
2026-03-26 18:32:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3ae3d295-d273-5b26-a8f3-ecb9ced4d2ca with identifier: 1985725 to the API
2026-03-26 18:32:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/945/36955d1f897f414fb70c65f5f7f46bed/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 200,
 'color': 'Santorini black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '3.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '3ae3d295-d273-5b26-a8f3-ecb9ced4d2ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER SPORT',
 'odometer': 89884,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ae3d295-d273-5b26-a8f3-ecb9ced4d2ca/3ae3d295-d273-5b26-a8f3-ecb9ced4d2ca_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 335524,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/945/36955d1f897f414fb70c65f5f7f46bed/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER RANGE ROVER SPORT 3.0D I6 220kW AWD HSE Dynamic Stealth',
 'transmission': 'manual',
 'trim': '3.0D I6 220kW AWD HSE Dynamic Stealth',
 'vin': None,
 'year': 2021}
2026-03-26 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985725%27 HTTP/1.1" 200 None
2026-03-26 18:32:27 [ayvens.es] INFO: Saving data for 1985725: {'created_time': 1774549947.847534, 'last_price_update_time': 1774549947.847545, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985725') HTTP/1.1" 204 0
2026-03-26 18:32:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2ec5cad9-010b-53ea-88ef-ed98e091075c with identifier: 1985726
2026-03-26 18:32:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2ec5cad9-010b-53ea-88ef-ed98e091075c with identifier: 1985726
2026-03-26 18:32:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 2ec5cad9-010b-53ea-88ef-ed98e091075c with identifier: 1985726 to the API
2026-03-26 18:32:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/548/53e80ab1df934a1a94a3b04ce6b42a8e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.2L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '2ec5cad9-010b-53ea-88ef-ed98e091075c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': '500',
 'odometer': 148770,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ec5cad9-010b-53ea-88ef-ed98e091075c/2ec5cad9-010b-53ea-88ef-ed98e091075c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 339195,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/548/53e80ab1df934a1a94a3b04ce6b42a8e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-31',
 'seats_number': 4,
 'seller_name': None,
 'title': 'FIAT 500 1.2 8v 51kW (69CV) Lounge',
 'transmission': 'manual',
 'trim': '1.2 8v 51kW (69CV) Lounge',
 'vin': None,
 'year': 2017}
2026-03-26 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985726%27 HTTP/1.1" 200 None
2026-03-26 18:32:28 [ayvens.es] INFO: Saving data for 1985726: {'created_time': 1774549948.146064, 'last_price_update_time': 1774549948.146074, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985726') HTTP/1.1" 204 0
2026-03-26 18:32:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/885/98751014134c42a8b326bba545bcde9d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:28 [ayvens.es] INFO: Found listing with ID: 1985736
2026-03-26 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985736%27 HTTP/1.1" 200 None
2026-03-26 18:32:28 [ayvens.es] INFO: Scrape type for 1985736: 1
2026-03-26 18:32:28 [ayvens.es] INFO: Extracting data for car ID: 1985736
2026-03-26 18:32:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1810c7de-7328-57b8-a689-3ecd7dd45941 with identifier: 1985736
2026-03-26 18:32:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1810c7de-7328-57b8-a689-3ecd7dd45941 with scrape type 1
2026-03-26 18:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1810c7de-7328-57b8-a689-3ecd7dd45941
2026-03-26 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F948%252F9717489f056d49eb8a5fa61bacf3ed39%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/948/9717489f056d49eb8a5fa61bacf3ed39/images/large/1.jpg not downloaded yet
2026-03-26 18:32:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c34950>
2026-03-26 18:32:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f9722e8-b53d-58d3-8373-fb3aff38239d/1f9722e8-b53d-58d3-8373-fb3aff38239d_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F856%252F6bdeedc8652d4f17be9a8d4acf0d5261%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/856/6bdeedc8652d4f17be9a8d4acf0d5261/images/large/1.jpg saved to cache
2026-03-26 18:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1f9722e8-b53d-58d3-8373-fb3aff38239d
2026-03-26 18:32:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1f9722e8-b53d-58d3-8373-fb3aff38239d, skipping ID generation
2026-03-26 18:32:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f9722e8-b53d-58d3-8373-fb3aff38239d with scrape type 1
2026-03-26 18:32:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1f9722e8-b53d-58d3-8373-fb3aff38239d sending to next pipeline
2026-03-26 18:32:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1f9722e8-b53d-58d3-8373-fb3aff38239d, identifier: 1985727
2026-03-26 18:32:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28aba8d0>
2026-03-26 18:32:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ad92e02-c68f-5c66-a2a6-99a773672f51/8ad92e02-c68f-5c66-a2a6-99a773672f51_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F371%252F5fdc140cc2454f1b8e42f7d9ec3ecabb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/371/5fdc140cc2454f1b8e42f7d9ec3ecabb/images/large/1.jpg saved to cache
2026-03-26 18:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8ad92e02-c68f-5c66-a2a6-99a773672f51
2026-03-26 18:32:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8ad92e02-c68f-5c66-a2a6-99a773672f51, skipping ID generation
2026-03-26 18:32:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ad92e02-c68f-5c66-a2a6-99a773672f51 with scrape type 1
2026-03-26 18:32:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8ad92e02-c68f-5c66-a2a6-99a773672f51 sending to next pipeline
2026-03-26 18:32:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8ad92e02-c68f-5c66-a2a6-99a773672f51, identifier: 1985728
2026-03-26 18:32:28 [ayvens.es] INFO: Found listing with ID: 1985737
2026-03-26 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985737%27 HTTP/1.1" 200 None
2026-03-26 18:32:28 [ayvens.es] INFO: Scrape type for 1985737: 1
2026-03-26 18:32:28 [ayvens.es] INFO: Extracting data for car ID: 1985737
2026-03-26 18:32:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae044edb-102c-58a4-8eea-d0f9b6589450 with identifier: 1985737
2026-03-26 18:32:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae044edb-102c-58a4-8eea-d0f9b6589450 with scrape type 1
2026-03-26 18:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ae044edb-102c-58a4-8eea-d0f9b6589450
2026-03-26 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F633%252Fdceebbbe90c54af481b0f858f1f260e8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/633/dceebbbe90c54af481b0f858f1f260e8/images/large/1.jpg not downloaded yet
2026-03-26 18:32:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1f9722e8-b53d-58d3-8373-fb3aff38239d with identifier: 1985727
2026-03-26 18:32:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1f9722e8-b53d-58d3-8373-fb3aff38239d with identifier: 1985727
2026-03-26 18:32:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1f9722e8-b53d-58d3-8373-fb3aff38239d with identifier: 1985727 to the API
2026-03-26 18:32:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/856/6bdeedc8652d4f17be9a8d4acf0d5261/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Mineralweiss',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '1f9722e8-b53d-58d3-8373-fb3aff38239d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 136896,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f9722e8-b53d-58d3-8373-fb3aff38239d/1f9722e8-b53d-58d3-8373-fb3aff38239d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 408237,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/856/6bdeedc8652d4f17be9a8d4acf0d5261/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 sDrive18d',
 'transmission': 'manual',
 'trim': 'sDrive18d',
 'vin': None,
 'year': 2020}
2026-03-26 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985727%27 HTTP/1.1" 200 None
2026-03-26 18:32:28 [ayvens.es] INFO: Saving data for 1985727: {'created_time': 1774549948.799362, 'last_price_update_time': 1774549948.799374, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985727') HTTP/1.1" 204 0
2026-03-26 18:32:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8ad92e02-c68f-5c66-a2a6-99a773672f51 with identifier: 1985728
2026-03-26 18:32:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:32:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8ad92e02-c68f-5c66-a2a6-99a773672f51 with identifier: 1985728
2026-03-26 18:32:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8ad92e02-c68f-5c66-a2a6-99a773672f51 with identifier: 1985728 to the API
2026-03-26 18:32:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/371/5fdc140cc2454f1b8e42f7d9ec3ecabb/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'color': 'Gris acero',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '8ad92e02-c68f-5c66-a2a6-99a773672f51',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'INSIGNIA',
 'odometer': 87860,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ad92e02-c68f-5c66-a2a6-99a773672f51/8ad92e02-c68f-5c66-a2a6-99a773672f51_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 513208,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/371/5fdc140cc2454f1b8e42f7d9ec3ecabb/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL INSIGNIA ST GS Line Plus 2.0D DVH 130kW AT8',
 'transmission': 'manual',
 'trim': 'ST GS Line Plus 2.0D DVH 130kW AT8',
 'vin': None,
 'year': 2021}
2026-03-26 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985728%27 HTTP/1.1" 200 None
2026-03-26 18:32:29 [ayvens.es] INFO: Saving data for 1985728: {'created_time': 1774549949.121535, 'last_price_update_time': 1774549949.121545, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985728') HTTP/1.1" 204 0
2026-03-26 18:32:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/697/5f0f43fe5d6e4e5f87c4e60cd9be9386/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/012/9c327c59586549cbac6b322208bb9eb4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/774/43c048ddea324482b2eaff50d9e7086c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:29 [ayvens.es] INFO: Found listing with ID: 1985738
2026-03-26 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985738%27 HTTP/1.1" 200 None
2026-03-26 18:32:29 [ayvens.es] INFO: Scrape type for 1985738: 1
2026-03-26 18:32:29 [ayvens.es] INFO: Extracting data for car ID: 1985738
2026-03-26 18:32:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f8af016-8aef-5cb2-8887-0444d747e2c9 with identifier: 1985738
2026-03-26 18:32:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f8af016-8aef-5cb2-8887-0444d747e2c9 with scrape type 1
2026-03-26 18:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9f8af016-8aef-5cb2-8887-0444d747e2c9
2026-03-26 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F474%252Fa9469404b31a4a468db86ee60d7e2eeb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/474/a9469404b31a4a468db86ee60d7e2eeb/images/large/1.jpg not downloaded yet
2026-03-26 18:32:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28233690>
2026-03-26 18:32:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36bd9482-6f5f-55ae-960f-b24ae95022e3/36bd9482-6f5f-55ae-960f-b24ae95022e3_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F885%252F98751014134c42a8b326bba545bcde9d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/885/98751014134c42a8b326bba545bcde9d/images/large/1.jpg saved to cache
2026-03-26 18:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 36bd9482-6f5f-55ae-960f-b24ae95022e3
2026-03-26 18:32:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 36bd9482-6f5f-55ae-960f-b24ae95022e3, skipping ID generation
2026-03-26 18:32:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36bd9482-6f5f-55ae-960f-b24ae95022e3 with scrape type 1
2026-03-26 18:32:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 36bd9482-6f5f-55ae-960f-b24ae95022e3 sending to next pipeline
2026-03-26 18:32:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 36bd9482-6f5f-55ae-960f-b24ae95022e3, identifier: 1985729
2026-03-26 18:32:29 [ayvens.es] INFO: Found listing with ID: 1985739
2026-03-26 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985739%27 HTTP/1.1" 200 None
2026-03-26 18:32:29 [ayvens.es] INFO: Scrape type for 1985739: 1
2026-03-26 18:32:29 [ayvens.es] INFO: Extracting data for car ID: 1985739
2026-03-26 18:32:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd610480-d0ef-5f40-9300-3b9388471b70 with identifier: 1985739
2026-03-26 18:32:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd610480-d0ef-5f40-9300-3b9388471b70 with scrape type 1
2026-03-26 18:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item fd610480-d0ef-5f40-9300-3b9388471b70
2026-03-26 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F103%252F24b15d5241244ec28e1a179d4abb0a10%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/103/24b15d5241244ec28e1a179d4abb0a10/images/large/1.jpg not downloaded yet
2026-03-26 18:32:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 36bd9482-6f5f-55ae-960f-b24ae95022e3 with identifier: 1985729
2026-03-26 18:32:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:32:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 36bd9482-6f5f-55ae-960f-b24ae95022e3 with identifier: 1985729
2026-03-26 18:32:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 36bd9482-6f5f-55ae-960f-b24ae95022e3 with identifier: 1985729 to the API
2026-03-26 18:32:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/885/98751014134c42a8b326bba545bcde9d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '36bd9482-6f5f-55ae-960f-b24ae95022e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X3',
 'odometer': 75513,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36bd9482-6f5f-55ae-960f-b24ae95022e3/36bd9482-6f5f-55ae-960f-b24ae95022e3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 356958,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/885/98751014134c42a8b326bba545bcde9d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 sDrive18d',
 'transmission': 'manual',
 'trim': 'sDrive18d',
 'vin': None,
 'year': 2020}
2026-03-26 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985729%27 HTTP/1.1" 200 None
2026-03-26 18:32:29 [ayvens.es] INFO: Saving data for 1985729: {'created_time': 1774549949.891103, 'last_price_update_time': 1774549949.891114, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985729') HTTP/1.1" 204 0
2026-03-26 18:32:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/329/cce245bb8c1f4641ab64a911ed8c8411/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:30 [ayvens.es] INFO: Found listing with ID: 1985740
2026-03-26 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985740%27 HTTP/1.1" 200 None
2026-03-26 18:32:30 [ayvens.es] INFO: Scrape type for 1985740: 1
2026-03-26 18:32:30 [ayvens.es] INFO: Extracting data for car ID: 1985740
2026-03-26 18:32:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56da1ef2-8820-50af-a2bf-a3693933c20b with identifier: 1985740
2026-03-26 18:32:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56da1ef2-8820-50af-a2bf-a3693933c20b with scrape type 1
2026-03-26 18:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 56da1ef2-8820-50af-a2bf-a3693933c20b
2026-03-26 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F811%252F070768c3ce2d48b295c6a05ea37e9009%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/811/070768c3ce2d48b295c6a05ea37e9009/images/large/1.jpg not downloaded yet
2026-03-26 18:32:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/816/f8539b804b394dc5a5f898ac8672beed/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c3f6d0>
2026-03-26 18:32:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2656dd08-f094-5372-bac0-f298a89f9f2d/2656dd08-f094-5372-bac0-f298a89f9f2d_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F697%252F5f0f43fe5d6e4e5f87c4e60cd9be9386%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/697/5f0f43fe5d6e4e5f87c4e60cd9be9386/images/large/1.jpg saved to cache
2026-03-26 18:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2656dd08-f094-5372-bac0-f298a89f9f2d
2026-03-26 18:32:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2656dd08-f094-5372-bac0-f298a89f9f2d, skipping ID generation
2026-03-26 18:32:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2656dd08-f094-5372-bac0-f298a89f9f2d with scrape type 1
2026-03-26 18:32:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2656dd08-f094-5372-bac0-f298a89f9f2d sending to next pipeline
2026-03-26 18:32:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2656dd08-f094-5372-bac0-f298a89f9f2d, identifier: 1985730
2026-03-26 18:32:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28dd3c50>
2026-03-26 18:32:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22c02a2a-c01f-516d-8946-9c445a6c7707/22c02a2a-c01f-516d-8946-9c445a6c7707_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F012%252F9c327c59586549cbac6b322208bb9eb4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/012/9c327c59586549cbac6b322208bb9eb4/images/large/1.jpg saved to cache
2026-03-26 18:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 22c02a2a-c01f-516d-8946-9c445a6c7707
2026-03-26 18:32:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 22c02a2a-c01f-516d-8946-9c445a6c7707, skipping ID generation
2026-03-26 18:32:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22c02a2a-c01f-516d-8946-9c445a6c7707 with scrape type 1
2026-03-26 18:32:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 22c02a2a-c01f-516d-8946-9c445a6c7707 sending to next pipeline
2026-03-26 18:32:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 22c02a2a-c01f-516d-8946-9c445a6c7707, identifier: 1985732
2026-03-26 18:32:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a2820ed10>
2026-03-26 18:32:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_870219e4-51b4-5a4b-8bab-3e4280b35813/870219e4-51b4-5a4b-8bab-3e4280b35813_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F774%252F43c048ddea324482b2eaff50d9e7086c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/774/43c048ddea324482b2eaff50d9e7086c/images/large/1.jpg saved to cache
2026-03-26 18:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 870219e4-51b4-5a4b-8bab-3e4280b35813
2026-03-26 18:32:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 870219e4-51b4-5a4b-8bab-3e4280b35813, skipping ID generation
2026-03-26 18:32:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 870219e4-51b4-5a4b-8bab-3e4280b35813 with scrape type 1
2026-03-26 18:32:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 870219e4-51b4-5a4b-8bab-3e4280b35813 sending to next pipeline
2026-03-26 18:32:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 870219e4-51b4-5a4b-8bab-3e4280b35813, identifier: 1985731
2026-03-26 18:32:30 [ayvens.es] INFO: Found listing with ID: 1985741
2026-03-26 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985741%27 HTTP/1.1" 200 None
2026-03-26 18:32:30 [ayvens.es] INFO: Scrape type for 1985741: 1
2026-03-26 18:32:30 [ayvens.es] INFO: Extracting data for car ID: 1985741
2026-03-26 18:32:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23796219-0b0b-5a1d-a18e-e2b4e4d222fc with identifier: 1985741
2026-03-26 18:32:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23796219-0b0b-5a1d-a18e-e2b4e4d222fc with scrape type 1
2026-03-26 18:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 23796219-0b0b-5a1d-a18e-e2b4e4d222fc
2026-03-26 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F048%252F752517411a7344d59403da8535a68267%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/048/752517411a7344d59403da8535a68267/images/large/1.jpg not downloaded yet
2026-03-26 18:32:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2656dd08-f094-5372-bac0-f298a89f9f2d with identifier: 1985730
2026-03-26 18:32:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:32:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2656dd08-f094-5372-bac0-f298a89f9f2d with identifier: 1985730
2026-03-26 18:32:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 2656dd08-f094-5372-bac0-f298a89f9f2d with identifier: 1985730 to the API
2026-03-26 18:32:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/697/5f0f43fe5d6e4e5f87c4e60cd9be9386/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'Blanco gelato',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '2656dd08-f094-5372-bac0-f298a89f9f2d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': '500',
 'odometer': 51375,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2656dd08-f094-5372-bac0-f298a89f9f2d/2656dd08-f094-5372-bac0-f298a89f9f2d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 547422,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/697/5f0f43fe5d6e4e5f87c4e60cd9be9386/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-25',
 'seats_number': 4,
 'seller_name': None,
 'title': 'FIAT 500 Dolcevita 1.0 Hybrid 51KW (70 CV)',
 'transmission': 'manual',
 'trim': 'Dolcevita 1.0 Hybrid 51KW (70 CV)',
 'vin': None,
 'year': 2021}
2026-03-26 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985730%27 HTTP/1.1" 200 None
2026-03-26 18:32:31 [ayvens.es] INFO: Saving data for 1985730: {'created_time': 1774549951.092216, 'last_price_update_time': 1774549951.092227, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985730') HTTP/1.1" 204 0
2026-03-26 18:32:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 22c02a2a-c01f-516d-8946-9c445a6c7707 with identifier: 1985732
2026-03-26 18:32:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 22c02a2a-c01f-516d-8946-9c445a6c7707 with identifier: 1985732
2026-03-26 18:32:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 22c02a2a-c01f-516d-8946-9c445a6c7707 with identifier: 1985732 to the API
2026-03-26 18:32:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/012/9c327c59586549cbac6b322208bb9eb4/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'color': 'Blanco everest',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '22c02a2a-c01f-516d-8946-9c445a6c7707',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 61057,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22c02a2a-c01f-516d-8946-9c445a6c7707/22c02a2a-c01f-516d-8946-9c445a6c7707_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 339775,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/012/9c327c59586549cbac6b322208bb9eb4/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI dCi 85 kW (115 CV) E6D ACENTA',
 'transmission': 'manual',
 'trim': 'dCi 85 kW (115 CV) E6D ACENTA',
 'vin': None,
 'year': 2020}
2026-03-26 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985732%27 HTTP/1.1" 200 None
2026-03-26 18:32:31 [ayvens.es] INFO: Saving data for 1985732: {'created_time': 1774549951.454104, 'last_price_update_time': 1774549951.454113, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985732') HTTP/1.1" 204 0
2026-03-26 18:32:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 870219e4-51b4-5a4b-8bab-3e4280b35813 with identifier: 1985731
2026-03-26 18:32:31 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:32:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 870219e4-51b4-5a4b-8bab-3e4280b35813 with identifier: 1985731
2026-03-26 18:32:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 870219e4-51b4-5a4b-8bab-3e4280b35813 with identifier: 1985731 to the API
2026-03-26 18:32:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/774/43c048ddea324482b2eaff50d9e7086c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Perennial grey',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '870219e4-51b4-5a4b-8bab-3e4280b35813',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'STONIC',
 'odometer': 30220,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_870219e4-51b4-5a4b-8bab-3e4280b35813/870219e4-51b4-5a4b-8bab-3e4280b35813_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 338018,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/774/43c048ddea324482b2eaff50d9e7086c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA STONIC 1.0 T-GDi 88kW (120CV) MHEV iMT Drive',
 'transmission': 'manual',
 'trim': '1.0 T-GDi 88kW (120CV) MHEV iMT Drive',
 'vin': None,
 'year': 2021}
2026-03-26 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985731%27 HTTP/1.1" 200 None
2026-03-26 18:32:31 [ayvens.es] INFO: Saving data for 1985731: {'created_time': 1774549951.747262, 'last_price_update_time': 1774549951.747271, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985731') HTTP/1.1" 204 0
2026-03-26 18:32:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/948/9717489f056d49eb8a5fa61bacf3ed39/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/951/3f1026d58eb94a0196eb602300ba414d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:31 [ayvens.es] INFO: Found listing with ID: 1985742
2026-03-26 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985742%27 HTTP/1.1" 200 None
2026-03-26 18:32:31 [ayvens.es] INFO: Scrape type for 1985742: 1
2026-03-26 18:32:31 [ayvens.es] INFO: Extracting data for car ID: 1985742
2026-03-26 18:32:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffcd4aa3-0fd8-5363-9c4d-5a3b1b40ccfc with identifier: 1985742
2026-03-26 18:32:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffcd4aa3-0fd8-5363-9c4d-5a3b1b40ccfc with scrape type 1
2026-03-26 18:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ffcd4aa3-0fd8-5363-9c4d-5a3b1b40ccfc
2026-03-26 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F061%252F67e2bc3e557c4bfcb12d803f7065d370%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/061/67e2bc3e557c4bfcb12d803f7065d370/images/large/1.jpg not downloaded yet
2026-03-26 18:32:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a29080350>
2026-03-26 18:32:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_097d0039-1580-5c4e-a3f2-63cd7060c6e6/097d0039-1580-5c4e-a3f2-63cd7060c6e6_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F329%252Fcce245bb8c1f4641ab64a911ed8c8411%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/329/cce245bb8c1f4641ab64a911ed8c8411/images/large/1.jpg saved to cache
2026-03-26 18:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 097d0039-1580-5c4e-a3f2-63cd7060c6e6
2026-03-26 18:32:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 097d0039-1580-5c4e-a3f2-63cd7060c6e6, skipping ID generation
2026-03-26 18:32:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 097d0039-1580-5c4e-a3f2-63cd7060c6e6 with scrape type 1
2026-03-26 18:32:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 097d0039-1580-5c4e-a3f2-63cd7060c6e6 sending to next pipeline
2026-03-26 18:32:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 097d0039-1580-5c4e-a3f2-63cd7060c6e6, identifier: 1985733
2026-03-26 18:32:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a283d0a50>
2026-03-26 18:32:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97efd7d7-5f81-56b2-a04c-2358ab71f1d1/97efd7d7-5f81-56b2-a04c-2358ab71f1d1_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F816%252Ff8539b804b394dc5a5f898ac8672beed%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/816/f8539b804b394dc5a5f898ac8672beed/images/large/1.jpg saved to cache
2026-03-26 18:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 97efd7d7-5f81-56b2-a04c-2358ab71f1d1
2026-03-26 18:32:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 97efd7d7-5f81-56b2-a04c-2358ab71f1d1, skipping ID generation
2026-03-26 18:32:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97efd7d7-5f81-56b2-a04c-2358ab71f1d1 with scrape type 1
2026-03-26 18:32:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 97efd7d7-5f81-56b2-a04c-2358ab71f1d1 sending to next pipeline
2026-03-26 18:32:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 97efd7d7-5f81-56b2-a04c-2358ab71f1d1, identifier: 1985734
2026-03-26 18:32:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 097d0039-1580-5c4e-a3f2-63cd7060c6e6 with identifier: 1985733
2026-03-26 18:32:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:32:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 097d0039-1580-5c4e-a3f2-63cd7060c6e6 with identifier: 1985733
2026-03-26 18:32:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 097d0039-1580-5c4e-a3f2-63cd7060c6e6 with identifier: 1985733 to the API
2026-03-26 18:32:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/329/cce245bb8c1f4641ab64a911ed8c8411/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Darkblue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '097d0039-1580-5c4e-a3f2-63cd7060c6e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508',
 'odometer': 61403,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_097d0039-1580-5c4e-a3f2-63cd7060c6e6/097d0039-1580-5c4e-a3f2-63cd7060c6e6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 362105,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/329/cce245bb8c1f4641ab64a911ed8c8411/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 5P Allure Pack BlueHDi 130 S&S EAT8',
 'transmission': 'manual',
 'trim': '5P Allure Pack BlueHDi 130 S&S EAT8',
 'vin': None,
 'year': 2022}
2026-03-26 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985733%27 HTTP/1.1" 200 None
2026-03-26 18:32:32 [ayvens.es] INFO: Saving data for 1985733: {'created_time': 1774549952.360188, 'last_price_update_time': 1774549952.360199, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985733') HTTP/1.1" 204 0
2026-03-26 18:32:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 97efd7d7-5f81-56b2-a04c-2358ab71f1d1 with identifier: 1985734
2026-03-26 18:32:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 97efd7d7-5f81-56b2-a04c-2358ab71f1d1 with identifier: 1985734
2026-03-26 18:32:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 97efd7d7-5f81-56b2-a04c-2358ab71f1d1 with identifier: 1985734 to the API
2026-03-26 18:32:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/816/f8539b804b394dc5a5f898ac8672beed/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '97efd7d7-5f81-56b2-a04c-2358ab71f1d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008',
 'odometer': 71775,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97efd7d7-5f81-56b2-a04c-2358ab71f1d1/97efd7d7-5f81-56b2-a04c-2358ab71f1d1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 449603,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/816/f8539b804b394dc5a5f898ac8672beed/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-29',
 'seats_number': 7,
 'seller_name': None,
 'title': 'PEUGEOT 5008 1.5 BlueHDi 96kW (130CV) S&S Allure',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi 96kW (130CV) S&S Allure',
 'vin': None,
 'year': 2021}
2026-03-26 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985734%27 HTTP/1.1" 200 None
2026-03-26 18:32:32 [ayvens.es] INFO: Saving data for 1985734: {'created_time': 1774549952.652375, 'last_price_update_time': 1774549952.652385, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985734') HTTP/1.1" 204 0
2026-03-26 18:32:32 [ayvens.es] INFO: Found listing with ID: 1985743
2026-03-26 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985743%27 HTTP/1.1" 200 None
2026-03-26 18:32:32 [ayvens.es] INFO: Scrape type for 1985743: 1
2026-03-26 18:32:32 [ayvens.es] INFO: Extracting data for car ID: 1985743
2026-03-26 18:32:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc4a4845-67f6-5fef-a289-a2fe6adc8a54 with identifier: 1985743
2026-03-26 18:32:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc4a4845-67f6-5fef-a289-a2fe6adc8a54 with scrape type 1
2026-03-26 18:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item dc4a4845-67f6-5fef-a289-a2fe6adc8a54
2026-03-26 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F859%252F0c96deb68c8e4b90bdedab99e09d0d0f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/859/0c96deb68c8e4b90bdedab99e09d0d0f/images/large/1.jpg not downloaded yet
2026-03-26 18:32:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/633/dceebbbe90c54af481b0f858f1f260e8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28314590>
2026-03-26 18:32:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1810c7de-7328-57b8-a689-3ecd7dd45941/1810c7de-7328-57b8-a689-3ecd7dd45941_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F948%252F9717489f056d49eb8a5fa61bacf3ed39%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/948/9717489f056d49eb8a5fa61bacf3ed39/images/large/1.jpg saved to cache
2026-03-26 18:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1810c7de-7328-57b8-a689-3ecd7dd45941
2026-03-26 18:32:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1810c7de-7328-57b8-a689-3ecd7dd45941, skipping ID generation
2026-03-26 18:32:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1810c7de-7328-57b8-a689-3ecd7dd45941 with scrape type 1
2026-03-26 18:32:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1810c7de-7328-57b8-a689-3ecd7dd45941 sending to next pipeline
2026-03-26 18:32:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1810c7de-7328-57b8-a689-3ecd7dd45941, identifier: 1985736
2026-03-26 18:32:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c80dd0>
2026-03-26 18:32:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_772ccc08-4770-55a8-9a32-53a52f27b854/772ccc08-4770-55a8-9a32-53a52f27b854_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F951%252F3f1026d58eb94a0196eb602300ba414d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/951/3f1026d58eb94a0196eb602300ba414d/images/large/1.jpg saved to cache
2026-03-26 18:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 772ccc08-4770-55a8-9a32-53a52f27b854
2026-03-26 18:32:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 772ccc08-4770-55a8-9a32-53a52f27b854, skipping ID generation
2026-03-26 18:32:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 772ccc08-4770-55a8-9a32-53a52f27b854 with scrape type 1
2026-03-26 18:32:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 772ccc08-4770-55a8-9a32-53a52f27b854 sending to next pipeline
2026-03-26 18:32:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 772ccc08-4770-55a8-9a32-53a52f27b854, identifier: 1985735
2026-03-26 18:32:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/474/a9469404b31a4a468db86ee60d7e2eeb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:33 [ayvens.es] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 200
2026-03-26 18:32:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1810c7de-7328-57b8-a689-3ecd7dd45941 with identifier: 1985736
2026-03-26 18:32:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:32:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1810c7de-7328-57b8-a689-3ecd7dd45941 with identifier: 1985736
2026-03-26 18:32:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1810c7de-7328-57b8-a689-3ecd7dd45941 with identifier: 1985736 to the API
2026-03-26 18:32:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/948/9717489f056d49eb8a5fa61bacf3ed39/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 165,
 'color': 'Blanco s',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '1810c7de-7328-57b8-a689-3ecd7dd45941',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT',
 'odometer': 484567,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1810c7de-7328-57b8-a689-3ecd7dd45941/1810c7de-7328-57b8-a689-3ecd7dd45941_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329599,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/948/9717489f056d49eb8a5fa61bacf3ed39/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-28',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 310 96kW L3H2 Van Trend FWD MHEV',
 'transmission': 'manual',
 'trim': '310 96kW L3H2 Van Trend FWD MHEV',
 'vin': None,
 'year': 2020}
2026-03-26 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985736%27 HTTP/1.1" 200 None
2026-03-26 18:32:33 [ayvens.es] INFO: Saving data for 1985736: {'created_time': 1774549953.314062, 'last_price_update_time': 1774549953.314072, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985736') HTTP/1.1" 204 0
2026-03-26 18:32:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 772ccc08-4770-55a8-9a32-53a52f27b854 with identifier: 1985735
2026-03-26 18:32:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:32:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 772ccc08-4770-55a8-9a32-53a52f27b854 with identifier: 1985735
2026-03-26 18:32:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 772ccc08-4770-55a8-9a32-53a52f27b854 with identifier: 1985735 to the API
2026-03-26 18:32:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/951/3f1026d58eb94a0196eb602300ba414d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'color': 'Polar white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '772ccc08-4770-55a8-9a32-53a52f27b854',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'TUCSON',
 'odometer': 80727,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_772ccc08-4770-55a8-9a32-53a52f27b854/772ccc08-4770-55a8-9a32-53a52f27b854_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 349945,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/951/3f1026d58eb94a0196eb602300ba414d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI TUCSON 1.6 CRDI 100kW (136CV) 48V Tecno DCT 2C',
 'transmission': 'manual',
 'trim': '1.6 CRDI 100kW (136CV) 48V Tecno DCT 2C',
 'vin': None,
 'year': 2023}
2026-03-26 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985735%27 HTTP/1.1" 200 None
2026-03-26 18:32:33 [ayvens.es] INFO: Saving data for 1985735: {'created_time': 1774549953.599684, 'last_price_update_time': 1774549953.599694, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985735') HTTP/1.1" 204 0
2026-03-26 18:32:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 18:32:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/811/070768c3ce2d48b295c6a05ea37e9009/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/103/24b15d5241244ec28e1a179d4abb0a10/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a384f07d0>
2026-03-26 18:32:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae044edb-102c-58a4-8eea-d0f9b6589450/ae044edb-102c-58a4-8eea-d0f9b6589450_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F633%252Fdceebbbe90c54af481b0f858f1f260e8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/633/dceebbbe90c54af481b0f858f1f260e8/images/large/1.jpg saved to cache
2026-03-26 18:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ae044edb-102c-58a4-8eea-d0f9b6589450
2026-03-26 18:32:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ae044edb-102c-58a4-8eea-d0f9b6589450, skipping ID generation
2026-03-26 18:32:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae044edb-102c-58a4-8eea-d0f9b6589450 with scrape type 1
2026-03-26 18:32:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ae044edb-102c-58a4-8eea-d0f9b6589450 sending to next pipeline
2026-03-26 18:32:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ae044edb-102c-58a4-8eea-d0f9b6589450, identifier: 1985737
2026-03-26 18:32:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28346c50>
2026-03-26 18:32:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f8af016-8aef-5cb2-8887-0444d747e2c9/9f8af016-8aef-5cb2-8887-0444d747e2c9_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F474%252Fa9469404b31a4a468db86ee60d7e2eeb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/474/a9469404b31a4a468db86ee60d7e2eeb/images/large/1.jpg saved to cache
2026-03-26 18:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9f8af016-8aef-5cb2-8887-0444d747e2c9
2026-03-26 18:32:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9f8af016-8aef-5cb2-8887-0444d747e2c9, skipping ID generation
2026-03-26 18:32:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f8af016-8aef-5cb2-8887-0444d747e2c9 with scrape type 1
2026-03-26 18:32:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9f8af016-8aef-5cb2-8887-0444d747e2c9 sending to next pipeline
2026-03-26 18:32:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9f8af016-8aef-5cb2-8887-0444d747e2c9, identifier: 1985738
2026-03-26 18:32:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ae044edb-102c-58a4-8eea-d0f9b6589450 with identifier: 1985737
2026-03-26 18:32:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:32:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ae044edb-102c-58a4-8eea-d0f9b6589450 with identifier: 1985737
2026-03-26 18:32:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ae044edb-102c-58a4-8eea-d0f9b6589450 with identifier: 1985737 to the API
2026-03-26 18:32:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/633/dceebbbe90c54af481b0f858f1f260e8/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'Banquise blanco s',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.6L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ae044edb-102c-58a4-8eea-d0f9b6589450',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'BERLINGO',
 'odometer': 108263,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae044edb-102c-58a4-8eea-d0f9b6589450/ae044edb-102c-58a4-8eea-d0f9b6589450_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325151,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/633/dceebbbe90c54af481b0f858f1f260e8/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-12',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROËN BERLINGO Talla M BlueHDi 55kW CONTROL',
 'transmission': 'manual',
 'trim': 'Talla M BlueHDi 55kW CONTROL',
 'vin': None,
 'year': 2019}
2026-03-26 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985737%27 HTTP/1.1" 200 None
2026-03-26 18:32:34 [ayvens.es] INFO: Saving data for 1985737: {'created_time': 1774549954.234169, 'last_price_update_time': 1774549954.234179, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985737') HTTP/1.1" 204 0
2026-03-26 18:32:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9f8af016-8aef-5cb2-8887-0444d747e2c9 with identifier: 1985738
2026-03-26 18:32:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:32:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9f8af016-8aef-5cb2-8887-0444d747e2c9 with identifier: 1985738
2026-03-26 18:32:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9f8af016-8aef-5cb2-8887-0444d747e2c9 with identifier: 1985738 to the API
2026-03-26 18:32:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/474/a9469404b31a4a468db86ee60d7e2eeb/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'Blanco banquise s',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '9f8af016-8aef-5cb2-8887-0444d747e2c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'BERLINGO',
 'odometer': 58482,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f8af016-8aef-5cb2-8887-0444d747e2c9/9f8af016-8aef-5cb2-8887-0444d747e2c9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336114,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/474/a9469404b31a4a468db86ee60d7e2eeb/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-31',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROËN BERLINGO Talla M BlueHDi 100 CONTROL',
 'transmission': 'manual',
 'trim': 'Talla M BlueHDi 100 CONTROL',
 'vin': None,
 'year': 2022}
2026-03-26 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985738%27 HTTP/1.1" 200 None
2026-03-26 18:32:34 [ayvens.es] INFO: Saving data for 1985738: {'created_time': 1774549954.53247, 'last_price_update_time': 1774549954.532483, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985738') HTTP/1.1" 204 0
2026-03-26 18:32:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/048/752517411a7344d59403da8535a68267/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/061/67e2bc3e557c4bfcb12d803f7065d370/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a2ab08d10>
2026-03-26 18:32:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56da1ef2-8820-50af-a2bf-a3693933c20b/56da1ef2-8820-50af-a2bf-a3693933c20b_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F811%252F070768c3ce2d48b295c6a05ea37e9009%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/811/070768c3ce2d48b295c6a05ea37e9009/images/large/1.jpg saved to cache
2026-03-26 18:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 56da1ef2-8820-50af-a2bf-a3693933c20b
2026-03-26 18:32:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 56da1ef2-8820-50af-a2bf-a3693933c20b, skipping ID generation
2026-03-26 18:32:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56da1ef2-8820-50af-a2bf-a3693933c20b with scrape type 1
2026-03-26 18:32:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 56da1ef2-8820-50af-a2bf-a3693933c20b sending to next pipeline
2026-03-26 18:32:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 56da1ef2-8820-50af-a2bf-a3693933c20b, identifier: 1985740
2026-03-26 18:32:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a29006ed0>
2026-03-26 18:32:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd610480-d0ef-5f40-9300-3b9388471b70/fd610480-d0ef-5f40-9300-3b9388471b70_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F103%252F24b15d5241244ec28e1a179d4abb0a10%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/103/24b15d5241244ec28e1a179d4abb0a10/images/large/1.jpg saved to cache
2026-03-26 18:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fd610480-d0ef-5f40-9300-3b9388471b70
2026-03-26 18:32:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fd610480-d0ef-5f40-9300-3b9388471b70, skipping ID generation
2026-03-26 18:32:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd610480-d0ef-5f40-9300-3b9388471b70 with scrape type 1
2026-03-26 18:32:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fd610480-d0ef-5f40-9300-3b9388471b70 sending to next pipeline
2026-03-26 18:32:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: fd610480-d0ef-5f40-9300-3b9388471b70, identifier: 1985739
2026-03-26 18:32:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 56da1ef2-8820-50af-a2bf-a3693933c20b with identifier: 1985740
2026-03-26 18:32:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:32:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 56da1ef2-8820-50af-a2bf-a3693933c20b with identifier: 1985740
2026-03-26 18:32:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 56da1ef2-8820-50af-a2bf-a3693933c20b with identifier: 1985740 to the API
2026-03-26 18:32:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/811/070768c3ce2d48b295c6a05ea37e9009/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'Mineralgrau metaliza',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '56da1ef2-8820-50af-a2bf-a3693933c20b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'SERIES 3',
 'odometer': 165988,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56da1ef2-8820-50af-a2bf-a3693933c20b/56da1ef2-8820-50af-a2bf-a3693933c20b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 358626,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/811/070768c3ce2d48b295c6a05ea37e9009/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW SERIES 3 320d Auto.Touring',
 'transmission': 'manual',
 'trim': '320d Auto.Touring',
 'vin': None,
 'year': 2020}
2026-03-26 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985740%27 HTTP/1.1" 200 None
2026-03-26 18:32:35 [ayvens.es] INFO: Saving data for 1985740: {'created_time': 1774549955.119203, 'last_price_update_time': 1774549955.119214, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985740') HTTP/1.1" 204 0
2026-03-26 18:32:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: fd610480-d0ef-5f40-9300-3b9388471b70 with identifier: 1985739
2026-03-26 18:32:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:32:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: fd610480-d0ef-5f40-9300-3b9388471b70 with identifier: 1985739
2026-03-26 18:32:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: fd610480-d0ef-5f40-9300-3b9388471b70 with identifier: 1985739 to the API
2026-03-26 18:32:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/103/24b15d5241244ec28e1a179d4abb0a10/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'color': 'Gris daytona',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'fd610480-d0ef-5f40-9300-3b9388471b70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4',
 'odometer': 144965,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd610480-d0ef-5f40-9300-3b9388471b70/fd610480-d0ef-5f40-9300-3b9388471b70_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 392382,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/103/24b15d5241244ec28e1a179d4abb0a10/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 S line ed 2.0 TDI 140kW quattro S tronic',
 'transmission': 'manual',
 'trim': 'S line ed 2.0 TDI 140kW quattro S tronic',
 'vin': None,
 'year': 2017}
2026-03-26 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985739%27 HTTP/1.1" 200 None
2026-03-26 18:32:35 [ayvens.es] INFO: Saving data for 1985739: {'created_time': 1774549955.412676, 'last_price_update_time': 1774549955.412687, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985739') HTTP/1.1" 204 0
2026-03-26 18:32:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28dd1390>
2026-03-26 18:32:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23796219-0b0b-5a1d-a18e-e2b4e4d222fc/23796219-0b0b-5a1d-a18e-e2b4e4d222fc_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F048%252F752517411a7344d59403da8535a68267%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/048/752517411a7344d59403da8535a68267/images/large/1.jpg saved to cache
2026-03-26 18:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 23796219-0b0b-5a1d-a18e-e2b4e4d222fc
2026-03-26 18:32:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 23796219-0b0b-5a1d-a18e-e2b4e4d222fc, skipping ID generation
2026-03-26 18:32:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23796219-0b0b-5a1d-a18e-e2b4e4d222fc with scrape type 1
2026-03-26 18:32:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 23796219-0b0b-5a1d-a18e-e2b4e4d222fc sending to next pipeline
2026-03-26 18:32:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 23796219-0b0b-5a1d-a18e-e2b4e4d222fc, identifier: 1985741
2026-03-26 18:32:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a290a6050>
2026-03-26 18:32:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffcd4aa3-0fd8-5363-9c4d-5a3b1b40ccfc/ffcd4aa3-0fd8-5363-9c4d-5a3b1b40ccfc_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F061%252F67e2bc3e557c4bfcb12d803f7065d370%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/061/67e2bc3e557c4bfcb12d803f7065d370/images/large/1.jpg saved to cache
2026-03-26 18:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ffcd4aa3-0fd8-5363-9c4d-5a3b1b40ccfc
2026-03-26 18:32:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ffcd4aa3-0fd8-5363-9c4d-5a3b1b40ccfc, skipping ID generation
2026-03-26 18:32:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffcd4aa3-0fd8-5363-9c4d-5a3b1b40ccfc with scrape type 1
2026-03-26 18:32:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ffcd4aa3-0fd8-5363-9c4d-5a3b1b40ccfc sending to next pipeline
2026-03-26 18:32:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ffcd4aa3-0fd8-5363-9c4d-5a3b1b40ccfc, identifier: 1985742
2026-03-26 18:32:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 23796219-0b0b-5a1d-a18e-e2b4e4d222fc with identifier: 1985741
2026-03-26 18:32:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:32:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 23796219-0b0b-5a1d-a18e-e2b4e4d222fc with identifier: 1985741
2026-03-26 18:32:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 23796219-0b0b-5a1d-a18e-e2b4e4d222fc with identifier: 1985741 to the API
2026-03-26 18:32:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/048/752517411a7344d59403da8535a68267/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Plata solar metaliza',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '23796219-0b0b-5a1d-a18e-e2b4e4d222fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'PUMA',
 'odometer': 83255,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23796219-0b0b-5a1d-a18e-e2b4e4d222fc/23796219-0b0b-5a1d-a18e-e2b4e4d222fc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 357909,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/048/752517411a7344d59403da8535a68267/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD PUMA 1.0 EcoBoost 125cv ST-Line X MHEV',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost 125cv ST-Line X MHEV',
 'vin': None,
 'year': 2021}
2026-03-26 18:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985741%27 HTTP/1.1" 200 None
2026-03-26 18:32:36 [ayvens.es] INFO: Saving data for 1985741: {'created_time': 1774549956.069646, 'last_price_update_time': 1774549956.069657, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985741') HTTP/1.1" 204 0
2026-03-26 18:32:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ffcd4aa3-0fd8-5363-9c4d-5a3b1b40ccfc with identifier: 1985742
2026-03-26 18:32:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:32:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ffcd4aa3-0fd8-5363-9c4d-5a3b1b40ccfc with identifier: 1985742
2026-03-26 18:32:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ffcd4aa3-0fd8-5363-9c4d-5a3b1b40ccfc with identifier: 1985742 to the API
2026-03-26 18:32:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/061/67e2bc3e557c4bfcb12d803f7065d370/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'color': 'Gris selenita magno',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'ffcd4aa3-0fd8-5363-9c4d-5a3b1b40ccfc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'C-CLASS',
 'odometer': 73477,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffcd4aa3-0fd8-5363-9c4d-5a3b1b40ccfc/ffcd4aa3-0fd8-5363-9c4d-5a3b1b40ccfc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 365094,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/061/67e2bc3e557c4bfcb12d803f7065d370/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ C-CLASS C 200',
 'transmission': 'manual',
 'trim': 'C 200',
 'vin': None,
 'year': 2019}
2026-03-26 18:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985742%27 HTTP/1.1" 200 None
2026-03-26 18:32:36 [ayvens.es] INFO: Saving data for 1985742: {'created_time': 1774549956.377758, 'last_price_update_time': 1774549956.377768, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985742') HTTP/1.1" 204 0
2026-03-26 18:32:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/859/0c96deb68c8e4b90bdedab99e09d0d0f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a2b112f90>
2026-03-26 18:32:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc4a4845-67f6-5fef-a289-a2fe6adc8a54/dc4a4845-67f6-5fef-a289-a2fe6adc8a54_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F859%252F0c96deb68c8e4b90bdedab99e09d0d0f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/859/0c96deb68c8e4b90bdedab99e09d0d0f/images/large/1.jpg saved to cache
2026-03-26 18:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dc4a4845-67f6-5fef-a289-a2fe6adc8a54
2026-03-26 18:32:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dc4a4845-67f6-5fef-a289-a2fe6adc8a54, skipping ID generation
2026-03-26 18:32:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc4a4845-67f6-5fef-a289-a2fe6adc8a54 with scrape type 1
2026-03-26 18:32:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dc4a4845-67f6-5fef-a289-a2fe6adc8a54 sending to next pipeline
2026-03-26 18:32:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: dc4a4845-67f6-5fef-a289-a2fe6adc8a54, identifier: 1985743
2026-03-26 18:32:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: dc4a4845-67f6-5fef-a289-a2fe6adc8a54 with identifier: 1985743
2026-03-26 18:32:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:32:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: dc4a4845-67f6-5fef-a289-a2fe6adc8a54 with identifier: 1985743
2026-03-26 18:32:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: dc4a4845-67f6-5fef-a289-a2fe6adc8a54 with identifier: 1985743 to the API
2026-03-26 18:32:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/859/0c96deb68c8e4b90bdedab99e09d0d0f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'color': 'Rojo shiraz',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'dc4a4845-67f6-5fef-a289-a2fe6adc8a54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3',
 'odometer': 84522,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc4a4845-67f6-5fef-a289-a2fe6adc8a54/dc4a4845-67f6-5fef-a289-a2fe6adc8a54_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 592118,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/859/0c96deb68c8e4b90bdedab99e09d0d0f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 Sedan 2.0 TDI clean 150CV S tro Advanced',
 'transmission': 'manual',
 'trim': 'Sedan 2.0 TDI clean 150CV S tro Advanced',
 'vin': None,
 'year': 2015}
2026-03-26 18:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985743%27 HTTP/1.1" 200 None
2026-03-26 18:32:36 [ayvens.es] INFO: Saving data for 1985743: {'created_time': 1774549956.960651, 'last_price_update_time': 1774549956.960662, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985743') HTTP/1.1" 204 0
2026-03-26 18:32:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-26 18:32:37 [ayvens.es] INFO: Found listing with ID: 1985744
2026-03-26 18:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985744%27 HTTP/1.1" 200 None
2026-03-26 18:32:37 [ayvens.es] INFO: Scrape type for 1985744: 1
2026-03-26 18:32:37 [ayvens.es] INFO: Extracting data for car ID: 1985744
2026-03-26 18:32:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d6d108b-9a9a-5bb1-9631-fe8001528410 with identifier: 1985744
2026-03-26 18:32:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d6d108b-9a9a-5bb1-9631-fe8001528410 with scrape type 1
2026-03-26 18:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6d6d108b-9a9a-5bb1-9631-fe8001528410
2026-03-26 18:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F765%252F6434f4a7fc2c4827bc0e296ca33d10b6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/765/6434f4a7fc2c4827bc0e296ca33d10b6/images/large/1.jpg not downloaded yet
2026-03-26 18:32:38 [ayvens.es] INFO: Found listing with ID: 1985745
2026-03-26 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985745%27 HTTP/1.1" 200 None
2026-03-26 18:32:38 [ayvens.es] INFO: Scrape type for 1985745: 1
2026-03-26 18:32:38 [ayvens.es] INFO: Extracting data for car ID: 1985745
2026-03-26 18:32:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ee7f2c2-0a12-588a-9831-6b38333f38c7 with identifier: 1985745
2026-03-26 18:32:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ee7f2c2-0a12-588a-9831-6b38333f38c7 with scrape type 1
2026-03-26 18:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7ee7f2c2-0a12-588a-9831-6b38333f38c7
2026-03-26 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F658%252F2760d5c45afd4c3fa2d9c43ed29499f4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/658/2760d5c45afd4c3fa2d9c43ed29499f4/images/large/1.jpg not downloaded yet
2026-03-26 18:32:38 [ayvens.es] INFO: Found listing with ID: 1985746
2026-03-26 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985746%27 HTTP/1.1" 200 None
2026-03-26 18:32:38 [ayvens.es] INFO: Scrape type for 1985746: 1
2026-03-26 18:32:38 [ayvens.es] INFO: Extracting data for car ID: 1985746
2026-03-26 18:32:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f3e4e51-f279-5221-9274-4ad6fbdf4896 with identifier: 1985746
2026-03-26 18:32:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f3e4e51-f279-5221-9274-4ad6fbdf4896 with scrape type 1
2026-03-26 18:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7f3e4e51-f279-5221-9274-4ad6fbdf4896
2026-03-26 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F466%252Fbcbb4a7e951c44d9a97e524f121a4673%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/466/bcbb4a7e951c44d9a97e524f121a4673/images/large/1.jpg not downloaded yet
2026-03-26 18:32:38 [ayvens.es] INFO: Found listing with ID: 1985747
2026-03-26 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985747%27 HTTP/1.1" 200 None
2026-03-26 18:32:38 [ayvens.es] INFO: Scrape type for 1985747: 1
2026-03-26 18:32:38 [ayvens.es] INFO: Extracting data for car ID: 1985747
2026-03-26 18:32:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29242d21-ada0-56e9-bf11-c96cc899b08a with identifier: 1985747
2026-03-26 18:32:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29242d21-ada0-56e9-bf11-c96cc899b08a with scrape type 1
2026-03-26 18:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 29242d21-ada0-56e9-bf11-c96cc899b08a
2026-03-26 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F121%252Fe645ffc88f4f40e2ba523e85eff66bab%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/121/e645ffc88f4f40e2ba523e85eff66bab/images/large/1.jpg not downloaded yet
2026-03-26 18:32:38 [ayvens.es] INFO: Found listing with ID: 1985748
2026-03-26 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985748%27 HTTP/1.1" 200 None
2026-03-26 18:32:38 [ayvens.es] INFO: Scrape type for 1985748: 1
2026-03-26 18:32:38 [ayvens.es] INFO: Extracting data for car ID: 1985748
2026-03-26 18:32:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d7c611b-36ab-5e68-99d7-505a83b79c9a with identifier: 1985748
2026-03-26 18:32:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d7c611b-36ab-5e68-99d7-505a83b79c9a with scrape type 1
2026-03-26 18:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7d7c611b-36ab-5e68-99d7-505a83b79c9a
2026-03-26 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F692%252Fc05fde012e5140fa910106b149741b24%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/692/c05fde012e5140fa910106b149741b24/images/large/1.jpg not downloaded yet
2026-03-26 18:32:38 [ayvens.es] INFO: Found listing with ID: 1985749
2026-03-26 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985749%27 HTTP/1.1" 200 None
2026-03-26 18:32:38 [ayvens.es] INFO: Scrape type for 1985749: 1
2026-03-26 18:32:38 [ayvens.es] INFO: Extracting data for car ID: 1985749
2026-03-26 18:32:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 954b9fc1-36be-564c-bed2-b8635c3b6554 with identifier: 1985749
2026-03-26 18:32:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 954b9fc1-36be-564c-bed2-b8635c3b6554 with scrape type 1
2026-03-26 18:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 954b9fc1-36be-564c-bed2-b8635c3b6554
2026-03-26 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F123%252F91dc6c0434f441aca5090bb858b56cc1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/123/91dc6c0434f441aca5090bb858b56cc1/images/large/1.jpg not downloaded yet
2026-03-26 18:32:38 [ayvens.es] INFO: Found listing with ID: 1985750
2026-03-26 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985750%27 HTTP/1.1" 200 None
2026-03-26 18:32:38 [ayvens.es] INFO: Scrape type for 1985750: 1
2026-03-26 18:32:38 [ayvens.es] INFO: Extracting data for car ID: 1985750
2026-03-26 18:32:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6290597b-1920-516d-a924-a41da46beb8a with identifier: 1985750
2026-03-26 18:32:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6290597b-1920-516d-a924-a41da46beb8a with scrape type 1
2026-03-26 18:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6290597b-1920-516d-a924-a41da46beb8a
2026-03-26 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F615%252F7620bcbb3b92428588ea7c0cb997ad7f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/615/7620bcbb3b92428588ea7c0cb997ad7f/images/large/1.jpg not downloaded yet
2026-03-26 18:32:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/765/6434f4a7fc2c4827bc0e296ca33d10b6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:38 [ayvens.es] INFO: Found listing with ID: 1985751
2026-03-26 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985751%27 HTTP/1.1" 200 None
2026-03-26 18:32:38 [ayvens.es] INFO: Scrape type for 1985751: 1
2026-03-26 18:32:38 [ayvens.es] INFO: Extracting data for car ID: 1985751
2026-03-26 18:32:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b291d3f6-078b-53e1-90fa-2f79e4a4b22c with identifier: 1985751
2026-03-26 18:32:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b291d3f6-078b-53e1-90fa-2f79e4a4b22c with scrape type 1
2026-03-26 18:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b291d3f6-078b-53e1-90fa-2f79e4a4b22c
2026-03-26 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F351%252F111fb64bd65f4a07ac7a63af40bec6be%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/351/111fb64bd65f4a07ac7a63af40bec6be/images/large/1.jpg not downloaded yet
2026-03-26 18:32:38 [ayvens.es] INFO: Found listing with ID: 1985752
2026-03-26 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985752%27 HTTP/1.1" 200 None
2026-03-26 18:32:38 [ayvens.es] INFO: Scrape type for 1985752: 1
2026-03-26 18:32:38 [ayvens.es] INFO: Extracting data for car ID: 1985752
2026-03-26 18:32:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2bd7183-10f3-56f1-abf3-0be61bc6ba98 with identifier: 1985752
2026-03-26 18:32:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2bd7183-10f3-56f1-abf3-0be61bc6ba98 with scrape type 1
2026-03-26 18:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b2bd7183-10f3-56f1-abf3-0be61bc6ba98
2026-03-26 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F048%252F41263b3e8e5141c39397c444fe5ac218%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/048/41263b3e8e5141c39397c444fe5ac218/images/large/1.jpg not downloaded yet
2026-03-26 18:32:38 [ayvens.es] INFO: Found listing with ID: 1985753
2026-03-26 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985753%27 HTTP/1.1" 200 None
2026-03-26 18:32:38 [ayvens.es] INFO: Scrape type for 1985753: 1
2026-03-26 18:32:38 [ayvens.es] INFO: Extracting data for car ID: 1985753
2026-03-26 18:32:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e8fd969-d5e7-5c90-9662-68b7e584a18b with identifier: 1985753
2026-03-26 18:32:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e8fd969-d5e7-5c90-9662-68b7e584a18b with scrape type 1
2026-03-26 18:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0e8fd969-d5e7-5c90-9662-68b7e584a18b
2026-03-26 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F082%252Ffc1a673556ae49dd9008f74489d0de44%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/082/fc1a673556ae49dd9008f74489d0de44/images/large/1.jpg not downloaded yet
2026-03-26 18:32:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/658/2760d5c45afd4c3fa2d9c43ed29499f4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:38 [ayvens.es] INFO: Found listing with ID: 1985754
2026-03-26 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985754%27 HTTP/1.1" 200 None
2026-03-26 18:32:38 [ayvens.es] INFO: Scrape type for 1985754: 1
2026-03-26 18:32:38 [ayvens.es] INFO: Extracting data for car ID: 1985754
2026-03-26 18:32:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 885908a6-87d8-5cda-a4e2-d3fcc94281e5 with identifier: 1985754
2026-03-26 18:32:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 885908a6-87d8-5cda-a4e2-d3fcc94281e5 with scrape type 1
2026-03-26 18:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 885908a6-87d8-5cda-a4e2-d3fcc94281e5
2026-03-26 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F008%252F8e808bd837ca40659cd666916a6f26af%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/008/8e808bd837ca40659cd666916a6f26af/images/large/1.jpg not downloaded yet
2026-03-26 18:32:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28eb43d0>
2026-03-26 18:32:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d6d108b-9a9a-5bb1-9631-fe8001528410/6d6d108b-9a9a-5bb1-9631-fe8001528410_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F765%252F6434f4a7fc2c4827bc0e296ca33d10b6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/765/6434f4a7fc2c4827bc0e296ca33d10b6/images/large/1.jpg saved to cache
2026-03-26 18:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6d6d108b-9a9a-5bb1-9631-fe8001528410
2026-03-26 18:32:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6d6d108b-9a9a-5bb1-9631-fe8001528410, skipping ID generation
2026-03-26 18:32:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d6d108b-9a9a-5bb1-9631-fe8001528410 with scrape type 1
2026-03-26 18:32:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6d6d108b-9a9a-5bb1-9631-fe8001528410 sending to next pipeline
2026-03-26 18:32:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6d6d108b-9a9a-5bb1-9631-fe8001528410, identifier: 1985744
2026-03-26 18:32:38 [ayvens.es] INFO: Found listing with ID: 1985755
2026-03-26 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985755%27 HTTP/1.1" 200 None
2026-03-26 18:32:38 [ayvens.es] INFO: Scrape type for 1985755: 1
2026-03-26 18:32:38 [ayvens.es] INFO: Extracting data for car ID: 1985755
2026-03-26 18:32:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9cc37c71-991e-58a2-a653-f75dddbf6f1e with identifier: 1985755
2026-03-26 18:32:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9cc37c71-991e-58a2-a653-f75dddbf6f1e with scrape type 1
2026-03-26 18:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9cc37c71-991e-58a2-a653-f75dddbf6f1e
2026-03-26 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F034%252Fd24ad9a456f44f019a228083dc6bdaa9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/034/d24ad9a456f44f019a228083dc6bdaa9/images/large/1.jpg not downloaded yet
2026-03-26 18:32:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6d6d108b-9a9a-5bb1-9631-fe8001528410 with identifier: 1985744
2026-03-26 18:32:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:32:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6d6d108b-9a9a-5bb1-9631-fe8001528410 with identifier: 1985744
2026-03-26 18:32:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 6d6d108b-9a9a-5bb1-9631-fe8001528410 with identifier: 1985744 to the API
2026-03-26 18:32:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/765/6434f4a7fc2c4827bc0e296ca33d10b6/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Plata iridio',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.9L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '6d6d108b-9a9a-5bb1-9631-fe8001528410',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA',
 'odometer': 39712,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d6d108b-9a9a-5bb1-9631-fe8001528410/6d6d108b-9a9a-5bb1-9631-fe8001528410_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 349178,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/765/6434f4a7fc2c4827bc0e296ca33d10b6/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA CLA 220 D DCT',
 'transmission': 'manual',
 'trim': 'CLA 220 D DCT',
 'vin': None,
 'year': 2021}
2026-03-26 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985744%27 HTTP/1.1" 200 None
2026-03-26 18:32:39 [ayvens.es] INFO: Saving data for 1985744: {'created_time': 1774549959.054389, 'last_price_update_time': 1774549959.0544, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985744') HTTP/1.1" 204 0
2026-03-26 18:32:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c3ff10>
2026-03-26 18:32:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ee7f2c2-0a12-588a-9831-6b38333f38c7/7ee7f2c2-0a12-588a-9831-6b38333f38c7_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F658%252F2760d5c45afd4c3fa2d9c43ed29499f4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/658/2760d5c45afd4c3fa2d9c43ed29499f4/images/large/1.jpg saved to cache
2026-03-26 18:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7ee7f2c2-0a12-588a-9831-6b38333f38c7
2026-03-26 18:32:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7ee7f2c2-0a12-588a-9831-6b38333f38c7, skipping ID generation
2026-03-26 18:32:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ee7f2c2-0a12-588a-9831-6b38333f38c7 with scrape type 1
2026-03-26 18:32:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7ee7f2c2-0a12-588a-9831-6b38333f38c7 sending to next pipeline
2026-03-26 18:32:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7ee7f2c2-0a12-588a-9831-6b38333f38c7, identifier: 1985745
2026-03-26 18:32:39 [ayvens.es] INFO: Found listing with ID: 1985756
2026-03-26 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985756%27 HTTP/1.1" 200 None
2026-03-26 18:32:39 [ayvens.es] INFO: Scrape type for 1985756: 1
2026-03-26 18:32:39 [ayvens.es] INFO: Extracting data for car ID: 1985756
2026-03-26 18:32:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 140b7b10-5cef-5137-a710-a45963521a81 with identifier: 1985756
2026-03-26 18:32:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 140b7b10-5cef-5137-a710-a45963521a81 with scrape type 1
2026-03-26 18:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 140b7b10-5cef-5137-a710-a45963521a81
2026-03-26 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F595%252F60e6bc7ebfd64c92b2814f0708a9baea%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/595/60e6bc7ebfd64c92b2814f0708a9baea/images/large/1.jpg not downloaded yet
2026-03-26 18:32:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7ee7f2c2-0a12-588a-9831-6b38333f38c7 with identifier: 1985745
2026-03-26 18:32:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:32:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7ee7f2c2-0a12-588a-9831-6b38333f38c7 with identifier: 1985745
2026-03-26 18:32:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7ee7f2c2-0a12-588a-9831-6b38333f38c7 with identifier: 1985745 to the API
2026-03-26 18:32:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/658/2760d5c45afd4c3fa2d9c43ed29499f4/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'color': 'Azul luz de luna',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '7ee7f2c2-0a12-588a-9831-6b38333f38c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q5',
 'odometer': 71925,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ee7f2c2-0a12-588a-9831-6b38333f38c7/7ee7f2c2-0a12-588a-9831-6b38333f38c7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 555568,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/658/2760d5c45afd4c3fa2d9c43ed29499f4/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q5 Design 40 TDI 140kW quattro S tronic',
 'transmission': 'manual',
 'trim': 'Design 40 TDI 140kW quattro S tronic',
 'vin': None,
 'year': 2019}
2026-03-26 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985745%27 HTTP/1.1" 200 None
2026-03-26 18:32:39 [ayvens.es] INFO: Saving data for 1985745: {'created_time': 1774549959.640946, 'last_price_update_time': 1774549959.640957, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985745') HTTP/1.1" 204 0
2026-03-26 18:32:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/466/bcbb4a7e951c44d9a97e524f121a4673/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/121/e645ffc88f4f40e2ba523e85eff66bab/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:39 [ayvens.es] INFO: Found listing with ID: 1985757
2026-03-26 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985757%27 HTTP/1.1" 200 None
2026-03-26 18:32:39 [ayvens.es] INFO: Scrape type for 1985757: 1
2026-03-26 18:32:39 [ayvens.es] INFO: Extracting data for car ID: 1985757
2026-03-26 18:32:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c585b2f9-3170-5ff4-bc43-bcda527c3d9f with identifier: 1985757
2026-03-26 18:32:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c585b2f9-3170-5ff4-bc43-bcda527c3d9f with scrape type 1
2026-03-26 18:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c585b2f9-3170-5ff4-bc43-bcda527c3d9f
2026-03-26 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F161%252Fd01a82dc90a6417d99efe8b04498b13f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/161/d01a82dc90a6417d99efe8b04498b13f/images/large/1.jpg not downloaded yet
2026-03-26 18:32:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/123/91dc6c0434f441aca5090bb858b56cc1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/615/7620bcbb3b92428588ea7c0cb997ad7f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/692/c05fde012e5140fa910106b149741b24/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:39 [ayvens.es] INFO: Found listing with ID: 1985758
2026-03-26 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985758%27 HTTP/1.1" 200 None
2026-03-26 18:32:39 [ayvens.es] INFO: Scrape type for 1985758: 1
2026-03-26 18:32:39 [ayvens.es] INFO: Extracting data for car ID: 1985758
2026-03-26 18:32:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54c59e78-5ee3-5234-b9de-5b7e1eae0c6c with identifier: 1985758
2026-03-26 18:32:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54c59e78-5ee3-5234-b9de-5b7e1eae0c6c with scrape type 1
2026-03-26 18:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 54c59e78-5ee3-5234-b9de-5b7e1eae0c6c
2026-03-26 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F819%252Fe1ebdeb5d0314d778d96d408e30ef823%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/819/e1ebdeb5d0314d778d96d408e30ef823/images/large/1.jpg not downloaded yet
2026-03-26 18:32:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/351/111fb64bd65f4a07ac7a63af40bec6be/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/048/41263b3e8e5141c39397c444fe5ac218/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:39 [ayvens.es] INFO: Found listing with ID: 1985759
2026-03-26 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985759%27 HTTP/1.1" 200 None
2026-03-26 18:32:39 [ayvens.es] INFO: Scrape type for 1985759: 1
2026-03-26 18:32:39 [ayvens.es] INFO: Extracting data for car ID: 1985759
2026-03-26 18:32:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24bf9780-cabb-5446-9752-2461505edabc with identifier: 1985759
2026-03-26 18:32:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24bf9780-cabb-5446-9752-2461505edabc with scrape type 1
2026-03-26 18:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 24bf9780-cabb-5446-9752-2461505edabc
2026-03-26 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F606%252Fe5204740a6574cdbabb46c6d4bd38255%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/606/e5204740a6574cdbabb46c6d4bd38255/images/large/1.jpg not downloaded yet
2026-03-26 18:32:39 [ayvens.es] INFO: Found listing with ID: 1985760
2026-03-26 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985760%27 HTTP/1.1" 200 None
2026-03-26 18:32:39 [ayvens.es] INFO: Scrape type for 1985760: 1
2026-03-26 18:32:39 [ayvens.es] INFO: Extracting data for car ID: 1985760
2026-03-26 18:32:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1941ee17-c97e-5a0b-adb2-f979c205a9b7 with identifier: 1985760
2026-03-26 18:32:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1941ee17-c97e-5a0b-adb2-f979c205a9b7 with scrape type 1
2026-03-26 18:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1941ee17-c97e-5a0b-adb2-f979c205a9b7
2026-03-26 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F763%252Fbcf561b733c84368aa8f69520655d170%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/763/bcf561b733c84368aa8f69520655d170/images/large/1.jpg not downloaded yet
2026-03-26 18:32:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/082/fc1a673556ae49dd9008f74489d0de44/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28325490>
2026-03-26 18:32:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f3e4e51-f279-5221-9274-4ad6fbdf4896/7f3e4e51-f279-5221-9274-4ad6fbdf4896_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F466%252Fbcbb4a7e951c44d9a97e524f121a4673%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/466/bcbb4a7e951c44d9a97e524f121a4673/images/large/1.jpg saved to cache
2026-03-26 18:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7f3e4e51-f279-5221-9274-4ad6fbdf4896
2026-03-26 18:32:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7f3e4e51-f279-5221-9274-4ad6fbdf4896, skipping ID generation
2026-03-26 18:32:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f3e4e51-f279-5221-9274-4ad6fbdf4896 with scrape type 1
2026-03-26 18:32:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7f3e4e51-f279-5221-9274-4ad6fbdf4896 sending to next pipeline
2026-03-26 18:32:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7f3e4e51-f279-5221-9274-4ad6fbdf4896, identifier: 1985746
2026-03-26 18:32:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c3c490>
2026-03-26 18:32:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29242d21-ada0-56e9-bf11-c96cc899b08a/29242d21-ada0-56e9-bf11-c96cc899b08a_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F121%252Fe645ffc88f4f40e2ba523e85eff66bab%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/121/e645ffc88f4f40e2ba523e85eff66bab/images/large/1.jpg saved to cache
2026-03-26 18:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 29242d21-ada0-56e9-bf11-c96cc899b08a
2026-03-26 18:32:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 29242d21-ada0-56e9-bf11-c96cc899b08a, skipping ID generation
2026-03-26 18:32:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29242d21-ada0-56e9-bf11-c96cc899b08a with scrape type 1
2026-03-26 18:32:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 29242d21-ada0-56e9-bf11-c96cc899b08a sending to next pipeline
2026-03-26 18:32:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 29242d21-ada0-56e9-bf11-c96cc899b08a, identifier: 1985747
2026-03-26 18:32:40 [ayvens.es] INFO: Found listing with ID: 1985761
2026-03-26 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985761%27 HTTP/1.1" 200 None
2026-03-26 18:32:40 [ayvens.es] INFO: Scrape type for 1985761: 1
2026-03-26 18:32:40 [ayvens.es] INFO: Extracting data for car ID: 1985761
2026-03-26 18:32:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e9e6476-2207-5654-a018-3ee20a707e6a with identifier: 1985761
2026-03-26 18:32:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e9e6476-2207-5654-a018-3ee20a707e6a with scrape type 1
2026-03-26 18:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9e9e6476-2207-5654-a018-3ee20a707e6a
2026-03-26 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F357%252F54caf182c52543c4ab6d843a744b6f66%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/357/54caf182c52543c4ab6d843a744b6f66/images/large/1.jpg not downloaded yet
2026-03-26 18:32:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7f3e4e51-f279-5221-9274-4ad6fbdf4896 with identifier: 1985746
2026-03-26 18:32:40 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:32:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7f3e4e51-f279-5221-9274-4ad6fbdf4896 with identifier: 1985746
2026-03-26 18:32:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7f3e4e51-f279-5221-9274-4ad6fbdf4896 with identifier: 1985746 to the API
2026-03-26 18:32:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/466/bcbb4a7e951c44d9a97e524f121a4673/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'Mineralwei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '7f3e4e51-f279-5221-9274-4ad6fbdf4896',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 195011,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f3e4e51-f279-5221-9274-4ad6fbdf4896/7f3e4e51-f279-5221-9274-4ad6fbdf4896_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 341191,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/466/bcbb4a7e951c44d9a97e524f121a4673/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 sDrive16d',
 'transmission': 'manual',
 'trim': 'sDrive16d',
 'vin': None,
 'year': 2021}
2026-03-26 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985746%27 HTTP/1.1" 200 None
2026-03-26 18:32:40 [ayvens.es] INFO: Saving data for 1985746: {'created_time': 1774549960.59078, 'last_price_update_time': 1774549960.59079, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985746') HTTP/1.1" 204 0
2026-03-26 18:32:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 29242d21-ada0-56e9-bf11-c96cc899b08a with identifier: 1985747
2026-03-26 18:32:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 29242d21-ada0-56e9-bf11-c96cc899b08a with identifier: 1985747
2026-03-26 18:32:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 29242d21-ada0-56e9-bf11-c96cc899b08a with identifier: 1985747 to the API
2026-03-26 18:32:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/121/e645ffc88f4f40e2ba523e85eff66bab/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'Blanco everest',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '29242d21-ada0-56e9-bf11-c96cc899b08a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'JUKE',
 'odometer': 84836,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29242d21-ada0-56e9-bf11-c96cc899b08a/29242d21-ada0-56e9-bf11-c96cc899b08a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 480678,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/121/e645ffc88f4f40e2ba523e85eff66bab/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN JUKE DIG-T 84 kW (114 CV) 6M/T Acenta',
 'transmission': 'manual',
 'trim': 'DIG-T 84 kW (114 CV) 6M/T Acenta',
 'vin': None,
 'year': 2021}
2026-03-26 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985747%27 HTTP/1.1" 200 None
2026-03-26 18:32:40 [ayvens.es] INFO: Saving data for 1985747: {'created_time': 1774549960.882613, 'last_price_update_time': 1774549960.882625, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985747') HTTP/1.1" 204 0
2026-03-26 18:32:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28384550>
2026-03-26 18:32:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_954b9fc1-36be-564c-bed2-b8635c3b6554/954b9fc1-36be-564c-bed2-b8635c3b6554_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F123%252F91dc6c0434f441aca5090bb858b56cc1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/123/91dc6c0434f441aca5090bb858b56cc1/images/large/1.jpg saved to cache
2026-03-26 18:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 954b9fc1-36be-564c-bed2-b8635c3b6554
2026-03-26 18:32:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 954b9fc1-36be-564c-bed2-b8635c3b6554, skipping ID generation
2026-03-26 18:32:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 954b9fc1-36be-564c-bed2-b8635c3b6554 with scrape type 1
2026-03-26 18:32:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 954b9fc1-36be-564c-bed2-b8635c3b6554 sending to next pipeline
2026-03-26 18:32:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 954b9fc1-36be-564c-bed2-b8635c3b6554, identifier: 1985749
2026-03-26 18:32:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c20dd0>
2026-03-26 18:32:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6290597b-1920-516d-a924-a41da46beb8a/6290597b-1920-516d-a924-a41da46beb8a_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F615%252F7620bcbb3b92428588ea7c0cb997ad7f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/615/7620bcbb3b92428588ea7c0cb997ad7f/images/large/1.jpg saved to cache
2026-03-26 18:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6290597b-1920-516d-a924-a41da46beb8a
2026-03-26 18:32:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6290597b-1920-516d-a924-a41da46beb8a, skipping ID generation
2026-03-26 18:32:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6290597b-1920-516d-a924-a41da46beb8a with scrape type 1
2026-03-26 18:32:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6290597b-1920-516d-a924-a41da46beb8a sending to next pipeline
2026-03-26 18:32:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6290597b-1920-516d-a924-a41da46beb8a, identifier: 1985750
2026-03-26 18:32:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28dbe1d0>
2026-03-26 18:32:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d7c611b-36ab-5e68-99d7-505a83b79c9a/7d7c611b-36ab-5e68-99d7-505a83b79c9a_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F692%252Fc05fde012e5140fa910106b149741b24%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/692/c05fde012e5140fa910106b149741b24/images/large/1.jpg saved to cache
2026-03-26 18:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7d7c611b-36ab-5e68-99d7-505a83b79c9a
2026-03-26 18:32:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7d7c611b-36ab-5e68-99d7-505a83b79c9a, skipping ID generation
2026-03-26 18:32:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d7c611b-36ab-5e68-99d7-505a83b79c9a with scrape type 1
2026-03-26 18:32:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7d7c611b-36ab-5e68-99d7-505a83b79c9a sending to next pipeline
2026-03-26 18:32:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7d7c611b-36ab-5e68-99d7-505a83b79c9a, identifier: 1985748
2026-03-26 18:32:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c4ea50>
2026-03-26 18:32:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b291d3f6-078b-53e1-90fa-2f79e4a4b22c/b291d3f6-078b-53e1-90fa-2f79e4a4b22c_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F351%252F111fb64bd65f4a07ac7a63af40bec6be%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/351/111fb64bd65f4a07ac7a63af40bec6be/images/large/1.jpg saved to cache
2026-03-26 18:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b291d3f6-078b-53e1-90fa-2f79e4a4b22c
2026-03-26 18:32:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b291d3f6-078b-53e1-90fa-2f79e4a4b22c, skipping ID generation
2026-03-26 18:32:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b291d3f6-078b-53e1-90fa-2f79e4a4b22c with scrape type 1
2026-03-26 18:32:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b291d3f6-078b-53e1-90fa-2f79e4a4b22c sending to next pipeline
2026-03-26 18:32:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b291d3f6-078b-53e1-90fa-2f79e4a4b22c, identifier: 1985751
2026-03-26 18:32:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28dbe650>
2026-03-26 18:32:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2bd7183-10f3-56f1-abf3-0be61bc6ba98/b2bd7183-10f3-56f1-abf3-0be61bc6ba98_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F048%252F41263b3e8e5141c39397c444fe5ac218%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/048/41263b3e8e5141c39397c444fe5ac218/images/large/1.jpg saved to cache
2026-03-26 18:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b2bd7183-10f3-56f1-abf3-0be61bc6ba98
2026-03-26 18:32:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b2bd7183-10f3-56f1-abf3-0be61bc6ba98, skipping ID generation
2026-03-26 18:32:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2bd7183-10f3-56f1-abf3-0be61bc6ba98 with scrape type 1
2026-03-26 18:32:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b2bd7183-10f3-56f1-abf3-0be61bc6ba98 sending to next pipeline
2026-03-26 18:32:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b2bd7183-10f3-56f1-abf3-0be61bc6ba98, identifier: 1985752
2026-03-26 18:32:41 [ayvens.es] INFO: Found listing with ID: 1985762
2026-03-26 18:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985762%27 HTTP/1.1" 200 None
2026-03-26 18:32:41 [ayvens.es] INFO: Scrape type for 1985762: 1
2026-03-26 18:32:41 [ayvens.es] INFO: Extracting data for car ID: 1985762
2026-03-26 18:32:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3710ae9-96fe-5ba3-af82-b95cc677f3a1 with identifier: 1985762
2026-03-26 18:32:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3710ae9-96fe-5ba3-af82-b95cc677f3a1 with scrape type 1
2026-03-26 18:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e3710ae9-96fe-5ba3-af82-b95cc677f3a1
2026-03-26 18:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F454%252F12ae80e79d9145fc87fb11420a4cc642%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/454/12ae80e79d9145fc87fb11420a4cc642/images/large/1.jpg not downloaded yet
2026-03-26 18:32:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 954b9fc1-36be-564c-bed2-b8635c3b6554 with identifier: 1985749
2026-03-26 18:32:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 954b9fc1-36be-564c-bed2-b8635c3b6554 with identifier: 1985749
2026-03-26 18:32:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 954b9fc1-36be-564c-bed2-b8635c3b6554 with identifier: 1985749 to the API
2026-03-26 18:32:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/123/91dc6c0434f441aca5090bb858b56cc1/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 148,
 'color': 'Blanco solido',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '954b9fc1-36be-564c-bed2-b8635c3b6554',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'JUMPY',
 'odometer': 184656,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_954b9fc1-36be-564c-bed2-b8635c3b6554/954b9fc1-36be-564c-bed2-b8635c3b6554_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 513078,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/123/91dc6c0434f441aca5090bb858b56cc1/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-27',
 'seats_number': 6,
 'seller_name': None,
 'title': 'CITROËN JUMPY DC Abatible Talla M BlueHDi 120 Control',
 'transmission': 'manual',
 'trim': 'DC Abatible Talla M BlueHDi 120 Control',
 'vin': None,
 'year': 2021}
2026-03-26 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985749%27 HTTP/1.1" 200 None
2026-03-26 18:32:42 [ayvens.es] INFO: Saving data for 1985749: {'created_time': 1774549962.013133, 'last_price_update_time': 1774549962.013144, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985749') HTTP/1.1" 204 0
2026-03-26 18:32:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6290597b-1920-516d-a924-a41da46beb8a with identifier: 1985750
2026-03-26 18:32:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6290597b-1920-516d-a924-a41da46beb8a with identifier: 1985750
2026-03-26 18:32:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 6290597b-1920-516d-a924-a41da46beb8a with identifier: 1985750 to the API
2026-03-26 18:32:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/615/7620bcbb3b92428588ea7c0cb997ad7f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.6L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '6290597b-1920-516d-a924-a41da46beb8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'DOBLO CARGO',
 'odometer': 121336,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6290597b-1920-516d-a924-a41da46beb8a/6290597b-1920-516d-a924-a41da46beb8a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 333992,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/615/7620bcbb3b92428588ea7c0cb997ad7f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-28',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FIAT DOBLO CARGO Cargo SX 1.6 Mjet 77kW (105CV)',
 'transmission': 'manual',
 'trim': 'Cargo SX 1.6 Mjet 77kW (105CV)',
 'vin': None,
 'year': 2021}
2026-03-26 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985750%27 HTTP/1.1" 200 None
2026-03-26 18:32:42 [ayvens.es] INFO: Saving data for 1985750: {'created_time': 1774549962.321868, 'last_price_update_time': 1774549962.321878, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985750') HTTP/1.1" 204 0
2026-03-26 18:32:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7d7c611b-36ab-5e68-99d7-505a83b79c9a with identifier: 1985748
2026-03-26 18:32:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7d7c611b-36ab-5e68-99d7-505a83b79c9a with identifier: 1985748
2026-03-26 18:32:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7d7c611b-36ab-5e68-99d7-505a83b79c9a with identifier: 1985748 to the API
2026-03-26 18:32:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/692/c05fde012e5140fa910106b149741b24/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '7d7c611b-36ab-5e68-99d7-505a83b79c9a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'DACIA',
 'model': 'DOKKER',
 'odometer': 151739,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d7c611b-36ab-5e68-99d7-505a83b79c9a/7d7c611b-36ab-5e68-99d7-505a83b79c9a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 541582,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/692/c05fde012e5140fa910106b149741b24/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DACIA DOKKER Essential Blue dCi 70kW (95CV) N1 **REVISAR '
          'PERITACION**',
 'transmission': 'manual',
 'trim': 'Essential Blue dCi 70kW (95CV) N1 **REVISAR PERITACION**',
 'vin': None,
 'year': 2020}
2026-03-26 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985748%27 HTTP/1.1" 200 None
2026-03-26 18:32:42 [ayvens.es] INFO: Saving data for 1985748: {'created_time': 1774549962.611589, 'last_price_update_time': 1774549962.611599, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985748') HTTP/1.1" 204 0
2026-03-26 18:32:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b291d3f6-078b-53e1-90fa-2f79e4a4b22c with identifier: 1985751
2026-03-26 18:32:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b291d3f6-078b-53e1-90fa-2f79e4a4b22c with identifier: 1985751
2026-03-26 18:32:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b291d3f6-078b-53e1-90fa-2f79e4a4b22c with identifier: 1985751 to the API
2026-03-26 18:32:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/351/111fb64bd65f4a07ac7a63af40bec6be/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 219,
 'color': 'Blanco s',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b291d3f6-078b-53e1-90fa-2f79e4a4b22c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT',
 'odometer': 117625,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b291d3f6-078b-53e1-90fa-2f79e4a4b22c/b291d3f6-078b-53e1-90fa-2f79e4a4b22c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 468542,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/351/111fb64bd65f4a07ac7a63af40bec6be/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-28',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 350 96kW L3H2 Van Trend FWD',
 'transmission': 'manual',
 'trim': '350 96kW L3H2 Van Trend FWD',
 'vin': None,
 'year': 2023}
2026-03-26 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985751%27 HTTP/1.1" 200 None
2026-03-26 18:32:42 [ayvens.es] INFO: Saving data for 1985751: {'created_time': 1774549962.912377, 'last_price_update_time': 1774549962.912387, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985751') HTTP/1.1" 204 0
2026-03-26 18:32:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b2bd7183-10f3-56f1-abf3-0be61bc6ba98 with identifier: 1985752
2026-03-26 18:32:42 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:32:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b2bd7183-10f3-56f1-abf3-0be61bc6ba98 with identifier: 1985752
2026-03-26 18:32:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b2bd7183-10f3-56f1-abf3-0be61bc6ba98 with identifier: 1985752 to the API
2026-03-26 18:32:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/048/41263b3e8e5141c39397c444fe5ac218/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'color': 'Gris nano',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b2bd7183-10f3-56f1-abf3-0be61bc6ba98',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q2',
 'odometer': 101468,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2bd7183-10f3-56f1-abf3-0be61bc6ba98/b2bd7183-10f3-56f1-abf3-0be61bc6ba98_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 502070,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/048/41263b3e8e5141c39397c444fe5ac218/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q2 Advanced 30 TDI 85kW (116CV) S tronic',
 'transmission': 'manual',
 'trim': 'Advanced 30 TDI 85kW (116CV) S tronic',
 'vin': None,
 'year': 2020}
2026-03-26 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985752%27 HTTP/1.1" 200 None
2026-03-26 18:32:43 [ayvens.es] INFO: Saving data for 1985752: {'created_time': 1774549963.20787, 'last_price_update_time': 1774549963.207881, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985752') HTTP/1.1" 204 0
2026-03-26 18:32:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28377dd0>
2026-03-26 18:32:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e8fd969-d5e7-5c90-9662-68b7e584a18b/0e8fd969-d5e7-5c90-9662-68b7e584a18b_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F082%252Ffc1a673556ae49dd9008f74489d0de44%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/082/fc1a673556ae49dd9008f74489d0de44/images/large/1.jpg saved to cache
2026-03-26 18:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0e8fd969-d5e7-5c90-9662-68b7e584a18b
2026-03-26 18:32:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0e8fd969-d5e7-5c90-9662-68b7e584a18b, skipping ID generation
2026-03-26 18:32:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e8fd969-d5e7-5c90-9662-68b7e584a18b with scrape type 1
2026-03-26 18:32:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0e8fd969-d5e7-5c90-9662-68b7e584a18b sending to next pipeline
2026-03-26 18:32:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0e8fd969-d5e7-5c90-9662-68b7e584a18b, identifier: 1985753
2026-03-26 18:32:43 [ayvens.es] INFO: Found listing with ID: 1985763
2026-03-26 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985763%27 HTTP/1.1" 200 None
2026-03-26 18:32:43 [ayvens.es] INFO: Scrape type for 1985763: 1
2026-03-26 18:32:43 [ayvens.es] INFO: Extracting data for car ID: 1985763
2026-03-26 18:32:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4bf4122-0506-5842-a316-f78e6a35452f with identifier: 1985763
2026-03-26 18:32:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4bf4122-0506-5842-a316-f78e6a35452f with scrape type 1
2026-03-26 18:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b4bf4122-0506-5842-a316-f78e6a35452f
2026-03-26 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F034%252F4caf5f42bc8a4733989d663783e6593e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/034/4caf5f42bc8a4733989d663783e6593e/images/large/1.jpg not downloaded yet
2026-03-26 18:32:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0e8fd969-d5e7-5c90-9662-68b7e584a18b with identifier: 1985753
2026-03-26 18:32:43 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:32:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0e8fd969-d5e7-5c90-9662-68b7e584a18b with identifier: 1985753
2026-03-26 18:32:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0e8fd969-d5e7-5c90-9662-68b7e584a18b with identifier: 1985753 to the API
2026-03-26 18:32:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/082/fc1a673556ae49dd9008f74489d0de44/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'Gris monta',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '0e8fd969-d5e7-5c90-9662-68b7e584a18b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS',
 'odometer': 105671,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e8fd969-d5e7-5c90-9662-68b7e584a18b/0e8fd969-d5e7-5c90-9662-68b7e584a18b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 652543,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/082/fc1a673556ae49dd9008f74489d0de44/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS A 180 d',
 'transmission': 'manual',
 'trim': 'A 180 d',
 'vin': None,
 'year': 2019}
2026-03-26 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985753%27 HTTP/1.1" 200 None
2026-03-26 18:32:43 [ayvens.es] INFO: Saving data for 1985753: {'created_time': 1774549963.777256, 'last_price_update_time': 1774549963.777267, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985753') HTTP/1.1" 204 0
2026-03-26 18:32:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/008/8e808bd837ca40659cd666916a6f26af/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/161/d01a82dc90a6417d99efe8b04498b13f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/034/d24ad9a456f44f019a228083dc6bdaa9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/595/60e6bc7ebfd64c92b2814f0708a9baea/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/819/e1ebdeb5d0314d778d96d408e30ef823/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:43 [ayvens.es] INFO: Found listing with ID: 1985764
2026-03-26 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985764%27 HTTP/1.1" 200 None
2026-03-26 18:32:43 [ayvens.es] INFO: Scrape type for 1985764: 1
2026-03-26 18:32:43 [ayvens.es] INFO: Extracting data for car ID: 1985764
2026-03-26 18:32:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f912415-ed86-5d07-a890-2ff4c10f8551 with identifier: 1985764
2026-03-26 18:32:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f912415-ed86-5d07-a890-2ff4c10f8551 with scrape type 1
2026-03-26 18:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3f912415-ed86-5d07-a890-2ff4c10f8551
2026-03-26 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F880%252F44e602dd6b6e488fa96a1c0d92570659%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/880/44e602dd6b6e488fa96a1c0d92570659/images/large/1.jpg not downloaded yet
2026-03-26 18:32:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/606/e5204740a6574cdbabb46c6d4bd38255/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:43 [ayvens.es] INFO: Found listing with ID: 1985765
2026-03-26 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985765%27 HTTP/1.1" 200 None
2026-03-26 18:32:43 [ayvens.es] INFO: Scrape type for 1985765: 1
2026-03-26 18:32:43 [ayvens.es] INFO: Extracting data for car ID: 1985765
2026-03-26 18:32:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b787f4c-6a63-509b-8d09-7cc4eb051806 with identifier: 1985765
2026-03-26 18:32:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b787f4c-6a63-509b-8d09-7cc4eb051806 with scrape type 1
2026-03-26 18:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4b787f4c-6a63-509b-8d09-7cc4eb051806
2026-03-26 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F452%252Ff1b7dd3b48d24f8c840c9a3c0c5fa961%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/452/f1b7dd3b48d24f8c840c9a3c0c5fa961/images/large/1.jpg not downloaded yet
2026-03-26 18:32:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/763/bcf561b733c84368aa8f69520655d170/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:43 [ayvens.es] INFO: Found listing with ID: 1985766
2026-03-26 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985766%27 HTTP/1.1" 200 None
2026-03-26 18:32:43 [ayvens.es] INFO: Scrape type for 1985766: 1
2026-03-26 18:32:43 [ayvens.es] INFO: Extracting data for car ID: 1985766
2026-03-26 18:32:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ff637b8-eb43-5d8e-a0ce-1469f091ebbb with identifier: 1985766
2026-03-26 18:32:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ff637b8-eb43-5d8e-a0ce-1469f091ebbb with scrape type 1
2026-03-26 18:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4ff637b8-eb43-5d8e-a0ce-1469f091ebbb
2026-03-26 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F476%252F88ffc8a6979c4dd7946232e3c93f8e82%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/476/88ffc8a6979c4dd7946232e3c93f8e82/images/large/1.jpg not downloaded yet
2026-03-26 18:32:43 [ayvens.es] INFO: Found listing with ID: 1985767
2026-03-26 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985767%27 HTTP/1.1" 200 None
2026-03-26 18:32:43 [ayvens.es] INFO: Scrape type for 1985767: 1
2026-03-26 18:32:43 [ayvens.es] INFO: Extracting data for car ID: 1985767
2026-03-26 18:32:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: adfe2d76-f6a3-565e-a22f-481383c85722 with identifier: 1985767
2026-03-26 18:32:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item adfe2d76-f6a3-565e-a22f-481383c85722 with scrape type 1
2026-03-26 18:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item adfe2d76-f6a3-565e-a22f-481383c85722
2026-03-26 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F772%252Fd89b31beccc74c80a09f240d25f749e9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/772/d89b31beccc74c80a09f240d25f749e9/images/large/1.jpg not downloaded yet
2026-03-26 18:32:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/357/54caf182c52543c4ab6d843a744b6f66/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c677d0>
2026-03-26 18:32:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_885908a6-87d8-5cda-a4e2-d3fcc94281e5/885908a6-87d8-5cda-a4e2-d3fcc94281e5_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F008%252F8e808bd837ca40659cd666916a6f26af%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/008/8e808bd837ca40659cd666916a6f26af/images/large/1.jpg saved to cache
2026-03-26 18:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 885908a6-87d8-5cda-a4e2-d3fcc94281e5
2026-03-26 18:32:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 885908a6-87d8-5cda-a4e2-d3fcc94281e5, skipping ID generation
2026-03-26 18:32:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 885908a6-87d8-5cda-a4e2-d3fcc94281e5 with scrape type 1
2026-03-26 18:32:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 885908a6-87d8-5cda-a4e2-d3fcc94281e5 sending to next pipeline
2026-03-26 18:32:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 885908a6-87d8-5cda-a4e2-d3fcc94281e5, identifier: 1985754
2026-03-26 18:32:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a2906b490>
2026-03-26 18:32:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c585b2f9-3170-5ff4-bc43-bcda527c3d9f/c585b2f9-3170-5ff4-bc43-bcda527c3d9f_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F161%252Fd01a82dc90a6417d99efe8b04498b13f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/161/d01a82dc90a6417d99efe8b04498b13f/images/large/1.jpg saved to cache
2026-03-26 18:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c585b2f9-3170-5ff4-bc43-bcda527c3d9f
2026-03-26 18:32:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c585b2f9-3170-5ff4-bc43-bcda527c3d9f, skipping ID generation
2026-03-26 18:32:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c585b2f9-3170-5ff4-bc43-bcda527c3d9f with scrape type 1
2026-03-26 18:32:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c585b2f9-3170-5ff4-bc43-bcda527c3d9f sending to next pipeline
2026-03-26 18:32:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c585b2f9-3170-5ff4-bc43-bcda527c3d9f, identifier: 1985757
2026-03-26 18:32:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28e9a6d0>
2026-03-26 18:32:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9cc37c71-991e-58a2-a653-f75dddbf6f1e/9cc37c71-991e-58a2-a653-f75dddbf6f1e_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F034%252Fd24ad9a456f44f019a228083dc6bdaa9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/034/d24ad9a456f44f019a228083dc6bdaa9/images/large/1.jpg saved to cache
2026-03-26 18:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9cc37c71-991e-58a2-a653-f75dddbf6f1e
2026-03-26 18:32:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9cc37c71-991e-58a2-a653-f75dddbf6f1e, skipping ID generation
2026-03-26 18:32:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9cc37c71-991e-58a2-a653-f75dddbf6f1e with scrape type 1
2026-03-26 18:32:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9cc37c71-991e-58a2-a653-f75dddbf6f1e sending to next pipeline
2026-03-26 18:32:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9cc37c71-991e-58a2-a653-f75dddbf6f1e, identifier: 1985755
2026-03-26 18:32:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c544d0>
2026-03-26 18:32:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_140b7b10-5cef-5137-a710-a45963521a81/140b7b10-5cef-5137-a710-a45963521a81_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F595%252F60e6bc7ebfd64c92b2814f0708a9baea%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/595/60e6bc7ebfd64c92b2814f0708a9baea/images/large/1.jpg saved to cache
2026-03-26 18:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 140b7b10-5cef-5137-a710-a45963521a81
2026-03-26 18:32:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 140b7b10-5cef-5137-a710-a45963521a81, skipping ID generation
2026-03-26 18:32:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 140b7b10-5cef-5137-a710-a45963521a81 with scrape type 1
2026-03-26 18:32:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 140b7b10-5cef-5137-a710-a45963521a81 sending to next pipeline
2026-03-26 18:32:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 140b7b10-5cef-5137-a710-a45963521a81, identifier: 1985756
2026-03-26 18:32:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c67b10>
2026-03-26 18:32:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54c59e78-5ee3-5234-b9de-5b7e1eae0c6c/54c59e78-5ee3-5234-b9de-5b7e1eae0c6c_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F819%252Fe1ebdeb5d0314d778d96d408e30ef823%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/819/e1ebdeb5d0314d778d96d408e30ef823/images/large/1.jpg saved to cache
2026-03-26 18:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 54c59e78-5ee3-5234-b9de-5b7e1eae0c6c
2026-03-26 18:32:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 54c59e78-5ee3-5234-b9de-5b7e1eae0c6c, skipping ID generation
2026-03-26 18:32:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54c59e78-5ee3-5234-b9de-5b7e1eae0c6c with scrape type 1
2026-03-26 18:32:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 54c59e78-5ee3-5234-b9de-5b7e1eae0c6c sending to next pipeline
2026-03-26 18:32:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 54c59e78-5ee3-5234-b9de-5b7e1eae0c6c, identifier: 1985758
2026-03-26 18:32:44 [ayvens.es] INFO: Found listing with ID: 1985768
2026-03-26 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985768%27 HTTP/1.1" 200 None
2026-03-26 18:32:44 [ayvens.es] INFO: Scrape type for 1985768: 1
2026-03-26 18:32:44 [ayvens.es] INFO: Extracting data for car ID: 1985768
2026-03-26 18:32:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70c2d100-96df-5ee3-97d0-925d19186571 with identifier: 1985768
2026-03-26 18:32:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70c2d100-96df-5ee3-97d0-925d19186571 with scrape type 1
2026-03-26 18:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 70c2d100-96df-5ee3-97d0-925d19186571
2026-03-26 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F442%252F4317cb33bb5440f599cafe3d6c9934e3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/442/4317cb33bb5440f599cafe3d6c9934e3/images/large/1.jpg not downloaded yet
2026-03-26 18:32:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 885908a6-87d8-5cda-a4e2-d3fcc94281e5 with identifier: 1985754
2026-03-26 18:32:44 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:32:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 885908a6-87d8-5cda-a4e2-d3fcc94281e5 with identifier: 1985754
2026-03-26 18:32:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 885908a6-87d8-5cda-a4e2-d3fcc94281e5 with identifier: 1985754 to the API
2026-03-26 18:32:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/008/8e808bd837ca40659cd666916a6f26af/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'Phytonicblau metaliz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '885908a6-87d8-5cda-a4e2-d3fcc94281e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'SERIES 2 GRAN TOURER',
 'odometer': 205944,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_885908a6-87d8-5cda-a4e2-d3fcc94281e5/885908a6-87d8-5cda-a4e2-d3fcc94281e5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 370919,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/008/8e808bd837ca40659cd666916a6f26af/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW SERIES 2 GRAN TOURER 218d',
 'transmission': 'manual',
 'trim': '218d',
 'vin': None,
 'year': 2021}
2026-03-26 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985754%27 HTTP/1.1" 200 None
2026-03-26 18:32:45 [ayvens.es] INFO: Saving data for 1985754: {'created_time': 1774549965.160649, 'last_price_update_time': 1774549965.16066, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985754') HTTP/1.1" 204 0
2026-03-26 18:32:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c585b2f9-3170-5ff4-bc43-bcda527c3d9f with identifier: 1985757
2026-03-26 18:32:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c585b2f9-3170-5ff4-bc43-bcda527c3d9f with identifier: 1985757
2026-03-26 18:32:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c585b2f9-3170-5ff4-bc43-bcda527c3d9f with identifier: 1985757 to the API
2026-03-26 18:32:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/161/d01a82dc90a6417d99efe8b04498b13f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Gris monta',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c585b2f9-3170-5ff4-bc43-bcda527c3d9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLA',
 'odometer': 83617,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c585b2f9-3170-5ff4-bc43-bcda527c3d9f/c585b2f9-3170-5ff4-bc43-bcda527c3d9f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 356690,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/161/d01a82dc90a6417d99efe8b04498b13f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLA GLA 200 D',
 'transmission': 'manual',
 'trim': 'GLA 200 D',
 'vin': None,
 'year': 2020}
2026-03-26 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985757%27 HTTP/1.1" 200 None
2026-03-26 18:32:45 [ayvens.es] INFO: Saving data for 1985757: {'created_time': 1774549965.54589, 'last_price_update_time': 1774549965.545901, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985757') HTTP/1.1" 204 0
2026-03-26 18:32:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9cc37c71-991e-58a2-a653-f75dddbf6f1e with identifier: 1985755
2026-03-26 18:32:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9cc37c71-991e-58a2-a653-f75dddbf6f1e with identifier: 1985755
2026-03-26 18:32:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9cc37c71-991e-58a2-a653-f75dddbf6f1e with identifier: 1985755 to the API
2026-03-26 18:32:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/034/d24ad9a456f44f019a228083dc6bdaa9/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '9cc37c71-991e-58a2-a653-f75dddbf6f1e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT COURIER',
 'odometer': 120914,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cc37c71-991e-58a2-a653-f75dddbf6f1e/9cc37c71-991e-58a2-a653-f75dddbf6f1e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 320724,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/034/d24ad9a456f44f019a228083dc6bdaa9/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-26',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FORD TRANSIT COURIER Van 1.5 TDCi 71kW Trend',
 'transmission': 'manual',
 'trim': 'Van 1.5 TDCi 71kW Trend',
 'vin': None,
 'year': 2023}
2026-03-26 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985755%27 HTTP/1.1" 200 None
2026-03-26 18:32:45 [ayvens.es] INFO: Saving data for 1985755: {'created_time': 1774549965.840231, 'last_price_update_time': 1774549965.840243, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985755') HTTP/1.1" 204 0
2026-03-26 18:32:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 140b7b10-5cef-5137-a710-a45963521a81 with identifier: 1985756
2026-03-26 18:32:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:32:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 140b7b10-5cef-5137-a710-a45963521a81 with identifier: 1985756
2026-03-26 18:32:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 140b7b10-5cef-5137-a710-a45963521a81 with identifier: 1985756 to the API
2026-03-26 18:32:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/595/60e6bc7ebfd64c92b2814f0708a9baea/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Negro noche est',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.9L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '140b7b10-5cef-5137-a710-a45963521a81',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS',
 'odometer': 83638,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_140b7b10-5cef-5137-a710-a45963521a81/140b7b10-5cef-5137-a710-a45963521a81_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 361068,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/595/60e6bc7ebfd64c92b2814f0708a9baea/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS Sedan A 180 d',
 'transmission': 'manual',
 'trim': 'Sedan A 180 d',
 'vin': None,
 'year': 2022}
2026-03-26 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985756%27 HTTP/1.1" 200 None
2026-03-26 18:32:46 [ayvens.es] INFO: Saving data for 1985756: {'created_time': 1774549966.1579, 'last_price_update_time': 1774549966.15791, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985756') HTTP/1.1" 204 0
2026-03-26 18:32:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 54c59e78-5ee3-5234-b9de-5b7e1eae0c6c with identifier: 1985758
2026-03-26 18:32:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:32:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 54c59e78-5ee3-5234-b9de-5b7e1eae0c6c with identifier: 1985758
2026-03-26 18:32:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 54c59e78-5ee3-5234-b9de-5b7e1eae0c6c with identifier: 1985758 to the API
2026-03-26 18:32:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/819/e1ebdeb5d0314d778d96d408e30ef823/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Gris platino',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '54c59e78-5ee3-5234-b9de-5b7e1eae0c6c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C3',
 'odometer': 72689,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54c59e78-5ee3-5234-b9de-5b7e1eae0c6c/54c59e78-5ee3-5234-b9de-5b7e1eae0c6c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 359871,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/819/e1ebdeb5d0314d778d96d408e30ef823/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C3 PureTech 60KW (83CV) C-Series',
 'transmission': 'manual',
 'trim': 'PureTech 60KW (83CV) C-Series',
 'vin': None,
 'year': 2020}
2026-03-26 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985758%27 HTTP/1.1" 200 None
2026-03-26 18:32:46 [ayvens.es] INFO: Saving data for 1985758: {'created_time': 1774549966.528299, 'last_price_update_time': 1774549966.528309, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985758') HTTP/1.1" 204 0
2026-03-26 18:32:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28e5fdd0>
2026-03-26 18:32:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24bf9780-cabb-5446-9752-2461505edabc/24bf9780-cabb-5446-9752-2461505edabc_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F606%252Fe5204740a6574cdbabb46c6d4bd38255%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/606/e5204740a6574cdbabb46c6d4bd38255/images/large/1.jpg saved to cache
2026-03-26 18:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 24bf9780-cabb-5446-9752-2461505edabc
2026-03-26 18:32:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 24bf9780-cabb-5446-9752-2461505edabc, skipping ID generation
2026-03-26 18:32:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24bf9780-cabb-5446-9752-2461505edabc with scrape type 1
2026-03-26 18:32:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 24bf9780-cabb-5446-9752-2461505edabc sending to next pipeline
2026-03-26 18:32:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 24bf9780-cabb-5446-9752-2461505edabc, identifier: 1985759
2026-03-26 18:32:46 [ayvens.es] INFO: Found listing with ID: 1985769
2026-03-26 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985769%27 HTTP/1.1" 200 None
2026-03-26 18:32:46 [ayvens.es] INFO: Scrape type for 1985769: 1
2026-03-26 18:32:46 [ayvens.es] INFO: Extracting data for car ID: 1985769
2026-03-26 18:32:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fbcf7fe-5a44-5f35-aa62-d22b84495efc with identifier: 1985769
2026-03-26 18:32:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fbcf7fe-5a44-5f35-aa62-d22b84495efc with scrape type 1
2026-03-26 18:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1fbcf7fe-5a44-5f35-aa62-d22b84495efc
2026-03-26 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F467%252F5850dda4846249c48a58dc502669f4cd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/467/5850dda4846249c48a58dc502669f4cd/images/large/1.jpg not downloaded yet
2026-03-26 18:32:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 24bf9780-cabb-5446-9752-2461505edabc with identifier: 1985759
2026-03-26 18:32:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:32:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 24bf9780-cabb-5446-9752-2461505edabc with identifier: 1985759
2026-03-26 18:32:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 24bf9780-cabb-5446-9752-2461505edabc with identifier: 1985759 to the API
2026-03-26 18:32:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/606/e5204740a6574cdbabb46c6d4bd38255/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Gris artense',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '24bf9780-cabb-5446-9752-2461505edabc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS 7 CROSSBACK',
 'odometer': 94653,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24bf9780-cabb-5446-9752-2461505edabc/24bf9780-cabb-5446-9752-2461505edabc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 355350,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/606/e5204740a6574cdbabb46c6d4bd38255/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS 7 CROSSBACK BlueHDi 132kW (180CV) Auto. SO CHIC',
 'transmission': 'manual',
 'trim': 'BlueHDi 132kW (180CV) Auto. SO CHIC',
 'vin': None,
 'year': 2019}
2026-03-26 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985759%27 HTTP/1.1" 200 None
2026-03-26 18:32:47 [ayvens.es] INFO: Saving data for 1985759: {'created_time': 1774549967.03323, 'last_price_update_time': 1774549967.033241, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985759') HTTP/1.1" 204 0
2026-03-26 18:32:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a29317ad0>
2026-03-26 18:32:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1941ee17-c97e-5a0b-adb2-f979c205a9b7/1941ee17-c97e-5a0b-adb2-f979c205a9b7_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F763%252Fbcf561b733c84368aa8f69520655d170%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/763/bcf561b733c84368aa8f69520655d170/images/large/1.jpg saved to cache
2026-03-26 18:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1941ee17-c97e-5a0b-adb2-f979c205a9b7
2026-03-26 18:32:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1941ee17-c97e-5a0b-adb2-f979c205a9b7, skipping ID generation
2026-03-26 18:32:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1941ee17-c97e-5a0b-adb2-f979c205a9b7 with scrape type 1
2026-03-26 18:32:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1941ee17-c97e-5a0b-adb2-f979c205a9b7 sending to next pipeline
2026-03-26 18:32:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1941ee17-c97e-5a0b-adb2-f979c205a9b7, identifier: 1985760
2026-03-26 18:32:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a2820df90>
2026-03-26 18:32:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e9e6476-2207-5654-a018-3ee20a707e6a/9e9e6476-2207-5654-a018-3ee20a707e6a_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F357%252F54caf182c52543c4ab6d843a744b6f66%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/357/54caf182c52543c4ab6d843a744b6f66/images/large/1.jpg saved to cache
2026-03-26 18:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9e9e6476-2207-5654-a018-3ee20a707e6a
2026-03-26 18:32:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9e9e6476-2207-5654-a018-3ee20a707e6a, skipping ID generation
2026-03-26 18:32:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e9e6476-2207-5654-a018-3ee20a707e6a with scrape type 1
2026-03-26 18:32:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9e9e6476-2207-5654-a018-3ee20a707e6a sending to next pipeline
2026-03-26 18:32:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9e9e6476-2207-5654-a018-3ee20a707e6a, identifier: 1985761
2026-03-26 18:32:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1941ee17-c97e-5a0b-adb2-f979c205a9b7 with identifier: 1985760
2026-03-26 18:32:47 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:32:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1941ee17-c97e-5a0b-adb2-f979c205a9b7 with identifier: 1985760
2026-03-26 18:32:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1941ee17-c97e-5a0b-adb2-f979c205a9b7 with identifier: 1985760 to the API
2026-03-26 18:32:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/763/bcf561b733c84368aa8f69520655d170/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 89,
 'color': 'Blanco banquise',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '1941ee17-c97e-5a0b-adb2-f979c205a9b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C4 CACTUS',
 'odometer': 190185,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1941ee17-c97e-5a0b-adb2-f979c205a9b7/1941ee17-c97e-5a0b-adb2-f979c205a9b7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 346378,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/763/bcf561b733c84368aa8f69520655d170/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C4 CACTUS (O) BlueHDi 100 S&S C-Series',
 'transmission': 'manual',
 'trim': '(O) BlueHDi 100 S&S C-Series',
 'vin': None,
 'year': 2021}
2026-03-26 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985760%27 HTTP/1.1" 200 None
2026-03-26 18:32:47 [ayvens.es] INFO: Saving data for 1985760: {'created_time': 1774549967.66477, 'last_price_update_time': 1774549967.664782, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985760') HTTP/1.1" 204 0
2026-03-26 18:32:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9e9e6476-2207-5654-a018-3ee20a707e6a with identifier: 1985761
2026-03-26 18:32:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9e9e6476-2207-5654-a018-3ee20a707e6a with identifier: 1985761
2026-03-26 18:32:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9e9e6476-2207-5654-a018-3ee20a707e6a with identifier: 1985761 to the API
2026-03-26 18:32:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/357/54caf182c52543c4ab6d843a744b6f66/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '9e9e6476-2207-5654-a018-3ee20a707e6a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'COMBO',
 'odometer': 130557,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e9e6476-2207-5654-a018-3ee20a707e6a/9e9e6476-2207-5654-a018-3ee20a707e6a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 479102,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/357/54caf182c52543c4ab6d843a744b6f66/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-04',
 'seats_number': 2,
 'seller_name': None,
 'title': 'OPEL COMBO 1.5 TD S/S 75kW (100CV) Express L H1 650 **REVISAR '
          'PERITACION**',
 'transmission': 'manual',
 'trim': '1.5 TD S/S 75kW (100CV) Express L H1 650 **REVISAR PERITACION**',
 'vin': None,
 'year': 2020}
2026-03-26 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985761%27 HTTP/1.1" 200 None
2026-03-26 18:32:47 [ayvens.es] INFO: Saving data for 1985761: {'created_time': 1774549967.975183, 'last_price_update_time': 1774549967.975193, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985761') HTTP/1.1" 204 0
2026-03-26 18:32:48 [ayvens.es] INFO: Found listing with ID: 1985770
2026-03-26 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985770%27 HTTP/1.1" 200 None
2026-03-26 18:32:48 [ayvens.es] INFO: Scrape type for 1985770: 1
2026-03-26 18:32:48 [ayvens.es] INFO: Extracting data for car ID: 1985770
2026-03-26 18:32:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c4341c2-2e1a-5e98-ba1a-84bd67e38006 with identifier: 1985770
2026-03-26 18:32:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c4341c2-2e1a-5e98-ba1a-84bd67e38006 with scrape type 1
2026-03-26 18:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8c4341c2-2e1a-5e98-ba1a-84bd67e38006
2026-03-26 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F945%252F48f7a88b16fa4e67ac0728db11839343%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/945/48f7a88b16fa4e67ac0728db11839343/images/large/1.jpg not downloaded yet
2026-03-26 18:32:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/454/12ae80e79d9145fc87fb11420a4cc642/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/034/4caf5f42bc8a4733989d663783e6593e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/452/f1b7dd3b48d24f8c840c9a3c0c5fa961/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/880/44e602dd6b6e488fa96a1c0d92570659/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:48 [ayvens.es] INFO: Found listing with ID: 1985771
2026-03-26 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985771%27 HTTP/1.1" 200 None
2026-03-26 18:32:48 [ayvens.es] INFO: Scrape type for 1985771: 1
2026-03-26 18:32:48 [ayvens.es] INFO: Extracting data for car ID: 1985771
2026-03-26 18:32:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9339bc13-72d4-5241-80f5-c5bb59349414 with identifier: 1985771
2026-03-26 18:32:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9339bc13-72d4-5241-80f5-c5bb59349414 with scrape type 1
2026-03-26 18:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9339bc13-72d4-5241-80f5-c5bb59349414
2026-03-26 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F958%252Fea1e9436a68a44509d17c093aabbf55b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/958/ea1e9436a68a44509d17c093aabbf55b/images/large/1.jpg not downloaded yet
2026-03-26 18:32:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/772/d89b31beccc74c80a09f240d25f749e9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:48 [ayvens.es] INFO: Found listing with ID: 1985772
2026-03-26 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985772%27 HTTP/1.1" 200 None
2026-03-26 18:32:48 [ayvens.es] INFO: Scrape type for 1985772: 1
2026-03-26 18:32:48 [ayvens.es] INFO: Extracting data for car ID: 1985772
2026-03-26 18:32:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da5362f5-b1dc-5810-a1fd-465f0478a5f2 with identifier: 1985772
2026-03-26 18:32:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da5362f5-b1dc-5810-a1fd-465f0478a5f2 with scrape type 1
2026-03-26 18:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item da5362f5-b1dc-5810-a1fd-465f0478a5f2
2026-03-26 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F508%252F24f63f0b70094265aa62e58ef0e43668%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/508/24f63f0b70094265aa62e58ef0e43668/images/large/1.jpg not downloaded yet
2026-03-26 18:32:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/476/88ffc8a6979c4dd7946232e3c93f8e82/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:48 [ayvens.es] INFO: Found listing with ID: 1985773
2026-03-26 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985773%27 HTTP/1.1" 200 None
2026-03-26 18:32:48 [ayvens.es] INFO: Scrape type for 1985773: 1
2026-03-26 18:32:48 [ayvens.es] INFO: Extracting data for car ID: 1985773
2026-03-26 18:32:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae8c1a1b-e30e-5fc4-9a6f-6a4b5b774197 with identifier: 1985773
2026-03-26 18:32:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae8c1a1b-e30e-5fc4-9a6f-6a4b5b774197 with scrape type 1
2026-03-26 18:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ae8c1a1b-e30e-5fc4-9a6f-6a4b5b774197
2026-03-26 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F341%252F8b9bfcd739014d96af629783116dbbb0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/341/8b9bfcd739014d96af629783116dbbb0/images/large/1.jpg not downloaded yet
2026-03-26 18:32:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a283e0d90>
2026-03-26 18:32:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3710ae9-96fe-5ba3-af82-b95cc677f3a1/e3710ae9-96fe-5ba3-af82-b95cc677f3a1_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F454%252F12ae80e79d9145fc87fb11420a4cc642%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/454/12ae80e79d9145fc87fb11420a4cc642/images/large/1.jpg saved to cache
2026-03-26 18:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e3710ae9-96fe-5ba3-af82-b95cc677f3a1
2026-03-26 18:32:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e3710ae9-96fe-5ba3-af82-b95cc677f3a1, skipping ID generation
2026-03-26 18:32:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3710ae9-96fe-5ba3-af82-b95cc677f3a1 with scrape type 1
2026-03-26 18:32:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e3710ae9-96fe-5ba3-af82-b95cc677f3a1 sending to next pipeline
2026-03-26 18:32:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e3710ae9-96fe-5ba3-af82-b95cc677f3a1, identifier: 1985762
2026-03-26 18:32:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a2833ff10>
2026-03-26 18:32:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4bf4122-0506-5842-a316-f78e6a35452f/b4bf4122-0506-5842-a316-f78e6a35452f_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F034%252F4caf5f42bc8a4733989d663783e6593e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/034/4caf5f42bc8a4733989d663783e6593e/images/large/1.jpg saved to cache
2026-03-26 18:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b4bf4122-0506-5842-a316-f78e6a35452f
2026-03-26 18:32:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b4bf4122-0506-5842-a316-f78e6a35452f, skipping ID generation
2026-03-26 18:32:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4bf4122-0506-5842-a316-f78e6a35452f with scrape type 1
2026-03-26 18:32:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b4bf4122-0506-5842-a316-f78e6a35452f sending to next pipeline
2026-03-26 18:32:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b4bf4122-0506-5842-a316-f78e6a35452f, identifier: 1985763
2026-03-26 18:32:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28bc8790>
2026-03-26 18:32:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b787f4c-6a63-509b-8d09-7cc4eb051806/4b787f4c-6a63-509b-8d09-7cc4eb051806_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F452%252Ff1b7dd3b48d24f8c840c9a3c0c5fa961%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/452/f1b7dd3b48d24f8c840c9a3c0c5fa961/images/large/1.jpg saved to cache
2026-03-26 18:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4b787f4c-6a63-509b-8d09-7cc4eb051806
2026-03-26 18:32:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4b787f4c-6a63-509b-8d09-7cc4eb051806, skipping ID generation
2026-03-26 18:32:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b787f4c-6a63-509b-8d09-7cc4eb051806 with scrape type 1
2026-03-26 18:32:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4b787f4c-6a63-509b-8d09-7cc4eb051806 sending to next pipeline
2026-03-26 18:32:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4b787f4c-6a63-509b-8d09-7cc4eb051806, identifier: 1985765
2026-03-26 18:32:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28bcb790>
2026-03-26 18:32:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f912415-ed86-5d07-a890-2ff4c10f8551/3f912415-ed86-5d07-a890-2ff4c10f8551_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F880%252F44e602dd6b6e488fa96a1c0d92570659%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/880/44e602dd6b6e488fa96a1c0d92570659/images/large/1.jpg saved to cache
2026-03-26 18:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3f912415-ed86-5d07-a890-2ff4c10f8551
2026-03-26 18:32:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3f912415-ed86-5d07-a890-2ff4c10f8551, skipping ID generation
2026-03-26 18:32:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f912415-ed86-5d07-a890-2ff4c10f8551 with scrape type 1
2026-03-26 18:32:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3f912415-ed86-5d07-a890-2ff4c10f8551 sending to next pipeline
2026-03-26 18:32:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3f912415-ed86-5d07-a890-2ff4c10f8551, identifier: 1985764
2026-03-26 18:32:48 [ayvens.es] INFO: Found listing with ID: 1985774
2026-03-26 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985774%27 HTTP/1.1" 200 None
2026-03-26 18:32:48 [ayvens.es] INFO: Scrape type for 1985774: 1
2026-03-26 18:32:48 [ayvens.es] INFO: Extracting data for car ID: 1985774
2026-03-26 18:32:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd6f364c-938d-5205-a1ce-85dca10d5570 with identifier: 1985774
2026-03-26 18:32:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd6f364c-938d-5205-a1ce-85dca10d5570 with scrape type 1
2026-03-26 18:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item bd6f364c-938d-5205-a1ce-85dca10d5570
2026-03-26 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F694%252F8016db208a8940be9189548595d87d03%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/694/8016db208a8940be9189548595d87d03/images/large/1.jpg not downloaded yet
2026-03-26 18:32:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e3710ae9-96fe-5ba3-af82-b95cc677f3a1 with identifier: 1985762
2026-03-26 18:32:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e3710ae9-96fe-5ba3-af82-b95cc677f3a1 with identifier: 1985762
2026-03-26 18:32:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e3710ae9-96fe-5ba3-af82-b95cc677f3a1 with identifier: 1985762 to the API
2026-03-26 18:32:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/454/12ae80e79d9145fc87fb11420a4cc642/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.7L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e3710ae9-96fe-5ba3-af82-b95cc677f3a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'X-TRAIL',
 'odometer': 132716,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3710ae9-96fe-5ba3-af82-b95cc677f3a1/e3710ae9-96fe-5ba3-af82-b95cc677f3a1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 316688,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/454/12ae80e79d9145fc87fb11420a4cc642/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN X-TRAIL 5P dCi 110 kW (150 CV) E6D 4X4-i ACENTA',
 'transmission': 'manual',
 'trim': '5P dCi 110 kW (150 CV) E6D 4X4-i ACENTA',
 'vin': None,
 'year': 2020}
2026-03-26 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985762%27 HTTP/1.1" 200 None
2026-03-26 18:32:49 [ayvens.es] INFO: Saving data for 1985762: {'created_time': 1774549969.151614, 'last_price_update_time': 1774549969.151625, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985762') HTTP/1.1" 204 0
2026-03-26 18:32:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b4bf4122-0506-5842-a316-f78e6a35452f with identifier: 1985763
2026-03-26 18:32:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b4bf4122-0506-5842-a316-f78e6a35452f with identifier: 1985763
2026-03-26 18:32:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b4bf4122-0506-5842-a316-f78e6a35452f with identifier: 1985763 to the API
2026-03-26 18:32:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/034/4caf5f42bc8a4733989d663783e6593e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b4bf4122-0506-5842-a316-f78e6a35452f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'CORSA',
 'odometer': 42818,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4bf4122-0506-5842-a316-f78e6a35452f/b4bf4122-0506-5842-a316-f78e6a35452f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 361223,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/034/4caf5f42bc8a4733989d663783e6593e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL CORSA 1.2T XHL 74kW (100CV) Edition',
 'transmission': 'manual',
 'trim': '1.2T XHL 74kW (100CV) Edition',
 'vin': None,
 'year': 2022}
2026-03-26 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985763%27 HTTP/1.1" 200 None
2026-03-26 18:32:49 [ayvens.es] INFO: Saving data for 1985763: {'created_time': 1774549969.463091, 'last_price_update_time': 1774549969.463102, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985763') HTTP/1.1" 204 0
2026-03-26 18:32:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4b787f4c-6a63-509b-8d09-7cc4eb051806 with identifier: 1985765
2026-03-26 18:32:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4b787f4c-6a63-509b-8d09-7cc4eb051806 with identifier: 1985765
2026-03-26 18:32:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 4b787f4c-6a63-509b-8d09-7cc4eb051806 with identifier: 1985765 to the API
2026-03-26 18:32:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/452/f1b7dd3b48d24f8c840c9a3c0c5fa961/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Serie',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '4b787f4c-6a63-509b-8d09-7cc4eb051806',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '208',
 'odometer': 95124,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b787f4c-6a63-509b-8d09-7cc4eb051806/4b787f4c-6a63-509b-8d09-7cc4eb051806_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 341273,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/452/f1b7dd3b48d24f8c840c9a3c0c5fa961/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 208 BlueHDi 73kW (100CV) Active',
 'transmission': 'manual',
 'trim': 'BlueHDi 73kW (100CV) Active',
 'vin': None,
 'year': 2022}
2026-03-26 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985765%27 HTTP/1.1" 200 None
2026-03-26 18:32:49 [ayvens.es] INFO: Saving data for 1985765: {'created_time': 1774549969.754382, 'last_price_update_time': 1774549969.754393, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985765') HTTP/1.1" 204 0
2026-03-26 18:32:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3f912415-ed86-5d07-a890-2ff4c10f8551 with identifier: 1985764
2026-03-26 18:32:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3f912415-ed86-5d07-a890-2ff4c10f8551 with identifier: 1985764
2026-03-26 18:32:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3f912415-ed86-5d07-a890-2ff4c10f8551 with identifier: 1985764 to the API
2026-03-26 18:32:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/880/44e602dd6b6e488fa96a1c0d92570659/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '3f912415-ed86-5d07-a890-2ff4c10f8551',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '308',
 'odometer': 137345,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f912415-ed86-5d07-a890-2ff4c10f8551/3f912415-ed86-5d07-a890-2ff4c10f8551_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354702,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/880/44e602dd6b6e488fa96a1c0d92570659/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 308 5p Allure PureTech 130 S&S',
 'transmission': 'manual',
 'trim': '5p Allure PureTech 130 S&S',
 'vin': None,
 'year': 2020}
2026-03-26 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985764%27 HTTP/1.1" 200 None
2026-03-26 18:32:50 [ayvens.es] INFO: Saving data for 1985764: {'created_time': 1774549970.048557, 'last_price_update_time': 1774549970.048567, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985764') HTTP/1.1" 204 0
2026-03-26 18:32:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c6fc50>
2026-03-26 18:32:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adfe2d76-f6a3-565e-a22f-481383c85722/adfe2d76-f6a3-565e-a22f-481383c85722_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F772%252Fd89b31beccc74c80a09f240d25f749e9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/772/d89b31beccc74c80a09f240d25f749e9/images/large/1.jpg saved to cache
2026-03-26 18:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item adfe2d76-f6a3-565e-a22f-481383c85722
2026-03-26 18:32:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: adfe2d76-f6a3-565e-a22f-481383c85722, skipping ID generation
2026-03-26 18:32:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item adfe2d76-f6a3-565e-a22f-481383c85722 with scrape type 1
2026-03-26 18:32:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item adfe2d76-f6a3-565e-a22f-481383c85722 sending to next pipeline
2026-03-26 18:32:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: adfe2d76-f6a3-565e-a22f-481383c85722, identifier: 1985767
2026-03-26 18:32:50 [ayvens.es] INFO: Found listing with ID: 1985775
2026-03-26 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985775%27 HTTP/1.1" 200 None
2026-03-26 18:32:50 [ayvens.es] INFO: Scrape type for 1985775: 1
2026-03-26 18:32:50 [ayvens.es] INFO: Extracting data for car ID: 1985775
2026-03-26 18:32:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3c53af9-e451-521d-90e1-fba718bc3d46 with identifier: 1985775
2026-03-26 18:32:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3c53af9-e451-521d-90e1-fba718bc3d46 with scrape type 1
2026-03-26 18:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f3c53af9-e451-521d-90e1-fba718bc3d46
2026-03-26 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F636%252Fb0dd442d6c7e406fb2619dc05687a3f8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/636/b0dd442d6c7e406fb2619dc05687a3f8/images/large/1.jpg not downloaded yet
2026-03-26 18:32:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: adfe2d76-f6a3-565e-a22f-481383c85722 with identifier: 1985767
2026-03-26 18:32:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: adfe2d76-f6a3-565e-a22f-481383c85722 with identifier: 1985767
2026-03-26 18:32:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: adfe2d76-f6a3-565e-a22f-481383c85722 with identifier: 1985767 to the API
2026-03-26 18:32:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/772/d89b31beccc74c80a09f240d25f749e9/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 167,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.3L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'adfe2d76-f6a3-565e-a22f-481383c85722',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'NAVARA',
 'odometer': 222133,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adfe2d76-f6a3-565e-a22f-481383c85722/adfe2d76-f6a3-565e-a22f-481383c85722_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 319145,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/772/d89b31beccc74c80a09f240d25f749e9/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN NAVARA Dob. Cab. 2.3dCi EU6 120kW(160CV) Acenta',
 'transmission': 'manual',
 'trim': 'Dob. Cab. 2.3dCi EU6 120kW(160CV) Acenta',
 'vin': None,
 'year': 2018}
2026-03-26 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985767%27 HTTP/1.1" 200 None
2026-03-26 18:32:50 [ayvens.es] INFO: Saving data for 1985767: {'created_time': 1774549970.529383, 'last_price_update_time': 1774549970.529392, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985767') HTTP/1.1" 204 0
2026-03-26 18:32:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/442/4317cb33bb5440f599cafe3d6c9934e3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c67ed0>
2026-03-26 18:32:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ff637b8-eb43-5d8e-a0ce-1469f091ebbb/4ff637b8-eb43-5d8e-a0ce-1469f091ebbb_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F476%252F88ffc8a6979c4dd7946232e3c93f8e82%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/476/88ffc8a6979c4dd7946232e3c93f8e82/images/large/1.jpg saved to cache
2026-03-26 18:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4ff637b8-eb43-5d8e-a0ce-1469f091ebbb
2026-03-26 18:32:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4ff637b8-eb43-5d8e-a0ce-1469f091ebbb, skipping ID generation
2026-03-26 18:32:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ff637b8-eb43-5d8e-a0ce-1469f091ebbb with scrape type 1
2026-03-26 18:32:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4ff637b8-eb43-5d8e-a0ce-1469f091ebbb sending to next pipeline
2026-03-26 18:32:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4ff637b8-eb43-5d8e-a0ce-1469f091ebbb, identifier: 1985766
2026-03-26 18:32:50 [ayvens.es] INFO: Found listing with ID: 1985776
2026-03-26 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985776%27 HTTP/1.1" 200 None
2026-03-26 18:32:50 [ayvens.es] INFO: Scrape type for 1985776: 1
2026-03-26 18:32:50 [ayvens.es] INFO: Extracting data for car ID: 1985776
2026-03-26 18:32:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8ff8c33-f4c8-521c-9afc-19359cdba6a2 with identifier: 1985776
2026-03-26 18:32:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8ff8c33-f4c8-521c-9afc-19359cdba6a2 with scrape type 1
2026-03-26 18:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e8ff8c33-f4c8-521c-9afc-19359cdba6a2
2026-03-26 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F098%252Fd66caf8dd5604b2aa0f75de88419c7d8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/098/d66caf8dd5604b2aa0f75de88419c7d8/images/large/1.jpg not downloaded yet
2026-03-26 18:32:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4ff637b8-eb43-5d8e-a0ce-1469f091ebbb with identifier: 1985766
2026-03-26 18:32:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4ff637b8-eb43-5d8e-a0ce-1469f091ebbb with identifier: 1985766
2026-03-26 18:32:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 4ff637b8-eb43-5d8e-a0ce-1469f091ebbb with identifier: 1985766 to the API
2026-03-26 18:32:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/476/88ffc8a6979c4dd7946232e3c93f8e82/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.7L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '4ff637b8-eb43-5d8e-a0ce-1469f091ebbb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'X-TRAIL',
 'odometer': 174817,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ff637b8-eb43-5d8e-a0ce-1469f091ebbb/4ff637b8-eb43-5d8e-a0ce-1469f091ebbb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 355448,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/476/88ffc8a6979c4dd7946232e3c93f8e82/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN X-TRAIL 5P dCi 110 kW (150 CV) E6D 4X4-i ACENTA **REVISAR '
          'PERITACION**',
 'transmission': 'manual',
 'trim': '5P dCi 110 kW (150 CV) E6D 4X4-i ACENTA **REVISAR PERITACION**',
 'vin': None,
 'year': 2020}
2026-03-26 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985766%27 HTTP/1.1" 200 None
2026-03-26 18:32:50 [ayvens.es] INFO: Saving data for 1985766: {'created_time': 1774549970.994759, 'last_price_update_time': 1774549970.99477, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985766') HTTP/1.1" 204 0
2026-03-26 18:32:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/467/5850dda4846249c48a58dc502669f4cd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/945/48f7a88b16fa4e67ac0728db11839343/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:51 [ayvens.es] INFO: Found listing with ID: 1985777
2026-03-26 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985777%27 HTTP/1.1" 200 None
2026-03-26 18:32:51 [ayvens.es] INFO: Scrape type for 1985777: 1
2026-03-26 18:32:51 [ayvens.es] INFO: Extracting data for car ID: 1985777
2026-03-26 18:32:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2eb05101-3041-588c-a61f-5c4fcc3ffac2 with identifier: 1985777
2026-03-26 18:32:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2eb05101-3041-588c-a61f-5c4fcc3ffac2 with scrape type 1
2026-03-26 18:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2eb05101-3041-588c-a61f-5c4fcc3ffac2
2026-03-26 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F544%252F31475f8719f24a18919c51cbc82c5834%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/544/31475f8719f24a18919c51cbc82c5834/images/large/1.jpg not downloaded yet
2026-03-26 18:32:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a2ab0c490>
2026-03-26 18:32:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70c2d100-96df-5ee3-97d0-925d19186571/70c2d100-96df-5ee3-97d0-925d19186571_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F442%252F4317cb33bb5440f599cafe3d6c9934e3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/442/4317cb33bb5440f599cafe3d6c9934e3/images/large/1.jpg saved to cache
2026-03-26 18:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 70c2d100-96df-5ee3-97d0-925d19186571
2026-03-26 18:32:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 70c2d100-96df-5ee3-97d0-925d19186571, skipping ID generation
2026-03-26 18:32:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70c2d100-96df-5ee3-97d0-925d19186571 with scrape type 1
2026-03-26 18:32:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 70c2d100-96df-5ee3-97d0-925d19186571 sending to next pipeline
2026-03-26 18:32:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 70c2d100-96df-5ee3-97d0-925d19186571, identifier: 1985768
2026-03-26 18:32:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/508/24f63f0b70094265aa62e58ef0e43668/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:51 [ayvens.es] INFO: Found listing with ID: 1985778
2026-03-26 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985778%27 HTTP/1.1" 200 None
2026-03-26 18:32:51 [ayvens.es] INFO: Scrape type for 1985778: 1
2026-03-26 18:32:51 [ayvens.es] INFO: Extracting data for car ID: 1985778
2026-03-26 18:32:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9085b26-80db-51a1-8b68-f3d2a6e0105e with identifier: 1985778
2026-03-26 18:32:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9085b26-80db-51a1-8b68-f3d2a6e0105e with scrape type 1
2026-03-26 18:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a9085b26-80db-51a1-8b68-f3d2a6e0105e
2026-03-26 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F775%252Faf5145a8cbc54efa96758a3720f3b97c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/775/af5145a8cbc54efa96758a3720f3b97c/images/large/1.jpg not downloaded yet
2026-03-26 18:32:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 70c2d100-96df-5ee3-97d0-925d19186571 with identifier: 1985768
2026-03-26 18:32:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 70c2d100-96df-5ee3-97d0-925d19186571 with identifier: 1985768
2026-03-26 18:32:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 70c2d100-96df-5ee3-97d0-925d19186571 with identifier: 1985768 to the API
2026-03-26 18:32:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/442/4317cb33bb5440f599cafe3d6c9934e3/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 96,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '70c2d100-96df-5ee3-97d0-925d19186571',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'CORSA',
 'odometer': 92013,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70c2d100-96df-5ee3-97d0-925d19186571/70c2d100-96df-5ee3-97d0-925d19186571_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347603,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/442/4317cb33bb5440f599cafe3d6c9934e3/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL CORSA 1.2T XHL 74kW (100CV) Edition',
 'transmission': 'manual',
 'trim': '1.2T XHL 74kW (100CV) Edition',
 'vin': None,
 'year': 2019}
2026-03-26 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985768%27 HTTP/1.1" 200 None
2026-03-26 18:32:51 [ayvens.es] INFO: Saving data for 1985768: {'created_time': 1774549971.525441, 'last_price_update_time': 1774549971.525451, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985768') HTTP/1.1" 204 0
2026-03-26 18:32:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/958/ea1e9436a68a44509d17c093aabbf55b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/341/8b9bfcd739014d96af629783116dbbb0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:51 [ayvens.es] INFO: Found listing with ID: 1985779
2026-03-26 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985779%27 HTTP/1.1" 200 None
2026-03-26 18:32:51 [ayvens.es] INFO: Scrape type for 1985779: 1
2026-03-26 18:32:51 [ayvens.es] INFO: Extracting data for car ID: 1985779
2026-03-26 18:32:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47077259-02f4-58a4-9b0b-eba77446baad with identifier: 1985779
2026-03-26 18:32:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47077259-02f4-58a4-9b0b-eba77446baad with scrape type 1
2026-03-26 18:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 47077259-02f4-58a4-9b0b-eba77446baad
2026-03-26 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F149%252Fd44e208098254f37904dc35740ef7c7a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/149/d44e208098254f37904dc35740ef7c7a/images/large/1.jpg not downloaded yet
2026-03-26 18:32:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28e6cd50>
2026-03-26 18:32:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fbcf7fe-5a44-5f35-aa62-d22b84495efc/1fbcf7fe-5a44-5f35-aa62-d22b84495efc_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F467%252F5850dda4846249c48a58dc502669f4cd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/467/5850dda4846249c48a58dc502669f4cd/images/large/1.jpg saved to cache
2026-03-26 18:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1fbcf7fe-5a44-5f35-aa62-d22b84495efc
2026-03-26 18:32:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1fbcf7fe-5a44-5f35-aa62-d22b84495efc, skipping ID generation
2026-03-26 18:32:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fbcf7fe-5a44-5f35-aa62-d22b84495efc with scrape type 1
2026-03-26 18:32:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1fbcf7fe-5a44-5f35-aa62-d22b84495efc sending to next pipeline
2026-03-26 18:32:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1fbcf7fe-5a44-5f35-aa62-d22b84495efc, identifier: 1985769
2026-03-26 18:32:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28deafd0>
2026-03-26 18:32:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c4341c2-2e1a-5e98-ba1a-84bd67e38006/8c4341c2-2e1a-5e98-ba1a-84bd67e38006_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F945%252F48f7a88b16fa4e67ac0728db11839343%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/945/48f7a88b16fa4e67ac0728db11839343/images/large/1.jpg saved to cache
2026-03-26 18:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8c4341c2-2e1a-5e98-ba1a-84bd67e38006
2026-03-26 18:32:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8c4341c2-2e1a-5e98-ba1a-84bd67e38006, skipping ID generation
2026-03-26 18:32:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c4341c2-2e1a-5e98-ba1a-84bd67e38006 with scrape type 1
2026-03-26 18:32:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8c4341c2-2e1a-5e98-ba1a-84bd67e38006 sending to next pipeline
2026-03-26 18:32:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8c4341c2-2e1a-5e98-ba1a-84bd67e38006, identifier: 1985770
2026-03-26 18:32:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28207ad0>
2026-03-26 18:32:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da5362f5-b1dc-5810-a1fd-465f0478a5f2/da5362f5-b1dc-5810-a1fd-465f0478a5f2_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F508%252F24f63f0b70094265aa62e58ef0e43668%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/508/24f63f0b70094265aa62e58ef0e43668/images/large/1.jpg saved to cache
2026-03-26 18:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item da5362f5-b1dc-5810-a1fd-465f0478a5f2
2026-03-26 18:32:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: da5362f5-b1dc-5810-a1fd-465f0478a5f2, skipping ID generation
2026-03-26 18:32:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da5362f5-b1dc-5810-a1fd-465f0478a5f2 with scrape type 1
2026-03-26 18:32:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item da5362f5-b1dc-5810-a1fd-465f0478a5f2 sending to next pipeline
2026-03-26 18:32:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: da5362f5-b1dc-5810-a1fd-465f0478a5f2, identifier: 1985772
2026-03-26 18:32:52 [ayvens.es] INFO: Found listing with ID: 1985780
2026-03-26 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985780%27 HTTP/1.1" 200 None
2026-03-26 18:32:52 [ayvens.es] INFO: Scrape type for 1985780: 1
2026-03-26 18:32:52 [ayvens.es] INFO: Extracting data for car ID: 1985780
2026-03-26 18:32:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 222fa702-c2d3-5956-9d13-5d144434ecda with identifier: 1985780
2026-03-26 18:32:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 222fa702-c2d3-5956-9d13-5d144434ecda with scrape type 1
2026-03-26 18:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 222fa702-c2d3-5956-9d13-5d144434ecda
2026-03-26 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F988%252F5245684a6d1b41718c9150aea0f5e20d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/988/5245684a6d1b41718c9150aea0f5e20d/images/large/1.jpg not downloaded yet
2026-03-26 18:32:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1fbcf7fe-5a44-5f35-aa62-d22b84495efc with identifier: 1985769
2026-03-26 18:32:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1fbcf7fe-5a44-5f35-aa62-d22b84495efc with identifier: 1985769
2026-03-26 18:32:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1fbcf7fe-5a44-5f35-aa62-d22b84495efc with identifier: 1985769 to the API
2026-03-26 18:32:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/467/5850dda4846249c48a58dc502669f4cd/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Gris artense',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '1fbcf7fe-5a44-5f35-aa62-d22b84495efc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508',
 'odometer': 126232,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fbcf7fe-5a44-5f35-aa62-d22b84495efc/1fbcf7fe-5a44-5f35-aa62-d22b84495efc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 326874,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/467/5850dda4846249c48a58dc502669f4cd/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 5P Active Pack BlueHDi 130 S&S EAT8',
 'transmission': 'manual',
 'trim': '5P Active Pack BlueHDi 130 S&S EAT8',
 'vin': None,
 'year': 2022}
2026-03-26 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985769%27 HTTP/1.1" 200 None
2026-03-26 18:32:52 [ayvens.es] INFO: Saving data for 1985769: {'created_time': 1774549972.327244, 'last_price_update_time': 1774549972.327255, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985769') HTTP/1.1" 204 0
2026-03-26 18:32:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8c4341c2-2e1a-5e98-ba1a-84bd67e38006 with identifier: 1985770
2026-03-26 18:32:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8c4341c2-2e1a-5e98-ba1a-84bd67e38006 with identifier: 1985770
2026-03-26 18:32:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8c4341c2-2e1a-5e98-ba1a-84bd67e38006 with identifier: 1985770 to the API
2026-03-26 18:32:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/945/48f7a88b16fa4e67ac0728db11839343/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '8c4341c2-2e1a-5e98-ba1a-84bd67e38006',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': 156682,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c4341c2-2e1a-5e98-ba1a-84bd67e38006/8c4341c2-2e1a-5e98-ba1a-84bd67e38006_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 343633,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/945/48f7a88b16fa4e67ac0728db11839343/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FOCUS 1.5 Ecoblue 70kW Trend+',
 'transmission': 'manual',
 'trim': '1.5 Ecoblue 70kW Trend+',
 'vin': None,
 'year': 2022}
2026-03-26 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985770%27 HTTP/1.1" 200 None
2026-03-26 18:32:52 [ayvens.es] INFO: Saving data for 1985770: {'created_time': 1774549972.70011, 'last_price_update_time': 1774549972.70012, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985770') HTTP/1.1" 204 0
2026-03-26 18:32:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: da5362f5-b1dc-5810-a1fd-465f0478a5f2 with identifier: 1985772
2026-03-26 18:32:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: da5362f5-b1dc-5810-a1fd-465f0478a5f2 with identifier: 1985772
2026-03-26 18:32:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: da5362f5-b1dc-5810-a1fd-465f0478a5f2 with identifier: 1985772 to the API
2026-03-26 18:32:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/508/24f63f0b70094265aa62e58ef0e43668/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 189,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'da5362f5-b1dc-5810-a1fd-465f0478a5f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT CUSTOM',
 'odometer': 94893,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da5362f5-b1dc-5810-a1fd-465f0478a5f2/da5362f5-b1dc-5810-a1fd-465f0478a5f2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324080,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/508/24f63f0b70094265aa62e58ef0e43668/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-23',
 'seats_number': 9,
 'seller_name': None,
 'title': 'FORD TRANSIT CUSTOM Kombi 2.0 TDCI 96kW 320 L2 Trend MHEV',
 'transmission': 'manual',
 'trim': 'Kombi 2.0 TDCI 96kW 320 L2 Trend MHEV',
 'vin': None,
 'year': 2021}
2026-03-26 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985772%27 HTTP/1.1" 200 None
2026-03-26 18:32:52 [ayvens.es] INFO: Saving data for 1985772: {'created_time': 1774549972.980436, 'last_price_update_time': 1774549972.980447, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985772') HTTP/1.1" 204 0
2026-03-26 18:32:53 [ayvens.es] INFO: Found listing with ID: 1985781
2026-03-26 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985781%27 HTTP/1.1" 200 None
2026-03-26 18:32:53 [ayvens.es] INFO: Scrape type for 1985781: 1
2026-03-26 18:32:53 [ayvens.es] INFO: Extracting data for car ID: 1985781
2026-03-26 18:32:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5d99c84-9efd-5ba8-a303-6c49417c22b0 with identifier: 1985781
2026-03-26 18:32:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5d99c84-9efd-5ba8-a303-6c49417c22b0 with scrape type 1
2026-03-26 18:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f5d99c84-9efd-5ba8-a303-6c49417c22b0
2026-03-26 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F051%252Fc3489d9ce2654593a570c613a5e53bb6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/051/c3489d9ce2654593a570c613a5e53bb6/images/large/1.jpg not downloaded yet
2026-03-26 18:32:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a2c29ef50>
2026-03-26 18:32:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9339bc13-72d4-5241-80f5-c5bb59349414/9339bc13-72d4-5241-80f5-c5bb59349414_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F958%252Fea1e9436a68a44509d17c093aabbf55b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/958/ea1e9436a68a44509d17c093aabbf55b/images/large/1.jpg saved to cache
2026-03-26 18:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9339bc13-72d4-5241-80f5-c5bb59349414
2026-03-26 18:32:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9339bc13-72d4-5241-80f5-c5bb59349414, skipping ID generation
2026-03-26 18:32:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9339bc13-72d4-5241-80f5-c5bb59349414 with scrape type 1
2026-03-26 18:32:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9339bc13-72d4-5241-80f5-c5bb59349414 sending to next pipeline
2026-03-26 18:32:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9339bc13-72d4-5241-80f5-c5bb59349414, identifier: 1985771
2026-03-26 18:32:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c5d350>
2026-03-26 18:32:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae8c1a1b-e30e-5fc4-9a6f-6a4b5b774197/ae8c1a1b-e30e-5fc4-9a6f-6a4b5b774197_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F341%252F8b9bfcd739014d96af629783116dbbb0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/341/8b9bfcd739014d96af629783116dbbb0/images/large/1.jpg saved to cache
2026-03-26 18:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ae8c1a1b-e30e-5fc4-9a6f-6a4b5b774197
2026-03-26 18:32:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ae8c1a1b-e30e-5fc4-9a6f-6a4b5b774197, skipping ID generation
2026-03-26 18:32:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae8c1a1b-e30e-5fc4-9a6f-6a4b5b774197 with scrape type 1
2026-03-26 18:32:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ae8c1a1b-e30e-5fc4-9a6f-6a4b5b774197 sending to next pipeline
2026-03-26 18:32:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ae8c1a1b-e30e-5fc4-9a6f-6a4b5b774197, identifier: 1985773
2026-03-26 18:32:53 [ayvens.es] INFO: Found listing with ID: 1985782
2026-03-26 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985782%27 HTTP/1.1" 200 None
2026-03-26 18:32:53 [ayvens.es] INFO: Scrape type for 1985782: 1
2026-03-26 18:32:53 [ayvens.es] INFO: Extracting data for car ID: 1985782
2026-03-26 18:32:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9474930d-4411-52c9-92e4-cc9cb2f23a02 with identifier: 1985782
2026-03-26 18:32:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9474930d-4411-52c9-92e4-cc9cb2f23a02 with scrape type 1
2026-03-26 18:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9474930d-4411-52c9-92e4-cc9cb2f23a02
2026-03-26 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F678%252F882892650b024bc4a72d2b46a8084f47%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/678/882892650b024bc4a72d2b46a8084f47/images/large/1.jpg not downloaded yet
2026-03-26 18:32:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9339bc13-72d4-5241-80f5-c5bb59349414 with identifier: 1985771
2026-03-26 18:32:53 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:32:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9339bc13-72d4-5241-80f5-c5bb59349414 with identifier: 1985771
2026-03-26 18:32:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9339bc13-72d4-5241-80f5-c5bb59349414 with identifier: 1985771 to the API
2026-03-26 18:32:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/958/ea1e9436a68a44509d17c093aabbf55b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 92,
 'color': 'Negro perla nera',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '9339bc13-72d4-5241-80f5-c5bb59349414',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508',
 'odometer': 113569,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9339bc13-72d4-5241-80f5-c5bb59349414/9339bc13-72d4-5241-80f5-c5bb59349414_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 543771,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/958/ea1e9436a68a44509d17c093aabbf55b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 5P Business Line BlueHDi 96kW S&S EAT8',
 'transmission': 'manual',
 'trim': '5P Business Line BlueHDi 96kW S&S EAT8',
 'vin': None,
 'year': 2020}
2026-03-26 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985771%27 HTTP/1.1" 200 None
2026-03-26 18:32:53 [ayvens.es] INFO: Saving data for 1985771: {'created_time': 1774549973.764788, 'last_price_update_time': 1774549973.764797, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985771') HTTP/1.1" 204 0
2026-03-26 18:32:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ae8c1a1b-e30e-5fc4-9a6f-6a4b5b774197 with identifier: 1985773
2026-03-26 18:32:53 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:32:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ae8c1a1b-e30e-5fc4-9a6f-6a4b5b774197 with identifier: 1985773
2026-03-26 18:32:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ae8c1a1b-e30e-5fc4-9a6f-6a4b5b774197 with identifier: 1985773 to the API
2026-03-26 18:32:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/341/8b9bfcd739014d96af629783116dbbb0/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Negro noche',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ae8c1a1b-e30e-5fc4-9a6f-6a4b5b774197',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLB',
 'odometer': 115969,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae8c1a1b-e30e-5fc4-9a6f-6a4b5b774197/ae8c1a1b-e30e-5fc4-9a6f-6a4b5b774197_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 335537,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/341/8b9bfcd739014d96af629783116dbbb0/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLB 2.0 GLB 200 D DCT 110KW (150CV)',
 'transmission': 'manual',
 'trim': '2.0 GLB 200 D DCT 110KW (150CV)',
 'vin': None,
 'year': 2021}
2026-03-26 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985773%27 HTTP/1.1" 200 None
2026-03-26 18:32:54 [ayvens.es] INFO: Saving data for 1985773: {'created_time': 1774549974.077083, 'last_price_update_time': 1774549974.077094, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985773') HTTP/1.1" 204 0
2026-03-26 18:32:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/636/b0dd442d6c7e406fb2619dc05687a3f8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/544/31475f8719f24a18919c51cbc82c5834/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/694/8016db208a8940be9189548595d87d03/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/098/d66caf8dd5604b2aa0f75de88419c7d8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:54 [ayvens.es] INFO: Found listing with ID: 1985783
2026-03-26 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985783%27 HTTP/1.1" 200 None
2026-03-26 18:32:54 [ayvens.es] INFO: Scrape type for 1985783: 1
2026-03-26 18:32:54 [ayvens.es] INFO: Extracting data for car ID: 1985783
2026-03-26 18:32:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70725f9e-f17f-57e3-938c-9fe3bdf89fcf with identifier: 1985783
2026-03-26 18:32:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70725f9e-f17f-57e3-938c-9fe3bdf89fcf with scrape type 1
2026-03-26 18:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 70725f9e-f17f-57e3-938c-9fe3bdf89fcf
2026-03-26 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F678%252F9a14d896edc14307a444a36a9337eb62%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/678/9a14d896edc14307a444a36a9337eb62/images/large/1.jpg not downloaded yet
2026-03-26 18:32:54 [ayvens.es] INFO: Found listing with ID: 1985784
2026-03-26 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985784%27 HTTP/1.1" 200 None
2026-03-26 18:32:54 [ayvens.es] INFO: Scrape type for 1985784: 1
2026-03-26 18:32:54 [ayvens.es] INFO: Extracting data for car ID: 1985784
2026-03-26 18:32:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ce5c45f-23da-5b58-993b-69f91e604441 with identifier: 1985784
2026-03-26 18:32:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ce5c45f-23da-5b58-993b-69f91e604441 with scrape type 1
2026-03-26 18:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8ce5c45f-23da-5b58-993b-69f91e604441
2026-03-26 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F309%252F505a86ea6e3c43a790158519f1be6a8b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/309/505a86ea6e3c43a790158519f1be6a8b/images/large/1.jpg not downloaded yet
2026-03-26 18:32:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/149/d44e208098254f37904dc35740ef7c7a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/775/af5145a8cbc54efa96758a3720f3b97c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:54 [ayvens.es] INFO: Found listing with ID: 1985785
2026-03-26 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985785%27 HTTP/1.1" 200 None
2026-03-26 18:32:54 [ayvens.es] INFO: Scrape type for 1985785: 1
2026-03-26 18:32:54 [ayvens.es] INFO: Extracting data for car ID: 1985785
2026-03-26 18:32:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5472cdc-285d-58c9-a5af-7b69c86cc28e with identifier: 1985785
2026-03-26 18:32:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5472cdc-285d-58c9-a5af-7b69c86cc28e with scrape type 1
2026-03-26 18:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b5472cdc-285d-58c9-a5af-7b69c86cc28e
2026-03-26 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F920%252F4e9142ec7e354a83aff1f990682a2f3c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/920/4e9142ec7e354a83aff1f990682a2f3c/images/large/1.jpg not downloaded yet
2026-03-26 18:32:54 [ayvens.es] INFO: Found listing with ID: 1985786
2026-03-26 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985786%27 HTTP/1.1" 200 None
2026-03-26 18:32:54 [ayvens.es] INFO: Scrape type for 1985786: 1
2026-03-26 18:32:54 [ayvens.es] INFO: Extracting data for car ID: 1985786
2026-03-26 18:32:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 528e1d74-c7ba-5920-8197-480bab531ed6 with identifier: 1985786
2026-03-26 18:32:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 528e1d74-c7ba-5920-8197-480bab531ed6 with scrape type 1
2026-03-26 18:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 528e1d74-c7ba-5920-8197-480bab531ed6
2026-03-26 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F213%252Fd599e9ae79054f14a26212d4f160e62c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/213/d599e9ae79054f14a26212d4f160e62c/images/large/1.jpg not downloaded yet
2026-03-26 18:32:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28230190>
2026-03-26 18:32:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3c53af9-e451-521d-90e1-fba718bc3d46/f3c53af9-e451-521d-90e1-fba718bc3d46_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F636%252Fb0dd442d6c7e406fb2619dc05687a3f8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/636/b0dd442d6c7e406fb2619dc05687a3f8/images/large/1.jpg saved to cache
2026-03-26 18:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f3c53af9-e451-521d-90e1-fba718bc3d46
2026-03-26 18:32:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f3c53af9-e451-521d-90e1-fba718bc3d46, skipping ID generation
2026-03-26 18:32:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3c53af9-e451-521d-90e1-fba718bc3d46 with scrape type 1
2026-03-26 18:32:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f3c53af9-e451-521d-90e1-fba718bc3d46 sending to next pipeline
2026-03-26 18:32:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f3c53af9-e451-521d-90e1-fba718bc3d46, identifier: 1985775
2026-03-26 18:32:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28ff50d0>
2026-03-26 18:32:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eb05101-3041-588c-a61f-5c4fcc3ffac2/2eb05101-3041-588c-a61f-5c4fcc3ffac2_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F544%252F31475f8719f24a18919c51cbc82c5834%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/544/31475f8719f24a18919c51cbc82c5834/images/large/1.jpg saved to cache
2026-03-26 18:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2eb05101-3041-588c-a61f-5c4fcc3ffac2
2026-03-26 18:32:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2eb05101-3041-588c-a61f-5c4fcc3ffac2, skipping ID generation
2026-03-26 18:32:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2eb05101-3041-588c-a61f-5c4fcc3ffac2 with scrape type 1
2026-03-26 18:32:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2eb05101-3041-588c-a61f-5c4fcc3ffac2 sending to next pipeline
2026-03-26 18:32:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2eb05101-3041-588c-a61f-5c4fcc3ffac2, identifier: 1985777
2026-03-26 18:32:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c37010>
2026-03-26 18:32:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd6f364c-938d-5205-a1ce-85dca10d5570/bd6f364c-938d-5205-a1ce-85dca10d5570_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F694%252F8016db208a8940be9189548595d87d03%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/694/8016db208a8940be9189548595d87d03/images/large/1.jpg saved to cache
2026-03-26 18:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bd6f364c-938d-5205-a1ce-85dca10d5570
2026-03-26 18:32:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bd6f364c-938d-5205-a1ce-85dca10d5570, skipping ID generation
2026-03-26 18:32:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd6f364c-938d-5205-a1ce-85dca10d5570 with scrape type 1
2026-03-26 18:32:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bd6f364c-938d-5205-a1ce-85dca10d5570 sending to next pipeline
2026-03-26 18:32:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: bd6f364c-938d-5205-a1ce-85dca10d5570, identifier: 1985774
2026-03-26 18:32:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c9d750>
2026-03-26 18:32:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8ff8c33-f4c8-521c-9afc-19359cdba6a2/e8ff8c33-f4c8-521c-9afc-19359cdba6a2_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F098%252Fd66caf8dd5604b2aa0f75de88419c7d8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/098/d66caf8dd5604b2aa0f75de88419c7d8/images/large/1.jpg saved to cache
2026-03-26 18:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e8ff8c33-f4c8-521c-9afc-19359cdba6a2
2026-03-26 18:32:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e8ff8c33-f4c8-521c-9afc-19359cdba6a2, skipping ID generation
2026-03-26 18:32:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8ff8c33-f4c8-521c-9afc-19359cdba6a2 with scrape type 1
2026-03-26 18:32:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e8ff8c33-f4c8-521c-9afc-19359cdba6a2 sending to next pipeline
2026-03-26 18:32:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e8ff8c33-f4c8-521c-9afc-19359cdba6a2, identifier: 1985776
2026-03-26 18:32:55 [ayvens.es] INFO: Found listing with ID: 1985787
2026-03-26 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985787%27 HTTP/1.1" 200 None
2026-03-26 18:32:55 [ayvens.es] INFO: Scrape type for 1985787: 1
2026-03-26 18:32:55 [ayvens.es] INFO: Extracting data for car ID: 1985787
2026-03-26 18:32:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08780c20-ae7c-543d-a7a9-25261804ba87 with identifier: 1985787
2026-03-26 18:32:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08780c20-ae7c-543d-a7a9-25261804ba87 with scrape type 1
2026-03-26 18:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 08780c20-ae7c-543d-a7a9-25261804ba87
2026-03-26 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F359%252F985c0ed034ad486baac9066d40a39c66%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/359/985c0ed034ad486baac9066d40a39c66/images/large/1.jpg not downloaded yet
2026-03-26 18:32:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f3c53af9-e451-521d-90e1-fba718bc3d46 with identifier: 1985775
2026-03-26 18:32:55 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:32:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f3c53af9-e451-521d-90e1-fba718bc3d46 with identifier: 1985775
2026-03-26 18:32:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f3c53af9-e451-521d-90e1-fba718bc3d46 with identifier: 1985775 to the API
2026-03-26 18:32:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/636/b0dd442d6c7e406fb2619dc05687a3f8/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'Metalizado',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.2L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'f3c53af9-e451-521d-90e1-fba718bc3d46',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': '500',
 'odometer': 47473,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3c53af9-e451-521d-90e1-fba718bc3d46/f3c53af9-e451-521d-90e1-fba718bc3d46_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 565586,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/636/b0dd442d6c7e406fb2619dc05687a3f8/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-18',
 'seats_number': 4,
 'seller_name': None,
 'title': 'FIAT 500 Lounge 1.2 8v 51KW (69 CV)',
 'transmission': 'manual',
 'trim': 'Lounge 1.2 8v 51KW (69 CV)',
 'vin': None,
 'year': 2019}
2026-03-26 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985775%27 HTTP/1.1" 200 None
2026-03-26 18:32:55 [ayvens.es] INFO: Saving data for 1985775: {'created_time': 1774549975.487153, 'last_price_update_time': 1774549975.487163, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985775') HTTP/1.1" 204 0
2026-03-26 18:32:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2eb05101-3041-588c-a61f-5c4fcc3ffac2 with identifier: 1985777
2026-03-26 18:32:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2eb05101-3041-588c-a61f-5c4fcc3ffac2 with identifier: 1985777
2026-03-26 18:32:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 2eb05101-3041-588c-a61f-5c4fcc3ffac2 with identifier: 1985777 to the API
2026-03-26 18:32:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/544/31475f8719f24a18919c51cbc82c5834/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'color': 'Blanco banquise',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '2eb05101-3041-588c-a61f-5c4fcc3ffac2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS 3 CROSSBACK',
 'odometer': 59017,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2eb05101-3041-588c-a61f-5c4fcc3ffac2/2eb05101-3041-588c-a61f-5c4fcc3ffac2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324860,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/544/31475f8719f24a18919c51cbc82c5834/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS 3 CROSSBACK PureTech 73 kW Manual PERFORMANCE '
          'LINE',
 'transmission': 'manual',
 'trim': 'PureTech 73 kW Manual PERFORMANCE LINE',
 'vin': None,
 'year': 2021}
2026-03-26 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985777%27 HTTP/1.1" 200 None
2026-03-26 18:32:55 [ayvens.es] INFO: Saving data for 1985777: {'created_time': 1774549975.757826, 'last_price_update_time': 1774549975.75784, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985777') HTTP/1.1" 204 0
2026-03-26 18:32:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: bd6f364c-938d-5205-a1ce-85dca10d5570 with identifier: 1985774
2026-03-26 18:32:55 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:32:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: bd6f364c-938d-5205-a1ce-85dca10d5570 with identifier: 1985774
2026-03-26 18:32:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: bd6f364c-938d-5205-a1ce-85dca10d5570 with identifier: 1985774 to the API
2026-03-26 18:32:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/694/8016db208a8940be9189548595d87d03/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 91,
 'color': 'Blanco banquise',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'bd6f364c-938d-5205-a1ce-85dca10d5570',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '308',
 'odometer': 138444,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd6f364c-938d-5205-a1ce-85dca10d5570/bd6f364c-938d-5205-a1ce-85dca10d5570_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 634509,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/694/8016db208a8940be9189548595d87d03/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 308 5P Allure Pack BlueHDi 100 S&S',
 'transmission': 'manual',
 'trim': '5P Allure Pack BlueHDi 100 S&S',
 'vin': None,
 'year': 2020}
2026-03-26 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985774%27 HTTP/1.1" 200 None
2026-03-26 18:32:56 [ayvens.es] INFO: Saving data for 1985774: {'created_time': 1774549976.071909, 'last_price_update_time': 1774549976.071928, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985774') HTTP/1.1" 204 0
2026-03-26 18:32:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e8ff8c33-f4c8-521c-9afc-19359cdba6a2 with identifier: 1985776
2026-03-26 18:32:56 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:32:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e8ff8c33-f4c8-521c-9afc-19359cdba6a2 with identifier: 1985776
2026-03-26 18:32:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e8ff8c33-f4c8-521c-9afc-19359cdba6a2 with identifier: 1985776 to the API
2026-03-26 18:32:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/098/d66caf8dd5604b2aa0f75de88419c7d8/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'color': 'Cassa white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e8ff8c33-f4c8-521c-9afc-19359cdba6a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'SPORTAGE',
 'odometer': 151099,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8ff8c33-f4c8-521c-9afc-19359cdba6a2/e8ff8c33-f4c8-521c-9afc-19359cdba6a2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 365460,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/098/d66caf8dd5604b2aa0f75de88419c7d8/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA SPORTAGE 1.6 MHEV Concept 100kW (136CV) 4x2',
 'transmission': 'manual',
 'trim': '1.6 MHEV Concept 100kW (136CV) 4x2',
 'vin': None,
 'year': 2019}
2026-03-26 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985776%27 HTTP/1.1" 200 None
2026-03-26 18:32:56 [ayvens.es] INFO: Saving data for 1985776: {'created_time': 1774549976.362629, 'last_price_update_time': 1774549976.36264, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985776') HTTP/1.1" 204 0
2026-03-26 18:32:56 [ayvens.es] INFO: Found listing with ID: 1985788
2026-03-26 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985788%27 HTTP/1.1" 200 None
2026-03-26 18:32:56 [ayvens.es] INFO: Scrape type for 1985788: 1
2026-03-26 18:32:56 [ayvens.es] INFO: Extracting data for car ID: 1985788
2026-03-26 18:32:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f761e944-84ae-5775-925d-c7ec364b2490 with identifier: 1985788
2026-03-26 18:32:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f761e944-84ae-5775-925d-c7ec364b2490 with scrape type 1
2026-03-26 18:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f761e944-84ae-5775-925d-c7ec364b2490
2026-03-26 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F562%252F5e8de1e6430340b9b7d10ec6ed68de28%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/562/5e8de1e6430340b9b7d10ec6ed68de28/images/large/1.jpg not downloaded yet
2026-03-26 18:32:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28ab9d90>
2026-03-26 18:32:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47077259-02f4-58a4-9b0b-eba77446baad/47077259-02f4-58a4-9b0b-eba77446baad_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F149%252Fd44e208098254f37904dc35740ef7c7a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/149/d44e208098254f37904dc35740ef7c7a/images/large/1.jpg saved to cache
2026-03-26 18:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 47077259-02f4-58a4-9b0b-eba77446baad
2026-03-26 18:32:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 47077259-02f4-58a4-9b0b-eba77446baad, skipping ID generation
2026-03-26 18:32:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47077259-02f4-58a4-9b0b-eba77446baad with scrape type 1
2026-03-26 18:32:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 47077259-02f4-58a4-9b0b-eba77446baad sending to next pipeline
2026-03-26 18:32:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 47077259-02f4-58a4-9b0b-eba77446baad, identifier: 1985779
2026-03-26 18:32:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a283b87d0>
2026-03-26 18:32:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9085b26-80db-51a1-8b68-f3d2a6e0105e/a9085b26-80db-51a1-8b68-f3d2a6e0105e_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F775%252Faf5145a8cbc54efa96758a3720f3b97c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/775/af5145a8cbc54efa96758a3720f3b97c/images/large/1.jpg saved to cache
2026-03-26 18:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a9085b26-80db-51a1-8b68-f3d2a6e0105e
2026-03-26 18:32:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a9085b26-80db-51a1-8b68-f3d2a6e0105e, skipping ID generation
2026-03-26 18:32:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9085b26-80db-51a1-8b68-f3d2a6e0105e with scrape type 1
2026-03-26 18:32:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a9085b26-80db-51a1-8b68-f3d2a6e0105e sending to next pipeline
2026-03-26 18:32:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a9085b26-80db-51a1-8b68-f3d2a6e0105e, identifier: 1985778
2026-03-26 18:32:56 [ayvens.es] INFO: Found listing with ID: 1985789
2026-03-26 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985789%27 HTTP/1.1" 200 None
2026-03-26 18:32:56 [ayvens.es] INFO: Scrape type for 1985789: 1
2026-03-26 18:32:56 [ayvens.es] INFO: Extracting data for car ID: 1985789
2026-03-26 18:32:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ffb433b-ddae-5e80-ba1e-ad2b615d15be with identifier: 1985789
2026-03-26 18:32:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ffb433b-ddae-5e80-ba1e-ad2b615d15be with scrape type 1
2026-03-26 18:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3ffb433b-ddae-5e80-ba1e-ad2b615d15be
2026-03-26 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F237%252F1c81af479e9a4655acf29b166e9059de%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/237/1c81af479e9a4655acf29b166e9059de/images/large/1.jpg not downloaded yet
2026-03-26 18:32:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 47077259-02f4-58a4-9b0b-eba77446baad with identifier: 1985779
2026-03-26 18:32:56 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:32:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 47077259-02f4-58a4-9b0b-eba77446baad with identifier: 1985779
2026-03-26 18:32:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 47077259-02f4-58a4-9b0b-eba77446baad with identifier: 1985779 to the API
2026-03-26 18:32:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/149/d44e208098254f37904dc35740ef7c7a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 100,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '47077259-02f4-58a4-9b0b-eba77446baad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 152506,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47077259-02f4-58a4-9b0b-eba77446baad/47077259-02f4-58a4-9b0b-eba77446baad_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 365738,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/149/d44e208098254f37904dc35740ef7c7a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI dCi 85 kW (115 CV) E6D ACENTA',
 'transmission': 'manual',
 'trim': 'dCi 85 kW (115 CV) E6D ACENTA',
 'vin': None,
 'year': 2020}
2026-03-26 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985779%27 HTTP/1.1" 200 None
2026-03-26 18:32:57 [ayvens.es] INFO: Saving data for 1985779: {'created_time': 1774549977.139478, 'last_price_update_time': 1774549977.139489, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985779') HTTP/1.1" 204 0
2026-03-26 18:32:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a9085b26-80db-51a1-8b68-f3d2a6e0105e with identifier: 1985778
2026-03-26 18:32:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a9085b26-80db-51a1-8b68-f3d2a6e0105e with identifier: 1985778
2026-03-26 18:32:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a9085b26-80db-51a1-8b68-f3d2a6e0105e with identifier: 1985778 to the API
2026-03-26 18:32:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/775/af5145a8cbc54efa96758a3720f3b97c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Gris acero',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'a9085b26-80db-51a1-8b68-f3d2a6e0105e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C3',
 'odometer': 160049,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9085b26-80db-51a1-8b68-f3d2a6e0105e/a9085b26-80db-51a1-8b68-f3d2a6e0105e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329532,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/775/af5145a8cbc54efa96758a3720f3b97c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C3 PureTech 60KW (83CV) Feel',
 'transmission': 'manual',
 'trim': 'PureTech 60KW (83CV) Feel',
 'vin': None,
 'year': 2022}
2026-03-26 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985778%27 HTTP/1.1" 200 None
2026-03-26 18:32:57 [ayvens.es] INFO: Saving data for 1985778: {'created_time': 1774549977.573863, 'last_price_update_time': 1774549977.573873, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985778') HTTP/1.1" 204 0
2026-03-26 18:32:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/988/5245684a6d1b41718c9150aea0f5e20d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/309/505a86ea6e3c43a790158519f1be6a8b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:57 [ayvens.es] INFO: Found listing with ID: 1985790
2026-03-26 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985790%27 HTTP/1.1" 200 None
2026-03-26 18:32:57 [ayvens.es] INFO: Scrape type for 1985790: 1
2026-03-26 18:32:57 [ayvens.es] INFO: Extracting data for car ID: 1985790
2026-03-26 18:32:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed2b79bf-5f95-55e2-9903-b8cc3dd40ac3 with identifier: 1985790
2026-03-26 18:32:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed2b79bf-5f95-55e2-9903-b8cc3dd40ac3 with scrape type 1
2026-03-26 18:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ed2b79bf-5f95-55e2-9903-b8cc3dd40ac3
2026-03-26 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F080%252F5a9fe22342a44756a8ebd7a5f57408d0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/080/5a9fe22342a44756a8ebd7a5f57408d0/images/large/1.jpg not downloaded yet
2026-03-26 18:32:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/920/4e9142ec7e354a83aff1f990682a2f3c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:57 [ayvens.es] INFO: Found listing with ID: 1985791
2026-03-26 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985791%27 HTTP/1.1" 200 None
2026-03-26 18:32:57 [ayvens.es] INFO: Scrape type for 1985791: 1
2026-03-26 18:32:57 [ayvens.es] INFO: Extracting data for car ID: 1985791
2026-03-26 18:32:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6cf8bfb5-ee25-54e4-948d-c3145f30825b with identifier: 1985791
2026-03-26 18:32:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cf8bfb5-ee25-54e4-948d-c3145f30825b with scrape type 1
2026-03-26 18:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6cf8bfb5-ee25-54e4-948d-c3145f30825b
2026-03-26 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F669%252Fd0af3fc1600b456b89c0ba101134381a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/669/d0af3fc1600b456b89c0ba101134381a/images/large/1.jpg not downloaded yet
2026-03-26 18:32:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/051/c3489d9ce2654593a570c613a5e53bb6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/678/9a14d896edc14307a444a36a9337eb62/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/678/882892650b024bc4a72d2b46a8084f47/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:57 [ayvens.es] INFO: Found listing with ID: 1985792
2026-03-26 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985792%27 HTTP/1.1" 200 None
2026-03-26 18:32:57 [ayvens.es] INFO: Scrape type for 1985792: 1
2026-03-26 18:32:57 [ayvens.es] INFO: Extracting data for car ID: 1985792
2026-03-26 18:32:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac34e0a7-64d7-5ff1-9207-8138742d1e72 with identifier: 1985792
2026-03-26 18:32:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac34e0a7-64d7-5ff1-9207-8138742d1e72 with scrape type 1
2026-03-26 18:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ac34e0a7-64d7-5ff1-9207-8138742d1e72
2026-03-26 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F537%252F3203181f61274ed8b944a4a22c650a15%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/537/3203181f61274ed8b944a4a22c650a15/images/large/1.jpg not downloaded yet
2026-03-26 18:32:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/213/d599e9ae79054f14a26212d4f160e62c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/359/985c0ed034ad486baac9066d40a39c66/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:32:57 [ayvens.es] INFO: Found listing with ID: 1985793
2026-03-26 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985793%27 HTTP/1.1" 200 None
2026-03-26 18:32:57 [ayvens.es] INFO: Scrape type for 1985793: 1
2026-03-26 18:32:57 [ayvens.es] INFO: Extracting data for car ID: 1985793
2026-03-26 18:32:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c19bb6e5-8203-5545-b49d-4b8dfc0a664c with identifier: 1985793
2026-03-26 18:32:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c19bb6e5-8203-5545-b49d-4b8dfc0a664c with scrape type 1
2026-03-26 18:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c19bb6e5-8203-5545-b49d-4b8dfc0a664c
2026-03-26 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F880%252F7521a83feaac4d0eaf32a305471d44b8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/880/7521a83feaac4d0eaf32a305471d44b8/images/large/1.jpg not downloaded yet
2026-03-26 18:32:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28ab8850>
2026-03-26 18:32:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_222fa702-c2d3-5956-9d13-5d144434ecda/222fa702-c2d3-5956-9d13-5d144434ecda_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F988%252F5245684a6d1b41718c9150aea0f5e20d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/988/5245684a6d1b41718c9150aea0f5e20d/images/large/1.jpg saved to cache
2026-03-26 18:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 222fa702-c2d3-5956-9d13-5d144434ecda
2026-03-26 18:32:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 222fa702-c2d3-5956-9d13-5d144434ecda, skipping ID generation
2026-03-26 18:32:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 222fa702-c2d3-5956-9d13-5d144434ecda with scrape type 1
2026-03-26 18:32:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 222fa702-c2d3-5956-9d13-5d144434ecda sending to next pipeline
2026-03-26 18:32:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 222fa702-c2d3-5956-9d13-5d144434ecda, identifier: 1985780
2026-03-26 18:32:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c30e50>
2026-03-26 18:32:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ce5c45f-23da-5b58-993b-69f91e604441/8ce5c45f-23da-5b58-993b-69f91e604441_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F309%252F505a86ea6e3c43a790158519f1be6a8b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/309/505a86ea6e3c43a790158519f1be6a8b/images/large/1.jpg saved to cache
2026-03-26 18:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8ce5c45f-23da-5b58-993b-69f91e604441
2026-03-26 18:32:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8ce5c45f-23da-5b58-993b-69f91e604441, skipping ID generation
2026-03-26 18:32:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ce5c45f-23da-5b58-993b-69f91e604441 with scrape type 1
2026-03-26 18:32:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8ce5c45f-23da-5b58-993b-69f91e604441 sending to next pipeline
2026-03-26 18:32:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8ce5c45f-23da-5b58-993b-69f91e604441, identifier: 1985784
2026-03-26 18:32:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28d1efd0>
2026-03-26 18:32:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5472cdc-285d-58c9-a5af-7b69c86cc28e/b5472cdc-285d-58c9-a5af-7b69c86cc28e_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F920%252F4e9142ec7e354a83aff1f990682a2f3c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/920/4e9142ec7e354a83aff1f990682a2f3c/images/large/1.jpg saved to cache
2026-03-26 18:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b5472cdc-285d-58c9-a5af-7b69c86cc28e
2026-03-26 18:32:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b5472cdc-285d-58c9-a5af-7b69c86cc28e, skipping ID generation
2026-03-26 18:32:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5472cdc-285d-58c9-a5af-7b69c86cc28e with scrape type 1
2026-03-26 18:32:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b5472cdc-285d-58c9-a5af-7b69c86cc28e sending to next pipeline
2026-03-26 18:32:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b5472cdc-285d-58c9-a5af-7b69c86cc28e, identifier: 1985785
2026-03-26 18:32:58 [ayvens.es] INFO: Found listing with ID: 1985794
2026-03-26 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985794%27 HTTP/1.1" 200 None
2026-03-26 18:32:58 [ayvens.es] INFO: Scrape type for 1985794: 1
2026-03-26 18:32:58 [ayvens.es] INFO: Extracting data for car ID: 1985794
2026-03-26 18:32:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7aac329-81ed-55bc-8d26-54b4905f5cd6 with identifier: 1985794
2026-03-26 18:32:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7aac329-81ed-55bc-8d26-54b4905f5cd6 with scrape type 1
2026-03-26 18:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c7aac329-81ed-55bc-8d26-54b4905f5cd6
2026-03-26 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F238%252Fb47948b8c6e64d82a64e7e66c040e963%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/238/b47948b8c6e64d82a64e7e66c040e963/images/large/1.jpg not downloaded yet
2026-03-26 18:32:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 222fa702-c2d3-5956-9d13-5d144434ecda with identifier: 1985780
2026-03-26 18:32:58 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:32:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 222fa702-c2d3-5956-9d13-5d144434ecda with identifier: 1985780
2026-03-26 18:32:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 222fa702-c2d3-5956-9d13-5d144434ecda with identifier: 1985780 to the API
2026-03-26 18:32:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/988/5245684a6d1b41718c9150aea0f5e20d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Rojo elixir',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '222fa702-c2d3-5956-9d13-5d144434ecda',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508',
 'odometer': 74134,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_222fa702-c2d3-5956-9d13-5d144434ecda/222fa702-c2d3-5956-9d13-5d144434ecda_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 362504,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/988/5245684a6d1b41718c9150aea0f5e20d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 5P Allure Pack BlueHDi 130 S&S EAT8',
 'transmission': 'manual',
 'trim': '5P Allure Pack BlueHDi 130 S&S EAT8',
 'vin': None,
 'year': 2022}
2026-03-26 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985780%27 HTTP/1.1" 200 None
2026-03-26 18:32:58 [ayvens.es] INFO: Saving data for 1985780: {'created_time': 1774549978.627188, 'last_price_update_time': 1774549978.627197, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985780') HTTP/1.1" 204 0
2026-03-26 18:32:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8ce5c45f-23da-5b58-993b-69f91e604441 with identifier: 1985784
2026-03-26 18:32:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8ce5c45f-23da-5b58-993b-69f91e604441 with identifier: 1985784
2026-03-26 18:32:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8ce5c45f-23da-5b58-993b-69f91e604441 with identifier: 1985784 to the API
2026-03-26 18:32:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/309/505a86ea6e3c43a790158519f1be6a8b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'Azul',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '8ce5c45f-23da-5b58-993b-69f91e604441',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508',
 'odometer': 203942,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ce5c45f-23da-5b58-993b-69f91e604441/8ce5c45f-23da-5b58-993b-69f91e604441_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 377996,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/309/505a86ea6e3c43a790158519f1be6a8b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 SW Allure Pack BlueHDi 130 S&S EAT8',
 'transmission': 'manual',
 'trim': 'SW Allure Pack BlueHDi 130 S&S EAT8',
 'vin': None,
 'year': 2022}
2026-03-26 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985784%27 HTTP/1.1" 200 None
2026-03-26 18:32:59 [ayvens.es] INFO: Saving data for 1985784: {'created_time': 1774549979.003449, 'last_price_update_time': 1774549979.003459, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985784') HTTP/1.1" 204 0
2026-03-26 18:32:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b5472cdc-285d-58c9-a5af-7b69c86cc28e with identifier: 1985785
2026-03-26 18:32:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b5472cdc-285d-58c9-a5af-7b69c86cc28e with identifier: 1985785
2026-03-26 18:32:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b5472cdc-285d-58c9-a5af-7b69c86cc28e with identifier: 1985785 to the API
2026-03-26 18:32:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:32:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:32:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/920/4e9142ec7e354a83aff1f990682a2f3c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'Blanco banquise',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b5472cdc-285d-58c9-a5af-7b69c86cc28e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 156747,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5472cdc-285d-58c9-a5af-7b69c86cc28e/b5472cdc-285d-58c9-a5af-7b69c86cc28e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 339240,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/920/4e9142ec7e354a83aff1f990682a2f3c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 Active Pack BlueHDI 81kW (110CV)',
 'transmission': 'manual',
 'trim': 'Active Pack BlueHDI 81kW (110CV)',
 'vin': None,
 'year': 2021}
2026-03-26 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985785%27 HTTP/1.1" 200 None
2026-03-26 18:32:59 [ayvens.es] INFO: Saving data for 1985785: {'created_time': 1774549979.293742, 'last_price_update_time': 1774549979.293752, 'auction_closing_time': 1774612800.0}
2026-03-26 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985785') HTTP/1.1" 204 0
2026-03-26 18:32:59 [ayvens.es] INFO: Found listing with ID: 1985795
2026-03-26 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985795%27 HTTP/1.1" 200 None
2026-03-26 18:32:59 [ayvens.es] INFO: Scrape type for 1985795: 1
2026-03-26 18:32:59 [ayvens.es] INFO: Extracting data for car ID: 1985795
2026-03-26 18:32:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6431f71-efc2-5671-b3e3-b0fc10cf47a5 with identifier: 1985795
2026-03-26 18:32:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6431f71-efc2-5671-b3e3-b0fc10cf47a5 with scrape type 1
2026-03-26 18:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a6431f71-efc2-5671-b3e3-b0fc10cf47a5
2026-03-26 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F857%252Fd7922874f4d549a08db7d7927365c4c7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/857/d7922874f4d549a08db7d7927365c4c7/images/large/1.jpg not downloaded yet
2026-03-26 18:32:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a2838ef90>
2026-03-26 18:32:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5d99c84-9efd-5ba8-a303-6c49417c22b0/f5d99c84-9efd-5ba8-a303-6c49417c22b0_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F051%252Fc3489d9ce2654593a570c613a5e53bb6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/051/c3489d9ce2654593a570c613a5e53bb6/images/large/1.jpg saved to cache
2026-03-26 18:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f5d99c84-9efd-5ba8-a303-6c49417c22b0
2026-03-26 18:32:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f5d99c84-9efd-5ba8-a303-6c49417c22b0, skipping ID generation
2026-03-26 18:32:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5d99c84-9efd-5ba8-a303-6c49417c22b0 with scrape type 1
2026-03-26 18:32:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f5d99c84-9efd-5ba8-a303-6c49417c22b0 sending to next pipeline
2026-03-26 18:32:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f5d99c84-9efd-5ba8-a303-6c49417c22b0, identifier: 1985781
2026-03-26 18:32:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a2838de10>
2026-03-26 18:32:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70725f9e-f17f-57e3-938c-9fe3bdf89fcf/70725f9e-f17f-57e3-938c-9fe3bdf89fcf_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F678%252F9a14d896edc14307a444a36a9337eb62%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/678/9a14d896edc14307a444a36a9337eb62/images/large/1.jpg saved to cache
2026-03-26 18:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 70725f9e-f17f-57e3-938c-9fe3bdf89fcf
2026-03-26 18:32:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 70725f9e-f17f-57e3-938c-9fe3bdf89fcf, skipping ID generation
2026-03-26 18:32:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70725f9e-f17f-57e3-938c-9fe3bdf89fcf with scrape type 1
2026-03-26 18:32:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 70725f9e-f17f-57e3-938c-9fe3bdf89fcf sending to next pipeline
2026-03-26 18:32:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 70725f9e-f17f-57e3-938c-9fe3bdf89fcf, identifier: 1985783
2026-03-26 18:32:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a3701cb90>
2026-03-26 18:32:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:32:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9474930d-4411-52c9-92e4-cc9cb2f23a02/9474930d-4411-52c9-92e4-cc9cb2f23a02_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F678%252F882892650b024bc4a72d2b46a8084f47%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/678/882892650b024bc4a72d2b46a8084f47/images/large/1.jpg saved to cache
2026-03-26 18:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9474930d-4411-52c9-92e4-cc9cb2f23a02
2026-03-26 18:32:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9474930d-4411-52c9-92e4-cc9cb2f23a02, skipping ID generation
2026-03-26 18:32:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9474930d-4411-52c9-92e4-cc9cb2f23a02 with scrape type 1
2026-03-26 18:32:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9474930d-4411-52c9-92e4-cc9cb2f23a02 sending to next pipeline
2026-03-26 18:32:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9474930d-4411-52c9-92e4-cc9cb2f23a02, identifier: 1985782
2026-03-26 18:32:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:32:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28e66fd0>
2026-03-26 18:32:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:32:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:32:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_528e1d74-c7ba-5920-8197-480bab531ed6/528e1d74-c7ba-5920-8197-480bab531ed6_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F213%252Fd599e9ae79054f14a26212d4f160e62c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/213/d599e9ae79054f14a26212d4f160e62c/images/large/1.jpg saved to cache
2026-03-26 18:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 528e1d74-c7ba-5920-8197-480bab531ed6
2026-03-26 18:33:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 528e1d74-c7ba-5920-8197-480bab531ed6, skipping ID generation
2026-03-26 18:33:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 528e1d74-c7ba-5920-8197-480bab531ed6 with scrape type 1
2026-03-26 18:33:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 528e1d74-c7ba-5920-8197-480bab531ed6 sending to next pipeline
2026-03-26 18:33:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 528e1d74-c7ba-5920-8197-480bab531ed6, identifier: 1985786
2026-03-26 18:33:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a284ef910>
2026-03-26 18:33:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08780c20-ae7c-543d-a7a9-25261804ba87/08780c20-ae7c-543d-a7a9-25261804ba87_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F359%252F985c0ed034ad486baac9066d40a39c66%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/359/985c0ed034ad486baac9066d40a39c66/images/large/1.jpg saved to cache
2026-03-26 18:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 08780c20-ae7c-543d-a7a9-25261804ba87
2026-03-26 18:33:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 08780c20-ae7c-543d-a7a9-25261804ba87, skipping ID generation
2026-03-26 18:33:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08780c20-ae7c-543d-a7a9-25261804ba87 with scrape type 1
2026-03-26 18:33:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 08780c20-ae7c-543d-a7a9-25261804ba87 sending to next pipeline
2026-03-26 18:33:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 08780c20-ae7c-543d-a7a9-25261804ba87, identifier: 1985787
2026-03-26 18:33:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/237/1c81af479e9a4655acf29b166e9059de/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:00 [ayvens.es] INFO: Found listing with ID: 1985796
2026-03-26 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985796%27 HTTP/1.1" 200 None
2026-03-26 18:33:00 [ayvens.es] INFO: Scrape type for 1985796: 1
2026-03-26 18:33:00 [ayvens.es] INFO: Extracting data for car ID: 1985796
2026-03-26 18:33:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da2b4e99-1d57-547d-b651-321b01a4896d with identifier: 1985796
2026-03-26 18:33:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da2b4e99-1d57-547d-b651-321b01a4896d with scrape type 1
2026-03-26 18:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item da2b4e99-1d57-547d-b651-321b01a4896d
2026-03-26 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F003%252F7815c09cf4a64054b88b32296aeff2f8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/003/7815c09cf4a64054b88b32296aeff2f8/images/large/1.jpg not downloaded yet
2026-03-26 18:33:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f5d99c84-9efd-5ba8-a303-6c49417c22b0 with identifier: 1985781
2026-03-26 18:33:00 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:33:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f5d99c84-9efd-5ba8-a303-6c49417c22b0 with identifier: 1985781
2026-03-26 18:33:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f5d99c84-9efd-5ba8-a303-6c49417c22b0 with identifier: 1985781 to the API
2026-03-26 18:33:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/051/c3489d9ce2654593a570c613a5e53bb6/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Midnight black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'f5d99c84-9efd-5ba8-a303-6c49417c22b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'COUNTRYMAN',
 'odometer': 60450,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5d99c84-9efd-5ba8-a303-6c49417c22b0/f5d99c84-9efd-5ba8-a303-6c49417c22b0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 550378,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/051/c3489d9ce2654593a570c613a5e53bb6/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI COUNTRYMAN Cooper',
 'transmission': 'manual',
 'trim': 'Cooper',
 'vin': None,
 'year': 2022}
2026-03-26 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985781%27 HTTP/1.1" 200 None
2026-03-26 18:33:00 [ayvens.es] INFO: Saving data for 1985781: {'created_time': 1774549980.643576, 'last_price_update_time': 1774549980.643585, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985781') HTTP/1.1" 204 0
2026-03-26 18:33:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 70725f9e-f17f-57e3-938c-9fe3bdf89fcf with identifier: 1985783
2026-03-26 18:33:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 70725f9e-f17f-57e3-938c-9fe3bdf89fcf with identifier: 1985783
2026-03-26 18:33:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 70725f9e-f17f-57e3-938c-9fe3bdf89fcf with identifier: 1985783 to the API
2026-03-26 18:33:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/678/9a14d896edc14307a444a36a9337eb62/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Midnight black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '70725f9e-f17f-57e3-938c-9fe3bdf89fcf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'COUNTRYMAN',
 'odometer': 53026,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70725f9e-f17f-57e3-938c-9fe3bdf89fcf/70725f9e-f17f-57e3-938c-9fe3bdf89fcf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 586179,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/678/9a14d896edc14307a444a36a9337eb62/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI COUNTRYMAN Cooper',
 'transmission': 'manual',
 'trim': 'Cooper',
 'vin': None,
 'year': 2022}
2026-03-26 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985783%27 HTTP/1.1" 200 None
2026-03-26 18:33:00 [ayvens.es] INFO: Saving data for 1985783: {'created_time': 1774549980.947513, 'last_price_update_time': 1774549980.947524, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985783') HTTP/1.1" 204 0
2026-03-26 18:33:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9474930d-4411-52c9-92e4-cc9cb2f23a02 with identifier: 1985782
2026-03-26 18:33:00 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:33:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9474930d-4411-52c9-92e4-cc9cb2f23a02 with identifier: 1985782
2026-03-26 18:33:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9474930d-4411-52c9-92e4-cc9cb2f23a02 with identifier: 1985782 to the API
2026-03-26 18:33:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/678/882892650b024bc4a72d2b46a8084f47/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'British',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '9474930d-4411-52c9-92e4-cc9cb2f23a02',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'COUNTRYMAN',
 'odometer': 107114,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9474930d-4411-52c9-92e4-cc9cb2f23a02/9474930d-4411-52c9-92e4-cc9cb2f23a02_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698473,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/678/882892650b024bc4a72d2b46a8084f47/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI COUNTRYMAN Cooper',
 'transmission': 'manual',
 'trim': 'Cooper',
 'vin': None,
 'year': 2022}
2026-03-26 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985782%27 HTTP/1.1" 200 None
2026-03-26 18:33:01 [ayvens.es] INFO: Saving data for 1985782: {'created_time': 1774549981.245814, 'last_price_update_time': 1774549981.245824, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985782') HTTP/1.1" 204 0
2026-03-26 18:33:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 528e1d74-c7ba-5920-8197-480bab531ed6 with identifier: 1985786
2026-03-26 18:33:01 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:33:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 528e1d74-c7ba-5920-8197-480bab531ed6 with identifier: 1985786
2026-03-26 18:33:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 528e1d74-c7ba-5920-8197-480bab531ed6 with identifier: 1985786 to the API
2026-03-26 18:33:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/213/d599e9ae79054f14a26212d4f160e62c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Negro perla nera',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '528e1d74-c7ba-5920-8197-480bab531ed6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 115874,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_528e1d74-c7ba-5920-8197-480bab531ed6/528e1d74-c7ba-5920-8197-480bab531ed6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 393583,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/213/d599e9ae79054f14a26212d4f160e62c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.5 BlueHDi 96kW (130CV) S&S Active Pack',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi 96kW (130CV) S&S Active Pack',
 'vin': None,
 'year': 2021}
2026-03-26 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985786%27 HTTP/1.1" 200 None
2026-03-26 18:33:01 [ayvens.es] INFO: Saving data for 1985786: {'created_time': 1774549981.532625, 'last_price_update_time': 1774549981.532636, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985786') HTTP/1.1" 204 0
2026-03-26 18:33:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 08780c20-ae7c-543d-a7a9-25261804ba87 with identifier: 1985787
2026-03-26 18:33:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 08780c20-ae7c-543d-a7a9-25261804ba87 with identifier: 1985787
2026-03-26 18:33:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 08780c20-ae7c-543d-a7a9-25261804ba87 with identifier: 1985787 to the API
2026-03-26 18:33:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/359/985c0ed034ad486baac9066d40a39c66/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'color': 'Blanco solido',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '08780c20-ae7c-543d-a7a9-25261804ba87',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 126020,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08780c20-ae7c-543d-a7a9-25261804ba87/08780c20-ae7c-543d-a7a9-25261804ba87_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 363895,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/359/985c0ed034ad486baac9066d40a39c66/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI dCi 85 kW (115 CV) E6D ACENTA',
 'transmission': 'manual',
 'trim': 'dCi 85 kW (115 CV) E6D ACENTA',
 'vin': None,
 'year': 2020}
2026-03-26 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985787%27 HTTP/1.1" 200 None
2026-03-26 18:33:01 [ayvens.es] INFO: Saving data for 1985787: {'created_time': 1774549981.818485, 'last_price_update_time': 1774549981.818496, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985787') HTTP/1.1" 204 0
2026-03-26 18:33:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/669/d0af3fc1600b456b89c0ba101134381a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/562/5e8de1e6430340b9b7d10ec6ed68de28/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/080/5a9fe22342a44756a8ebd7a5f57408d0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:01 [ayvens.es] INFO: Found listing with ID: 1985797
2026-03-26 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985797%27 HTTP/1.1" 200 None
2026-03-26 18:33:01 [ayvens.es] INFO: Scrape type for 1985797: 1
2026-03-26 18:33:01 [ayvens.es] INFO: Extracting data for car ID: 1985797
2026-03-26 18:33:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: edfd8807-25da-5d8d-a4d6-0c4012276ae9 with identifier: 1985797
2026-03-26 18:33:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item edfd8807-25da-5d8d-a4d6-0c4012276ae9 with scrape type 1
2026-03-26 18:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item edfd8807-25da-5d8d-a4d6-0c4012276ae9
2026-03-26 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F469%252F4b7314ae2c444f73988138df4503034d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/469/4b7314ae2c444f73988138df4503034d/images/large/1.jpg not downloaded yet
2026-03-26 18:33:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a290353d0>
2026-03-26 18:33:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ffb433b-ddae-5e80-ba1e-ad2b615d15be/3ffb433b-ddae-5e80-ba1e-ad2b615d15be_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F237%252F1c81af479e9a4655acf29b166e9059de%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/237/1c81af479e9a4655acf29b166e9059de/images/large/1.jpg saved to cache
2026-03-26 18:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3ffb433b-ddae-5e80-ba1e-ad2b615d15be
2026-03-26 18:33:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3ffb433b-ddae-5e80-ba1e-ad2b615d15be, skipping ID generation
2026-03-26 18:33:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ffb433b-ddae-5e80-ba1e-ad2b615d15be with scrape type 1
2026-03-26 18:33:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3ffb433b-ddae-5e80-ba1e-ad2b615d15be sending to next pipeline
2026-03-26 18:33:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3ffb433b-ddae-5e80-ba1e-ad2b615d15be, identifier: 1985789
2026-03-26 18:33:02 [ayvens.es] INFO: Found listing with ID: 1985798
2026-03-26 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985798%27 HTTP/1.1" 200 None
2026-03-26 18:33:02 [ayvens.es] INFO: Scrape type for 1985798: 1
2026-03-26 18:33:02 [ayvens.es] INFO: Extracting data for car ID: 1985798
2026-03-26 18:33:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1072d141-e12a-5f5c-911e-f0eba7b7f851 with identifier: 1985798
2026-03-26 18:33:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1072d141-e12a-5f5c-911e-f0eba7b7f851 with scrape type 1
2026-03-26 18:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1072d141-e12a-5f5c-911e-f0eba7b7f851
2026-03-26 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F780%252Fba469b52a549446982d97c42e8050676%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/780/ba469b52a549446982d97c42e8050676/images/large/1.jpg not downloaded yet
2026-03-26 18:33:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3ffb433b-ddae-5e80-ba1e-ad2b615d15be with identifier: 1985789
2026-03-26 18:33:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:33:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3ffb433b-ddae-5e80-ba1e-ad2b615d15be with identifier: 1985789
2026-03-26 18:33:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3ffb433b-ddae-5e80-ba1e-ad2b615d15be with identifier: 1985789 to the API
2026-03-26 18:33:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/237/1c81af479e9a4655acf29b166e9059de/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 94,
 'color': 'Beige capuccino',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '3ffb433b-ddae-5e80-ba1e-ad2b615d15be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'RAPID',
 'odometer': 133185,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ffb433b-ddae-5e80-ba1e-ad2b615d15be/3ffb433b-ddae-5e80-ba1e-ad2b615d15be_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329420,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/237/1c81af479e9a4655acf29b166e9059de/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA RAPID 1.4 TDI CR 66KW (90cv) Like Spaceback',
 'transmission': 'manual',
 'trim': '1.4 TDI CR 66KW (90cv) Like Spaceback',
 'vin': None,
 'year': 2018}
2026-03-26 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985789%27 HTTP/1.1" 200 None
2026-03-26 18:33:02 [ayvens.es] INFO: Saving data for 1985789: {'created_time': 1774549982.387671, 'last_price_update_time': 1774549982.387682, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985789') HTTP/1.1" 204 0
2026-03-26 18:33:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/880/7521a83feaac4d0eaf32a305471d44b8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/537/3203181f61274ed8b944a4a22c650a15/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:02 [ayvens.es] INFO: Found listing with ID: 1985799
2026-03-26 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985799%27 HTTP/1.1" 200 None
2026-03-26 18:33:02 [ayvens.es] INFO: Scrape type for 1985799: 1
2026-03-26 18:33:02 [ayvens.es] INFO: Extracting data for car ID: 1985799
2026-03-26 18:33:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3133654f-5d8f-5cb8-81f1-5e9a5615a8d2 with identifier: 1985799
2026-03-26 18:33:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3133654f-5d8f-5cb8-81f1-5e9a5615a8d2 with scrape type 1
2026-03-26 18:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3133654f-5d8f-5cb8-81f1-5e9a5615a8d2
2026-03-26 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F403%252Fac61e6c59ff44736a6843a2530db5b3b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/403/ac61e6c59ff44736a6843a2530db5b3b/images/large/1.jpg not downloaded yet
2026-03-26 18:33:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a2ab07c50>
2026-03-26 18:33:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cf8bfb5-ee25-54e4-948d-c3145f30825b/6cf8bfb5-ee25-54e4-948d-c3145f30825b_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F669%252Fd0af3fc1600b456b89c0ba101134381a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/669/d0af3fc1600b456b89c0ba101134381a/images/large/1.jpg saved to cache
2026-03-26 18:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6cf8bfb5-ee25-54e4-948d-c3145f30825b
2026-03-26 18:33:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6cf8bfb5-ee25-54e4-948d-c3145f30825b, skipping ID generation
2026-03-26 18:33:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cf8bfb5-ee25-54e4-948d-c3145f30825b with scrape type 1
2026-03-26 18:33:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6cf8bfb5-ee25-54e4-948d-c3145f30825b sending to next pipeline
2026-03-26 18:33:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6cf8bfb5-ee25-54e4-948d-c3145f30825b, identifier: 1985791
2026-03-26 18:33:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a2ab05d50>
2026-03-26 18:33:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f761e944-84ae-5775-925d-c7ec364b2490/f761e944-84ae-5775-925d-c7ec364b2490_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F562%252F5e8de1e6430340b9b7d10ec6ed68de28%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/562/5e8de1e6430340b9b7d10ec6ed68de28/images/large/1.jpg saved to cache
2026-03-26 18:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f761e944-84ae-5775-925d-c7ec364b2490
2026-03-26 18:33:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f761e944-84ae-5775-925d-c7ec364b2490, skipping ID generation
2026-03-26 18:33:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f761e944-84ae-5775-925d-c7ec364b2490 with scrape type 1
2026-03-26 18:33:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f761e944-84ae-5775-925d-c7ec364b2490 sending to next pipeline
2026-03-26 18:33:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f761e944-84ae-5775-925d-c7ec364b2490, identifier: 1985788
2026-03-26 18:33:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28d3c950>
2026-03-26 18:33:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed2b79bf-5f95-55e2-9903-b8cc3dd40ac3/ed2b79bf-5f95-55e2-9903-b8cc3dd40ac3_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F080%252F5a9fe22342a44756a8ebd7a5f57408d0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/080/5a9fe22342a44756a8ebd7a5f57408d0/images/large/1.jpg saved to cache
2026-03-26 18:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ed2b79bf-5f95-55e2-9903-b8cc3dd40ac3
2026-03-26 18:33:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ed2b79bf-5f95-55e2-9903-b8cc3dd40ac3, skipping ID generation
2026-03-26 18:33:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed2b79bf-5f95-55e2-9903-b8cc3dd40ac3 with scrape type 1
2026-03-26 18:33:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ed2b79bf-5f95-55e2-9903-b8cc3dd40ac3 sending to next pipeline
2026-03-26 18:33:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ed2b79bf-5f95-55e2-9903-b8cc3dd40ac3, identifier: 1985790
2026-03-26 18:33:02 [ayvens.es] INFO: Found listing with ID: 1985800
2026-03-26 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985800%27 HTTP/1.1" 200 None
2026-03-26 18:33:02 [ayvens.es] INFO: Scrape type for 1985800: 1
2026-03-26 18:33:02 [ayvens.es] INFO: Extracting data for car ID: 1985800
2026-03-26 18:33:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e55ac6c6-a562-562e-af4d-724b38a88f1d with identifier: 1985800
2026-03-26 18:33:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e55ac6c6-a562-562e-af4d-724b38a88f1d with scrape type 1
2026-03-26 18:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e55ac6c6-a562-562e-af4d-724b38a88f1d
2026-03-26 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F199%252F6dca8af8016f4a8dbbbc58246803dac6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/199/6dca8af8016f4a8dbbbc58246803dac6/images/large/1.jpg not downloaded yet
2026-03-26 18:33:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6cf8bfb5-ee25-54e4-948d-c3145f30825b with identifier: 1985791
2026-03-26 18:33:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:33:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6cf8bfb5-ee25-54e4-948d-c3145f30825b with identifier: 1985791
2026-03-26 18:33:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 6cf8bfb5-ee25-54e4-948d-c3145f30825b with identifier: 1985791 to the API
2026-03-26 18:33:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/669/d0af3fc1600b456b89c0ba101134381a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Plata r',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '6cf8bfb5-ee25-54e4-948d-c3145f30825b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT',
 'odometer': 153070,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cf8bfb5-ee25-54e4-948d-c3145f30825b/6cf8bfb5-ee25-54e4-948d-c3145f30825b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 358531,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/669/d0af3fc1600b456b89c0ba101134381a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT Business 2.0 TDI 90kW (122CV) DSG',
 'transmission': 'manual',
 'trim': 'Business 2.0 TDI 90kW (122CV) DSG',
 'vin': None,
 'year': 2020}
2026-03-26 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985791%27 HTTP/1.1" 200 None
2026-03-26 18:33:03 [ayvens.es] INFO: Saving data for 1985791: {'created_time': 1774549983.288431, 'last_price_update_time': 1774549983.28844, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985791') HTTP/1.1" 204 0
2026-03-26 18:33:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f761e944-84ae-5775-925d-c7ec364b2490 with identifier: 1985788
2026-03-26 18:33:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f761e944-84ae-5775-925d-c7ec364b2490 with identifier: 1985788
2026-03-26 18:33:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f761e944-84ae-5775-925d-c7ec364b2490 with identifier: 1985788 to the API
2026-03-26 18:33:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/562/5e8de1e6430340b9b7d10ec6ed68de28/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'Gris magnetic',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'f761e944-84ae-5775-925d-c7ec364b2490',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 104136,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f761e944-84ae-5775-925d-c7ec364b2490/f761e944-84ae-5775-925d-c7ec364b2490_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330752,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/562/5e8de1e6430340b9b7d10ec6ed68de28/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON 1.0 TSI 81kW S&S Style Go',
 'transmission': 'manual',
 'trim': '1.0 TSI 81kW S&S Style Go',
 'vin': None,
 'year': 2021}
2026-03-26 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985788%27 HTTP/1.1" 200 None
2026-03-26 18:33:03 [ayvens.es] INFO: Saving data for 1985788: {'created_time': 1774549983.621873, 'last_price_update_time': 1774549983.621882, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985788') HTTP/1.1" 204 0
2026-03-26 18:33:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ed2b79bf-5f95-55e2-9903-b8cc3dd40ac3 with identifier: 1985790
2026-03-26 18:33:03 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:33:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ed2b79bf-5f95-55e2-9903-b8cc3dd40ac3 with identifier: 1985790
2026-03-26 18:33:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ed2b79bf-5f95-55e2-9903-b8cc3dd40ac3 with identifier: 1985790 to the API
2026-03-26 18:33:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/080/5a9fe22342a44756a8ebd7a5f57408d0/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'color': 'Azul zanz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'ed2b79bf-5f95-55e2-9903-b8cc3dd40ac3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'ARKANA',
 'odometer': 135827,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed2b79bf-5f95-55e2-9903-b8cc3dd40ac3/ed2b79bf-5f95-55e2-9903-b8cc3dd40ac3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 378830,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/080/5a9fe22342a44756a8ebd7a5f57408d0/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT ARKANA RS Line TCe 117kW(160CV) EDC Micro Hibr.',
 'transmission': 'manual',
 'trim': 'RS Line TCe 117kW(160CV) EDC Micro Hibr.',
 'vin': None,
 'year': 2021}
2026-03-26 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985790%27 HTTP/1.1" 200 None
2026-03-26 18:33:03 [ayvens.es] INFO: Saving data for 1985790: {'created_time': 1774549983.978223, 'last_price_update_time': 1774549983.978234, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985790') HTTP/1.1" 204 0
2026-03-26 18:33:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/238/b47948b8c6e64d82a64e7e66c040e963/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/857/d7922874f4d549a08db7d7927365c4c7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:04 [ayvens.es] INFO: Found listing with ID: 1985801
2026-03-26 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985801%27 HTTP/1.1" 200 None
2026-03-26 18:33:04 [ayvens.es] INFO: Scrape type for 1985801: 1
2026-03-26 18:33:04 [ayvens.es] INFO: Extracting data for car ID: 1985801
2026-03-26 18:33:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f57d87b-017c-5396-b787-51632ae69eaf with identifier: 1985801
2026-03-26 18:33:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f57d87b-017c-5396-b787-51632ae69eaf with scrape type 1
2026-03-26 18:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2f57d87b-017c-5396-b787-51632ae69eaf
2026-03-26 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F485%252F2a45e42488e64829930832108bca3974%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/485/2a45e42488e64829930832108bca3974/images/large/1.jpg not downloaded yet
2026-03-26 18:33:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/003/7815c09cf4a64054b88b32296aeff2f8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28d3e610>
2026-03-26 18:33:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c19bb6e5-8203-5545-b49d-4b8dfc0a664c/c19bb6e5-8203-5545-b49d-4b8dfc0a664c_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F880%252F7521a83feaac4d0eaf32a305471d44b8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/880/7521a83feaac4d0eaf32a305471d44b8/images/large/1.jpg saved to cache
2026-03-26 18:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c19bb6e5-8203-5545-b49d-4b8dfc0a664c
2026-03-26 18:33:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c19bb6e5-8203-5545-b49d-4b8dfc0a664c, skipping ID generation
2026-03-26 18:33:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c19bb6e5-8203-5545-b49d-4b8dfc0a664c with scrape type 1
2026-03-26 18:33:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c19bb6e5-8203-5545-b49d-4b8dfc0a664c sending to next pipeline
2026-03-26 18:33:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c19bb6e5-8203-5545-b49d-4b8dfc0a664c, identifier: 1985793
2026-03-26 18:33:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a29030f50>
2026-03-26 18:33:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac34e0a7-64d7-5ff1-9207-8138742d1e72/ac34e0a7-64d7-5ff1-9207-8138742d1e72_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F537%252F3203181f61274ed8b944a4a22c650a15%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/537/3203181f61274ed8b944a4a22c650a15/images/large/1.jpg saved to cache
2026-03-26 18:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ac34e0a7-64d7-5ff1-9207-8138742d1e72
2026-03-26 18:33:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ac34e0a7-64d7-5ff1-9207-8138742d1e72, skipping ID generation
2026-03-26 18:33:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac34e0a7-64d7-5ff1-9207-8138742d1e72 with scrape type 1
2026-03-26 18:33:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ac34e0a7-64d7-5ff1-9207-8138742d1e72 sending to next pipeline
2026-03-26 18:33:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ac34e0a7-64d7-5ff1-9207-8138742d1e72, identifier: 1985792
2026-03-26 18:33:04 [ayvens.es] INFO: Found listing with ID: 1985802
2026-03-26 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985802%27 HTTP/1.1" 200 None
2026-03-26 18:33:04 [ayvens.es] INFO: Scrape type for 1985802: 1
2026-03-26 18:33:04 [ayvens.es] INFO: Extracting data for car ID: 1985802
2026-03-26 18:33:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4a3736d-3160-592a-85ae-6b8af0e406b7 with identifier: 1985802
2026-03-26 18:33:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4a3736d-3160-592a-85ae-6b8af0e406b7 with scrape type 1
2026-03-26 18:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b4a3736d-3160-592a-85ae-6b8af0e406b7
2026-03-26 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F539%252Fefe6304b6d6645f3bb14ac9140080386%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/539/efe6304b6d6645f3bb14ac9140080386/images/large/1.jpg not downloaded yet
2026-03-26 18:33:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c19bb6e5-8203-5545-b49d-4b8dfc0a664c with identifier: 1985793
2026-03-26 18:33:04 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:33:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c19bb6e5-8203-5545-b49d-4b8dfc0a664c with identifier: 1985793
2026-03-26 18:33:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c19bb6e5-8203-5545-b49d-4b8dfc0a664c with identifier: 1985793 to the API
2026-03-26 18:33:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/880/7521a83feaac4d0eaf32a305471d44b8/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'color': 'Plata tungteno',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c19bb6e5-8203-5545-b49d-4b8dfc0a664c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF',
 'odometer': 127613,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c19bb6e5-8203-5545-b49d-4b8dfc0a664c/c19bb6e5-8203-5545-b49d-4b8dfc0a664c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330210,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/880/7521a83feaac4d0eaf32a305471d44b8/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF Advance 1.6 TDI 85kW (115CV)',
 'transmission': 'manual',
 'trim': 'Advance 1.6 TDI 85kW (115CV)',
 'vin': None,
 'year': 2019}
2026-03-26 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985793%27 HTTP/1.1" 200 None
2026-03-26 18:33:05 [ayvens.es] INFO: Saving data for 1985793: {'created_time': 1774549985.761581, 'last_price_update_time': 1774549985.761591, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985793') HTTP/1.1" 204 0
2026-03-26 18:33:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ac34e0a7-64d7-5ff1-9207-8138742d1e72 with identifier: 1985792
2026-03-26 18:33:05 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:33:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ac34e0a7-64d7-5ff1-9207-8138742d1e72 with identifier: 1985792
2026-03-26 18:33:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ac34e0a7-64d7-5ff1-9207-8138742d1e72 with identifier: 1985792 to the API
2026-03-26 18:33:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/537/3203181f61274ed8b944a4a22c650a15/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'Negro midnight',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'ac34e0a7-64d7-5ff1-9207-8138742d1e72',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 139292,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac34e0a7-64d7-5ff1-9207-8138742d1e72/ac34e0a7-64d7-5ff1-9207-8138742d1e72_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 375408,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/537/3203181f61274ed8b944a4a22c650a15/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON SP 1.5 eTSI 110kW DSG S&S FR Go L',
 'transmission': 'manual',
 'trim': 'SP 1.5 eTSI 110kW DSG S&S FR Go L',
 'vin': None,
 'year': 2021}
2026-03-26 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985792%27 HTTP/1.1" 200 None
2026-03-26 18:33:06 [ayvens.es] INFO: Saving data for 1985792: {'created_time': 1774549986.170083, 'last_price_update_time': 1774549986.170093, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985792') HTTP/1.1" 204 0
2026-03-26 18:33:06 [scrapy.extensions.logstats] INFO: Crawled 7 pages (at 2 pages/min), scraped 250 items (at 106 items/min)
2026-03-26 18:33:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 177MiB
2026-03-26 18:33:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/469/4b7314ae2c444f73988138df4503034d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:06 [ayvens.es] INFO: Found listing with ID: 1985803
2026-03-26 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985803%27 HTTP/1.1" 200 None
2026-03-26 18:33:06 [ayvens.es] INFO: Scrape type for 1985803: 1
2026-03-26 18:33:06 [ayvens.es] INFO: Extracting data for car ID: 1985803
2026-03-26 18:33:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dca2e5a2-10a1-50a6-a7b4-007b30c11869 with identifier: 1985803
2026-03-26 18:33:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dca2e5a2-10a1-50a6-a7b4-007b30c11869 with scrape type 1
2026-03-26 18:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item dca2e5a2-10a1-50a6-a7b4-007b30c11869
2026-03-26 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F930%252F15897be6e2f34a96adf3c2859a8465e4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/930/15897be6e2f34a96adf3c2859a8465e4/images/large/1.jpg not downloaded yet
2026-03-26 18:33:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28dd22d0>
2026-03-26 18:33:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7aac329-81ed-55bc-8d26-54b4905f5cd6/c7aac329-81ed-55bc-8d26-54b4905f5cd6_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F238%252Fb47948b8c6e64d82a64e7e66c040e963%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/238/b47948b8c6e64d82a64e7e66c040e963/images/large/1.jpg saved to cache
2026-03-26 18:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c7aac329-81ed-55bc-8d26-54b4905f5cd6
2026-03-26 18:33:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c7aac329-81ed-55bc-8d26-54b4905f5cd6, skipping ID generation
2026-03-26 18:33:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7aac329-81ed-55bc-8d26-54b4905f5cd6 with scrape type 1
2026-03-26 18:33:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c7aac329-81ed-55bc-8d26-54b4905f5cd6 sending to next pipeline
2026-03-26 18:33:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c7aac329-81ed-55bc-8d26-54b4905f5cd6, identifier: 1985794
2026-03-26 18:33:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a283a8110>
2026-03-26 18:33:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6431f71-efc2-5671-b3e3-b0fc10cf47a5/a6431f71-efc2-5671-b3e3-b0fc10cf47a5_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F857%252Fd7922874f4d549a08db7d7927365c4c7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/857/d7922874f4d549a08db7d7927365c4c7/images/large/1.jpg saved to cache
2026-03-26 18:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a6431f71-efc2-5671-b3e3-b0fc10cf47a5
2026-03-26 18:33:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a6431f71-efc2-5671-b3e3-b0fc10cf47a5, skipping ID generation
2026-03-26 18:33:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6431f71-efc2-5671-b3e3-b0fc10cf47a5 with scrape type 1
2026-03-26 18:33:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a6431f71-efc2-5671-b3e3-b0fc10cf47a5 sending to next pipeline
2026-03-26 18:33:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a6431f71-efc2-5671-b3e3-b0fc10cf47a5, identifier: 1985795
2026-03-26 18:33:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c30790>
2026-03-26 18:33:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da2b4e99-1d57-547d-b651-321b01a4896d/da2b4e99-1d57-547d-b651-321b01a4896d_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F003%252F7815c09cf4a64054b88b32296aeff2f8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/003/7815c09cf4a64054b88b32296aeff2f8/images/large/1.jpg saved to cache
2026-03-26 18:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item da2b4e99-1d57-547d-b651-321b01a4896d
2026-03-26 18:33:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: da2b4e99-1d57-547d-b651-321b01a4896d, skipping ID generation
2026-03-26 18:33:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da2b4e99-1d57-547d-b651-321b01a4896d with scrape type 1
2026-03-26 18:33:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item da2b4e99-1d57-547d-b651-321b01a4896d sending to next pipeline
2026-03-26 18:33:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: da2b4e99-1d57-547d-b651-321b01a4896d, identifier: 1985796
2026-03-26 18:33:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c7aac329-81ed-55bc-8d26-54b4905f5cd6 with identifier: 1985794
2026-03-26 18:33:06 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:33:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c7aac329-81ed-55bc-8d26-54b4905f5cd6 with identifier: 1985794
2026-03-26 18:33:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c7aac329-81ed-55bc-8d26-54b4905f5cd6 with identifier: 1985794 to the API
2026-03-26 18:33:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/238/b47948b8c6e64d82a64e7e66c040e963/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'Blanco candy s',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c7aac329-81ed-55bc-8d26-54b4905f5cd6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CADDY',
 'odometer': 26161,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7aac329-81ed-55bc-8d26-54b4905f5cd6/c7aac329-81ed-55bc-8d26-54b4905f5cd6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 322077,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/238/b47948b8c6e64d82a64e7e66c040e963/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-29',
 'seats_number': 2,
 'seller_name': None,
 'title': 'VOLKSWAGEN CADDY Cargo 2.0 TDI 55kW (75CV)',
 'transmission': 'manual',
 'trim': 'Cargo 2.0 TDI 55kW (75CV)',
 'vin': None,
 'year': 2021}
2026-03-26 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985794%27 HTTP/1.1" 200 None
2026-03-26 18:33:07 [ayvens.es] INFO: Saving data for 1985794: {'created_time': 1774549987.074634, 'last_price_update_time': 1774549987.074646, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985794') HTTP/1.1" 204 0
2026-03-26 18:33:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a6431f71-efc2-5671-b3e3-b0fc10cf47a5 with identifier: 1985795
2026-03-26 18:33:07 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:33:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a6431f71-efc2-5671-b3e3-b0fc10cf47a5 with identifier: 1985795
2026-03-26 18:33:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a6431f71-efc2-5671-b3e3-b0fc10cf47a5 with identifier: 1985795 to the API
2026-03-26 18:33:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/857/d7922874f4d549a08db7d7927365c4c7/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Morado boheme',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'a6431f71-efc2-5671-b3e3-b0fc10cf47a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 126993,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6431f71-efc2-5671-b3e3-b0fc10cf47a5/a6431f71-efc2-5671-b3e3-b0fc10cf47a5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 362070,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/857/d7922874f4d549a08db7d7927365c4c7/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON ST 1.4 TSI 92kW (125CV) S&SpStyle Ad Nav',
 'transmission': 'manual',
 'trim': 'ST 1.4 TSI 92kW (125CV) S&SpStyle Ad Nav',
 'vin': None,
 'year': 2018}
2026-03-26 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985795%27 HTTP/1.1" 200 None
2026-03-26 18:33:07 [ayvens.es] INFO: Saving data for 1985795: {'created_time': 1774549987.409507, 'last_price_update_time': 1774549987.409517, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985795') HTTP/1.1" 204 0
2026-03-26 18:33:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: da2b4e99-1d57-547d-b651-321b01a4896d with identifier: 1985796
2026-03-26 18:33:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: da2b4e99-1d57-547d-b651-321b01a4896d with identifier: 1985796
2026-03-26 18:33:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: da2b4e99-1d57-547d-b651-321b01a4896d with identifier: 1985796 to the API
2026-03-26 18:33:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/003/7815c09cf4a64054b88b32296aeff2f8/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 187,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'da2b4e99-1d57-547d-b651-321b01a4896d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'TRAFIC',
 'odometer': 142545,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da2b4e99-1d57-547d-b651-321b01a4896d/da2b4e99-1d57-547d-b651-321b01a4896d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344366,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/003/7815c09cf4a64054b88b32296aeff2f8/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-22',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT TRAFIC Furgon 29 L1H1 Energy BluedCi 88 kW',
 'transmission': 'manual',
 'trim': 'Furgon 29 L1H1 Energy BluedCi 88 kW',
 'vin': None,
 'year': 2021}
2026-03-26 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985796%27 HTTP/1.1" 200 None
2026-03-26 18:33:07 [ayvens.es] INFO: Saving data for 1985796: {'created_time': 1774549987.75959, 'last_price_update_time': 1774549987.759599, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985796') HTTP/1.1" 204 0
2026-03-26 18:33:07 [ayvens.es] INFO: Found listing with ID: 1985804
2026-03-26 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985804%27 HTTP/1.1" 200 None
2026-03-26 18:33:07 [ayvens.es] INFO: Scrape type for 1985804: 1
2026-03-26 18:33:07 [ayvens.es] INFO: Extracting data for car ID: 1985804
2026-03-26 18:33:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9771bbae-7517-542a-bcc1-f10084ed11b8 with identifier: 1985804
2026-03-26 18:33:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9771bbae-7517-542a-bcc1-f10084ed11b8 with scrape type 1
2026-03-26 18:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9771bbae-7517-542a-bcc1-f10084ed11b8
2026-03-26 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F191%252F52b50f63fe8043ac81678d5aeb12e285%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/191/52b50f63fe8043ac81678d5aeb12e285/images/large/1.jpg not downloaded yet
2026-03-26 18:33:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a29317dd0>
2026-03-26 18:33:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edfd8807-25da-5d8d-a4d6-0c4012276ae9/edfd8807-25da-5d8d-a4d6-0c4012276ae9_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F469%252F4b7314ae2c444f73988138df4503034d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/469/4b7314ae2c444f73988138df4503034d/images/large/1.jpg saved to cache
2026-03-26 18:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item edfd8807-25da-5d8d-a4d6-0c4012276ae9
2026-03-26 18:33:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: edfd8807-25da-5d8d-a4d6-0c4012276ae9, skipping ID generation
2026-03-26 18:33:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item edfd8807-25da-5d8d-a4d6-0c4012276ae9 with scrape type 1
2026-03-26 18:33:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item edfd8807-25da-5d8d-a4d6-0c4012276ae9 sending to next pipeline
2026-03-26 18:33:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: edfd8807-25da-5d8d-a4d6-0c4012276ae9, identifier: 1985797
2026-03-26 18:33:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/403/ac61e6c59ff44736a6843a2530db5b3b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/780/ba469b52a549446982d97c42e8050676/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:07 [ayvens.es] INFO: Found listing with ID: 1985805
2026-03-26 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985805%27 HTTP/1.1" 200 None
2026-03-26 18:33:07 [ayvens.es] INFO: Scrape type for 1985805: 1
2026-03-26 18:33:07 [ayvens.es] INFO: Extracting data for car ID: 1985805
2026-03-26 18:33:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 424a7f08-eafd-5b9b-b7d1-b84a0c5150a8 with identifier: 1985805
2026-03-26 18:33:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 424a7f08-eafd-5b9b-b7d1-b84a0c5150a8 with scrape type 1
2026-03-26 18:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 424a7f08-eafd-5b9b-b7d1-b84a0c5150a8
2026-03-26 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F415%252F49d1d9905a9b414a92596ff2e092d8e8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/415/49d1d9905a9b414a92596ff2e092d8e8/images/large/1.jpg not downloaded yet
2026-03-26 18:33:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: edfd8807-25da-5d8d-a4d6-0c4012276ae9 with identifier: 1985797
2026-03-26 18:33:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: edfd8807-25da-5d8d-a4d6-0c4012276ae9 with identifier: 1985797
2026-03-26 18:33:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: edfd8807-25da-5d8d-a4d6-0c4012276ae9 with identifier: 1985797 to the API
2026-03-26 18:33:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/469/4b7314ae2c444f73988138df4503034d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'edfd8807-25da-5d8d-a4d6-0c4012276ae9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-ROC',
 'odometer': 120325,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edfd8807-25da-5d8d-a4d6-0c4012276ae9/edfd8807-25da-5d8d-a4d6-0c4012276ae9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347322,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/469/4b7314ae2c444f73988138df4503034d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-ROC Edition 2.0 TDI 85kW (115CV)',
 'transmission': 'manual',
 'trim': 'Edition 2.0 TDI 85kW (115CV)',
 'vin': None,
 'year': 2022}
2026-03-26 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985797%27 HTTP/1.1" 200 None
2026-03-26 18:33:08 [ayvens.es] INFO: Saving data for 1985797: {'created_time': 1774549988.352742, 'last_price_update_time': 1774549988.352752, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985797') HTTP/1.1" 204 0
2026-03-26 18:33:08 [ayvens.es] INFO: Found listing with ID: 1985806
2026-03-26 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985806%27 HTTP/1.1" 200 None
2026-03-26 18:33:08 [ayvens.es] INFO: Scrape type for 1985806: 1
2026-03-26 18:33:08 [ayvens.es] INFO: Extracting data for car ID: 1985806
2026-03-26 18:33:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1f6d115-1b08-541f-a6c9-09883dacec13 with identifier: 1985806
2026-03-26 18:33:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1f6d115-1b08-541f-a6c9-09883dacec13 with scrape type 1
2026-03-26 18:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a1f6d115-1b08-541f-a6c9-09883dacec13
2026-03-26 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F141%252F8876bf4fbe1545cba2b9dcd8f961bdc9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/141/8876bf4fbe1545cba2b9dcd8f961bdc9/images/large/1.jpg not downloaded yet
2026-03-26 18:33:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/199/6dca8af8016f4a8dbbbc58246803dac6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28f80290>
2026-03-26 18:33:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3133654f-5d8f-5cb8-81f1-5e9a5615a8d2/3133654f-5d8f-5cb8-81f1-5e9a5615a8d2_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F403%252Fac61e6c59ff44736a6843a2530db5b3b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/403/ac61e6c59ff44736a6843a2530db5b3b/images/large/1.jpg saved to cache
2026-03-26 18:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3133654f-5d8f-5cb8-81f1-5e9a5615a8d2
2026-03-26 18:33:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3133654f-5d8f-5cb8-81f1-5e9a5615a8d2, skipping ID generation
2026-03-26 18:33:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3133654f-5d8f-5cb8-81f1-5e9a5615a8d2 with scrape type 1
2026-03-26 18:33:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3133654f-5d8f-5cb8-81f1-5e9a5615a8d2 sending to next pipeline
2026-03-26 18:33:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3133654f-5d8f-5cb8-81f1-5e9a5615a8d2, identifier: 1985799
2026-03-26 18:33:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c89c50>
2026-03-26 18:33:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1072d141-e12a-5f5c-911e-f0eba7b7f851/1072d141-e12a-5f5c-911e-f0eba7b7f851_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F780%252Fba469b52a549446982d97c42e8050676%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/780/ba469b52a549446982d97c42e8050676/images/large/1.jpg saved to cache
2026-03-26 18:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1072d141-e12a-5f5c-911e-f0eba7b7f851
2026-03-26 18:33:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1072d141-e12a-5f5c-911e-f0eba7b7f851, skipping ID generation
2026-03-26 18:33:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1072d141-e12a-5f5c-911e-f0eba7b7f851 with scrape type 1
2026-03-26 18:33:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1072d141-e12a-5f5c-911e-f0eba7b7f851 sending to next pipeline
2026-03-26 18:33:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1072d141-e12a-5f5c-911e-f0eba7b7f851, identifier: 1985798
2026-03-26 18:33:08 [ayvens.es] INFO: Found listing with ID: 1985807
2026-03-26 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985807%27 HTTP/1.1" 200 None
2026-03-26 18:33:08 [ayvens.es] INFO: Scrape type for 1985807: 1
2026-03-26 18:33:08 [ayvens.es] INFO: Extracting data for car ID: 1985807
2026-03-26 18:33:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57afd5d4-56cf-50b7-aea0-f09b80c91f4e with identifier: 1985807
2026-03-26 18:33:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57afd5d4-56cf-50b7-aea0-f09b80c91f4e with scrape type 1
2026-03-26 18:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 57afd5d4-56cf-50b7-aea0-f09b80c91f4e
2026-03-26 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F207%252Fa516f4bad45247f8b0affe61454f5ef2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/207/a516f4bad45247f8b0affe61454f5ef2/images/large/1.jpg not downloaded yet
2026-03-26 18:33:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3133654f-5d8f-5cb8-81f1-5e9a5615a8d2 with identifier: 1985799
2026-03-26 18:33:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3133654f-5d8f-5cb8-81f1-5e9a5615a8d2 with identifier: 1985799
2026-03-26 18:33:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3133654f-5d8f-5cb8-81f1-5e9a5615a8d2 with identifier: 1985799 to the API
2026-03-26 18:33:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/403/ac61e6c59ff44736a6843a2530db5b3b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '3133654f-5d8f-5cb8-81f1-5e9a5615a8d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CADDY',
 'odometer': 148004,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3133654f-5d8f-5cb8-81f1-5e9a5615a8d2/3133654f-5d8f-5cb8-81f1-5e9a5615a8d2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332755,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/403/ac61e6c59ff44736a6843a2530db5b3b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN CADDY Origin 2.0 TDI 90kW (122CV) 4MOTION',
 'transmission': 'manual',
 'trim': 'Origin 2.0 TDI 90kW (122CV) 4MOTION',
 'vin': None,
 'year': 2022}
2026-03-26 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985799%27 HTTP/1.1" 200 None
2026-03-26 18:33:09 [ayvens.es] INFO: Saving data for 1985799: {'created_time': 1774549989.2077, 'last_price_update_time': 1774549989.20771, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985799') HTTP/1.1" 204 0
2026-03-26 18:33:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1072d141-e12a-5f5c-911e-f0eba7b7f851 with identifier: 1985798
2026-03-26 18:33:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1072d141-e12a-5f5c-911e-f0eba7b7f851 with identifier: 1985798
2026-03-26 18:33:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1072d141-e12a-5f5c-911e-f0eba7b7f851 with identifier: 1985798 to the API
2026-03-26 18:33:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/780/ba469b52a549446982d97c42e8050676/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 94,
 'color': 'Blanco glaciar',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '1072d141-e12a-5f5c-911e-f0eba7b7f851',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 272087,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1072d141-e12a-5f5c-911e-f0eba7b7f851/1072d141-e12a-5f5c-911e-f0eba7b7f851_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 348723,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/780/ba469b52a549446982d97c42e8050676/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO (O) Business Blue dCi 63 kW (85CV)',
 'transmission': 'manual',
 'trim': '(O) Business Blue dCi 63 kW (85CV)',
 'vin': None,
 'year': 2021}
2026-03-26 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985798%27 HTTP/1.1" 200 None
2026-03-26 18:33:09 [ayvens.es] INFO: Saving data for 1985798: {'created_time': 1774549989.567194, 'last_price_update_time': 1774549989.567206, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985798') HTTP/1.1" 204 0
2026-03-26 18:33:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/485/2a45e42488e64829930832108bca3974/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/539/efe6304b6d6645f3bb14ac9140080386/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:09 [ayvens.es] INFO: Found listing with ID: 1985808
2026-03-26 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985808%27 HTTP/1.1" 200 None
2026-03-26 18:33:09 [ayvens.es] INFO: Scrape type for 1985808: 1
2026-03-26 18:33:09 [ayvens.es] INFO: Extracting data for car ID: 1985808
2026-03-26 18:33:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46f545bc-34f3-5f2f-9f33-4948b6be6090 with identifier: 1985808
2026-03-26 18:33:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46f545bc-34f3-5f2f-9f33-4948b6be6090 with scrape type 1
2026-03-26 18:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 46f545bc-34f3-5f2f-9f33-4948b6be6090
2026-03-26 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F896%252F86cb3614bdc647c88abe40f123c38e9d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/896/86cb3614bdc647c88abe40f123c38e9d/images/large/1.jpg not downloaded yet
2026-03-26 18:33:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a283d2a50>
2026-03-26 18:33:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e55ac6c6-a562-562e-af4d-724b38a88f1d/e55ac6c6-a562-562e-af4d-724b38a88f1d_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F199%252F6dca8af8016f4a8dbbbc58246803dac6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/199/6dca8af8016f4a8dbbbc58246803dac6/images/large/1.jpg saved to cache
2026-03-26 18:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e55ac6c6-a562-562e-af4d-724b38a88f1d
2026-03-26 18:33:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e55ac6c6-a562-562e-af4d-724b38a88f1d, skipping ID generation
2026-03-26 18:33:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e55ac6c6-a562-562e-af4d-724b38a88f1d with scrape type 1
2026-03-26 18:33:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e55ac6c6-a562-562e-af4d-724b38a88f1d sending to next pipeline
2026-03-26 18:33:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e55ac6c6-a562-562e-af4d-724b38a88f1d, identifier: 1985800
2026-03-26 18:33:09 [ayvens.es] INFO: Found listing with ID: 1985809
2026-03-26 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985809%27 HTTP/1.1" 200 None
2026-03-26 18:33:09 [ayvens.es] INFO: Scrape type for 1985809: 1
2026-03-26 18:33:09 [ayvens.es] INFO: Extracting data for car ID: 1985809
2026-03-26 18:33:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7994c08-27b2-5b6c-a39f-e5254a7d3ae4 with identifier: 1985809
2026-03-26 18:33:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7994c08-27b2-5b6c-a39f-e5254a7d3ae4 with scrape type 1
2026-03-26 18:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b7994c08-27b2-5b6c-a39f-e5254a7d3ae4
2026-03-26 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F258%252Fb4fc4bbbc1a84ec9a258d26d56e93b1c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/258/b4fc4bbbc1a84ec9a258d26d56e93b1c/images/large/1.jpg not downloaded yet
2026-03-26 18:33:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e55ac6c6-a562-562e-af4d-724b38a88f1d with identifier: 1985800
2026-03-26 18:33:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e55ac6c6-a562-562e-af4d-724b38a88f1d with identifier: 1985800
2026-03-26 18:33:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e55ac6c6-a562-562e-af4d-724b38a88f1d with identifier: 1985800 to the API
2026-03-26 18:33:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/199/6dca8af8016f4a8dbbbc58246803dac6/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Negro metalizado',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e55ac6c6-a562-562e-af4d-724b38a88f1d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT',
 'odometer': 98547,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e55ac6c6-a562-562e-af4d-724b38a88f1d/e55ac6c6-a562-562e-af4d-724b38a88f1d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342658,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/199/6dca8af8016f4a8dbbbc58246803dac6/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT Business 2.0 TDI 90kW (122CV) DSG',
 'transmission': 'manual',
 'trim': 'Business 2.0 TDI 90kW (122CV) DSG',
 'vin': None,
 'year': 2022}
2026-03-26 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985800%27 HTTP/1.1" 200 None
2026-03-26 18:33:10 [ayvens.es] INFO: Saving data for 1985800: {'created_time': 1774549990.098471, 'last_price_update_time': 1774549990.098481, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985800') HTTP/1.1" 204 0
2026-03-26 18:33:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/930/15897be6e2f34a96adf3c2859a8465e4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/191/52b50f63fe8043ac81678d5aeb12e285/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:10 [ayvens.es] INFO: Found listing with ID: 1985810
2026-03-26 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985810%27 HTTP/1.1" 200 None
2026-03-26 18:33:10 [ayvens.es] INFO: Scrape type for 1985810: 1
2026-03-26 18:33:10 [ayvens.es] INFO: Extracting data for car ID: 1985810
2026-03-26 18:33:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 891c44c7-48b5-5b47-9b25-f51a42f651eb with identifier: 1985810
2026-03-26 18:33:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 891c44c7-48b5-5b47-9b25-f51a42f651eb with scrape type 1
2026-03-26 18:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 891c44c7-48b5-5b47-9b25-f51a42f651eb
2026-03-26 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F241%252F7e4ebcbb60f94e2f9c28170950d07a3a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/241/7e4ebcbb60f94e2f9c28170950d07a3a/images/large/1.jpg not downloaded yet
2026-03-26 18:33:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/415/49d1d9905a9b414a92596ff2e092d8e8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28ac7010>
2026-03-26 18:33:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f57d87b-017c-5396-b787-51632ae69eaf/2f57d87b-017c-5396-b787-51632ae69eaf_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F485%252F2a45e42488e64829930832108bca3974%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/485/2a45e42488e64829930832108bca3974/images/large/1.jpg saved to cache
2026-03-26 18:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2f57d87b-017c-5396-b787-51632ae69eaf
2026-03-26 18:33:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2f57d87b-017c-5396-b787-51632ae69eaf, skipping ID generation
2026-03-26 18:33:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f57d87b-017c-5396-b787-51632ae69eaf with scrape type 1
2026-03-26 18:33:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2f57d87b-017c-5396-b787-51632ae69eaf sending to next pipeline
2026-03-26 18:33:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2f57d87b-017c-5396-b787-51632ae69eaf, identifier: 1985801
2026-03-26 18:33:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c6cd90>
2026-03-26 18:33:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4a3736d-3160-592a-85ae-6b8af0e406b7/b4a3736d-3160-592a-85ae-6b8af0e406b7_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F539%252Fefe6304b6d6645f3bb14ac9140080386%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/539/efe6304b6d6645f3bb14ac9140080386/images/large/1.jpg saved to cache
2026-03-26 18:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b4a3736d-3160-592a-85ae-6b8af0e406b7
2026-03-26 18:33:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b4a3736d-3160-592a-85ae-6b8af0e406b7, skipping ID generation
2026-03-26 18:33:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4a3736d-3160-592a-85ae-6b8af0e406b7 with scrape type 1
2026-03-26 18:33:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b4a3736d-3160-592a-85ae-6b8af0e406b7 sending to next pipeline
2026-03-26 18:33:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b4a3736d-3160-592a-85ae-6b8af0e406b7, identifier: 1985802
2026-03-26 18:33:10 [ayvens.es] INFO: Found listing with ID: 1985811
2026-03-26 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985811%27 HTTP/1.1" 200 None
2026-03-26 18:33:10 [ayvens.es] INFO: Scrape type for 1985811: 1
2026-03-26 18:33:10 [ayvens.es] INFO: Extracting data for car ID: 1985811
2026-03-26 18:33:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c2aca3b-317f-5501-b6fb-a03ffbe1d7d0 with identifier: 1985811
2026-03-26 18:33:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c2aca3b-317f-5501-b6fb-a03ffbe1d7d0 with scrape type 1
2026-03-26 18:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0c2aca3b-317f-5501-b6fb-a03ffbe1d7d0
2026-03-26 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F535%252Fbb128674085a4f48ab9d4b1940e17990%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/535/bb128674085a4f48ab9d4b1940e17990/images/large/1.jpg not downloaded yet
2026-03-26 18:33:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2f57d87b-017c-5396-b787-51632ae69eaf with identifier: 1985801
2026-03-26 18:33:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2f57d87b-017c-5396-b787-51632ae69eaf with identifier: 1985801
2026-03-26 18:33:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 2f57d87b-017c-5396-b787-51632ae69eaf with identifier: 1985801 to the API
2026-03-26 18:33:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/485/2a45e42488e64829930832108bca3974/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 101,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '2f57d87b-017c-5396-b787-51632ae69eaf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MEGANE',
 'odometer': 131824,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f57d87b-017c-5396-b787-51632ae69eaf/2f57d87b-017c-5396-b787-51632ae69eaf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 495132,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/485/2a45e42488e64829930832108bca3974/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT MEGANE Business Blue dCi 81 kW (115CV)',
 'transmission': 'manual',
 'trim': 'Business Blue dCi 81 kW (115CV)',
 'vin': None,
 'year': 2019}
2026-03-26 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985801%27 HTTP/1.1" 200 None
2026-03-26 18:33:10 [ayvens.es] INFO: Saving data for 1985801: {'created_time': 1774549990.958016, 'last_price_update_time': 1774549990.958027, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985801') HTTP/1.1" 204 0
2026-03-26 18:33:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b4a3736d-3160-592a-85ae-6b8af0e406b7 with identifier: 1985802
2026-03-26 18:33:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b4a3736d-3160-592a-85ae-6b8af0e406b7 with identifier: 1985802
2026-03-26 18:33:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b4a3736d-3160-592a-85ae-6b8af0e406b7 with identifier: 1985802 to the API
2026-03-26 18:33:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/539/efe6304b6d6645f3bb14ac9140080386/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b4a3736d-3160-592a-85ae-6b8af0e406b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 133072,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4a3736d-3160-592a-85ae-6b8af0e406b7/b4a3736d-3160-592a-85ae-6b8af0e406b7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 337592,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/539/efe6304b6d6645f3bb14ac9140080386/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON 2.0 TDI 85kW S&S Style Go',
 'transmission': 'manual',
 'trim': '2.0 TDI 85kW S&S Style Go',
 'vin': None,
 'year': 2021}
2026-03-26 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985802%27 HTTP/1.1" 200 None
2026-03-26 18:33:11 [ayvens.es] INFO: Saving data for 1985802: {'created_time': 1774549991.298516, 'last_price_update_time': 1774549991.298526, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985802') HTTP/1.1" 204 0
2026-03-26 18:33:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/141/8876bf4fbe1545cba2b9dcd8f961bdc9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:11 [ayvens.es] INFO: Found listing with ID: 1985812
2026-03-26 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985812%27 HTTP/1.1" 200 None
2026-03-26 18:33:11 [ayvens.es] INFO: Scrape type for 1985812: 1
2026-03-26 18:33:11 [ayvens.es] INFO: Extracting data for car ID: 1985812
2026-03-26 18:33:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59e50255-3f14-5f4b-ab2a-f0183266b248 with identifier: 1985812
2026-03-26 18:33:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59e50255-3f14-5f4b-ab2a-f0183266b248 with scrape type 1
2026-03-26 18:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 59e50255-3f14-5f4b-ab2a-f0183266b248
2026-03-26 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F111%252F0a440d4078df457997843a40829955f7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/111/0a440d4078df457997843a40829955f7/images/large/1.jpg not downloaded yet
2026-03-26 18:33:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c9ccd0>
2026-03-26 18:33:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dca2e5a2-10a1-50a6-a7b4-007b30c11869/dca2e5a2-10a1-50a6-a7b4-007b30c11869_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F930%252F15897be6e2f34a96adf3c2859a8465e4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/930/15897be6e2f34a96adf3c2859a8465e4/images/large/1.jpg saved to cache
2026-03-26 18:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dca2e5a2-10a1-50a6-a7b4-007b30c11869
2026-03-26 18:33:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dca2e5a2-10a1-50a6-a7b4-007b30c11869, skipping ID generation
2026-03-26 18:33:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dca2e5a2-10a1-50a6-a7b4-007b30c11869 with scrape type 1
2026-03-26 18:33:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dca2e5a2-10a1-50a6-a7b4-007b30c11869 sending to next pipeline
2026-03-26 18:33:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: dca2e5a2-10a1-50a6-a7b4-007b30c11869, identifier: 1985803
2026-03-26 18:33:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a2ab06850>
2026-03-26 18:33:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9771bbae-7517-542a-bcc1-f10084ed11b8/9771bbae-7517-542a-bcc1-f10084ed11b8_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F191%252F52b50f63fe8043ac81678d5aeb12e285%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/191/52b50f63fe8043ac81678d5aeb12e285/images/large/1.jpg saved to cache
2026-03-26 18:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9771bbae-7517-542a-bcc1-f10084ed11b8
2026-03-26 18:33:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9771bbae-7517-542a-bcc1-f10084ed11b8, skipping ID generation
2026-03-26 18:33:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9771bbae-7517-542a-bcc1-f10084ed11b8 with scrape type 1
2026-03-26 18:33:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9771bbae-7517-542a-bcc1-f10084ed11b8 sending to next pipeline
2026-03-26 18:33:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9771bbae-7517-542a-bcc1-f10084ed11b8, identifier: 1985804
2026-03-26 18:33:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28e5f410>
2026-03-26 18:33:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_424a7f08-eafd-5b9b-b7d1-b84a0c5150a8/424a7f08-eafd-5b9b-b7d1-b84a0c5150a8_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F415%252F49d1d9905a9b414a92596ff2e092d8e8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/415/49d1d9905a9b414a92596ff2e092d8e8/images/large/1.jpg saved to cache
2026-03-26 18:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 424a7f08-eafd-5b9b-b7d1-b84a0c5150a8
2026-03-26 18:33:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 424a7f08-eafd-5b9b-b7d1-b84a0c5150a8, skipping ID generation
2026-03-26 18:33:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 424a7f08-eafd-5b9b-b7d1-b84a0c5150a8 with scrape type 1
2026-03-26 18:33:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 424a7f08-eafd-5b9b-b7d1-b84a0c5150a8 sending to next pipeline
2026-03-26 18:33:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 424a7f08-eafd-5b9b-b7d1-b84a0c5150a8, identifier: 1985805
2026-03-26 18:33:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: dca2e5a2-10a1-50a6-a7b4-007b30c11869 with identifier: 1985803
2026-03-26 18:33:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: dca2e5a2-10a1-50a6-a7b4-007b30c11869 with identifier: 1985803
2026-03-26 18:33:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: dca2e5a2-10a1-50a6-a7b4-007b30c11869 with identifier: 1985803 to the API
2026-03-26 18:33:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/930/15897be6e2f34a96adf3c2859a8465e4/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'dca2e5a2-10a1-50a6-a7b4-007b30c11869',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KAROQ',
 'odometer': 91356,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dca2e5a2-10a1-50a6-a7b4-007b30c11869/dca2e5a2-10a1-50a6-a7b4-007b30c11869_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 578435,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/930/15897be6e2f34a96adf3c2859a8465e4/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA KAROQ 2.0 TDI 110kW (150CV) DSG 4X4 Ambition',
 'transmission': 'manual',
 'trim': '2.0 TDI 110kW (150CV) DSG 4X4 Ambition',
 'vin': None,
 'year': 2022}
2026-03-26 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985803%27 HTTP/1.1" 200 None
2026-03-26 18:33:12 [ayvens.es] INFO: Saving data for 1985803: {'created_time': 1774549992.222199, 'last_price_update_time': 1774549992.222208, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985803') HTTP/1.1" 204 0
2026-03-26 18:33:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9771bbae-7517-542a-bcc1-f10084ed11b8 with identifier: 1985804
2026-03-26 18:33:12 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:33:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9771bbae-7517-542a-bcc1-f10084ed11b8 with identifier: 1985804
2026-03-26 18:33:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9771bbae-7517-542a-bcc1-f10084ed11b8 with identifier: 1985804 to the API
2026-03-26 18:33:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/191/52b50f63fe8043ac81678d5aeb12e285/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'Pintura blanco glaci',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '9771bbae-7517-542a-bcc1-f10084ed11b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'EXPRESS',
 'odometer': 102987,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9771bbae-7517-542a-bcc1-f10084ed11b8/9771bbae-7517-542a-bcc1-f10084ed11b8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 348150,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/191/52b50f63fe8043ac81678d5aeb12e285/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-15',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT EXPRESS Confort 1.5 Blue dCi 55 kW (75 cv)',
 'transmission': 'manual',
 'trim': 'Confort 1.5 Blue dCi 55 kW (75 cv)',
 'vin': None,
 'year': 2022}
2026-03-26 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985804%27 HTTP/1.1" 200 None
2026-03-26 18:33:12 [ayvens.es] INFO: Saving data for 1985804: {'created_time': 1774549992.561489, 'last_price_update_time': 1774549992.561499, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985804') HTTP/1.1" 204 0
2026-03-26 18:33:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 424a7f08-eafd-5b9b-b7d1-b84a0c5150a8 with identifier: 1985805
2026-03-26 18:33:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 424a7f08-eafd-5b9b-b7d1-b84a0c5150a8 with identifier: 1985805
2026-03-26 18:33:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 424a7f08-eafd-5b9b-b7d1-b84a0c5150a8 with identifier: 1985805 to the API
2026-03-26 18:33:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/415/49d1d9905a9b414a92596ff2e092d8e8/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '424a7f08-eafd-5b9b-b7d1-b84a0c5150a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 127171,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424a7f08-eafd-5b9b-b7d1-b84a0c5150a8/424a7f08-eafd-5b9b-b7d1-b84a0c5150a8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332994,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/415/49d1d9905a9b414a92596ff2e092d8e8/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON SP 2.0 TDI 85kW Style Go',
 'transmission': 'manual',
 'trim': 'SP 2.0 TDI 85kW Style Go',
 'vin': None,
 'year': 2021}
2026-03-26 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985805%27 HTTP/1.1" 200 None
2026-03-26 18:33:12 [ayvens.es] INFO: Saving data for 1985805: {'created_time': 1774549992.904771, 'last_price_update_time': 1774549992.90478, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985805') HTTP/1.1" 204 0
2026-03-26 18:33:12 [ayvens.es] INFO: Found listing with ID: 1985813
2026-03-26 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985813%27 HTTP/1.1" 200 None
2026-03-26 18:33:13 [ayvens.es] INFO: Scrape type for 1985813: 1
2026-03-26 18:33:13 [ayvens.es] INFO: Extracting data for car ID: 1985813
2026-03-26 18:33:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acdfcfd0-4c00-5abd-8f37-f4b9544f8ddd with identifier: 1985813
2026-03-26 18:33:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acdfcfd0-4c00-5abd-8f37-f4b9544f8ddd with scrape type 1
2026-03-26 18:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item acdfcfd0-4c00-5abd-8f37-f4b9544f8ddd
2026-03-26 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F338%252Fad8c99d7aee44eac961500fe5fe27dc0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/338/ad8c99d7aee44eac961500fe5fe27dc0/images/large/1.jpg not downloaded yet
2026-03-26 18:33:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28384590>
2026-03-26 18:33:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1f6d115-1b08-541f-a6c9-09883dacec13/a1f6d115-1b08-541f-a6c9-09883dacec13_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F141%252F8876bf4fbe1545cba2b9dcd8f961bdc9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/141/8876bf4fbe1545cba2b9dcd8f961bdc9/images/large/1.jpg saved to cache
2026-03-26 18:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a1f6d115-1b08-541f-a6c9-09883dacec13
2026-03-26 18:33:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a1f6d115-1b08-541f-a6c9-09883dacec13, skipping ID generation
2026-03-26 18:33:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1f6d115-1b08-541f-a6c9-09883dacec13 with scrape type 1
2026-03-26 18:33:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a1f6d115-1b08-541f-a6c9-09883dacec13 sending to next pipeline
2026-03-26 18:33:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a1f6d115-1b08-541f-a6c9-09883dacec13, identifier: 1985806
2026-03-26 18:33:13 [ayvens.es] INFO: Found listing with ID: 1985814
2026-03-26 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985814%27 HTTP/1.1" 200 None
2026-03-26 18:33:13 [ayvens.es] INFO: Scrape type for 1985814: 1
2026-03-26 18:33:13 [ayvens.es] INFO: Extracting data for car ID: 1985814
2026-03-26 18:33:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63ce2c25-4b0e-51a1-a499-88ac4cb7acf2 with identifier: 1985814
2026-03-26 18:33:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63ce2c25-4b0e-51a1-a499-88ac4cb7acf2 with scrape type 1
2026-03-26 18:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 63ce2c25-4b0e-51a1-a499-88ac4cb7acf2
2026-03-26 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F787%252F9bc9bb8a0bb24908885c8684873ba3fd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/787/9bc9bb8a0bb24908885c8684873ba3fd/images/large/1.jpg not downloaded yet
2026-03-26 18:33:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a1f6d115-1b08-541f-a6c9-09883dacec13 with identifier: 1985806
2026-03-26 18:33:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a1f6d115-1b08-541f-a6c9-09883dacec13 with identifier: 1985806
2026-03-26 18:33:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a1f6d115-1b08-541f-a6c9-09883dacec13 with identifier: 1985806 to the API
2026-03-26 18:33:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/141/8876bf4fbe1545cba2b9dcd8f961bdc9/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a1f6d115-1b08-541f-a6c9-09883dacec13',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MEGANE',
 'odometer': 233517,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1f6d115-1b08-541f-a6c9-09883dacec13/a1f6d115-1b08-541f-a6c9-09883dacec13_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 357815,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/141/8876bf4fbe1545cba2b9dcd8f961bdc9/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT MEGANE (O) S.T. Business Blue dCi 85kW (115CV)',
 'transmission': 'manual',
 'trim': '(O) S.T. Business Blue dCi 85kW (115CV)',
 'vin': None,
 'year': 2020}
2026-03-26 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985806%27 HTTP/1.1" 200 None
2026-03-26 18:33:13 [ayvens.es] INFO: Saving data for 1985806: {'created_time': 1774549993.84228, 'last_price_update_time': 1774549993.84229, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985806') HTTP/1.1" 204 0
2026-03-26 18:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/207/a516f4bad45247f8b0affe61454f5ef2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/896/86cb3614bdc647c88abe40f123c38e9d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:13 [ayvens.es] INFO: Found listing with ID: 1985815
2026-03-26 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985815%27 HTTP/1.1" 200 None
2026-03-26 18:33:13 [ayvens.es] INFO: Scrape type for 1985815: 1
2026-03-26 18:33:13 [ayvens.es] INFO: Extracting data for car ID: 1985815
2026-03-26 18:33:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52be57fd-c0b3-5c2b-9c56-e9c84ddd467c with identifier: 1985815
2026-03-26 18:33:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52be57fd-c0b3-5c2b-9c56-e9c84ddd467c with scrape type 1
2026-03-26 18:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 52be57fd-c0b3-5c2b-9c56-e9c84ddd467c
2026-03-26 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F596%252Fa3eb2face2704e3587b13855a85b2922%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/596/a3eb2face2704e3587b13855a85b2922/images/large/1.jpg not downloaded yet
2026-03-26 18:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/258/b4fc4bbbc1a84ec9a258d26d56e93b1c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:13 [ayvens.es] INFO: Found listing with ID: 1985816
2026-03-26 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985816%27 HTTP/1.1" 200 None
2026-03-26 18:33:13 [ayvens.es] INFO: Scrape type for 1985816: 1
2026-03-26 18:33:13 [ayvens.es] INFO: Extracting data for car ID: 1985816
2026-03-26 18:33:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 656ced1c-24d7-5269-991b-fa77280cd441 with identifier: 1985816
2026-03-26 18:33:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 656ced1c-24d7-5269-991b-fa77280cd441 with scrape type 1
2026-03-26 18:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 656ced1c-24d7-5269-991b-fa77280cd441
2026-03-26 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F677%252Fb255890173c740808df9c7307182f414%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/677/b255890173c740808df9c7307182f414/images/large/1.jpg not downloaded yet
2026-03-26 18:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/535/bb128674085a4f48ab9d4b1940e17990/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/241/7e4ebcbb60f94e2f9c28170950d07a3a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:13 [ayvens.es] INFO: Found listing with ID: 1985817
2026-03-26 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985817%27 HTTP/1.1" 200 None
2026-03-26 18:33:13 [ayvens.es] INFO: Scrape type for 1985817: 1
2026-03-26 18:33:13 [ayvens.es] INFO: Extracting data for car ID: 1985817
2026-03-26 18:33:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9328d5ff-e4c1-5db4-917c-c33888ab1601 with identifier: 1985817
2026-03-26 18:33:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9328d5ff-e4c1-5db4-917c-c33888ab1601 with scrape type 1
2026-03-26 18:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9328d5ff-e4c1-5db4-917c-c33888ab1601
2026-03-26 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F056%252Fb831bf8aea084e5e884afc104cf9072f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/056/b831bf8aea084e5e884afc104cf9072f/images/large/1.jpg not downloaded yet
2026-03-26 18:33:13 [ayvens.es] INFO: Found listing with ID: 1985818
2026-03-26 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985818%27 HTTP/1.1" 200 None
2026-03-26 18:33:14 [ayvens.es] INFO: Scrape type for 1985818: 1
2026-03-26 18:33:14 [ayvens.es] INFO: Extracting data for car ID: 1985818
2026-03-26 18:33:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 956ce645-bc31-5e40-af6c-d968fce00ad8 with identifier: 1985818
2026-03-26 18:33:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 956ce645-bc31-5e40-af6c-d968fce00ad8 with scrape type 1
2026-03-26 18:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 956ce645-bc31-5e40-af6c-d968fce00ad8
2026-03-26 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F493%252F13351f0ac2d841de8d83fdc9d6472b80%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/493/13351f0ac2d841de8d83fdc9d6472b80/images/large/1.jpg not downloaded yet
2026-03-26 18:33:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/111/0a440d4078df457997843a40829955f7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a283c0190>
2026-03-26 18:33:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57afd5d4-56cf-50b7-aea0-f09b80c91f4e/57afd5d4-56cf-50b7-aea0-f09b80c91f4e_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F207%252Fa516f4bad45247f8b0affe61454f5ef2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/207/a516f4bad45247f8b0affe61454f5ef2/images/large/1.jpg saved to cache
2026-03-26 18:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 57afd5d4-56cf-50b7-aea0-f09b80c91f4e
2026-03-26 18:33:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 57afd5d4-56cf-50b7-aea0-f09b80c91f4e, skipping ID generation
2026-03-26 18:33:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57afd5d4-56cf-50b7-aea0-f09b80c91f4e with scrape type 1
2026-03-26 18:33:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 57afd5d4-56cf-50b7-aea0-f09b80c91f4e sending to next pipeline
2026-03-26 18:33:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 57afd5d4-56cf-50b7-aea0-f09b80c91f4e, identifier: 1985807
2026-03-26 18:33:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a2820fe10>
2026-03-26 18:33:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46f545bc-34f3-5f2f-9f33-4948b6be6090/46f545bc-34f3-5f2f-9f33-4948b6be6090_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F896%252F86cb3614bdc647c88abe40f123c38e9d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/896/86cb3614bdc647c88abe40f123c38e9d/images/large/1.jpg saved to cache
2026-03-26 18:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 46f545bc-34f3-5f2f-9f33-4948b6be6090
2026-03-26 18:33:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 46f545bc-34f3-5f2f-9f33-4948b6be6090, skipping ID generation
2026-03-26 18:33:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46f545bc-34f3-5f2f-9f33-4948b6be6090 with scrape type 1
2026-03-26 18:33:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 46f545bc-34f3-5f2f-9f33-4948b6be6090 sending to next pipeline
2026-03-26 18:33:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 46f545bc-34f3-5f2f-9f33-4948b6be6090, identifier: 1985808
2026-03-26 18:33:14 [ayvens.es] INFO: Found listing with ID: 1985819
2026-03-26 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985819%27 HTTP/1.1" 200 None
2026-03-26 18:33:14 [ayvens.es] INFO: Scrape type for 1985819: 1
2026-03-26 18:33:14 [ayvens.es] INFO: Extracting data for car ID: 1985819
2026-03-26 18:33:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a52dbe0a-2397-58e1-9252-f1c47c24472c with identifier: 1985819
2026-03-26 18:33:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a52dbe0a-2397-58e1-9252-f1c47c24472c with scrape type 1
2026-03-26 18:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a52dbe0a-2397-58e1-9252-f1c47c24472c
2026-03-26 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F763%252F2c3f74b5e21643e18ad22a401b38c29c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/763/2c3f74b5e21643e18ad22a401b38c29c/images/large/1.jpg not downloaded yet
2026-03-26 18:33:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 57afd5d4-56cf-50b7-aea0-f09b80c91f4e with identifier: 1985807
2026-03-26 18:33:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 57afd5d4-56cf-50b7-aea0-f09b80c91f4e with identifier: 1985807
2026-03-26 18:33:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 57afd5d4-56cf-50b7-aea0-f09b80c91f4e with identifier: 1985807 to the API
2026-03-26 18:33:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/207/a516f4bad45247f8b0affe61454f5ef2/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '57afd5d4-56cf-50b7-aea0-f09b80c91f4e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO',
 'odometer': 70414,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57afd5d4-56cf-50b7-aea0-f09b80c91f4e/57afd5d4-56cf-50b7-aea0-f09b80c91f4e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 623331,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/207/a516f4bad45247f8b0affe61454f5ef2/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT KANGOO Profesional M1-AF Blue dCi 70 kW (95 CV)',
 'transmission': 'manual',
 'trim': 'Profesional M1-AF Blue dCi 70 kW (95 CV)',
 'vin': None,
 'year': 2020}
2026-03-26 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985807%27 HTTP/1.1" 200 None
2026-03-26 18:33:14 [ayvens.es] INFO: Saving data for 1985807: {'created_time': 1774549994.79063, 'last_price_update_time': 1774549994.790643, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985807') HTTP/1.1" 204 0
2026-03-26 18:33:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 46f545bc-34f3-5f2f-9f33-4948b6be6090 with identifier: 1985808
2026-03-26 18:33:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 46f545bc-34f3-5f2f-9f33-4948b6be6090 with identifier: 1985808
2026-03-26 18:33:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 46f545bc-34f3-5f2f-9f33-4948b6be6090 with identifier: 1985808 to the API
2026-03-26 18:33:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/896/86cb3614bdc647c88abe40f123c38e9d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 236,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.3L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '46f545bc-34f3-5f2f-9f33-4948b6be6090',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MASTER',
 'odometer': 113984,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46f545bc-34f3-5f2f-9f33-4948b6be6090/46f545bc-34f3-5f2f-9f33-4948b6be6090_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 485671,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/896/86cb3614bdc647c88abe40f123c38e9d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-22',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT MASTER Furgon T L2H2 3500 Bl dCi 100kW (135CV)',
 'transmission': 'manual',
 'trim': 'Furgon T L2H2 3500 Bl dCi 100kW (135CV)',
 'vin': None,
 'year': 2021}
2026-03-26 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985808%27 HTTP/1.1" 200 None
2026-03-26 18:33:15 [ayvens.es] INFO: Saving data for 1985808: {'created_time': 1774549995.215706, 'last_price_update_time': 1774549995.215718, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985808') HTTP/1.1" 204 0
2026-03-26 18:33:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28d80b90>
2026-03-26 18:33:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7994c08-27b2-5b6c-a39f-e5254a7d3ae4/b7994c08-27b2-5b6c-a39f-e5254a7d3ae4_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F258%252Fb4fc4bbbc1a84ec9a258d26d56e93b1c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/258/b4fc4bbbc1a84ec9a258d26d56e93b1c/images/large/1.jpg saved to cache
2026-03-26 18:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b7994c08-27b2-5b6c-a39f-e5254a7d3ae4
2026-03-26 18:33:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b7994c08-27b2-5b6c-a39f-e5254a7d3ae4, skipping ID generation
2026-03-26 18:33:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7994c08-27b2-5b6c-a39f-e5254a7d3ae4 with scrape type 1
2026-03-26 18:33:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b7994c08-27b2-5b6c-a39f-e5254a7d3ae4 sending to next pipeline
2026-03-26 18:33:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b7994c08-27b2-5b6c-a39f-e5254a7d3ae4, identifier: 1985809
2026-03-26 18:33:15 [ayvens.es] INFO: Found listing with ID: 1985820
2026-03-26 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985820%27 HTTP/1.1" 200 None
2026-03-26 18:33:15 [ayvens.es] INFO: Scrape type for 1985820: 1
2026-03-26 18:33:15 [ayvens.es] INFO: Extracting data for car ID: 1985820
2026-03-26 18:33:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6105727-b841-50f5-abdf-febcb256045e with identifier: 1985820
2026-03-26 18:33:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6105727-b841-50f5-abdf-febcb256045e with scrape type 1
2026-03-26 18:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a6105727-b841-50f5-abdf-febcb256045e
2026-03-26 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F736%252Fbc6050a348154f13bf2734acff3c8b6b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/736/bc6050a348154f13bf2734acff3c8b6b/images/large/1.jpg not downloaded yet
2026-03-26 18:33:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b7994c08-27b2-5b6c-a39f-e5254a7d3ae4 with identifier: 1985809
2026-03-26 18:33:15 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:33:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b7994c08-27b2-5b6c-a39f-e5254a7d3ae4 with identifier: 1985809
2026-03-26 18:33:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b7994c08-27b2-5b6c-a39f-e5254a7d3ae4 with identifier: 1985809 to the API
2026-03-26 18:33:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/258/b4fc4bbbc1a84ec9a258d26d56e93b1c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Negro profundo ef pe',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b7994c08-27b2-5b6c-a39f-e5254a7d3ae4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT',
 'odometer': 231716,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7994c08-27b2-5b6c-a39f-e5254a7d3ae4/b7994c08-27b2-5b6c-a39f-e5254a7d3ae4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329873,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/258/b4fc4bbbc1a84ec9a258d26d56e93b1c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT Variant R-Line 2.0 TDI 110kW DSG',
 'transmission': 'manual',
 'trim': 'Variant R-Line 2.0 TDI 110kW DSG',
 'vin': None,
 'year': 2022}
2026-03-26 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985809%27 HTTP/1.1" 200 None
2026-03-26 18:33:15 [ayvens.es] INFO: Saving data for 1985809: {'created_time': 1774549995.811599, 'last_price_update_time': 1774549995.811611, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985809') HTTP/1.1" 204 0
2026-03-26 18:33:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28ec1990>
2026-03-26 18:33:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c2aca3b-317f-5501-b6fb-a03ffbe1d7d0/0c2aca3b-317f-5501-b6fb-a03ffbe1d7d0_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F535%252Fbb128674085a4f48ab9d4b1940e17990%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/535/bb128674085a4f48ab9d4b1940e17990/images/large/1.jpg saved to cache
2026-03-26 18:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0c2aca3b-317f-5501-b6fb-a03ffbe1d7d0
2026-03-26 18:33:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0c2aca3b-317f-5501-b6fb-a03ffbe1d7d0, skipping ID generation
2026-03-26 18:33:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c2aca3b-317f-5501-b6fb-a03ffbe1d7d0 with scrape type 1
2026-03-26 18:33:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0c2aca3b-317f-5501-b6fb-a03ffbe1d7d0 sending to next pipeline
2026-03-26 18:33:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0c2aca3b-317f-5501-b6fb-a03ffbe1d7d0, identifier: 1985811
2026-03-26 18:33:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28e6ef50>
2026-03-26 18:33:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_891c44c7-48b5-5b47-9b25-f51a42f651eb/891c44c7-48b5-5b47-9b25-f51a42f651eb_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F241%252F7e4ebcbb60f94e2f9c28170950d07a3a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/241/7e4ebcbb60f94e2f9c28170950d07a3a/images/large/1.jpg saved to cache
2026-03-26 18:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 891c44c7-48b5-5b47-9b25-f51a42f651eb
2026-03-26 18:33:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 891c44c7-48b5-5b47-9b25-f51a42f651eb, skipping ID generation
2026-03-26 18:33:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 891c44c7-48b5-5b47-9b25-f51a42f651eb with scrape type 1
2026-03-26 18:33:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 891c44c7-48b5-5b47-9b25-f51a42f651eb sending to next pipeline
2026-03-26 18:33:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 891c44c7-48b5-5b47-9b25-f51a42f651eb, identifier: 1985810
2026-03-26 18:33:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a2832ef90>
2026-03-26 18:33:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59e50255-3f14-5f4b-ab2a-f0183266b248/59e50255-3f14-5f4b-ab2a-f0183266b248_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F111%252F0a440d4078df457997843a40829955f7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/111/0a440d4078df457997843a40829955f7/images/large/1.jpg saved to cache
2026-03-26 18:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 59e50255-3f14-5f4b-ab2a-f0183266b248
2026-03-26 18:33:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 59e50255-3f14-5f4b-ab2a-f0183266b248, skipping ID generation
2026-03-26 18:33:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59e50255-3f14-5f4b-ab2a-f0183266b248 with scrape type 1
2026-03-26 18:33:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 59e50255-3f14-5f4b-ab2a-f0183266b248 sending to next pipeline
2026-03-26 18:33:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 59e50255-3f14-5f4b-ab2a-f0183266b248, identifier: 1985812
2026-03-26 18:33:16 [ayvens.es] INFO: Found listing with ID: 1985821
2026-03-26 18:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985821%27 HTTP/1.1" 200 None
2026-03-26 18:33:16 [ayvens.es] INFO: Scrape type for 1985821: 1
2026-03-26 18:33:16 [ayvens.es] INFO: Extracting data for car ID: 1985821
2026-03-26 18:33:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ad68b07-6b3a-5953-ba51-608233f433a9 with identifier: 1985821
2026-03-26 18:33:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ad68b07-6b3a-5953-ba51-608233f433a9 with scrape type 1
2026-03-26 18:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6ad68b07-6b3a-5953-ba51-608233f433a9
2026-03-26 18:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F069%252Ffafb9b49b00c4ae9b19fd22f6fedbd1e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/069/fafb9b49b00c4ae9b19fd22f6fedbd1e/images/large/1.jpg not downloaded yet
2026-03-26 18:33:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0c2aca3b-317f-5501-b6fb-a03ffbe1d7d0 with identifier: 1985811
2026-03-26 18:33:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:33:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0c2aca3b-317f-5501-b6fb-a03ffbe1d7d0 with identifier: 1985811
2026-03-26 18:33:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0c2aca3b-317f-5501-b6fb-a03ffbe1d7d0 with identifier: 1985811 to the API
2026-03-26 18:33:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/535/bb128674085a4f48ab9d4b1940e17990/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'color': 'Plata pirita',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '0c2aca3b-317f-5501-b6fb-a03ffbe1d7d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT',
 'odometer': 142711,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c2aca3b-317f-5501-b6fb-a03ffbe1d7d0/0c2aca3b-317f-5501-b6fb-a03ffbe1d7d0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353713,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/535/bb128674085a4f48ab9d4b1940e17990/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT Variant Business 2.0 TDI 90kW (122CV) DS',
 'transmission': 'manual',
 'trim': 'Variant Business 2.0 TDI 90kW (122CV) DS',
 'vin': None,
 'year': 2021}
2026-03-26 18:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985811%27 HTTP/1.1" 200 None
2026-03-26 18:33:16 [ayvens.es] INFO: Saving data for 1985811: {'created_time': 1774549996.853189, 'last_price_update_time': 1774549996.853201, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985811') HTTP/1.1" 204 0
2026-03-26 18:33:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 891c44c7-48b5-5b47-9b25-f51a42f651eb with identifier: 1985810
2026-03-26 18:33:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 891c44c7-48b5-5b47-9b25-f51a42f651eb with identifier: 1985810
2026-03-26 18:33:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 891c44c7-48b5-5b47-9b25-f51a42f651eb with identifier: 1985810 to the API
2026-03-26 18:33:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/241/7e4ebcbb60f94e2f9c28170950d07a3a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Blanco glaciar',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '891c44c7-48b5-5b47-9b25-f51a42f651eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 109295,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_891c44c7-48b5-5b47-9b25-f51a42f651eb/891c44c7-48b5-5b47-9b25-f51a42f651eb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 530040,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/241/7e4ebcbb60f94e2f9c28170950d07a3a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO Business dCi 66kW (90CV) -18',
 'transmission': 'manual',
 'trim': 'Business dCi 66kW (90CV) -18',
 'vin': None,
 'year': 2019}
2026-03-26 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985810%27 HTTP/1.1" 200 None
2026-03-26 18:33:17 [ayvens.es] INFO: Saving data for 1985810: {'created_time': 1774549997.225982, 'last_price_update_time': 1774549997.225993, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985810') HTTP/1.1" 204 0
2026-03-26 18:33:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 59e50255-3f14-5f4b-ab2a-f0183266b248 with identifier: 1985812
2026-03-26 18:33:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 59e50255-3f14-5f4b-ab2a-f0183266b248 with identifier: 1985812
2026-03-26 18:33:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 59e50255-3f14-5f4b-ab2a-f0183266b248 with identifier: 1985812 to the API
2026-03-26 18:33:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/111/0a440d4078df457997843a40829955f7/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '59e50255-3f14-5f4b-ab2a-f0183266b248',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 71354,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59e50255-3f14-5f4b-ab2a-f0183266b248/59e50255-3f14-5f4b-ab2a-f0183266b248_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 516962,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/111/0a440d4078df457997843a40829955f7/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO Equilibre Blue dCi 74kW (100CV)',
 'transmission': 'manual',
 'trim': 'Equilibre Blue dCi 74kW (100CV)',
 'vin': None,
 'year': 2022}
2026-03-26 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985812%27 HTTP/1.1" 200 None
2026-03-26 18:33:17 [ayvens.es] INFO: Saving data for 1985812: {'created_time': 1774549997.590093, 'last_price_update_time': 1774549997.590104, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985812') HTTP/1.1" 204 0
2026-03-26 18:33:17 [ayvens.es] INFO: Found listing with ID: 1985822
2026-03-26 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985822%27 HTTP/1.1" 200 None
2026-03-26 18:33:17 [ayvens.es] INFO: Scrape type for 1985822: 1
2026-03-26 18:33:17 [ayvens.es] INFO: Extracting data for car ID: 1985822
2026-03-26 18:33:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ed69733-6d18-55d5-98a2-12476ab63395 with identifier: 1985822
2026-03-26 18:33:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ed69733-6d18-55d5-98a2-12476ab63395 with scrape type 1
2026-03-26 18:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8ed69733-6d18-55d5-98a2-12476ab63395
2026-03-26 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F409%252Febdbc3f5210d4176ab4fbf799ed37142%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/409/ebdbc3f5210d4176ab4fbf799ed37142/images/large/1.jpg not downloaded yet
2026-03-26 18:33:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/596/a3eb2face2704e3587b13855a85b2922/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/677/b255890173c740808df9c7307182f414/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:17 [ayvens.es] INFO: Found listing with ID: 1985823
2026-03-26 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985823%27 HTTP/1.1" 200 None
2026-03-26 18:33:17 [ayvens.es] INFO: Scrape type for 1985823: 1
2026-03-26 18:33:17 [ayvens.es] INFO: Extracting data for car ID: 1985823
2026-03-26 18:33:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9335d9d-23c4-513f-b5d9-ed14dae122da with identifier: 1985823
2026-03-26 18:33:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9335d9d-23c4-513f-b5d9-ed14dae122da with scrape type 1
2026-03-26 18:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e9335d9d-23c4-513f-b5d9-ed14dae122da
2026-03-26 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F316%252Fb851b75314db41ab9c4a06cd3dbe2c0f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/316/b851b75314db41ab9c4a06cd3dbe2c0f/images/large/1.jpg not downloaded yet
2026-03-26 18:33:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/338/ad8c99d7aee44eac961500fe5fe27dc0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/787/9bc9bb8a0bb24908885c8684873ba3fd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/056/b831bf8aea084e5e884afc104cf9072f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:17 [ayvens.es] INFO: Found listing with ID: 1985824
2026-03-26 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985824%27 HTTP/1.1" 200 None
2026-03-26 18:33:17 [ayvens.es] INFO: Scrape type for 1985824: 1
2026-03-26 18:33:17 [ayvens.es] INFO: Extracting data for car ID: 1985824
2026-03-26 18:33:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d61bf7dc-8916-5279-9d87-72767f280ea6 with identifier: 1985824
2026-03-26 18:33:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d61bf7dc-8916-5279-9d87-72767f280ea6 with scrape type 1
2026-03-26 18:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d61bf7dc-8916-5279-9d87-72767f280ea6
2026-03-26 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F409%252F7de06c2fa23f4fb1aabc3b9599c57437%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/409/7de06c2fa23f4fb1aabc3b9599c57437/images/large/1.jpg not downloaded yet
2026-03-26 18:33:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/493/13351f0ac2d841de8d83fdc9d6472b80/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:17 [ayvens.es] INFO: Found listing with ID: 1985825
2026-03-26 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985825%27 HTTP/1.1" 200 None
2026-03-26 18:33:17 [ayvens.es] INFO: Scrape type for 1985825: 1
2026-03-26 18:33:17 [ayvens.es] INFO: Extracting data for car ID: 1985825
2026-03-26 18:33:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c26741b3-b952-5d83-9ea1-99c2aa30b101 with identifier: 1985825
2026-03-26 18:33:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c26741b3-b952-5d83-9ea1-99c2aa30b101 with scrape type 1
2026-03-26 18:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c26741b3-b952-5d83-9ea1-99c2aa30b101
2026-03-26 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F088%252F8b546612e2a04cc3b31bebc30dd962ab%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/088/8b546612e2a04cc3b31bebc30dd962ab/images/large/1.jpg not downloaded yet
2026-03-26 18:33:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a29036290>
2026-03-26 18:33:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52be57fd-c0b3-5c2b-9c56-e9c84ddd467c/52be57fd-c0b3-5c2b-9c56-e9c84ddd467c_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F596%252Fa3eb2face2704e3587b13855a85b2922%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/596/a3eb2face2704e3587b13855a85b2922/images/large/1.jpg saved to cache
2026-03-26 18:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 52be57fd-c0b3-5c2b-9c56-e9c84ddd467c
2026-03-26 18:33:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 52be57fd-c0b3-5c2b-9c56-e9c84ddd467c, skipping ID generation
2026-03-26 18:33:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52be57fd-c0b3-5c2b-9c56-e9c84ddd467c with scrape type 1
2026-03-26 18:33:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 52be57fd-c0b3-5c2b-9c56-e9c84ddd467c sending to next pipeline
2026-03-26 18:33:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 52be57fd-c0b3-5c2b-9c56-e9c84ddd467c, identifier: 1985815
2026-03-26 18:33:18 [ayvens.es] INFO: Found listing with ID: 1985826
2026-03-26 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985826%27 HTTP/1.1" 200 None
2026-03-26 18:33:18 [ayvens.es] INFO: Scrape type for 1985826: 1
2026-03-26 18:33:18 [ayvens.es] INFO: Extracting data for car ID: 1985826
2026-03-26 18:33:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 664cf847-5b97-5f80-b41b-f14018a9f91e with identifier: 1985826
2026-03-26 18:33:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 664cf847-5b97-5f80-b41b-f14018a9f91e with scrape type 1
2026-03-26 18:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 664cf847-5b97-5f80-b41b-f14018a9f91e
2026-03-26 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F972%252F920fef82465c4d0ebb85849681ae4928%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/972/920fef82465c4d0ebb85849681ae4928/images/large/1.jpg not downloaded yet
2026-03-26 18:33:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 52be57fd-c0b3-5c2b-9c56-e9c84ddd467c with identifier: 1985815
2026-03-26 18:33:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:33:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 52be57fd-c0b3-5c2b-9c56-e9c84ddd467c with identifier: 1985815
2026-03-26 18:33:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 52be57fd-c0b3-5c2b-9c56-e9c84ddd467c with identifier: 1985815 to the API
2026-03-26 18:33:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/596/a3eb2face2704e3587b13855a85b2922/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Gris indy',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '52be57fd-c0b3-5c2b-9c56-e9c84ddd467c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN',
 'odometer': 188760,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52be57fd-c0b3-5c2b-9c56-e9c84ddd467c/52be57fd-c0b3-5c2b-9c56-e9c84ddd467c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 515780,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/596/a3eb2face2704e3587b13855a85b2922/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN Advance 2.0 TDI 110kW (150CV)',
 'transmission': 'manual',
 'trim': 'Advance 2.0 TDI 110kW (150CV)',
 'vin': None,
 'year': 2020}
2026-03-26 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985815%27 HTTP/1.1" 200 None
2026-03-26 18:33:18 [ayvens.es] INFO: Saving data for 1985815: {'created_time': 1774549998.428145, 'last_price_update_time': 1774549998.428155, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985815') HTTP/1.1" 204 0
2026-03-26 18:33:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a29035450>
2026-03-26 18:33:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_656ced1c-24d7-5269-991b-fa77280cd441/656ced1c-24d7-5269-991b-fa77280cd441_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F677%252Fb255890173c740808df9c7307182f414%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/677/b255890173c740808df9c7307182f414/images/large/1.jpg saved to cache
2026-03-26 18:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 656ced1c-24d7-5269-991b-fa77280cd441
2026-03-26 18:33:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 656ced1c-24d7-5269-991b-fa77280cd441, skipping ID generation
2026-03-26 18:33:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 656ced1c-24d7-5269-991b-fa77280cd441 with scrape type 1
2026-03-26 18:33:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 656ced1c-24d7-5269-991b-fa77280cd441 sending to next pipeline
2026-03-26 18:33:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 656ced1c-24d7-5269-991b-fa77280cd441, identifier: 1985816
2026-03-26 18:33:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28ec20d0>
2026-03-26 18:33:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acdfcfd0-4c00-5abd-8f37-f4b9544f8ddd/acdfcfd0-4c00-5abd-8f37-f4b9544f8ddd_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F338%252Fad8c99d7aee44eac961500fe5fe27dc0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/338/ad8c99d7aee44eac961500fe5fe27dc0/images/large/1.jpg saved to cache
2026-03-26 18:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item acdfcfd0-4c00-5abd-8f37-f4b9544f8ddd
2026-03-26 18:33:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: acdfcfd0-4c00-5abd-8f37-f4b9544f8ddd, skipping ID generation
2026-03-26 18:33:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acdfcfd0-4c00-5abd-8f37-f4b9544f8ddd with scrape type 1
2026-03-26 18:33:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item acdfcfd0-4c00-5abd-8f37-f4b9544f8ddd sending to next pipeline
2026-03-26 18:33:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: acdfcfd0-4c00-5abd-8f37-f4b9544f8ddd, identifier: 1985813
2026-03-26 18:33:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28e5cb90>
2026-03-26 18:33:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63ce2c25-4b0e-51a1-a499-88ac4cb7acf2/63ce2c25-4b0e-51a1-a499-88ac4cb7acf2_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F787%252F9bc9bb8a0bb24908885c8684873ba3fd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/787/9bc9bb8a0bb24908885c8684873ba3fd/images/large/1.jpg saved to cache
2026-03-26 18:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 63ce2c25-4b0e-51a1-a499-88ac4cb7acf2
2026-03-26 18:33:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 63ce2c25-4b0e-51a1-a499-88ac4cb7acf2, skipping ID generation
2026-03-26 18:33:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63ce2c25-4b0e-51a1-a499-88ac4cb7acf2 with scrape type 1
2026-03-26 18:33:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 63ce2c25-4b0e-51a1-a499-88ac4cb7acf2 sending to next pipeline
2026-03-26 18:33:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 63ce2c25-4b0e-51a1-a499-88ac4cb7acf2, identifier: 1985814
2026-03-26 18:33:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28d81110>
2026-03-26 18:33:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9328d5ff-e4c1-5db4-917c-c33888ab1601/9328d5ff-e4c1-5db4-917c-c33888ab1601_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F056%252Fb831bf8aea084e5e884afc104cf9072f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/056/b831bf8aea084e5e884afc104cf9072f/images/large/1.jpg saved to cache
2026-03-26 18:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9328d5ff-e4c1-5db4-917c-c33888ab1601
2026-03-26 18:33:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9328d5ff-e4c1-5db4-917c-c33888ab1601, skipping ID generation
2026-03-26 18:33:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9328d5ff-e4c1-5db4-917c-c33888ab1601 with scrape type 1
2026-03-26 18:33:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9328d5ff-e4c1-5db4-917c-c33888ab1601 sending to next pipeline
2026-03-26 18:33:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9328d5ff-e4c1-5db4-917c-c33888ab1601, identifier: 1985817
2026-03-26 18:33:19 [ayvens.es] INFO: Found listing with ID: 1985827
2026-03-26 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985827%27 HTTP/1.1" 200 None
2026-03-26 18:33:19 [ayvens.es] INFO: Scrape type for 1985827: 1
2026-03-26 18:33:19 [ayvens.es] INFO: Extracting data for car ID: 1985827
2026-03-26 18:33:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7ce036c-ba84-5f72-9300-0f0af027e100 with identifier: 1985827
2026-03-26 18:33:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7ce036c-ba84-5f72-9300-0f0af027e100 with scrape type 1
2026-03-26 18:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c7ce036c-ba84-5f72-9300-0f0af027e100
2026-03-26 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F940%252Fbdac037475d546aa897a50fc57cca43c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/940/bdac037475d546aa897a50fc57cca43c/images/large/1.jpg not downloaded yet
2026-03-26 18:33:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 656ced1c-24d7-5269-991b-fa77280cd441 with identifier: 1985816
2026-03-26 18:33:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 656ced1c-24d7-5269-991b-fa77280cd441 with identifier: 1985816
2026-03-26 18:33:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 656ced1c-24d7-5269-991b-fa77280cd441 with identifier: 1985816 to the API
2026-03-26 18:33:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/677/b255890173c740808df9c7307182f414/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 86,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '656ced1c-24d7-5269-991b-fa77280cd441',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'C-HR',
 'odometer': 101326,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_656ced1c-24d7-5269-991b-fa77280cd441/656ced1c-24d7-5269-991b-fa77280cd441_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 508219,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/677/b255890173c740808df9c7307182f414/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA C-HR 1.8 125H Active',
 'transmission': 'manual',
 'trim': '1.8 125H Active',
 'vin': None,
 'year': 2019}
2026-03-26 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985816%27 HTTP/1.1" 200 None
2026-03-26 18:33:19 [ayvens.es] INFO: Saving data for 1985816: {'created_time': 1774549999.41966, 'last_price_update_time': 1774549999.419672, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985816') HTTP/1.1" 204 0
2026-03-26 18:33:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: acdfcfd0-4c00-5abd-8f37-f4b9544f8ddd with identifier: 1985813
2026-03-26 18:33:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: acdfcfd0-4c00-5abd-8f37-f4b9544f8ddd with identifier: 1985813
2026-03-26 18:33:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: acdfcfd0-4c00-5abd-8f37-f4b9544f8ddd with identifier: 1985813 to the API
2026-03-26 18:33:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/338/ad8c99d7aee44eac961500fe5fe27dc0/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'acdfcfd0-4c00-5abd-8f37-f4b9544f8ddd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'POLO',
 'odometer': 61511,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acdfcfd0-4c00-5abd-8f37-f4b9544f8ddd/acdfcfd0-4c00-5abd-8f37-f4b9544f8ddd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 555618,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/338/ad8c99d7aee44eac961500fe5fe27dc0/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN POLO Advance 1.0 TSI 70kW (95CV)',
 'transmission': 'manual',
 'trim': 'Advance 1.0 TSI 70kW (95CV)',
 'vin': None,
 'year': 2019}
2026-03-26 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985813%27 HTTP/1.1" 200 None
2026-03-26 18:33:19 [ayvens.es] INFO: Saving data for 1985813: {'created_time': 1774549999.762521, 'last_price_update_time': 1774549999.762531, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985813') HTTP/1.1" 204 0
2026-03-26 18:33:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 63ce2c25-4b0e-51a1-a499-88ac4cb7acf2 with identifier: 1985814
2026-03-26 18:33:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 63ce2c25-4b0e-51a1-a499-88ac4cb7acf2 with identifier: 1985814
2026-03-26 18:33:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 63ce2c25-4b0e-51a1-a499-88ac4cb7acf2 with identifier: 1985814 to the API
2026-03-26 18:33:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/787/9bc9bb8a0bb24908885c8684873ba3fd/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '63ce2c25-4b0e-51a1-a499-88ac4cb7acf2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ARONA',
 'odometer': 98343,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63ce2c25-4b0e-51a1-a499-88ac4cb7acf2/63ce2c25-4b0e-51a1-a499-88ac4cb7acf2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 543121,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/787/9bc9bb8a0bb24908885c8684873ba3fd/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ARONA 1.0 TSI 85kW (115CV) Style Edition Eco',
 'transmission': 'manual',
 'trim': '1.0 TSI 85kW (115CV) Style Edition Eco',
 'vin': None,
 'year': 2020}
2026-03-26 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985814%27 HTTP/1.1" 200 None
2026-03-26 18:33:20 [ayvens.es] INFO: Saving data for 1985814: {'created_time': 1774550000.107754, 'last_price_update_time': 1774550000.107765, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985814') HTTP/1.1" 204 0
2026-03-26 18:33:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9328d5ff-e4c1-5db4-917c-c33888ab1601 with identifier: 1985817
2026-03-26 18:33:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9328d5ff-e4c1-5db4-917c-c33888ab1601 with identifier: 1985817
2026-03-26 18:33:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9328d5ff-e4c1-5db4-917c-c33888ab1601 with identifier: 1985817 to the API
2026-03-26 18:33:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/056/b831bf8aea084e5e884afc104cf9072f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 179,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.4L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '9328d5ff-e4c1-5db4-917c-c33888ab1601',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'HILUX',
 'odometer': 80249,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9328d5ff-e4c1-5db4-917c-c33888ab1601/9328d5ff-e4c1-5db4-917c-c33888ab1601_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 480327,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/056/b831bf8aea084e5e884afc104cf9072f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA HILUX 2.4 D-4D Cabina Doble GX',
 'transmission': 'manual',
 'trim': '2.4 D-4D Cabina Doble GX',
 'vin': None,
 'year': 2021}
2026-03-26 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985817%27 HTTP/1.1" 200 None
2026-03-26 18:33:20 [ayvens.es] INFO: Saving data for 1985817: {'created_time': 1774550000.456177, 'last_price_update_time': 1774550000.456187, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985817') HTTP/1.1" 204 0
2026-03-26 18:33:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28d80cd0>
2026-03-26 18:33:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_956ce645-bc31-5e40-af6c-d968fce00ad8/956ce645-bc31-5e40-af6c-d968fce00ad8_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F493%252F13351f0ac2d841de8d83fdc9d6472b80%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/493/13351f0ac2d841de8d83fdc9d6472b80/images/large/1.jpg saved to cache
2026-03-26 18:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 956ce645-bc31-5e40-af6c-d968fce00ad8
2026-03-26 18:33:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 956ce645-bc31-5e40-af6c-d968fce00ad8, skipping ID generation
2026-03-26 18:33:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 956ce645-bc31-5e40-af6c-d968fce00ad8 with scrape type 1
2026-03-26 18:33:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 956ce645-bc31-5e40-af6c-d968fce00ad8 sending to next pipeline
2026-03-26 18:33:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 956ce645-bc31-5e40-af6c-d968fce00ad8, identifier: 1985818
2026-03-26 18:33:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/763/2c3f74b5e21643e18ad22a401b38c29c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/069/fafb9b49b00c4ae9b19fd22f6fedbd1e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:20 [ayvens.es] INFO: Found listing with ID: 1985828
2026-03-26 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985828%27 HTTP/1.1" 200 None
2026-03-26 18:33:20 [ayvens.es] INFO: Scrape type for 1985828: 1
2026-03-26 18:33:20 [ayvens.es] INFO: Extracting data for car ID: 1985828
2026-03-26 18:33:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78860afc-54ee-5779-ba9f-582d6ca4dace with identifier: 1985828
2026-03-26 18:33:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78860afc-54ee-5779-ba9f-582d6ca4dace with scrape type 1
2026-03-26 18:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 78860afc-54ee-5779-ba9f-582d6ca4dace
2026-03-26 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F527%252Fbc4904be2b2045fc9f7cd7189b3bb981%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/527/bc4904be2b2045fc9f7cd7189b3bb981/images/large/1.jpg not downloaded yet
2026-03-26 18:33:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 956ce645-bc31-5e40-af6c-d968fce00ad8 with identifier: 1985818
2026-03-26 18:33:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 956ce645-bc31-5e40-af6c-d968fce00ad8 with identifier: 1985818
2026-03-26 18:33:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 956ce645-bc31-5e40-af6c-d968fce00ad8 with identifier: 1985818 to the API
2026-03-26 18:33:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/493/13351f0ac2d841de8d83fdc9d6472b80/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '956ce645-bc31-5e40-af6c-d968fce00ad8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'POLO',
 'odometer': 34230,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_956ce645-bc31-5e40-af6c-d968fce00ad8/956ce645-bc31-5e40-af6c-d968fce00ad8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 517923,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/493/13351f0ac2d841de8d83fdc9d6472b80/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN POLO Sport 1.0 TSI 70kW (95CV)',
 'transmission': 'manual',
 'trim': 'Sport 1.0 TSI 70kW (95CV)',
 'vin': None,
 'year': 2020}
2026-03-26 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985818%27 HTTP/1.1" 200 None
2026-03-26 18:33:20 [ayvens.es] INFO: Saving data for 1985818: {'created_time': 1774550000.965081, 'last_price_update_time': 1774550000.965091, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985818') HTTP/1.1" 204 0
2026-03-26 18:33:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/409/ebdbc3f5210d4176ab4fbf799ed37142/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/316/b851b75314db41ab9c4a06cd3dbe2c0f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:21 [ayvens.es] INFO: Found listing with ID: 1985829
2026-03-26 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985829%27 HTTP/1.1" 200 None
2026-03-26 18:33:21 [ayvens.es] INFO: Scrape type for 1985829: 1
2026-03-26 18:33:21 [ayvens.es] INFO: Extracting data for car ID: 1985829
2026-03-26 18:33:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e65ac201-ca32-55ff-9b5e-a00bdf901033 with identifier: 1985829
2026-03-26 18:33:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e65ac201-ca32-55ff-9b5e-a00bdf901033 with scrape type 1
2026-03-26 18:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e65ac201-ca32-55ff-9b5e-a00bdf901033
2026-03-26 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F315%252Fb1980d4d343c4e2890db240cde6cf71c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/315/b1980d4d343c4e2890db240cde6cf71c/images/large/1.jpg not downloaded yet
2026-03-26 18:33:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/736/bc6050a348154f13bf2734acff3c8b6b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a2b4ec890>
2026-03-26 18:33:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a52dbe0a-2397-58e1-9252-f1c47c24472c/a52dbe0a-2397-58e1-9252-f1c47c24472c_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F763%252F2c3f74b5e21643e18ad22a401b38c29c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/763/2c3f74b5e21643e18ad22a401b38c29c/images/large/1.jpg saved to cache
2026-03-26 18:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a52dbe0a-2397-58e1-9252-f1c47c24472c
2026-03-26 18:33:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a52dbe0a-2397-58e1-9252-f1c47c24472c, skipping ID generation
2026-03-26 18:33:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a52dbe0a-2397-58e1-9252-f1c47c24472c with scrape type 1
2026-03-26 18:33:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a52dbe0a-2397-58e1-9252-f1c47c24472c sending to next pipeline
2026-03-26 18:33:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a52dbe0a-2397-58e1-9252-f1c47c24472c, identifier: 1985819
2026-03-26 18:33:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c9e250>
2026-03-26 18:33:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ad68b07-6b3a-5953-ba51-608233f433a9/6ad68b07-6b3a-5953-ba51-608233f433a9_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F069%252Ffafb9b49b00c4ae9b19fd22f6fedbd1e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/069/fafb9b49b00c4ae9b19fd22f6fedbd1e/images/large/1.jpg saved to cache
2026-03-26 18:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6ad68b07-6b3a-5953-ba51-608233f433a9
2026-03-26 18:33:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6ad68b07-6b3a-5953-ba51-608233f433a9, skipping ID generation
2026-03-26 18:33:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ad68b07-6b3a-5953-ba51-608233f433a9 with scrape type 1
2026-03-26 18:33:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6ad68b07-6b3a-5953-ba51-608233f433a9 sending to next pipeline
2026-03-26 18:33:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6ad68b07-6b3a-5953-ba51-608233f433a9, identifier: 1985821
2026-03-26 18:33:21 [ayvens.es] INFO: Found listing with ID: 1985830
2026-03-26 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985830%27 HTTP/1.1" 200 None
2026-03-26 18:33:21 [ayvens.es] INFO: Scrape type for 1985830: 1
2026-03-26 18:33:21 [ayvens.es] INFO: Extracting data for car ID: 1985830
2026-03-26 18:33:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93588b6b-f9c7-5fb2-b00d-341665c84f13 with identifier: 1985830
2026-03-26 18:33:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93588b6b-f9c7-5fb2-b00d-341665c84f13 with scrape type 1
2026-03-26 18:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 93588b6b-f9c7-5fb2-b00d-341665c84f13
2026-03-26 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F651%252F13e96ddfe0884a968448cda5eba9c6cf%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/651/13e96ddfe0884a968448cda5eba9c6cf/images/large/1.jpg not downloaded yet
2026-03-26 18:33:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a52dbe0a-2397-58e1-9252-f1c47c24472c with identifier: 1985819
2026-03-26 18:33:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a52dbe0a-2397-58e1-9252-f1c47c24472c with identifier: 1985819
2026-03-26 18:33:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a52dbe0a-2397-58e1-9252-f1c47c24472c with identifier: 1985819 to the API
2026-03-26 18:33:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/763/2c3f74b5e21643e18ad22a401b38c29c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Gris plata metalizad',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a52dbe0a-2397-58e1-9252-f1c47c24472c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 67276,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a52dbe0a-2397-58e1-9252-f1c47c24472c/a52dbe0a-2397-58e1-9252-f1c47c24472c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 527052,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/763/2c3f74b5e21643e18ad22a401b38c29c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON 2.0 TDI 110kW DSG-7 S&S Xcellence',
 'transmission': 'manual',
 'trim': '2.0 TDI 110kW DSG-7 S&S Xcellence',
 'vin': None,
 'year': 2020}
2026-03-26 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985819%27 HTTP/1.1" 200 None
2026-03-26 18:33:21 [ayvens.es] INFO: Saving data for 1985819: {'created_time': 1774550001.813524, 'last_price_update_time': 1774550001.813536, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985819') HTTP/1.1" 204 0
2026-03-26 18:33:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6ad68b07-6b3a-5953-ba51-608233f433a9 with identifier: 1985821
2026-03-26 18:33:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6ad68b07-6b3a-5953-ba51-608233f433a9 with identifier: 1985821
2026-03-26 18:33:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 6ad68b07-6b3a-5953-ba51-608233f433a9 with identifier: 1985821 to the API
2026-03-26 18:33:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/069/fafb9b49b00c4ae9b19fd22f6fedbd1e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '6ad68b07-6b3a-5953-ba51-608233f433a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'COUNTRYMAN',
 'odometer': 23961,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ad68b07-6b3a-5953-ba51-608233f433a9/6ad68b07-6b3a-5953-ba51-608233f433a9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 357113,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/069/fafb9b49b00c4ae9b19fd22f6fedbd1e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI COUNTRYMAN Cooper',
 'transmission': 'manual',
 'trim': 'Cooper',
 'vin': None,
 'year': 2021}
2026-03-26 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985821%27 HTTP/1.1" 200 None
2026-03-26 18:33:22 [ayvens.es] INFO: Saving data for 1985821: {'created_time': 1774550002.181282, 'last_price_update_time': 1774550002.181295, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985821') HTTP/1.1" 204 0
2026-03-26 18:33:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/409/7de06c2fa23f4fb1aabc3b9599c57437/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:22 [ayvens.es] INFO: Found listing with ID: 1985831
2026-03-26 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985831%27 HTTP/1.1" 200 None
2026-03-26 18:33:22 [ayvens.es] INFO: Scrape type for 1985831: 1
2026-03-26 18:33:22 [ayvens.es] INFO: Extracting data for car ID: 1985831
2026-03-26 18:33:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: add41c3a-84e0-5deb-b366-32c332cf7eb3 with identifier: 1985831
2026-03-26 18:33:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item add41c3a-84e0-5deb-b366-32c332cf7eb3 with scrape type 1
2026-03-26 18:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item add41c3a-84e0-5deb-b366-32c332cf7eb3
2026-03-26 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F146%252F0bd22e883b0948e495d0dece7a472bdc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/146/0bd22e883b0948e495d0dece7a472bdc/images/large/1.jpg not downloaded yet
2026-03-26 18:33:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/972/920fef82465c4d0ebb85849681ae4928/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a2abd8410>
2026-03-26 18:33:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ed69733-6d18-55d5-98a2-12476ab63395/8ed69733-6d18-55d5-98a2-12476ab63395_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F409%252Febdbc3f5210d4176ab4fbf799ed37142%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/409/ebdbc3f5210d4176ab4fbf799ed37142/images/large/1.jpg saved to cache
2026-03-26 18:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8ed69733-6d18-55d5-98a2-12476ab63395
2026-03-26 18:33:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8ed69733-6d18-55d5-98a2-12476ab63395, skipping ID generation
2026-03-26 18:33:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ed69733-6d18-55d5-98a2-12476ab63395 with scrape type 1
2026-03-26 18:33:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8ed69733-6d18-55d5-98a2-12476ab63395 sending to next pipeline
2026-03-26 18:33:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8ed69733-6d18-55d5-98a2-12476ab63395, identifier: 1985822
2026-03-26 18:33:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a2ab01a10>
2026-03-26 18:33:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9335d9d-23c4-513f-b5d9-ed14dae122da/e9335d9d-23c4-513f-b5d9-ed14dae122da_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F316%252Fb851b75314db41ab9c4a06cd3dbe2c0f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/316/b851b75314db41ab9c4a06cd3dbe2c0f/images/large/1.jpg saved to cache
2026-03-26 18:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e9335d9d-23c4-513f-b5d9-ed14dae122da
2026-03-26 18:33:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e9335d9d-23c4-513f-b5d9-ed14dae122da, skipping ID generation
2026-03-26 18:33:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9335d9d-23c4-513f-b5d9-ed14dae122da with scrape type 1
2026-03-26 18:33:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e9335d9d-23c4-513f-b5d9-ed14dae122da sending to next pipeline
2026-03-26 18:33:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e9335d9d-23c4-513f-b5d9-ed14dae122da, identifier: 1985823
2026-03-26 18:33:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c314d0>
2026-03-26 18:33:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6105727-b841-50f5-abdf-febcb256045e/a6105727-b841-50f5-abdf-febcb256045e_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F736%252Fbc6050a348154f13bf2734acff3c8b6b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/736/bc6050a348154f13bf2734acff3c8b6b/images/large/1.jpg saved to cache
2026-03-26 18:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a6105727-b841-50f5-abdf-febcb256045e
2026-03-26 18:33:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a6105727-b841-50f5-abdf-febcb256045e, skipping ID generation
2026-03-26 18:33:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6105727-b841-50f5-abdf-febcb256045e with scrape type 1
2026-03-26 18:33:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a6105727-b841-50f5-abdf-febcb256045e sending to next pipeline
2026-03-26 18:33:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a6105727-b841-50f5-abdf-febcb256045e, identifier: 1985820
2026-03-26 18:33:22 [ayvens.es] INFO: Found listing with ID: 1985832
2026-03-26 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985832%27 HTTP/1.1" 200 None
2026-03-26 18:33:22 [ayvens.es] INFO: Scrape type for 1985832: 1
2026-03-26 18:33:22 [ayvens.es] INFO: Extracting data for car ID: 1985832
2026-03-26 18:33:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 932baa27-d627-5243-a517-a8421ac761bd with identifier: 1985832
2026-03-26 18:33:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 932baa27-d627-5243-a517-a8421ac761bd with scrape type 1
2026-03-26 18:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 932baa27-d627-5243-a517-a8421ac761bd
2026-03-26 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F703%252Fcd8e29a1f7584b22b9a1a31601112aa3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/703/cd8e29a1f7584b22b9a1a31601112aa3/images/large/1.jpg not downloaded yet
2026-03-26 18:33:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8ed69733-6d18-55d5-98a2-12476ab63395 with identifier: 1985822
2026-03-26 18:33:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8ed69733-6d18-55d5-98a2-12476ab63395 with identifier: 1985822
2026-03-26 18:33:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8ed69733-6d18-55d5-98a2-12476ab63395 with identifier: 1985822 to the API
2026-03-26 18:33:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/409/ebdbc3f5210d4176ab4fbf799ed37142/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'British',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '8ed69733-6d18-55d5-98a2-12476ab63395',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'COUNTRYMAN',
 'odometer': 41580,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ed69733-6d18-55d5-98a2-12476ab63395/8ed69733-6d18-55d5-98a2-12476ab63395_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 374739,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/409/ebdbc3f5210d4176ab4fbf799ed37142/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI COUNTRYMAN Cooper',
 'transmission': 'manual',
 'trim': 'Cooper',
 'vin': None,
 'year': 2022}
2026-03-26 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985822%27 HTTP/1.1" 200 None
2026-03-26 18:33:23 [ayvens.es] INFO: Saving data for 1985822: {'created_time': 1774550003.148858, 'last_price_update_time': 1774550003.148868, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985822') HTTP/1.1" 204 0
2026-03-26 18:33:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e9335d9d-23c4-513f-b5d9-ed14dae122da with identifier: 1985823
2026-03-26 18:33:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:33:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e9335d9d-23c4-513f-b5d9-ed14dae122da with identifier: 1985823
2026-03-26 18:33:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e9335d9d-23c4-513f-b5d9-ed14dae122da with identifier: 1985823 to the API
2026-03-26 18:33:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/316/b851b75314db41ab9c4a06cd3dbe2c0f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Pintura s',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e9335d9d-23c4-513f-b5d9-ed14dae122da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'SERIES 1',
 'odometer': 61112,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9335d9d-23c4-513f-b5d9-ed14dae122da/e9335d9d-23c4-513f-b5d9-ed14dae122da_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330434,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/316/b851b75314db41ab9c4a06cd3dbe2c0f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW SERIES 1 116d',
 'transmission': 'manual',
 'trim': '116d',
 'vin': None,
 'year': 2023}
2026-03-26 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985823%27 HTTP/1.1" 200 None
2026-03-26 18:33:23 [ayvens.es] INFO: Saving data for 1985823: {'created_time': 1774550003.457331, 'last_price_update_time': 1774550003.457341, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985823') HTTP/1.1" 204 0
2026-03-26 18:33:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a6105727-b841-50f5-abdf-febcb256045e with identifier: 1985820
2026-03-26 18:33:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a6105727-b841-50f5-abdf-febcb256045e with identifier: 1985820
2026-03-26 18:33:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a6105727-b841-50f5-abdf-febcb256045e with identifier: 1985820 to the API
2026-03-26 18:33:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/736/bc6050a348154f13bf2734acff3c8b6b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 101,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a6105727-b841-50f5-abdf-febcb256045e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 50712,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6105727-b841-50f5-abdf-febcb256045e/a6105727-b841-50f5-abdf-febcb256045e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 494748,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/736/bc6050a348154f13bf2734acff3c8b6b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.5 BlueHDi 96kW (130CV) S&S Style',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi 96kW (130CV) S&S Style',
 'vin': None,
 'year': 2020}
2026-03-26 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985820%27 HTTP/1.1" 200 None
2026-03-26 18:33:23 [ayvens.es] INFO: Saving data for 1985820: {'created_time': 1774550003.746411, 'last_price_update_time': 1774550003.746422, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985820') HTTP/1.1" 204 0
2026-03-26 18:33:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/088/8b546612e2a04cc3b31bebc30dd962ab/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:23 [ayvens.es] INFO: Found listing with ID: 1985833
2026-03-26 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985833%27 HTTP/1.1" 200 None
2026-03-26 18:33:23 [ayvens.es] INFO: Scrape type for 1985833: 1
2026-03-26 18:33:23 [ayvens.es] INFO: Extracting data for car ID: 1985833
2026-03-26 18:33:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08707f89-4f72-5a44-a17d-5218ef733f1a with identifier: 1985833
2026-03-26 18:33:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08707f89-4f72-5a44-a17d-5218ef733f1a with scrape type 1
2026-03-26 18:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 08707f89-4f72-5a44-a17d-5218ef733f1a
2026-03-26 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F997%252F572313cc2d61490aa7388f1ab1488c22%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/997/572313cc2d61490aa7388f1ab1488c22/images/large/1.jpg not downloaded yet
2026-03-26 18:33:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28ea1910>
2026-03-26 18:33:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d61bf7dc-8916-5279-9d87-72767f280ea6/d61bf7dc-8916-5279-9d87-72767f280ea6_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F409%252F7de06c2fa23f4fb1aabc3b9599c57437%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/409/7de06c2fa23f4fb1aabc3b9599c57437/images/large/1.jpg saved to cache
2026-03-26 18:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d61bf7dc-8916-5279-9d87-72767f280ea6
2026-03-26 18:33:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d61bf7dc-8916-5279-9d87-72767f280ea6, skipping ID generation
2026-03-26 18:33:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d61bf7dc-8916-5279-9d87-72767f280ea6 with scrape type 1
2026-03-26 18:33:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d61bf7dc-8916-5279-9d87-72767f280ea6 sending to next pipeline
2026-03-26 18:33:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d61bf7dc-8916-5279-9d87-72767f280ea6, identifier: 1985824
2026-03-26 18:33:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28ce2090>
2026-03-26 18:33:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_664cf847-5b97-5f80-b41b-f14018a9f91e/664cf847-5b97-5f80-b41b-f14018a9f91e_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F972%252F920fef82465c4d0ebb85849681ae4928%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/972/920fef82465c4d0ebb85849681ae4928/images/large/1.jpg saved to cache
2026-03-26 18:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 664cf847-5b97-5f80-b41b-f14018a9f91e
2026-03-26 18:33:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 664cf847-5b97-5f80-b41b-f14018a9f91e, skipping ID generation
2026-03-26 18:33:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 664cf847-5b97-5f80-b41b-f14018a9f91e with scrape type 1
2026-03-26 18:33:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 664cf847-5b97-5f80-b41b-f14018a9f91e sending to next pipeline
2026-03-26 18:33:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 664cf847-5b97-5f80-b41b-f14018a9f91e, identifier: 1985826
2026-03-26 18:33:24 [ayvens.es] INFO: Found listing with ID: 1985834
2026-03-26 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985834%27 HTTP/1.1" 200 None
2026-03-26 18:33:24 [ayvens.es] INFO: Scrape type for 1985834: 1
2026-03-26 18:33:24 [ayvens.es] INFO: Extracting data for car ID: 1985834
2026-03-26 18:33:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37f2249a-beaf-59f9-be6b-f6564b531fea with identifier: 1985834
2026-03-26 18:33:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37f2249a-beaf-59f9-be6b-f6564b531fea with scrape type 1
2026-03-26 18:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 37f2249a-beaf-59f9-be6b-f6564b531fea
2026-03-26 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F379%252Fb1a7b03a2cce4388a8281b37eafbe0ec%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/379/b1a7b03a2cce4388a8281b37eafbe0ec/images/large/1.jpg not downloaded yet
2026-03-26 18:33:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d61bf7dc-8916-5279-9d87-72767f280ea6 with identifier: 1985824
2026-03-26 18:33:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:33:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d61bf7dc-8916-5279-9d87-72767f280ea6 with identifier: 1985824
2026-03-26 18:33:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d61bf7dc-8916-5279-9d87-72767f280ea6 with identifier: 1985824 to the API
2026-03-26 18:33:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/409/7de06c2fa23f4fb1aabc3b9599c57437/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'color': 'Sapporo white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'd61bf7dc-8916-5279-9d87-72767f280ea6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 33032,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d61bf7dc-8916-5279-9d87-72767f280ea6/d61bf7dc-8916-5279-9d87-72767f280ea6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 477002,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/409/7de06c2fa23f4fb1aabc3b9599c57437/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI DIG-T 103kW (140CV) mHEV 4x2 Acenta',
 'transmission': 'manual',
 'trim': 'DIG-T 103kW (140CV) mHEV 4x2 Acenta',
 'vin': None,
 'year': 2023}
2026-03-26 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985824%27 HTTP/1.1" 200 None
2026-03-26 18:33:24 [ayvens.es] INFO: Saving data for 1985824: {'created_time': 1774550004.564471, 'last_price_update_time': 1774550004.564482, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985824') HTTP/1.1" 204 0
2026-03-26 18:33:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 664cf847-5b97-5f80-b41b-f14018a9f91e with identifier: 1985826
2026-03-26 18:33:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:33:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 664cf847-5b97-5f80-b41b-f14018a9f91e with identifier: 1985826
2026-03-26 18:33:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 664cf847-5b97-5f80-b41b-f14018a9f91e with identifier: 1985826 to the API
2026-03-26 18:33:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/972/920fef82465c4d0ebb85849681ae4928/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'Blanco blanquise',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '664cf847-5b97-5f80-b41b-f14018a9f91e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '208',
 'odometer': 43633,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_664cf847-5b97-5f80-b41b-f14018a9f91e/664cf847-5b97-5f80-b41b-f14018a9f91e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 327456,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/972/920fef82465c4d0ebb85849681ae4928/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 208 5P ACTIVE PureTech 60kW (82CV)',
 'transmission': 'manual',
 'trim': '5P ACTIVE PureTech 60kW (82CV)',
 'vin': None,
 'year': 2019}
2026-03-26 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985826%27 HTTP/1.1" 200 None
2026-03-26 18:33:24 [ayvens.es] INFO: Saving data for 1985826: {'created_time': 1774550004.852953, 'last_price_update_time': 1774550004.852964, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985826') HTTP/1.1" 204 0
2026-03-26 18:33:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/315/b1980d4d343c4e2890db240cde6cf71c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/940/bdac037475d546aa897a50fc57cca43c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:24 [ayvens.es] INFO: Found listing with ID: 1985835
2026-03-26 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985835%27 HTTP/1.1" 200 None
2026-03-26 18:33:24 [ayvens.es] INFO: Scrape type for 1985835: 1
2026-03-26 18:33:24 [ayvens.es] INFO: Extracting data for car ID: 1985835
2026-03-26 18:33:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e96cbe08-2793-5e96-bb7a-487a10af7629 with identifier: 1985835
2026-03-26 18:33:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e96cbe08-2793-5e96-bb7a-487a10af7629 with scrape type 1
2026-03-26 18:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e96cbe08-2793-5e96-bb7a-487a10af7629
2026-03-26 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F626%252F036e5963938d4527a167a30eba5bc0a7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/626/036e5963938d4527a167a30eba5bc0a7/images/large/1.jpg not downloaded yet
2026-03-26 18:33:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/527/bc4904be2b2045fc9f7cd7189b3bb981/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28347ad0>
2026-03-26 18:33:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c26741b3-b952-5d83-9ea1-99c2aa30b101/c26741b3-b952-5d83-9ea1-99c2aa30b101_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F088%252F8b546612e2a04cc3b31bebc30dd962ab%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/088/8b546612e2a04cc3b31bebc30dd962ab/images/large/1.jpg saved to cache
2026-03-26 18:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c26741b3-b952-5d83-9ea1-99c2aa30b101
2026-03-26 18:33:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c26741b3-b952-5d83-9ea1-99c2aa30b101, skipping ID generation
2026-03-26 18:33:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c26741b3-b952-5d83-9ea1-99c2aa30b101 with scrape type 1
2026-03-26 18:33:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c26741b3-b952-5d83-9ea1-99c2aa30b101 sending to next pipeline
2026-03-26 18:33:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c26741b3-b952-5d83-9ea1-99c2aa30b101, identifier: 1985825
2026-03-26 18:33:25 [ayvens.es] INFO: Found listing with ID: 1985836
2026-03-26 18:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985836%27 HTTP/1.1" 200 None
2026-03-26 18:33:25 [ayvens.es] INFO: Scrape type for 1985836: 1
2026-03-26 18:33:25 [ayvens.es] INFO: Extracting data for car ID: 1985836
2026-03-26 18:33:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f20d35b1-02fe-5b15-a26a-26a98163b48e with identifier: 1985836
2026-03-26 18:33:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f20d35b1-02fe-5b15-a26a-26a98163b48e with scrape type 1
2026-03-26 18:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f20d35b1-02fe-5b15-a26a-26a98163b48e
2026-03-26 18:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F252%252Fa3a95805656d414a982f64c5881ff3bf%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/252/a3a95805656d414a982f64c5881ff3bf/images/large/1.jpg not downloaded yet
2026-03-26 18:33:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c26741b3-b952-5d83-9ea1-99c2aa30b101 with identifier: 1985825
2026-03-26 18:33:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:33:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c26741b3-b952-5d83-9ea1-99c2aa30b101 with identifier: 1985825
2026-03-26 18:33:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c26741b3-b952-5d83-9ea1-99c2aa30b101 with identifier: 1985825 to the API
2026-03-26 18:33:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/088/8b546612e2a04cc3b31bebc30dd962ab/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Gris oscuro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'c26741b3-b952-5d83-9ea1-99c2aa30b101',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 66976,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c26741b3-b952-5d83-9ea1-99c2aa30b101/c26741b3-b952-5d83-9ea1-99c2aa30b101_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 503624,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/088/8b546612e2a04cc3b31bebc30dd962ab/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 Active Pack Puretech 100 S&S BVM6',
 'transmission': 'manual',
 'trim': 'Active Pack Puretech 100 S&S BVM6',
 'vin': None,
 'year': 2021}
2026-03-26 18:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985825%27 HTTP/1.1" 200 None
2026-03-26 18:33:25 [ayvens.es] INFO: Saving data for 1985825: {'created_time': 1774550005.446766, 'last_price_update_time': 1774550005.446778, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985825') HTTP/1.1" 204 0
2026-03-26 18:33:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/146/0bd22e883b0948e495d0dece7a472bdc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:25 [ayvens.es] INFO: Found listing with ID: 1985837
2026-03-26 18:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985837%27 HTTP/1.1" 200 None
2026-03-26 18:33:25 [ayvens.es] INFO: Scrape type for 1985837: 1
2026-03-26 18:33:25 [ayvens.es] INFO: Extracting data for car ID: 1985837
2026-03-26 18:33:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eea47fb0-5ca0-5d1d-92cf-7e2b4048b69d with identifier: 1985837
2026-03-26 18:33:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eea47fb0-5ca0-5d1d-92cf-7e2b4048b69d with scrape type 1
2026-03-26 18:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item eea47fb0-5ca0-5d1d-92cf-7e2b4048b69d
2026-03-26 18:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F631%252F021b75611df343a4a1811e6f38311f71%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/631/021b75611df343a4a1811e6f38311f71/images/large/1.jpg not downloaded yet
2026-03-26 18:33:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a282f8f90>
2026-03-26 18:33:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e65ac201-ca32-55ff-9b5e-a00bdf901033/e65ac201-ca32-55ff-9b5e-a00bdf901033_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F315%252Fb1980d4d343c4e2890db240cde6cf71c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/315/b1980d4d343c4e2890db240cde6cf71c/images/large/1.jpg saved to cache
2026-03-26 18:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e65ac201-ca32-55ff-9b5e-a00bdf901033
2026-03-26 18:33:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e65ac201-ca32-55ff-9b5e-a00bdf901033, skipping ID generation
2026-03-26 18:33:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e65ac201-ca32-55ff-9b5e-a00bdf901033 with scrape type 1
2026-03-26 18:33:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e65ac201-ca32-55ff-9b5e-a00bdf901033 sending to next pipeline
2026-03-26 18:33:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e65ac201-ca32-55ff-9b5e-a00bdf901033, identifier: 1985829
2026-03-26 18:33:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a283245d0>
2026-03-26 18:33:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7ce036c-ba84-5f72-9300-0f0af027e100/c7ce036c-ba84-5f72-9300-0f0af027e100_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F940%252Fbdac037475d546aa897a50fc57cca43c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/940/bdac037475d546aa897a50fc57cca43c/images/large/1.jpg saved to cache
2026-03-26 18:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c7ce036c-ba84-5f72-9300-0f0af027e100
2026-03-26 18:33:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c7ce036c-ba84-5f72-9300-0f0af027e100, skipping ID generation
2026-03-26 18:33:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7ce036c-ba84-5f72-9300-0f0af027e100 with scrape type 1
2026-03-26 18:33:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c7ce036c-ba84-5f72-9300-0f0af027e100 sending to next pipeline
2026-03-26 18:33:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c7ce036c-ba84-5f72-9300-0f0af027e100, identifier: 1985827
2026-03-26 18:33:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28caf2d0>
2026-03-26 18:33:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78860afc-54ee-5779-ba9f-582d6ca4dace/78860afc-54ee-5779-ba9f-582d6ca4dace_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F527%252Fbc4904be2b2045fc9f7cd7189b3bb981%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/527/bc4904be2b2045fc9f7cd7189b3bb981/images/large/1.jpg saved to cache
2026-03-26 18:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 78860afc-54ee-5779-ba9f-582d6ca4dace
2026-03-26 18:33:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 78860afc-54ee-5779-ba9f-582d6ca4dace, skipping ID generation
2026-03-26 18:33:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78860afc-54ee-5779-ba9f-582d6ca4dace with scrape type 1
2026-03-26 18:33:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 78860afc-54ee-5779-ba9f-582d6ca4dace sending to next pipeline
2026-03-26 18:33:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 78860afc-54ee-5779-ba9f-582d6ca4dace, identifier: 1985828
2026-03-26 18:33:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/651/13e96ddfe0884a968448cda5eba9c6cf/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:26 [ayvens.es] INFO: Found listing with ID: 1985838
2026-03-26 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985838%27 HTTP/1.1" 200 None
2026-03-26 18:33:26 [ayvens.es] INFO: Scrape type for 1985838: 1
2026-03-26 18:33:26 [ayvens.es] INFO: Extracting data for car ID: 1985838
2026-03-26 18:33:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93c9b44c-23d8-50b6-8db8-6ce9ebd7c328 with identifier: 1985838
2026-03-26 18:33:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93c9b44c-23d8-50b6-8db8-6ce9ebd7c328 with scrape type 1
2026-03-26 18:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 93c9b44c-23d8-50b6-8db8-6ce9ebd7c328
2026-03-26 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F580%252F4c58928ef33f4d89ac4950c00d8aa150%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/580/4c58928ef33f4d89ac4950c00d8aa150/images/large/1.jpg not downloaded yet
2026-03-26 18:33:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e65ac201-ca32-55ff-9b5e-a00bdf901033 with identifier: 1985829
2026-03-26 18:33:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e65ac201-ca32-55ff-9b5e-a00bdf901033 with identifier: 1985829
2026-03-26 18:33:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e65ac201-ca32-55ff-9b5e-a00bdf901033 with identifier: 1985829 to the API
2026-03-26 18:33:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/315/b1980d4d343c4e2890db240cde6cf71c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.2L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e65ac201-ca32-55ff-9b5e-a00bdf901033',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'DOBLO CARGO',
 'odometer': 128686,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e65ac201-ca32-55ff-9b5e-a00bdf901033/e65ac201-ca32-55ff-9b5e-a00bdf901033_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 308187,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/315/b1980d4d343c4e2890db240cde6cf71c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-28',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FIAT DOBLO CARGO Cargo Base 1.3 Multijet 70kW (95CV)',
 'transmission': 'manual',
 'trim': 'Cargo Base 1.3 Multijet 70kW (95CV)',
 'vin': None,
 'year': 2019}
2026-03-26 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985829%27 HTTP/1.1" 200 None
2026-03-26 18:33:26 [ayvens.es] INFO: Saving data for 1985829: {'created_time': 1774550006.526831, 'last_price_update_time': 1774550006.526841, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985829') HTTP/1.1" 204 0
2026-03-26 18:33:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c7ce036c-ba84-5f72-9300-0f0af027e100 with identifier: 1985827
2026-03-26 18:33:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c7ce036c-ba84-5f72-9300-0f0af027e100 with identifier: 1985827
2026-03-26 18:33:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c7ce036c-ba84-5f72-9300-0f0af027e100 with identifier: 1985827 to the API
2026-03-26 18:33:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/940/bdac037475d546aa897a50fc57cca43c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 206,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '2.1L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c7ce036c-ba84-5f72-9300-0f0af027e100',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'SPRINTER',
 'odometer': 247225,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7ce036c-ba84-5f72-9300-0f0af027e100/c7ce036c-ba84-5f72-9300-0f0af027e100_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 590320,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/940/bdac037475d546aa897a50fc57cca43c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-11',
 'seats_number': 3,
 'seller_name': None,
 'title': 'MERCEDES-BENZ SPRINTER 314 CDI MEDIO 3.5T',
 'transmission': 'manual',
 'trim': '314 CDI MEDIO 3.5T',
 'vin': None,
 'year': 2019}
2026-03-26 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985827%27 HTTP/1.1" 200 None
2026-03-26 18:33:26 [ayvens.es] INFO: Saving data for 1985827: {'created_time': 1774550006.799471, 'last_price_update_time': 1774550006.799484, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985827') HTTP/1.1" 204 0
2026-03-26 18:33:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 78860afc-54ee-5779-ba9f-582d6ca4dace with identifier: 1985828
2026-03-26 18:33:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 78860afc-54ee-5779-ba9f-582d6ca4dace with identifier: 1985828
2026-03-26 18:33:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 78860afc-54ee-5779-ba9f-582d6ca4dace with identifier: 1985828 to the API
2026-03-26 18:33:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/527/bc4904be2b2045fc9f7cd7189b3bb981/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '78860afc-54ee-5779-ba9f-582d6ca4dace',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'COMBO',
 'odometer': 152768,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78860afc-54ee-5779-ba9f-582d6ca4dace/78860afc-54ee-5779-ba9f-582d6ca4dace_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 445589,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/527/bc4904be2b2045fc9f7cd7189b3bb981/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-09',
 'seats_number': 2,
 'seller_name': None,
 'title': 'OPEL COMBO 1.5 TD S/S 75kW (100CV) Express L H1 650',
 'transmission': 'manual',
 'trim': '1.5 TD S/S 75kW (100CV) Express L H1 650',
 'vin': None,
 'year': 2020}
2026-03-26 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985828%27 HTTP/1.1" 200 None
2026-03-26 18:33:27 [ayvens.es] INFO: Saving data for 1985828: {'created_time': 1774550007.106935, 'last_price_update_time': 1774550007.106946, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985828') HTTP/1.1" 204 0
2026-03-26 18:33:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/997/572313cc2d61490aa7388f1ab1488c22/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:27 [ayvens.es] INFO: Found listing with ID: 1985839
2026-03-26 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985839%27 HTTP/1.1" 200 None
2026-03-26 18:33:27 [ayvens.es] INFO: Scrape type for 1985839: 1
2026-03-26 18:33:27 [ayvens.es] INFO: Extracting data for car ID: 1985839
2026-03-26 18:33:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06b6bedb-365c-54d1-b4b9-8e519a847943 with identifier: 1985839
2026-03-26 18:33:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06b6bedb-365c-54d1-b4b9-8e519a847943 with scrape type 1
2026-03-26 18:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 06b6bedb-365c-54d1-b4b9-8e519a847943
2026-03-26 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F014%252F936eac01740b462a842285118b520491%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/014/936eac01740b462a842285118b520491/images/large/1.jpg not downloaded yet
2026-03-26 18:33:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/703/cd8e29a1f7584b22b9a1a31601112aa3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28d46c10>
2026-03-26 18:33:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_add41c3a-84e0-5deb-b366-32c332cf7eb3/add41c3a-84e0-5deb-b366-32c332cf7eb3_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F146%252F0bd22e883b0948e495d0dece7a472bdc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/146/0bd22e883b0948e495d0dece7a472bdc/images/large/1.jpg saved to cache
2026-03-26 18:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item add41c3a-84e0-5deb-b366-32c332cf7eb3
2026-03-26 18:33:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: add41c3a-84e0-5deb-b366-32c332cf7eb3, skipping ID generation
2026-03-26 18:33:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item add41c3a-84e0-5deb-b366-32c332cf7eb3 with scrape type 1
2026-03-26 18:33:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item add41c3a-84e0-5deb-b366-32c332cf7eb3 sending to next pipeline
2026-03-26 18:33:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: add41c3a-84e0-5deb-b366-32c332cf7eb3, identifier: 1985831
2026-03-26 18:33:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a283279d0>
2026-03-26 18:33:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93588b6b-f9c7-5fb2-b00d-341665c84f13/93588b6b-f9c7-5fb2-b00d-341665c84f13_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F651%252F13e96ddfe0884a968448cda5eba9c6cf%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/651/13e96ddfe0884a968448cda5eba9c6cf/images/large/1.jpg saved to cache
2026-03-26 18:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 93588b6b-f9c7-5fb2-b00d-341665c84f13
2026-03-26 18:33:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 93588b6b-f9c7-5fb2-b00d-341665c84f13, skipping ID generation
2026-03-26 18:33:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93588b6b-f9c7-5fb2-b00d-341665c84f13 with scrape type 1
2026-03-26 18:33:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 93588b6b-f9c7-5fb2-b00d-341665c84f13 sending to next pipeline
2026-03-26 18:33:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 93588b6b-f9c7-5fb2-b00d-341665c84f13, identifier: 1985830
2026-03-26 18:33:27 [ayvens.es] INFO: Found listing with ID: 1985840
2026-03-26 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985840%27 HTTP/1.1" 200 None
2026-03-26 18:33:27 [ayvens.es] INFO: Scrape type for 1985840: 1
2026-03-26 18:33:27 [ayvens.es] INFO: Extracting data for car ID: 1985840
2026-03-26 18:33:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99921dc4-77b6-5076-858f-5bfda0a0da9d with identifier: 1985840
2026-03-26 18:33:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99921dc4-77b6-5076-858f-5bfda0a0da9d with scrape type 1
2026-03-26 18:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 99921dc4-77b6-5076-858f-5bfda0a0da9d
2026-03-26 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F872%252Fdd7ede598f164f39b82cc9142f08c335%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/872/dd7ede598f164f39b82cc9142f08c335/images/large/1.jpg not downloaded yet
2026-03-26 18:33:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: add41c3a-84e0-5deb-b366-32c332cf7eb3 with identifier: 1985831
2026-03-26 18:33:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: add41c3a-84e0-5deb-b366-32c332cf7eb3 with identifier: 1985831
2026-03-26 18:33:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: add41c3a-84e0-5deb-b366-32c332cf7eb3 with identifier: 1985831 to the API
2026-03-26 18:33:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/146/0bd22e883b0948e495d0dece7a472bdc/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 190,
 'color': 'Blanco s',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'add41c3a-84e0-5deb-b366-32c332cf7eb3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT CUSTOM',
 'odometer': 112521,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_add41c3a-84e0-5deb-b366-32c332cf7eb3/add41c3a-84e0-5deb-b366-32c332cf7eb3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 349866,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/146/0bd22e883b0948e495d0dece7a472bdc/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-25',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT CUSTOM Van 2.0 TDCI 96kW 300 L2 Trend',
 'transmission': 'manual',
 'trim': 'Van 2.0 TDCI 96kW 300 L2 Trend',
 'vin': None,
 'year': 2022}
2026-03-26 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985831%27 HTTP/1.1" 200 None
2026-03-26 18:33:27 [ayvens.es] INFO: Saving data for 1985831: {'created_time': 1774550007.795304, 'last_price_update_time': 1774550007.795318, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985831') HTTP/1.1" 204 0
2026-03-26 18:33:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 93588b6b-f9c7-5fb2-b00d-341665c84f13 with identifier: 1985830
2026-03-26 18:33:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 93588b6b-f9c7-5fb2-b00d-341665c84f13 with identifier: 1985830
2026-03-26 18:33:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 93588b6b-f9c7-5fb2-b00d-341665c84f13 with identifier: 1985830 to the API
2026-03-26 18:33:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/651/13e96ddfe0884a968448cda5eba9c6cf/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 163,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '93588b6b-f9c7-5fb2-b00d-341665c84f13',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'JUMPER',
 'odometer': 77669,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93588b6b-f9c7-5fb2-b00d-341665c84f13/93588b6b-f9c7-5fb2-b00d-341665c84f13_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 457495,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/651/13e96ddfe0884a968448cda5eba9c6cf/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-30',
 'seats_number': 3,
 'seller_name': None,
 'title': 'CITROËN JUMPER BlueHDi 96KW (130CV) Furgon 33L2H1',
 'transmission': 'manual',
 'trim': 'BlueHDi 96KW (130CV) Furgon 33L2H1',
 'vin': None,
 'year': 2019}
2026-03-26 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985830%27 HTTP/1.1" 200 None
2026-03-26 18:33:28 [ayvens.es] INFO: Saving data for 1985830: {'created_time': 1774550008.081706, 'last_price_update_time': 1774550008.081717, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985830') HTTP/1.1" 204 0
2026-03-26 18:33:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/379/b1a7b03a2cce4388a8281b37eafbe0ec/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/626/036e5963938d4527a167a30eba5bc0a7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:28 [ayvens.es] INFO: Found listing with ID: 1985841
2026-03-26 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985841%27 HTTP/1.1" 200 None
2026-03-26 18:33:28 [ayvens.es] INFO: Scrape type for 1985841: 1
2026-03-26 18:33:28 [ayvens.es] INFO: Extracting data for car ID: 1985841
2026-03-26 18:33:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f3b78eb-c1f2-5bdc-aec0-10b59bd9600e with identifier: 1985841
2026-03-26 18:33:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f3b78eb-c1f2-5bdc-aec0-10b59bd9600e with scrape type 1
2026-03-26 18:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1f3b78eb-c1f2-5bdc-aec0-10b59bd9600e
2026-03-26 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F833%252F9b432c8bbf784281ba93ea84c1bbad97%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/833/9b432c8bbf784281ba93ea84c1bbad97/images/large/1.jpg not downloaded yet
2026-03-26 18:33:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a290a4810>
2026-03-26 18:33:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08707f89-4f72-5a44-a17d-5218ef733f1a/08707f89-4f72-5a44-a17d-5218ef733f1a_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F997%252F572313cc2d61490aa7388f1ab1488c22%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/997/572313cc2d61490aa7388f1ab1488c22/images/large/1.jpg saved to cache
2026-03-26 18:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 08707f89-4f72-5a44-a17d-5218ef733f1a
2026-03-26 18:33:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 08707f89-4f72-5a44-a17d-5218ef733f1a, skipping ID generation
2026-03-26 18:33:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08707f89-4f72-5a44-a17d-5218ef733f1a with scrape type 1
2026-03-26 18:33:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 08707f89-4f72-5a44-a17d-5218ef733f1a sending to next pipeline
2026-03-26 18:33:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 08707f89-4f72-5a44-a17d-5218ef733f1a, identifier: 1985833
2026-03-26 18:33:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a290a4110>
2026-03-26 18:33:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_932baa27-d627-5243-a517-a8421ac761bd/932baa27-d627-5243-a517-a8421ac761bd_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F703%252Fcd8e29a1f7584b22b9a1a31601112aa3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/703/cd8e29a1f7584b22b9a1a31601112aa3/images/large/1.jpg saved to cache
2026-03-26 18:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 932baa27-d627-5243-a517-a8421ac761bd
2026-03-26 18:33:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 932baa27-d627-5243-a517-a8421ac761bd, skipping ID generation
2026-03-26 18:33:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 932baa27-d627-5243-a517-a8421ac761bd with scrape type 1
2026-03-26 18:33:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 932baa27-d627-5243-a517-a8421ac761bd sending to next pipeline
2026-03-26 18:33:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 932baa27-d627-5243-a517-a8421ac761bd, identifier: 1985832
2026-03-26 18:33:28 [ayvens.es] INFO: Found listing with ID: 1985842
2026-03-26 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985842%27 HTTP/1.1" 200 None
2026-03-26 18:33:28 [ayvens.es] INFO: Scrape type for 1985842: 1
2026-03-26 18:33:28 [ayvens.es] INFO: Extracting data for car ID: 1985842
2026-03-26 18:33:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72f28929-245e-5aea-abce-88ff8e02a6b0 with identifier: 1985842
2026-03-26 18:33:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72f28929-245e-5aea-abce-88ff8e02a6b0 with scrape type 1
2026-03-26 18:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 72f28929-245e-5aea-abce-88ff8e02a6b0
2026-03-26 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F474%252F8bb581b20c7b4ae4b5a35e774eb18019%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/474/8bb581b20c7b4ae4b5a35e774eb18019/images/large/1.jpg not downloaded yet
2026-03-26 18:33:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 08707f89-4f72-5a44-a17d-5218ef733f1a with identifier: 1985833
2026-03-26 18:33:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 08707f89-4f72-5a44-a17d-5218ef733f1a with identifier: 1985833
2026-03-26 18:33:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 08707f89-4f72-5a44-a17d-5218ef733f1a with identifier: 1985833 to the API
2026-03-26 18:33:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/997/572313cc2d61490aa7388f1ab1488c22/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '08707f89-4f72-5a44-a17d-5218ef733f1a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'COMBO',
 'odometer': 105556,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08707f89-4f72-5a44-a17d-5218ef733f1a/08707f89-4f72-5a44-a17d-5218ef733f1a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 304736,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/997/572313cc2d61490aa7388f1ab1488c22/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-11',
 'seats_number': 2,
 'seller_name': None,
 'title': 'OPEL COMBO 1.5 TD 75kW (100CV) Express L H1 650kg',
 'transmission': 'manual',
 'trim': '1.5 TD 75kW (100CV) Express L H1 650kg',
 'vin': None,
 'year': 2021}
2026-03-26 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985833%27 HTTP/1.1" 200 None
2026-03-26 18:33:28 [ayvens.es] INFO: Saving data for 1985833: {'created_time': 1774550008.788514, 'last_price_update_time': 1774550008.788524, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985833') HTTP/1.1" 204 0
2026-03-26 18:33:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 932baa27-d627-5243-a517-a8421ac761bd with identifier: 1985832
2026-03-26 18:33:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:33:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 932baa27-d627-5243-a517-a8421ac761bd with identifier: 1985832
2026-03-26 18:33:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 932baa27-d627-5243-a517-a8421ac761bd with identifier: 1985832 to the API
2026-03-26 18:33:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/703/cd8e29a1f7584b22b9a1a31601112aa3/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 185,
 'color': 'Blanco hielo',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '932baa27-d627-5243-a517-a8421ac761bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'NV300',
 'odometer': 210273,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_932baa27-d627-5243-a517-a8421ac761bd/932baa27-d627-5243-a517-a8421ac761bd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 392998,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/703/cd8e29a1f7584b22b9a1a31601112aa3/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-30',
 'seats_number': 3,
 'seller_name': None,
 'title': 'NISSAN NV300 2.0dCi 107kW (145CV) L1H2 1,2T Comfort',
 'transmission': 'manual',
 'trim': '2.0dCi 107kW (145CV) L1H2 1,2T Comfort',
 'vin': None,
 'year': 2022}
2026-03-26 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985832%27 HTTP/1.1" 200 None
2026-03-26 18:33:29 [ayvens.es] INFO: Saving data for 1985832: {'created_time': 1774550009.19205, 'last_price_update_time': 1774550009.192061, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985832') HTTP/1.1" 204 0
2026-03-26 18:33:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/631/021b75611df343a4a1811e6f38311f71/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:29 [ayvens.es] INFO: Found listing with ID: 1985843
2026-03-26 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985843%27 HTTP/1.1" 200 None
2026-03-26 18:33:29 [ayvens.es] INFO: Scrape type for 1985843: 1
2026-03-26 18:33:29 [ayvens.es] INFO: Extracting data for car ID: 1985843
2026-03-26 18:33:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 713c1a84-6d66-5b3d-9e54-5d379c25f42a with identifier: 1985843
2026-03-26 18:33:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 713c1a84-6d66-5b3d-9e54-5d379c25f42a with scrape type 1
2026-03-26 18:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 713c1a84-6d66-5b3d-9e54-5d379c25f42a
2026-03-26 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F605%252F1e4e1de925d14d3a8ef5c202c20bdbef%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/605/1e4e1de925d14d3a8ef5c202c20bdbef/images/large/1.jpg not downloaded yet
2026-03-26 18:33:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a281ffe90>
2026-03-26 18:33:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37f2249a-beaf-59f9-be6b-f6564b531fea/37f2249a-beaf-59f9-be6b-f6564b531fea_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F379%252Fb1a7b03a2cce4388a8281b37eafbe0ec%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/379/b1a7b03a2cce4388a8281b37eafbe0ec/images/large/1.jpg saved to cache
2026-03-26 18:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 37f2249a-beaf-59f9-be6b-f6564b531fea
2026-03-26 18:33:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 37f2249a-beaf-59f9-be6b-f6564b531fea, skipping ID generation
2026-03-26 18:33:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37f2249a-beaf-59f9-be6b-f6564b531fea with scrape type 1
2026-03-26 18:33:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 37f2249a-beaf-59f9-be6b-f6564b531fea sending to next pipeline
2026-03-26 18:33:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 37f2249a-beaf-59f9-be6b-f6564b531fea, identifier: 1985834
2026-03-26 18:33:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a282fde90>
2026-03-26 18:33:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e96cbe08-2793-5e96-bb7a-487a10af7629/e96cbe08-2793-5e96-bb7a-487a10af7629_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F626%252F036e5963938d4527a167a30eba5bc0a7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/626/036e5963938d4527a167a30eba5bc0a7/images/large/1.jpg saved to cache
2026-03-26 18:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e96cbe08-2793-5e96-bb7a-487a10af7629
2026-03-26 18:33:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e96cbe08-2793-5e96-bb7a-487a10af7629, skipping ID generation
2026-03-26 18:33:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e96cbe08-2793-5e96-bb7a-487a10af7629 with scrape type 1
2026-03-26 18:33:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e96cbe08-2793-5e96-bb7a-487a10af7629 sending to next pipeline
2026-03-26 18:33:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e96cbe08-2793-5e96-bb7a-487a10af7629, identifier: 1985835
2026-03-26 18:33:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/252/a3a95805656d414a982f64c5881ff3bf/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:29 [ayvens.es] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 300
2026-03-26 18:33:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 37f2249a-beaf-59f9-be6b-f6564b531fea with identifier: 1985834
2026-03-26 18:33:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 37f2249a-beaf-59f9-be6b-f6564b531fea with identifier: 1985834
2026-03-26 18:33:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 37f2249a-beaf-59f9-be6b-f6564b531fea with identifier: 1985834 to the API
2026-03-26 18:33:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/379/b1a7b03a2cce4388a8281b37eafbe0ec/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 215,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '37f2249a-beaf-59f9-be6b-f6564b531fea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT',
 'odometer': 224901,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37f2249a-beaf-59f9-be6b-f6564b531fea/37f2249a-beaf-59f9-be6b-f6564b531fea_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325991,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/379/b1a7b03a2cce4388a8281b37eafbe0ec/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-01',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 350 96kW L3H2 Van Trend FWD MHEV',
 'transmission': 'manual',
 'trim': '350 96kW L3H2 Van Trend FWD MHEV',
 'vin': None,
 'year': 2022}
2026-03-26 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985834%27 HTTP/1.1" 200 None
2026-03-26 18:33:29 [ayvens.es] INFO: Saving data for 1985834: {'created_time': 1774550009.832081, 'last_price_update_time': 1774550009.832093, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985834') HTTP/1.1" 204 0
2026-03-26 18:33:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e96cbe08-2793-5e96-bb7a-487a10af7629 with identifier: 1985835
2026-03-26 18:33:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e96cbe08-2793-5e96-bb7a-487a10af7629 with identifier: 1985835
2026-03-26 18:33:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e96cbe08-2793-5e96-bb7a-487a10af7629 with identifier: 1985835 to the API
2026-03-26 18:33:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/626/036e5963938d4527a167a30eba5bc0a7/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e96cbe08-2793-5e96-bb7a-487a10af7629',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT CONNECT',
 'odometer': 115083,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e96cbe08-2793-5e96-bb7a-487a10af7629/e96cbe08-2793-5e96-bb7a-487a10af7629_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328863,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/626/036e5963938d4527a167a30eba5bc0a7/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-01',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT CONNECT Van 1.5 TDCi 74kW Trend 200 L1',
 'transmission': 'manual',
 'trim': 'Van 1.5 TDCi 74kW Trend 200 L1',
 'vin': None,
 'year': 2018}
2026-03-26 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985835%27 HTTP/1.1" 200 None
2026-03-26 18:33:30 [ayvens.es] INFO: Saving data for 1985835: {'created_time': 1774550010.139727, 'last_price_update_time': 1774550010.139737, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985835') HTTP/1.1" 204 0
2026-03-26 18:33:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 18:33:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a282fba10>
2026-03-26 18:33:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eea47fb0-5ca0-5d1d-92cf-7e2b4048b69d/eea47fb0-5ca0-5d1d-92cf-7e2b4048b69d_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F631%252F021b75611df343a4a1811e6f38311f71%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/631/021b75611df343a4a1811e6f38311f71/images/large/1.jpg saved to cache
2026-03-26 18:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eea47fb0-5ca0-5d1d-92cf-7e2b4048b69d
2026-03-26 18:33:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eea47fb0-5ca0-5d1d-92cf-7e2b4048b69d, skipping ID generation
2026-03-26 18:33:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eea47fb0-5ca0-5d1d-92cf-7e2b4048b69d with scrape type 1
2026-03-26 18:33:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eea47fb0-5ca0-5d1d-92cf-7e2b4048b69d sending to next pipeline
2026-03-26 18:33:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: eea47fb0-5ca0-5d1d-92cf-7e2b4048b69d, identifier: 1985837
2026-03-26 18:33:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28d470d0>
2026-03-26 18:33:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f20d35b1-02fe-5b15-a26a-26a98163b48e/f20d35b1-02fe-5b15-a26a-26a98163b48e_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F252%252Fa3a95805656d414a982f64c5881ff3bf%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/252/a3a95805656d414a982f64c5881ff3bf/images/large/1.jpg saved to cache
2026-03-26 18:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f20d35b1-02fe-5b15-a26a-26a98163b48e
2026-03-26 18:33:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f20d35b1-02fe-5b15-a26a-26a98163b48e, skipping ID generation
2026-03-26 18:33:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f20d35b1-02fe-5b15-a26a-26a98163b48e with scrape type 1
2026-03-26 18:33:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f20d35b1-02fe-5b15-a26a-26a98163b48e sending to next pipeline
2026-03-26 18:33:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f20d35b1-02fe-5b15-a26a-26a98163b48e, identifier: 1985836
2026-03-26 18:33:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/580/4c58928ef33f4d89ac4950c00d8aa150/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/014/936eac01740b462a842285118b520491/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: eea47fb0-5ca0-5d1d-92cf-7e2b4048b69d with identifier: 1985837
2026-03-26 18:33:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: eea47fb0-5ca0-5d1d-92cf-7e2b4048b69d with identifier: 1985837
2026-03-26 18:33:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: eea47fb0-5ca0-5d1d-92cf-7e2b4048b69d with identifier: 1985837 to the API
2026-03-26 18:33:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/631/021b75611df343a4a1811e6f38311f71/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 146,
 'color': 'Cassa white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'eea47fb0-5ca0-5d1d-92cf-7e2b4048b69d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'SPORTAGE',
 'odometer': 115579,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eea47fb0-5ca0-5d1d-92cf-7e2b4048b69d/eea47fb0-5ca0-5d1d-92cf-7e2b4048b69d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 337253,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/631/021b75611df343a4a1811e6f38311f71/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA SPORTAGE 1.6 MHEV Black Edition 100kW (136CV) 4x2 **REVISAR '
          'PERITACION**',
 'transmission': 'manual',
 'trim': '1.6 MHEV Black Edition 100kW (136CV) 4x2 **REVISAR PERITACION**',
 'vin': None,
 'year': 2021}
2026-03-26 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985837%27 HTTP/1.1" 200 None
2026-03-26 18:33:30 [ayvens.es] INFO: Saving data for 1985837: {'created_time': 1774550010.798596, 'last_price_update_time': 1774550010.798606, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985837') HTTP/1.1" 204 0
2026-03-26 18:33:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f20d35b1-02fe-5b15-a26a-26a98163b48e with identifier: 1985836
2026-03-26 18:33:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f20d35b1-02fe-5b15-a26a-26a98163b48e with identifier: 1985836
2026-03-26 18:33:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f20d35b1-02fe-5b15-a26a-26a98163b48e with identifier: 1985836 to the API
2026-03-26 18:33:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/252/a3a95805656d414a982f64c5881ff3bf/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 170,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f20d35b1-02fe-5b15-a26a-26a98163b48e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'JUMPY',
 'odometer': 187723,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f20d35b1-02fe-5b15-a26a-26a98163b48e/f20d35b1-02fe-5b15-a26a-26a98163b48e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 501177,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/252/a3a95805656d414a982f64c5881ff3bf/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-08-14',
 'seats_number': 3,
 'seller_name': None,
 'title': 'CITROËN JUMPY Furgon Talla M BlueHDi 100 S&S 6v **REVISAR '
          'PERITACION**',
 'transmission': 'manual',
 'trim': 'Furgon Talla M BlueHDi 100 S&S 6v **REVISAR PERITACION**',
 'vin': None,
 'year': 2023}
2026-03-26 18:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985836%27 HTTP/1.1" 200 None
2026-03-26 18:33:31 [ayvens.es] INFO: Saving data for 1985836: {'created_time': 1774550011.208664, 'last_price_update_time': 1774550011.208676, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985836') HTTP/1.1" 204 0
2026-03-26 18:33:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/833/9b432c8bbf784281ba93ea84c1bbad97/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/872/dd7ede598f164f39b82cc9142f08c335/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a2af9f690>
2026-03-26 18:33:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93c9b44c-23d8-50b6-8db8-6ce9ebd7c328/93c9b44c-23d8-50b6-8db8-6ce9ebd7c328_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F580%252F4c58928ef33f4d89ac4950c00d8aa150%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/580/4c58928ef33f4d89ac4950c00d8aa150/images/large/1.jpg saved to cache
2026-03-26 18:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 93c9b44c-23d8-50b6-8db8-6ce9ebd7c328
2026-03-26 18:33:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 93c9b44c-23d8-50b6-8db8-6ce9ebd7c328, skipping ID generation
2026-03-26 18:33:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93c9b44c-23d8-50b6-8db8-6ce9ebd7c328 with scrape type 1
2026-03-26 18:33:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 93c9b44c-23d8-50b6-8db8-6ce9ebd7c328 sending to next pipeline
2026-03-26 18:33:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 93c9b44c-23d8-50b6-8db8-6ce9ebd7c328, identifier: 1985838
2026-03-26 18:33:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28d46890>
2026-03-26 18:33:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06b6bedb-365c-54d1-b4b9-8e519a847943/06b6bedb-365c-54d1-b4b9-8e519a847943_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F014%252F936eac01740b462a842285118b520491%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/014/936eac01740b462a842285118b520491/images/large/1.jpg saved to cache
2026-03-26 18:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 06b6bedb-365c-54d1-b4b9-8e519a847943
2026-03-26 18:33:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 06b6bedb-365c-54d1-b4b9-8e519a847943, skipping ID generation
2026-03-26 18:33:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06b6bedb-365c-54d1-b4b9-8e519a847943 with scrape type 1
2026-03-26 18:33:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 06b6bedb-365c-54d1-b4b9-8e519a847943 sending to next pipeline
2026-03-26 18:33:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 06b6bedb-365c-54d1-b4b9-8e519a847943, identifier: 1985839
2026-03-26 18:33:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 93c9b44c-23d8-50b6-8db8-6ce9ebd7c328 with identifier: 1985838
2026-03-26 18:33:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 93c9b44c-23d8-50b6-8db8-6ce9ebd7c328 with identifier: 1985838
2026-03-26 18:33:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 93c9b44c-23d8-50b6-8db8-6ce9ebd7c328 with identifier: 1985838 to the API
2026-03-26 18:33:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/580/4c58928ef33f4d89ac4950c00d8aa150/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.2L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '93c9b44c-23d8-50b6-8db8-6ce9ebd7c328',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'FIORINO',
 'odometer': 123834,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93c9b44c-23d8-50b6-8db8-6ce9ebd7c328/93c9b44c-23d8-50b6-8db8-6ce9ebd7c328_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 519894,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/580/4c58928ef33f4d89ac4950c00d8aa150/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-31',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FIAT FIORINO Cargo SX N1 1.3 MJet 70 kW (95 CV)',
 'transmission': 'manual',
 'trim': 'Cargo SX N1 1.3 MJet 70 kW (95 CV)',
 'vin': None,
 'year': 2021}
2026-03-26 18:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985838%27 HTTP/1.1" 200 None
2026-03-26 18:33:31 [ayvens.es] INFO: Saving data for 1985838: {'created_time': 1774550011.899698, 'last_price_update_time': 1774550011.899706, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985838') HTTP/1.1" 204 0
2026-03-26 18:33:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 06b6bedb-365c-54d1-b4b9-8e519a847943 with identifier: 1985839
2026-03-26 18:33:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 06b6bedb-365c-54d1-b4b9-8e519a847943 with identifier: 1985839
2026-03-26 18:33:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 06b6bedb-365c-54d1-b4b9-8e519a847943 with identifier: 1985839 to the API
2026-03-26 18:33:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/014/936eac01740b462a842285118b520491/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.6L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '06b6bedb-365c-54d1-b4b9-8e519a847943',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'BERLINGO',
 'odometer': 140563,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06b6bedb-365c-54d1-b4b9-8e519a847943/06b6bedb-365c-54d1-b4b9-8e519a847943_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 493968,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/014/936eac01740b462a842285118b520491/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-08',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROËN BERLINGO BlueHDi 55KW (75CV)',
 'transmission': 'manual',
 'trim': 'BlueHDi 55KW (75CV)',
 'vin': None,
 'year': 2018}
2026-03-26 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985839%27 HTTP/1.1" 200 None
2026-03-26 18:33:32 [ayvens.es] INFO: Saving data for 1985839: {'created_time': 1774550012.321817, 'last_price_update_time': 1774550012.321827, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985839') HTTP/1.1" 204 0
2026-03-26 18:33:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/605/1e4e1de925d14d3a8ef5c202c20bdbef/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28399210>
2026-03-26 18:33:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f3b78eb-c1f2-5bdc-aec0-10b59bd9600e/1f3b78eb-c1f2-5bdc-aec0-10b59bd9600e_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F833%252F9b432c8bbf784281ba93ea84c1bbad97%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/833/9b432c8bbf784281ba93ea84c1bbad97/images/large/1.jpg saved to cache
2026-03-26 18:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1f3b78eb-c1f2-5bdc-aec0-10b59bd9600e
2026-03-26 18:33:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1f3b78eb-c1f2-5bdc-aec0-10b59bd9600e, skipping ID generation
2026-03-26 18:33:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f3b78eb-c1f2-5bdc-aec0-10b59bd9600e with scrape type 1
2026-03-26 18:33:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1f3b78eb-c1f2-5bdc-aec0-10b59bd9600e sending to next pipeline
2026-03-26 18:33:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1f3b78eb-c1f2-5bdc-aec0-10b59bd9600e, identifier: 1985841
2026-03-26 18:33:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28ff71d0>
2026-03-26 18:33:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99921dc4-77b6-5076-858f-5bfda0a0da9d/99921dc4-77b6-5076-858f-5bfda0a0da9d_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F872%252Fdd7ede598f164f39b82cc9142f08c335%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/872/dd7ede598f164f39b82cc9142f08c335/images/large/1.jpg saved to cache
2026-03-26 18:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 99921dc4-77b6-5076-858f-5bfda0a0da9d
2026-03-26 18:33:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 99921dc4-77b6-5076-858f-5bfda0a0da9d, skipping ID generation
2026-03-26 18:33:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99921dc4-77b6-5076-858f-5bfda0a0da9d with scrape type 1
2026-03-26 18:33:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 99921dc4-77b6-5076-858f-5bfda0a0da9d sending to next pipeline
2026-03-26 18:33:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 99921dc4-77b6-5076-858f-5bfda0a0da9d, identifier: 1985840
2026-03-26 18:33:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/474/8bb581b20c7b4ae4b5a35e774eb18019/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1f3b78eb-c1f2-5bdc-aec0-10b59bd9600e with identifier: 1985841
2026-03-26 18:33:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1f3b78eb-c1f2-5bdc-aec0-10b59bd9600e with identifier: 1985841
2026-03-26 18:33:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1f3b78eb-c1f2-5bdc-aec0-10b59bd9600e with identifier: 1985841 to the API
2026-03-26 18:33:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/833/9b432c8bbf784281ba93ea84c1bbad97/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '1f3b78eb-c1f2-5bdc-aec0-10b59bd9600e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'EXPERT',
 'odometer': 201143,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f3b78eb-c1f2-5bdc-aec0-10b59bd9600e/1f3b78eb-c1f2-5bdc-aec0-10b59bd9600e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332243,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/833/9b432c8bbf784281ba93ea84c1bbad97/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-19',
 'seats_number': 2,
 'seller_name': None,
 'title': 'PEUGEOT EXPERT Combi 1.6 BlueHDi 88KW (120CV) Standard',
 'transmission': 'manual',
 'trim': 'Combi 1.6 BlueHDi 88KW (120CV) Standard',
 'vin': None,
 'year': 2019}
2026-03-26 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985841%27 HTTP/1.1" 200 None
2026-03-26 18:33:33 [ayvens.es] INFO: Saving data for 1985841: {'created_time': 1774550013.227056, 'last_price_update_time': 1774550013.227066, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985841') HTTP/1.1" 204 0
2026-03-26 18:33:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 99921dc4-77b6-5076-858f-5bfda0a0da9d with identifier: 1985840
2026-03-26 18:33:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:33:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 99921dc4-77b6-5076-858f-5bfda0a0da9d with identifier: 1985840
2026-03-26 18:33:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 99921dc4-77b6-5076-858f-5bfda0a0da9d with identifier: 1985840 to the API
2026-03-26 18:33:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/872/dd7ede598f164f39b82cc9142f08c335/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'Clear white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '99921dc4-77b6-5076-858f-5bfda0a0da9d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'PICANTO',
 'odometer': 85241,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99921dc4-77b6-5076-858f-5bfda0a0da9d/99921dc4-77b6-5076-858f-5bfda0a0da9d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347578,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/872/dd7ede598f164f39b82cc9142f08c335/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA PICANTO 1.0 DPi 49kW (67CV) Concept Pack Comfort',
 'transmission': 'manual',
 'trim': '1.0 DPi 49kW (67CV) Concept Pack Comfort',
 'vin': None,
 'year': 2022}
2026-03-26 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985840%27 HTTP/1.1" 200 None
2026-03-26 18:33:33 [ayvens.es] INFO: Saving data for 1985840: {'created_time': 1774550013.632011, 'last_price_update_time': 1774550013.632024, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985840') HTTP/1.1" 204 0
2026-03-26 18:33:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28acd150>
2026-03-26 18:33:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_713c1a84-6d66-5b3d-9e54-5d379c25f42a/713c1a84-6d66-5b3d-9e54-5d379c25f42a_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F605%252F1e4e1de925d14d3a8ef5c202c20bdbef%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/605/1e4e1de925d14d3a8ef5c202c20bdbef/images/large/1.jpg saved to cache
2026-03-26 18:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 713c1a84-6d66-5b3d-9e54-5d379c25f42a
2026-03-26 18:33:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 713c1a84-6d66-5b3d-9e54-5d379c25f42a, skipping ID generation
2026-03-26 18:33:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 713c1a84-6d66-5b3d-9e54-5d379c25f42a with scrape type 1
2026-03-26 18:33:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 713c1a84-6d66-5b3d-9e54-5d379c25f42a sending to next pipeline
2026-03-26 18:33:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 713c1a84-6d66-5b3d-9e54-5d379c25f42a, identifier: 1985843
2026-03-26 18:33:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a2820dd90>
2026-03-26 18:33:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72f28929-245e-5aea-abce-88ff8e02a6b0/72f28929-245e-5aea-abce-88ff8e02a6b0_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F474%252F8bb581b20c7b4ae4b5a35e774eb18019%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/474/8bb581b20c7b4ae4b5a35e774eb18019/images/large/1.jpg saved to cache
2026-03-26 18:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 72f28929-245e-5aea-abce-88ff8e02a6b0
2026-03-26 18:33:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 72f28929-245e-5aea-abce-88ff8e02a6b0, skipping ID generation
2026-03-26 18:33:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72f28929-245e-5aea-abce-88ff8e02a6b0 with scrape type 1
2026-03-26 18:33:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 72f28929-245e-5aea-abce-88ff8e02a6b0 sending to next pipeline
2026-03-26 18:33:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 72f28929-245e-5aea-abce-88ff8e02a6b0, identifier: 1985842
2026-03-26 18:33:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 713c1a84-6d66-5b3d-9e54-5d379c25f42a with identifier: 1985843
2026-03-26 18:33:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 713c1a84-6d66-5b3d-9e54-5d379c25f42a with identifier: 1985843
2026-03-26 18:33:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 713c1a84-6d66-5b3d-9e54-5d379c25f42a with identifier: 1985843 to the API
2026-03-26 18:33:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/605/1e4e1de925d14d3a8ef5c202c20bdbef/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'Gris platinum',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '713c1a84-6d66-5b3d-9e54-5d379c25f42a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008',
 'odometer': 148207,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_713c1a84-6d66-5b3d-9e54-5d379c25f42a/713c1a84-6d66-5b3d-9e54-5d379c25f42a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 371710,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/605/1e4e1de925d14d3a8ef5c202c20bdbef/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-10',
 'seats_number': 7,
 'seller_name': None,
 'title': 'PEUGEOT 5008 1.5 BlueHDi 96kW (130CV) S&S Allure',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi 96kW (130CV) S&S Allure',
 'vin': None,
 'year': 2021}
2026-03-26 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985843%27 HTTP/1.1" 200 None
2026-03-26 18:33:34 [ayvens.es] INFO: Saving data for 1985843: {'created_time': 1774550014.294988, 'last_price_update_time': 1774550014.294998, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985843') HTTP/1.1" 204 0
2026-03-26 18:33:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 72f28929-245e-5aea-abce-88ff8e02a6b0 with identifier: 1985842
2026-03-26 18:33:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 72f28929-245e-5aea-abce-88ff8e02a6b0 with identifier: 1985842
2026-03-26 18:33:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 72f28929-245e-5aea-abce-88ff8e02a6b0 with identifier: 1985842 to the API
2026-03-26 18:33:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/474/8bb581b20c7b4ae4b5a35e774eb18019/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Clear white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '72f28929-245e-5aea-abce-88ff8e02a6b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'STONIC',
 'odometer': 21433,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72f28929-245e-5aea-abce-88ff8e02a6b0/72f28929-245e-5aea-abce-88ff8e02a6b0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 475130,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/474/8bb581b20c7b4ae4b5a35e774eb18019/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA STONIC 1.2 DPi 62kW (84CV) Concept',
 'transmission': 'manual',
 'trim': '1.2 DPi 62kW (84CV) Concept',
 'vin': None,
 'year': 2023}
2026-03-26 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985842%27 HTTP/1.1" 200 None
2026-03-26 18:33:34 [ayvens.es] INFO: Saving data for 1985842: {'created_time': 1774550014.632266, 'last_price_update_time': 1774550014.632276, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985842') HTTP/1.1" 204 0
2026-03-26 18:33:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-26 18:33:35 [ayvens.es] INFO: Found listing with ID: 1985844
2026-03-26 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985844%27 HTTP/1.1" 200 None
2026-03-26 18:33:35 [ayvens.es] INFO: Scrape type for 1985844: 1
2026-03-26 18:33:35 [ayvens.es] INFO: Extracting data for car ID: 1985844
2026-03-26 18:33:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38c3d118-3223-5f30-9b9b-ded447d6affe with identifier: 1985844
2026-03-26 18:33:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38c3d118-3223-5f30-9b9b-ded447d6affe with scrape type 1
2026-03-26 18:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 38c3d118-3223-5f30-9b9b-ded447d6affe
2026-03-26 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F148%252Fe8214ccc6e904de4a5e2fb6734d5e107%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/148/e8214ccc6e904de4a5e2fb6734d5e107/images/large/1.jpg not downloaded yet
2026-03-26 18:33:35 [ayvens.es] INFO: Found listing with ID: 1985845
2026-03-26 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985845%27 HTTP/1.1" 200 None
2026-03-26 18:33:35 [ayvens.es] INFO: Scrape type for 1985845: 1
2026-03-26 18:33:35 [ayvens.es] INFO: Extracting data for car ID: 1985845
2026-03-26 18:33:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6efcd6e-bd73-589d-af5c-5e1b8843fd78 with identifier: 1985845
2026-03-26 18:33:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6efcd6e-bd73-589d-af5c-5e1b8843fd78 with scrape type 1
2026-03-26 18:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f6efcd6e-bd73-589d-af5c-5e1b8843fd78
2026-03-26 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F581%252F30e5c5b5213c418f8373837c3fd936cb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/581/30e5c5b5213c418f8373837c3fd936cb/images/large/1.jpg not downloaded yet
2026-03-26 18:33:35 [ayvens.es] INFO: Found listing with ID: 1985846
2026-03-26 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985846%27 HTTP/1.1" 200 None
2026-03-26 18:33:35 [ayvens.es] INFO: Scrape type for 1985846: 1
2026-03-26 18:33:35 [ayvens.es] INFO: Extracting data for car ID: 1985846
2026-03-26 18:33:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 838cf9b7-5210-5ec0-aaae-5b1d80314c7a with identifier: 1985846
2026-03-26 18:33:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 838cf9b7-5210-5ec0-aaae-5b1d80314c7a with scrape type 1
2026-03-26 18:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 838cf9b7-5210-5ec0-aaae-5b1d80314c7a
2026-03-26 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F477%252F27cce73634c94a59ad5c1248d32878eb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/477/27cce73634c94a59ad5c1248d32878eb/images/large/1.jpg not downloaded yet
2026-03-26 18:33:35 [ayvens.es] INFO: Found listing with ID: 1985847
2026-03-26 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985847%27 HTTP/1.1" 200 None
2026-03-26 18:33:35 [ayvens.es] INFO: Scrape type for 1985847: 1
2026-03-26 18:33:35 [ayvens.es] INFO: Extracting data for car ID: 1985847
2026-03-26 18:33:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 929126f5-b9c5-54f1-a4fe-9d8488a561db with identifier: 1985847
2026-03-26 18:33:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 929126f5-b9c5-54f1-a4fe-9d8488a561db with scrape type 1
2026-03-26 18:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 929126f5-b9c5-54f1-a4fe-9d8488a561db
2026-03-26 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F186%252F828394adebd24522a4086254cc42277e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/186/828394adebd24522a4086254cc42277e/images/large/1.jpg not downloaded yet
2026-03-26 18:33:35 [ayvens.es] INFO: Found listing with ID: 1985848
2026-03-26 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985848%27 HTTP/1.1" 200 None
2026-03-26 18:33:35 [ayvens.es] INFO: Scrape type for 1985848: 1
2026-03-26 18:33:35 [ayvens.es] INFO: Extracting data for car ID: 1985848
2026-03-26 18:33:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 523af908-c7a5-50a1-b745-4a68284c745a with identifier: 1985848
2026-03-26 18:33:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 523af908-c7a5-50a1-b745-4a68284c745a with scrape type 1
2026-03-26 18:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 523af908-c7a5-50a1-b745-4a68284c745a
2026-03-26 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F466%252Fe04204365c89402d8eac1a5221703691%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/466/e04204365c89402d8eac1a5221703691/images/large/1.jpg not downloaded yet
2026-03-26 18:33:35 [ayvens.es] INFO: Found listing with ID: 1985849
2026-03-26 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985849%27 HTTP/1.1" 200 None
2026-03-26 18:33:35 [ayvens.es] INFO: Scrape type for 1985849: 1
2026-03-26 18:33:35 [ayvens.es] INFO: Extracting data for car ID: 1985849
2026-03-26 18:33:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: facbf2cf-6df5-56b4-b1c3-3096d7319629 with identifier: 1985849
2026-03-26 18:33:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item facbf2cf-6df5-56b4-b1c3-3096d7319629 with scrape type 1
2026-03-26 18:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item facbf2cf-6df5-56b4-b1c3-3096d7319629
2026-03-26 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F250%252Fd7a50a03629b4fed9a4dd9cfeb4bfcee%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/250/d7a50a03629b4fed9a4dd9cfeb4bfcee/images/large/1.jpg not downloaded yet
2026-03-26 18:33:35 [ayvens.es] INFO: Found listing with ID: 1985850
2026-03-26 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985850%27 HTTP/1.1" 200 None
2026-03-26 18:33:35 [ayvens.es] INFO: Scrape type for 1985850: 1
2026-03-26 18:33:35 [ayvens.es] INFO: Extracting data for car ID: 1985850
2026-03-26 18:33:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd4f4bce-c476-5516-a67a-60eca34c5402 with identifier: 1985850
2026-03-26 18:33:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd4f4bce-c476-5516-a67a-60eca34c5402 with scrape type 1
2026-03-26 18:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item fd4f4bce-c476-5516-a67a-60eca34c5402
2026-03-26 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F259%252Fc3ff7349a5404f4ca7c337e1fb9780b5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/259/c3ff7349a5404f4ca7c337e1fb9780b5/images/large/1.jpg not downloaded yet
2026-03-26 18:33:35 [ayvens.es] INFO: Found listing with ID: 1985851
2026-03-26 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985851%27 HTTP/1.1" 200 None
2026-03-26 18:33:35 [ayvens.es] INFO: Scrape type for 1985851: 1
2026-03-26 18:33:35 [ayvens.es] INFO: Extracting data for car ID: 1985851
2026-03-26 18:33:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92ce7863-de02-5a7a-8eff-50a373fa4f5d with identifier: 1985851
2026-03-26 18:33:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92ce7863-de02-5a7a-8eff-50a373fa4f5d with scrape type 1
2026-03-26 18:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 92ce7863-de02-5a7a-8eff-50a373fa4f5d
2026-03-26 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F473%252F8e8ae2ce87cc4f1c83256ab1a2330c41%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/473/8e8ae2ce87cc4f1c83256ab1a2330c41/images/large/1.jpg not downloaded yet
2026-03-26 18:33:35 [ayvens.es] INFO: Found listing with ID: 1985852
2026-03-26 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985852%27 HTTP/1.1" 200 None
2026-03-26 18:33:35 [ayvens.es] INFO: Scrape type for 1985852: 1
2026-03-26 18:33:35 [ayvens.es] INFO: Extracting data for car ID: 1985852
2026-03-26 18:33:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a7ef455-1016-53f6-a2a2-3179ddd8e5f0 with identifier: 1985852
2026-03-26 18:33:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a7ef455-1016-53f6-a2a2-3179ddd8e5f0 with scrape type 1
2026-03-26 18:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0a7ef455-1016-53f6-a2a2-3179ddd8e5f0
2026-03-26 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F563%252F840c04bbcaac42a8849f1a4eec0d72b6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/563/840c04bbcaac42a8849f1a4eec0d72b6/images/large/1.jpg not downloaded yet
2026-03-26 18:33:35 [ayvens.es] INFO: Found listing with ID: 1985853
2026-03-26 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985853%27 HTTP/1.1" 200 None
2026-03-26 18:33:35 [ayvens.es] INFO: Scrape type for 1985853: 1
2026-03-26 18:33:35 [ayvens.es] INFO: Extracting data for car ID: 1985853
2026-03-26 18:33:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cabc5aa1-1384-561d-96d9-0c33bc25c18c with identifier: 1985853
2026-03-26 18:33:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cabc5aa1-1384-561d-96d9-0c33bc25c18c with scrape type 1
2026-03-26 18:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item cabc5aa1-1384-561d-96d9-0c33bc25c18c
2026-03-26 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F241%252F3ac63fcfb62246f1a2bbd7b26091045a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/241/3ac63fcfb62246f1a2bbd7b26091045a/images/large/1.jpg not downloaded yet
2026-03-26 18:33:35 [ayvens.es] INFO: Found listing with ID: 1985854
2026-03-26 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985854%27 HTTP/1.1" 200 None
2026-03-26 18:33:35 [ayvens.es] INFO: Scrape type for 1985854: 1
2026-03-26 18:33:35 [ayvens.es] INFO: Extracting data for car ID: 1985854
2026-03-26 18:33:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ce8a90e-a257-5ab9-a2e5-e251452a8195 with identifier: 1985854
2026-03-26 18:33:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ce8a90e-a257-5ab9-a2e5-e251452a8195 with scrape type 1
2026-03-26 18:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7ce8a90e-a257-5ab9-a2e5-e251452a8195
2026-03-26 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F429%252Ffe5eef94a9f448459d321012ce8202ef%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/429/fe5eef94a9f448459d321012ce8202ef/images/large/1.jpg not downloaded yet
2026-03-26 18:33:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/148/e8214ccc6e904de4a5e2fb6734d5e107/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:35 [ayvens.es] INFO: Found listing with ID: 1985855
2026-03-26 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985855%27 HTTP/1.1" 200 None
2026-03-26 18:33:35 [ayvens.es] INFO: Scrape type for 1985855: 1
2026-03-26 18:33:35 [ayvens.es] INFO: Extracting data for car ID: 1985855
2026-03-26 18:33:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4feaf8b8-2e73-5f9b-96f4-1feba0a9bbcf with identifier: 1985855
2026-03-26 18:33:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4feaf8b8-2e73-5f9b-96f4-1feba0a9bbcf with scrape type 1
2026-03-26 18:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4feaf8b8-2e73-5f9b-96f4-1feba0a9bbcf
2026-03-26 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F176%252F055435fbbe3b42d9a50d4788546a6b79%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/176/055435fbbe3b42d9a50d4788546a6b79/images/large/1.jpg not downloaded yet
2026-03-26 18:33:35 [ayvens.es] INFO: Found listing with ID: 1985856
2026-03-26 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985856%27 HTTP/1.1" 200 None
2026-03-26 18:33:35 [ayvens.es] INFO: Scrape type for 1985856: 1
2026-03-26 18:33:35 [ayvens.es] INFO: Extracting data for car ID: 1985856
2026-03-26 18:33:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a81b7bda-179c-5d9f-9bf5-f46348574ca1 with identifier: 1985856
2026-03-26 18:33:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a81b7bda-179c-5d9f-9bf5-f46348574ca1 with scrape type 1
2026-03-26 18:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a81b7bda-179c-5d9f-9bf5-f46348574ca1
2026-03-26 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F400%252F1184465f9af5443eb2db6daed818b332%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/400/1184465f9af5443eb2db6daed818b332/images/large/1.jpg not downloaded yet
2026-03-26 18:33:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/581/30e5c5b5213c418f8373837c3fd936cb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/186/828394adebd24522a4086254cc42277e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:35 [ayvens.es] INFO: Found listing with ID: 1985857
2026-03-26 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985857%27 HTTP/1.1" 200 None
2026-03-26 18:33:35 [ayvens.es] INFO: Scrape type for 1985857: 1
2026-03-26 18:33:35 [ayvens.es] INFO: Extracting data for car ID: 1985857
2026-03-26 18:33:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cce5596e-ad0d-52cb-92e4-46c128fb3792 with identifier: 1985857
2026-03-26 18:33:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cce5596e-ad0d-52cb-92e4-46c128fb3792 with scrape type 1
2026-03-26 18:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item cce5596e-ad0d-52cb-92e4-46c128fb3792
2026-03-26 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F999%252Fc44a61d478ff46868f58222365bbd8ed%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/999/c44a61d478ff46868f58222365bbd8ed/images/large/1.jpg not downloaded yet
2026-03-26 18:33:35 [ayvens.es] INFO: Found listing with ID: 1985858
2026-03-26 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985858%27 HTTP/1.1" 200 None
2026-03-26 18:33:35 [ayvens.es] INFO: Scrape type for 1985858: 1
2026-03-26 18:33:35 [ayvens.es] INFO: Extracting data for car ID: 1985858
2026-03-26 18:33:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 365736ec-55b4-55df-89f6-95561e6cc74e with identifier: 1985858
2026-03-26 18:33:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 365736ec-55b4-55df-89f6-95561e6cc74e with scrape type 1
2026-03-26 18:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 365736ec-55b4-55df-89f6-95561e6cc74e
2026-03-26 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F945%252F046f31ac53564b0d9723a40413796db0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/945/046f31ac53564b0d9723a40413796db0/images/large/1.jpg not downloaded yet
2026-03-26 18:33:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28348d10>
2026-03-26 18:33:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38c3d118-3223-5f30-9b9b-ded447d6affe/38c3d118-3223-5f30-9b9b-ded447d6affe_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F148%252Fe8214ccc6e904de4a5e2fb6734d5e107%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/148/e8214ccc6e904de4a5e2fb6734d5e107/images/large/1.jpg saved to cache
2026-03-26 18:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 38c3d118-3223-5f30-9b9b-ded447d6affe
2026-03-26 18:33:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 38c3d118-3223-5f30-9b9b-ded447d6affe, skipping ID generation
2026-03-26 18:33:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38c3d118-3223-5f30-9b9b-ded447d6affe with scrape type 1
2026-03-26 18:33:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 38c3d118-3223-5f30-9b9b-ded447d6affe sending to next pipeline
2026-03-26 18:33:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 38c3d118-3223-5f30-9b9b-ded447d6affe, identifier: 1985844
2026-03-26 18:33:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/473/8e8ae2ce87cc4f1c83256ab1a2330c41/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/477/27cce73634c94a59ad5c1248d32878eb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:36 [ayvens.es] INFO: Found listing with ID: 1985859
2026-03-26 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985859%27 HTTP/1.1" 200 None
2026-03-26 18:33:36 [ayvens.es] INFO: Scrape type for 1985859: 1
2026-03-26 18:33:36 [ayvens.es] INFO: Extracting data for car ID: 1985859
2026-03-26 18:33:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81817674-390d-5cb7-b6f2-a8a1f5e3a0d5 with identifier: 1985859
2026-03-26 18:33:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81817674-390d-5cb7-b6f2-a8a1f5e3a0d5 with scrape type 1
2026-03-26 18:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 81817674-390d-5cb7-b6f2-a8a1f5e3a0d5
2026-03-26 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F491%252Fb968ae32f3704964817694874bbdca91%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/491/b968ae32f3704964817694874bbdca91/images/large/1.jpg not downloaded yet
2026-03-26 18:33:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 38c3d118-3223-5f30-9b9b-ded447d6affe with identifier: 1985844
2026-03-26 18:33:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 38c3d118-3223-5f30-9b9b-ded447d6affe with identifier: 1985844
2026-03-26 18:33:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 38c3d118-3223-5f30-9b9b-ded447d6affe with identifier: 1985844 to the API
2026-03-26 18:33:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/148/e8214ccc6e904de4a5e2fb6734d5e107/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '38c3d118-3223-5f30-9b9b-ded447d6affe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'BERLINGO',
 'odometer': 178642,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38c3d118-3223-5f30-9b9b-ded447d6affe/38c3d118-3223-5f30-9b9b-ded447d6affe_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 517189,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/148/e8214ccc6e904de4a5e2fb6734d5e107/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-28',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROËN BERLINGO Talla M BlueHDi 100 CONTROL',
 'transmission': 'manual',
 'trim': 'Talla M BlueHDi 100 CONTROL',
 'vin': None,
 'year': 2021}
2026-03-26 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985844%27 HTTP/1.1" 200 None
2026-03-26 18:33:36 [ayvens.es] INFO: Saving data for 1985844: {'created_time': 1774550016.594509, 'last_price_update_time': 1774550016.59452, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985844') HTTP/1.1" 204 0
2026-03-26 18:33:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/259/c3ff7349a5404f4ca7c337e1fb9780b5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/250/d7a50a03629b4fed9a4dd9cfeb4bfcee/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/466/e04204365c89402d8eac1a5221703691/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:36 [ayvens.es] INFO: Found listing with ID: 1985860
2026-03-26 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985860%27 HTTP/1.1" 200 None
2026-03-26 18:33:36 [ayvens.es] INFO: Scrape type for 1985860: 1
2026-03-26 18:33:36 [ayvens.es] INFO: Extracting data for car ID: 1985860
2026-03-26 18:33:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5524d492-b71b-5b4c-b557-88a3663ac1b9 with identifier: 1985860
2026-03-26 18:33:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5524d492-b71b-5b4c-b557-88a3663ac1b9 with scrape type 1
2026-03-26 18:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5524d492-b71b-5b4c-b557-88a3663ac1b9
2026-03-26 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F860%252Fe031ebce16cb4abd8fa90dc3b29a61a9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/860/e031ebce16cb4abd8fa90dc3b29a61a9/images/large/1.jpg not downloaded yet
2026-03-26 18:33:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a283e2410>
2026-03-26 18:33:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6efcd6e-bd73-589d-af5c-5e1b8843fd78/f6efcd6e-bd73-589d-af5c-5e1b8843fd78_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F581%252F30e5c5b5213c418f8373837c3fd936cb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/581/30e5c5b5213c418f8373837c3fd936cb/images/large/1.jpg saved to cache
2026-03-26 18:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f6efcd6e-bd73-589d-af5c-5e1b8843fd78
2026-03-26 18:33:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f6efcd6e-bd73-589d-af5c-5e1b8843fd78, skipping ID generation
2026-03-26 18:33:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6efcd6e-bd73-589d-af5c-5e1b8843fd78 with scrape type 1
2026-03-26 18:33:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f6efcd6e-bd73-589d-af5c-5e1b8843fd78 sending to next pipeline
2026-03-26 18:33:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f6efcd6e-bd73-589d-af5c-5e1b8843fd78, identifier: 1985845
2026-03-26 18:33:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28d44850>
2026-03-26 18:33:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_929126f5-b9c5-54f1-a4fe-9d8488a561db/929126f5-b9c5-54f1-a4fe-9d8488a561db_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F186%252F828394adebd24522a4086254cc42277e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/186/828394adebd24522a4086254cc42277e/images/large/1.jpg saved to cache
2026-03-26 18:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 929126f5-b9c5-54f1-a4fe-9d8488a561db
2026-03-26 18:33:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 929126f5-b9c5-54f1-a4fe-9d8488a561db, skipping ID generation
2026-03-26 18:33:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 929126f5-b9c5-54f1-a4fe-9d8488a561db with scrape type 1
2026-03-26 18:33:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 929126f5-b9c5-54f1-a4fe-9d8488a561db sending to next pipeline
2026-03-26 18:33:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 929126f5-b9c5-54f1-a4fe-9d8488a561db, identifier: 1985847
2026-03-26 18:33:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c1fc90>
2026-03-26 18:33:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92ce7863-de02-5a7a-8eff-50a373fa4f5d/92ce7863-de02-5a7a-8eff-50a373fa4f5d_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F473%252F8e8ae2ce87cc4f1c83256ab1a2330c41%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/473/8e8ae2ce87cc4f1c83256ab1a2330c41/images/large/1.jpg saved to cache
2026-03-26 18:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 92ce7863-de02-5a7a-8eff-50a373fa4f5d
2026-03-26 18:33:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 92ce7863-de02-5a7a-8eff-50a373fa4f5d, skipping ID generation
2026-03-26 18:33:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92ce7863-de02-5a7a-8eff-50a373fa4f5d with scrape type 1
2026-03-26 18:33:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 92ce7863-de02-5a7a-8eff-50a373fa4f5d sending to next pipeline
2026-03-26 18:33:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 92ce7863-de02-5a7a-8eff-50a373fa4f5d, identifier: 1985851
2026-03-26 18:33:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a283e1d50>
2026-03-26 18:33:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_838cf9b7-5210-5ec0-aaae-5b1d80314c7a/838cf9b7-5210-5ec0-aaae-5b1d80314c7a_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F477%252F27cce73634c94a59ad5c1248d32878eb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/477/27cce73634c94a59ad5c1248d32878eb/images/large/1.jpg saved to cache
2026-03-26 18:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 838cf9b7-5210-5ec0-aaae-5b1d80314c7a
2026-03-26 18:33:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 838cf9b7-5210-5ec0-aaae-5b1d80314c7a, skipping ID generation
2026-03-26 18:33:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 838cf9b7-5210-5ec0-aaae-5b1d80314c7a with scrape type 1
2026-03-26 18:33:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 838cf9b7-5210-5ec0-aaae-5b1d80314c7a sending to next pipeline
2026-03-26 18:33:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 838cf9b7-5210-5ec0-aaae-5b1d80314c7a, identifier: 1985846
2026-03-26 18:33:37 [ayvens.es] INFO: Found listing with ID: 1985861
2026-03-26 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985861%27 HTTP/1.1" 200 None
2026-03-26 18:33:37 [ayvens.es] INFO: Scrape type for 1985861: 1
2026-03-26 18:33:37 [ayvens.es] INFO: Extracting data for car ID: 1985861
2026-03-26 18:33:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90b5f7f1-d64b-5602-ae70-ba0f2486e78a with identifier: 1985861
2026-03-26 18:33:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90b5f7f1-d64b-5602-ae70-ba0f2486e78a with scrape type 1
2026-03-26 18:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 90b5f7f1-d64b-5602-ae70-ba0f2486e78a
2026-03-26 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F631%252F0d5f6b67f7634ad49633cf3ca7dad5ca%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/631/0d5f6b67f7634ad49633cf3ca7dad5ca/images/large/1.jpg not downloaded yet
2026-03-26 18:33:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f6efcd6e-bd73-589d-af5c-5e1b8843fd78 with identifier: 1985845
2026-03-26 18:33:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f6efcd6e-bd73-589d-af5c-5e1b8843fd78 with identifier: 1985845
2026-03-26 18:33:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f6efcd6e-bd73-589d-af5c-5e1b8843fd78 with identifier: 1985845 to the API
2026-03-26 18:33:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/581/30e5c5b5213c418f8373837c3fd936cb/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'f6efcd6e-bd73-589d-af5c-5e1b8843fd78',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'KUGA',
 'odometer': 225920,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6efcd6e-bd73-589d-af5c-5e1b8843fd78/f6efcd6e-bd73-589d-af5c-5e1b8843fd78_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 550527,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/581/30e5c5b5213c418f8373837c3fd936cb/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD KUGA ST-Line 1.5 EcoBoost 110kW (150CV)',
 'transmission': 'manual',
 'trim': 'ST-Line 1.5 EcoBoost 110kW (150CV)',
 'vin': None,
 'year': 2021}
2026-03-26 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985845%27 HTTP/1.1" 200 None
2026-03-26 18:33:37 [ayvens.es] INFO: Saving data for 1985845: {'created_time': 1774550017.884771, 'last_price_update_time': 1774550017.884782, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985845') HTTP/1.1" 204 0
2026-03-26 18:33:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 929126f5-b9c5-54f1-a4fe-9d8488a561db with identifier: 1985847
2026-03-26 18:33:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 929126f5-b9c5-54f1-a4fe-9d8488a561db with identifier: 1985847
2026-03-26 18:33:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 929126f5-b9c5-54f1-a4fe-9d8488a561db with identifier: 1985847 to the API
2026-03-26 18:33:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/186/828394adebd24522a4086254cc42277e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 179,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '929126f5-b9c5-54f1-a4fe-9d8488a561db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT',
 'odometer': 136579,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_929126f5-b9c5-54f1-a4fe-9d8488a561db/929126f5-b9c5-54f1-a4fe-9d8488a561db_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336757,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/186/828394adebd24522a4086254cc42277e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-08',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 350 96kW L3H2 Van Trend FWD',
 'transmission': 'manual',
 'trim': '350 96kW L3H2 Van Trend FWD',
 'vin': None,
 'year': 2020}
2026-03-26 18:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985847%27 HTTP/1.1" 200 None
2026-03-26 18:33:38 [ayvens.es] INFO: Saving data for 1985847: {'created_time': 1774550018.224236, 'last_price_update_time': 1774550018.224246, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985847') HTTP/1.1" 204 0
2026-03-26 18:33:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 92ce7863-de02-5a7a-8eff-50a373fa4f5d with identifier: 1985851
2026-03-26 18:33:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 92ce7863-de02-5a7a-8eff-50a373fa4f5d with identifier: 1985851
2026-03-26 18:33:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 92ce7863-de02-5a7a-8eff-50a373fa4f5d with identifier: 1985851 to the API
2026-03-26 18:33:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/473/8e8ae2ce87cc4f1c83256ab1a2330c41/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '92ce7863-de02-5a7a-8eff-50a373fa4f5d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'VIVARO',
 'odometer': 141316,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92ce7863-de02-5a7a-8eff-50a373fa4f5d/92ce7863-de02-5a7a-8eff-50a373fa4f5d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 327910,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/473/8e8ae2ce87cc4f1c83256ab1a2330c41/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-27',
 'seats_number': 2,
 'seller_name': None,
 'title': 'OPEL VIVARO 1.5 Diesel 88kW (120CV) S Std Express',
 'transmission': 'manual',
 'trim': '1.5 Diesel 88kW (120CV) S Std Express',
 'vin': None,
 'year': 2021}
2026-03-26 18:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985851%27 HTTP/1.1" 200 None
2026-03-26 18:33:38 [ayvens.es] INFO: Saving data for 1985851: {'created_time': 1774550018.65273, 'last_price_update_time': 1774550018.652745, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985851') HTTP/1.1" 204 0
2026-03-26 18:33:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 838cf9b7-5210-5ec0-aaae-5b1d80314c7a with identifier: 1985846
2026-03-26 18:33:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:33:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 838cf9b7-5210-5ec0-aaae-5b1d80314c7a with identifier: 1985846
2026-03-26 18:33:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 838cf9b7-5210-5ec0-aaae-5b1d80314c7a with identifier: 1985846 to the API
2026-03-26 18:33:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/477/27cce73634c94a59ad5c1248d32878eb/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'color': 'Azul encre',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '838cf9b7-5210-5ec0-aaae-5b1d80314c7a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS 7 CROSSBACK',
 'odometer': 133905,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_838cf9b7-5210-5ec0-aaae-5b1d80314c7a/838cf9b7-5210-5ec0-aaae-5b1d80314c7a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 367215,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/477/27cce73634c94a59ad5c1248d32878eb/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS 7 CROSSBACK BlueHDi DE 96kW (130CV) AT Bastille +',
 'transmission': 'manual',
 'trim': 'BlueHDi DE 96kW (130CV) AT Bastille +',
 'vin': None,
 'year': 2021}
2026-03-26 18:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985846%27 HTTP/1.1" 200 None
2026-03-26 18:33:39 [ayvens.es] INFO: Saving data for 1985846: {'created_time': 1774550019.066753, 'last_price_update_time': 1774550019.066764, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985846') HTTP/1.1" 204 0
2026-03-26 18:33:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/241/3ac63fcfb62246f1a2bbd7b26091045a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/563/840c04bbcaac42a8849f1a4eec0d72b6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/429/fe5eef94a9f448459d321012ce8202ef/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:39 [ayvens.es] INFO: Found listing with ID: 1985862
2026-03-26 18:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985862%27 HTTP/1.1" 200 None
2026-03-26 18:33:39 [ayvens.es] INFO: Scrape type for 1985862: 1
2026-03-26 18:33:39 [ayvens.es] INFO: Extracting data for car ID: 1985862
2026-03-26 18:33:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d52b06a-05f5-5736-8e78-721f4aa068b0 with identifier: 1985862
2026-03-26 18:33:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d52b06a-05f5-5736-8e78-721f4aa068b0 with scrape type 1
2026-03-26 18:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9d52b06a-05f5-5736-8e78-721f4aa068b0
2026-03-26 18:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F198%252F72e201121f684f46af55973d8fbe89bd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/198/72e201121f684f46af55973d8fbe89bd/images/large/1.jpg not downloaded yet
2026-03-26 18:33:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28395810>
2026-03-26 18:33:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd4f4bce-c476-5516-a67a-60eca34c5402/fd4f4bce-c476-5516-a67a-60eca34c5402_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F259%252Fc3ff7349a5404f4ca7c337e1fb9780b5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/259/c3ff7349a5404f4ca7c337e1fb9780b5/images/large/1.jpg saved to cache
2026-03-26 18:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fd4f4bce-c476-5516-a67a-60eca34c5402
2026-03-26 18:33:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fd4f4bce-c476-5516-a67a-60eca34c5402, skipping ID generation
2026-03-26 18:33:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd4f4bce-c476-5516-a67a-60eca34c5402 with scrape type 1
2026-03-26 18:33:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fd4f4bce-c476-5516-a67a-60eca34c5402 sending to next pipeline
2026-03-26 18:33:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: fd4f4bce-c476-5516-a67a-60eca34c5402, identifier: 1985850
2026-03-26 18:33:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a283750d0>
2026-03-26 18:33:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_facbf2cf-6df5-56b4-b1c3-3096d7319629/facbf2cf-6df5-56b4-b1c3-3096d7319629_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F250%252Fd7a50a03629b4fed9a4dd9cfeb4bfcee%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/250/d7a50a03629b4fed9a4dd9cfeb4bfcee/images/large/1.jpg saved to cache
2026-03-26 18:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item facbf2cf-6df5-56b4-b1c3-3096d7319629
2026-03-26 18:33:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: facbf2cf-6df5-56b4-b1c3-3096d7319629, skipping ID generation
2026-03-26 18:33:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item facbf2cf-6df5-56b4-b1c3-3096d7319629 with scrape type 1
2026-03-26 18:33:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item facbf2cf-6df5-56b4-b1c3-3096d7319629 sending to next pipeline
2026-03-26 18:33:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: facbf2cf-6df5-56b4-b1c3-3096d7319629, identifier: 1985849
2026-03-26 18:33:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28377c90>
2026-03-26 18:33:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_523af908-c7a5-50a1-b745-4a68284c745a/523af908-c7a5-50a1-b745-4a68284c745a_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F466%252Fe04204365c89402d8eac1a5221703691%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/466/e04204365c89402d8eac1a5221703691/images/large/1.jpg saved to cache
2026-03-26 18:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 523af908-c7a5-50a1-b745-4a68284c745a
2026-03-26 18:33:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 523af908-c7a5-50a1-b745-4a68284c745a, skipping ID generation
2026-03-26 18:33:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 523af908-c7a5-50a1-b745-4a68284c745a with scrape type 1
2026-03-26 18:33:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 523af908-c7a5-50a1-b745-4a68284c745a sending to next pipeline
2026-03-26 18:33:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 523af908-c7a5-50a1-b745-4a68284c745a, identifier: 1985848
2026-03-26 18:33:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: fd4f4bce-c476-5516-a67a-60eca34c5402 with identifier: 1985850
2026-03-26 18:33:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:33:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: fd4f4bce-c476-5516-a67a-60eca34c5402 with identifier: 1985850
2026-03-26 18:33:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: fd4f4bce-c476-5516-a67a-60eca34c5402 with identifier: 1985850 to the API
2026-03-26 18:33:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/259/c3ff7349a5404f4ca7c337e1fb9780b5/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'Alpinweiss',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'fd4f4bce-c476-5516-a67a-60eca34c5402',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X4',
 'odometer': 71227,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd4f4bce-c476-5516-a67a-60eca34c5402/fd4f4bce-c476-5516-a67a-60eca34c5402_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 552181,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/259/c3ff7349a5404f4ca7c337e1fb9780b5/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X4 xDrive20d',
 'transmission': 'manual',
 'trim': 'xDrive20d',
 'vin': None,
 'year': 2021}
2026-03-26 18:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985850%27 HTTP/1.1" 200 None
2026-03-26 18:33:39 [ayvens.es] INFO: Saving data for 1985850: {'created_time': 1774550019.99259, 'last_price_update_time': 1774550019.992604, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985850') HTTP/1.1" 204 0
2026-03-26 18:33:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: facbf2cf-6df5-56b4-b1c3-3096d7319629 with identifier: 1985849
2026-03-26 18:33:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: facbf2cf-6df5-56b4-b1c3-3096d7319629 with identifier: 1985849
2026-03-26 18:33:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: facbf2cf-6df5-56b4-b1c3-3096d7319629 with identifier: 1985849 to the API
2026-03-26 18:33:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/250/d7a50a03629b4fed9a4dd9cfeb4bfcee/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'facbf2cf-6df5-56b4-b1c3-3096d7319629',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'BERLINGO',
 'odometer': 113019,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_facbf2cf-6df5-56b4-b1c3-3096d7319629/facbf2cf-6df5-56b4-b1c3-3096d7319629_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329126,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/250/d7a50a03629b4fed9a4dd9cfeb4bfcee/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN BERLINGO Talla M BlueHDi 100 S&S FEEL',
 'transmission': 'manual',
 'trim': 'Talla M BlueHDi 100 S&S FEEL',
 'vin': None,
 'year': 2021}
2026-03-26 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985849%27 HTTP/1.1" 200 None
2026-03-26 18:33:40 [ayvens.es] INFO: Saving data for 1985849: {'created_time': 1774550020.364325, 'last_price_update_time': 1774550020.364336, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985849') HTTP/1.1" 204 0
2026-03-26 18:33:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 523af908-c7a5-50a1-b745-4a68284c745a with identifier: 1985848
2026-03-26 18:33:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 523af908-c7a5-50a1-b745-4a68284c745a with identifier: 1985848
2026-03-26 18:33:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 523af908-c7a5-50a1-b745-4a68284c745a with identifier: 1985848 to the API
2026-03-26 18:33:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/466/e04204365c89402d8eac1a5221703691/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 231,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.3L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '523af908-c7a5-50a1-b745-4a68284c745a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'NAVARA',
 'odometer': 92231,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_523af908-c7a5-50a1-b745-4a68284c745a/523af908-c7a5-50a1-b745-4a68284c745a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 341018,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/466/e04204365c89402d8eac1a5221703691/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN NAVARA D. Cab. 2.3dCi 120kW(160CV) Visia BDif',
 'transmission': 'manual',
 'trim': 'D. Cab. 2.3dCi 120kW(160CV) Visia BDif',
 'vin': None,
 'year': 2020}
2026-03-26 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985848%27 HTTP/1.1" 200 None
2026-03-26 18:33:40 [ayvens.es] INFO: Saving data for 1985848: {'created_time': 1774550020.699183, 'last_price_update_time': 1774550020.699193, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985848') HTTP/1.1" 204 0
2026-03-26 18:33:40 [ayvens.es] INFO: Found listing with ID: 1985863
2026-03-26 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985863%27 HTTP/1.1" 200 None
2026-03-26 18:33:40 [ayvens.es] INFO: Scrape type for 1985863: 1
2026-03-26 18:33:40 [ayvens.es] INFO: Extracting data for car ID: 1985863
2026-03-26 18:33:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b929b84b-1e3a-549a-b566-6d6032aff4bf with identifier: 1985863
2026-03-26 18:33:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b929b84b-1e3a-549a-b566-6d6032aff4bf with scrape type 1
2026-03-26 18:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b929b84b-1e3a-549a-b566-6d6032aff4bf
2026-03-26 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F423%252F969620452f7c49908acb0ded8a8ffc6e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/423/969620452f7c49908acb0ded8a8ffc6e/images/large/1.jpg not downloaded yet
2026-03-26 18:33:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/400/1184465f9af5443eb2db6daed818b332/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/176/055435fbbe3b42d9a50d4788546a6b79/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a2ab02950>
2026-03-26 18:33:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cabc5aa1-1384-561d-96d9-0c33bc25c18c/cabc5aa1-1384-561d-96d9-0c33bc25c18c_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F241%252F3ac63fcfb62246f1a2bbd7b26091045a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/241/3ac63fcfb62246f1a2bbd7b26091045a/images/large/1.jpg saved to cache
2026-03-26 18:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cabc5aa1-1384-561d-96d9-0c33bc25c18c
2026-03-26 18:33:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cabc5aa1-1384-561d-96d9-0c33bc25c18c, skipping ID generation
2026-03-26 18:33:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cabc5aa1-1384-561d-96d9-0c33bc25c18c with scrape type 1
2026-03-26 18:33:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cabc5aa1-1384-561d-96d9-0c33bc25c18c sending to next pipeline
2026-03-26 18:33:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: cabc5aa1-1384-561d-96d9-0c33bc25c18c, identifier: 1985853
2026-03-26 18:33:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c29390>
2026-03-26 18:33:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a7ef455-1016-53f6-a2a2-3179ddd8e5f0/0a7ef455-1016-53f6-a2a2-3179ddd8e5f0_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F563%252F840c04bbcaac42a8849f1a4eec0d72b6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/563/840c04bbcaac42a8849f1a4eec0d72b6/images/large/1.jpg saved to cache
2026-03-26 18:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0a7ef455-1016-53f6-a2a2-3179ddd8e5f0
2026-03-26 18:33:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0a7ef455-1016-53f6-a2a2-3179ddd8e5f0, skipping ID generation
2026-03-26 18:33:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a7ef455-1016-53f6-a2a2-3179ddd8e5f0 with scrape type 1
2026-03-26 18:33:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0a7ef455-1016-53f6-a2a2-3179ddd8e5f0 sending to next pipeline
2026-03-26 18:33:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0a7ef455-1016-53f6-a2a2-3179ddd8e5f0, identifier: 1985852
2026-03-26 18:33:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28347cd0>
2026-03-26 18:33:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ce8a90e-a257-5ab9-a2e5-e251452a8195/7ce8a90e-a257-5ab9-a2e5-e251452a8195_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F429%252Ffe5eef94a9f448459d321012ce8202ef%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/429/fe5eef94a9f448459d321012ce8202ef/images/large/1.jpg saved to cache
2026-03-26 18:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7ce8a90e-a257-5ab9-a2e5-e251452a8195
2026-03-26 18:33:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7ce8a90e-a257-5ab9-a2e5-e251452a8195, skipping ID generation
2026-03-26 18:33:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ce8a90e-a257-5ab9-a2e5-e251452a8195 with scrape type 1
2026-03-26 18:33:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7ce8a90e-a257-5ab9-a2e5-e251452a8195 sending to next pipeline
2026-03-26 18:33:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7ce8a90e-a257-5ab9-a2e5-e251452a8195, identifier: 1985854
2026-03-26 18:33:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/945/046f31ac53564b0d9723a40413796db0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:41 [ayvens.es] INFO: Found listing with ID: 1985864
2026-03-26 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985864%27 HTTP/1.1" 200 None
2026-03-26 18:33:41 [ayvens.es] INFO: Scrape type for 1985864: 1
2026-03-26 18:33:41 [ayvens.es] INFO: Extracting data for car ID: 1985864
2026-03-26 18:33:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 531ca14b-3e35-5c73-9ca5-24811640801e with identifier: 1985864
2026-03-26 18:33:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 531ca14b-3e35-5c73-9ca5-24811640801e with scrape type 1
2026-03-26 18:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 531ca14b-3e35-5c73-9ca5-24811640801e
2026-03-26 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F744%252F607c0dfc7e874440b484ba5cbb742a52%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/744/607c0dfc7e874440b484ba5cbb742a52/images/large/1.jpg not downloaded yet
2026-03-26 18:33:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: cabc5aa1-1384-561d-96d9-0c33bc25c18c with identifier: 1985853
2026-03-26 18:33:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: cabc5aa1-1384-561d-96d9-0c33bc25c18c with identifier: 1985853
2026-03-26 18:33:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: cabc5aa1-1384-561d-96d9-0c33bc25c18c with identifier: 1985853 to the API
2026-03-26 18:33:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/241/3ac63fcfb62246f1a2bbd7b26091045a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'color': 'Grafito',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'cabc5aa1-1384-561d-96d9-0c33bc25c18c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLC-CLASS',
 'odometer': 91514,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cabc5aa1-1384-561d-96d9-0c33bc25c18c/cabc5aa1-1384-561d-96d9-0c33bc25c18c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 361363,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/241/3ac63fcfb62246f1a2bbd7b26091045a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLC-CLASS GLC 220 d 4MATIC',
 'transmission': 'manual',
 'trim': 'GLC 220 d 4MATIC',
 'vin': None,
 'year': 2020}
2026-03-26 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985853%27 HTTP/1.1" 200 None
2026-03-26 18:33:41 [ayvens.es] INFO: Saving data for 1985853: {'created_time': 1774550021.608443, 'last_price_update_time': 1774550021.608455, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985853') HTTP/1.1" 204 0
2026-03-26 18:33:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0a7ef455-1016-53f6-a2a2-3179ddd8e5f0 with identifier: 1985852
2026-03-26 18:33:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:33:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0a7ef455-1016-53f6-a2a2-3179ddd8e5f0 with identifier: 1985852
2026-03-26 18:33:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0a7ef455-1016-53f6-a2a2-3179ddd8e5f0 with identifier: 1985852 to the API
2026-03-26 18:33:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/563/840c04bbcaac42a8849f1a4eec0d72b6/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 92,
 'color': 'Azul celebes',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '0a7ef455-1016-53f6-a2a2-3179ddd8e5f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508',
 'odometer': 132359,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a7ef455-1016-53f6-a2a2-3179ddd8e5f0/0a7ef455-1016-53f6-a2a2-3179ddd8e5f0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 366116,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/563/840c04bbcaac42a8849f1a4eec0d72b6/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 5P Business Line BlueHDi 96kW S&S EAT8',
 'transmission': 'manual',
 'trim': '5P Business Line BlueHDi 96kW S&S EAT8',
 'vin': None,
 'year': 2020}
2026-03-26 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985852%27 HTTP/1.1" 200 None
2026-03-26 18:33:41 [ayvens.es] INFO: Saving data for 1985852: {'created_time': 1774550021.93874, 'last_price_update_time': 1774550021.938749, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985852') HTTP/1.1" 204 0
2026-03-26 18:33:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7ce8a90e-a257-5ab9-a2e5-e251452a8195 with identifier: 1985854
2026-03-26 18:33:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7ce8a90e-a257-5ab9-a2e5-e251452a8195 with identifier: 1985854
2026-03-26 18:33:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7ce8a90e-a257-5ab9-a2e5-e251452a8195 with identifier: 1985854 to the API
2026-03-26 18:33:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/429/fe5eef94a9f448459d321012ce8202ef/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '7ce8a90e-a257-5ab9-a2e5-e251452a8195',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'CORSA',
 'odometer': 152520,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ce8a90e-a257-5ab9-a2e5-e251452a8195/7ce8a90e-a257-5ab9-a2e5-e251452a8195_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340072,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/429/fe5eef94a9f448459d321012ce8202ef/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL CORSA 1.5D DT 74kW (100CV) Edition',
 'transmission': 'manual',
 'trim': '1.5D DT 74kW (100CV) Edition',
 'vin': None,
 'year': 2023}
2026-03-26 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985854%27 HTTP/1.1" 200 None
2026-03-26 18:33:42 [ayvens.es] INFO: Saving data for 1985854: {'created_time': 1774550022.283771, 'last_price_update_time': 1774550022.283781, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985854') HTTP/1.1" 204 0
2026-03-26 18:33:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/491/b968ae32f3704964817694874bbdca91/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:42 [ayvens.es] INFO: Found listing with ID: 1985865
2026-03-26 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985865%27 HTTP/1.1" 200 None
2026-03-26 18:33:42 [ayvens.es] INFO: Scrape type for 1985865: 1
2026-03-26 18:33:42 [ayvens.es] INFO: Extracting data for car ID: 1985865
2026-03-26 18:33:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 441d143c-1df5-568a-920c-fb1ded97785b with identifier: 1985865
2026-03-26 18:33:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 441d143c-1df5-568a-920c-fb1ded97785b with scrape type 1
2026-03-26 18:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 441d143c-1df5-568a-920c-fb1ded97785b
2026-03-26 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F372%252Fd0c9cdb6e4e946d9b84c52fd4e3d25c4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/372/d0c9cdb6e4e946d9b84c52fd4e3d25c4/images/large/1.jpg not downloaded yet
2026-03-26 18:33:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/999/c44a61d478ff46868f58222365bbd8ed/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/860/e031ebce16cb4abd8fa90dc3b29a61a9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28d310d0>
2026-03-26 18:33:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a81b7bda-179c-5d9f-9bf5-f46348574ca1/a81b7bda-179c-5d9f-9bf5-f46348574ca1_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F400%252F1184465f9af5443eb2db6daed818b332%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/400/1184465f9af5443eb2db6daed818b332/images/large/1.jpg saved to cache
2026-03-26 18:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a81b7bda-179c-5d9f-9bf5-f46348574ca1
2026-03-26 18:33:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a81b7bda-179c-5d9f-9bf5-f46348574ca1, skipping ID generation
2026-03-26 18:33:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a81b7bda-179c-5d9f-9bf5-f46348574ca1 with scrape type 1
2026-03-26 18:33:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a81b7bda-179c-5d9f-9bf5-f46348574ca1 sending to next pipeline
2026-03-26 18:33:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a81b7bda-179c-5d9f-9bf5-f46348574ca1, identifier: 1985856
2026-03-26 18:33:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28d30f50>
2026-03-26 18:33:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4feaf8b8-2e73-5f9b-96f4-1feba0a9bbcf/4feaf8b8-2e73-5f9b-96f4-1feba0a9bbcf_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F176%252F055435fbbe3b42d9a50d4788546a6b79%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/176/055435fbbe3b42d9a50d4788546a6b79/images/large/1.jpg saved to cache
2026-03-26 18:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4feaf8b8-2e73-5f9b-96f4-1feba0a9bbcf
2026-03-26 18:33:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4feaf8b8-2e73-5f9b-96f4-1feba0a9bbcf, skipping ID generation
2026-03-26 18:33:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4feaf8b8-2e73-5f9b-96f4-1feba0a9bbcf with scrape type 1
2026-03-26 18:33:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4feaf8b8-2e73-5f9b-96f4-1feba0a9bbcf sending to next pipeline
2026-03-26 18:33:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4feaf8b8-2e73-5f9b-96f4-1feba0a9bbcf, identifier: 1985855
2026-03-26 18:33:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a29080550>
2026-03-26 18:33:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_365736ec-55b4-55df-89f6-95561e6cc74e/365736ec-55b4-55df-89f6-95561e6cc74e_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F945%252F046f31ac53564b0d9723a40413796db0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/945/046f31ac53564b0d9723a40413796db0/images/large/1.jpg saved to cache
2026-03-26 18:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 365736ec-55b4-55df-89f6-95561e6cc74e
2026-03-26 18:33:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 365736ec-55b4-55df-89f6-95561e6cc74e, skipping ID generation
2026-03-26 18:33:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 365736ec-55b4-55df-89f6-95561e6cc74e with scrape type 1
2026-03-26 18:33:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 365736ec-55b4-55df-89f6-95561e6cc74e sending to next pipeline
2026-03-26 18:33:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 365736ec-55b4-55df-89f6-95561e6cc74e, identifier: 1985858
2026-03-26 18:33:42 [ayvens.es] INFO: Found listing with ID: 1985866
2026-03-26 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985866%27 HTTP/1.1" 200 None
2026-03-26 18:33:42 [ayvens.es] INFO: Scrape type for 1985866: 1
2026-03-26 18:33:42 [ayvens.es] INFO: Extracting data for car ID: 1985866
2026-03-26 18:33:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07bec2c4-d3aa-5972-bb19-426fef7424c9 with identifier: 1985866
2026-03-26 18:33:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07bec2c4-d3aa-5972-bb19-426fef7424c9 with scrape type 1
2026-03-26 18:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 07bec2c4-d3aa-5972-bb19-426fef7424c9
2026-03-26 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F707%252Fd10632d702fe497b9ed13f90159a3c55%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/707/d10632d702fe497b9ed13f90159a3c55/images/large/1.jpg not downloaded yet
2026-03-26 18:33:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a81b7bda-179c-5d9f-9bf5-f46348574ca1 with identifier: 1985856
2026-03-26 18:33:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a81b7bda-179c-5d9f-9bf5-f46348574ca1 with identifier: 1985856
2026-03-26 18:33:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a81b7bda-179c-5d9f-9bf5-f46348574ca1 with identifier: 1985856 to the API
2026-03-26 18:33:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/400/1184465f9af5443eb2db6daed818b332/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a81b7bda-179c-5d9f-9bf5-f46348574ca1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': 135508,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a81b7bda-179c-5d9f-9bf5-f46348574ca1/a81b7bda-179c-5d9f-9bf5-f46348574ca1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 281632,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/400/1184465f9af5443eb2db6daed818b332/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FOCUS 1.5 TDCi 70kW Trend+',
 'transmission': 'manual',
 'trim': '1.5 TDCi 70kW Trend+',
 'vin': None,
 'year': 2017}
2026-03-26 18:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985856%27 HTTP/1.1" 200 None
2026-03-26 18:33:43 [ayvens.es] INFO: Saving data for 1985856: {'created_time': 1774550023.181248, 'last_price_update_time': 1774550023.181257, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985856') HTTP/1.1" 204 0
2026-03-26 18:33:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4feaf8b8-2e73-5f9b-96f4-1feba0a9bbcf with identifier: 1985855
2026-03-26 18:33:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4feaf8b8-2e73-5f9b-96f4-1feba0a9bbcf with identifier: 1985855
2026-03-26 18:33:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 4feaf8b8-2e73-5f9b-96f4-1feba0a9bbcf with identifier: 1985855 to the API
2026-03-26 18:33:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/176/055435fbbe3b42d9a50d4788546a6b79/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '4feaf8b8-2e73-5f9b-96f4-1feba0a9bbcf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'CEED',
 'odometer': 210473,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4feaf8b8-2e73-5f9b-96f4-1feba0a9bbcf/4feaf8b8-2e73-5f9b-96f4-1feba0a9bbcf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 326083,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/176/055435fbbe3b42d9a50d4788546a6b79/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA CEED 1.6 CRDi 85kW (115CV) Concept',
 'transmission': 'manual',
 'trim': '1.6 CRDi 85kW (115CV) Concept',
 'vin': None,
 'year': 2019}
2026-03-26 18:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985855%27 HTTP/1.1" 200 None
2026-03-26 18:33:43 [ayvens.es] INFO: Saving data for 1985855: {'created_time': 1774550023.509838, 'last_price_update_time': 1774550023.509847, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985855') HTTP/1.1" 204 0
2026-03-26 18:33:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 365736ec-55b4-55df-89f6-95561e6cc74e with identifier: 1985858
2026-03-26 18:33:43 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:33:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 365736ec-55b4-55df-89f6-95561e6cc74e with identifier: 1985858
2026-03-26 18:33:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 365736ec-55b4-55df-89f6-95561e6cc74e with identifier: 1985858 to the API
2026-03-26 18:33:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/945/046f31ac53564b0d9723a40413796db0/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'color': 'Penta metal',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '365736ec-55b4-55df-89f6-95561e6cc74e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'SPORTAGE',
 'odometer': 50357,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_365736ec-55b4-55df-89f6-95561e6cc74e/365736ec-55b4-55df-89f6-95561e6cc74e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 368630,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/945/046f31ac53564b0d9723a40413796db0/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-12-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA SPORTAGE 1.6 CRDi MHEV 100kW (136CV) Business 4x2',
 'transmission': 'manual',
 'trim': '1.6 CRDi MHEV 100kW (136CV) Business 4x2',
 'vin': None,
 'year': 2023}
2026-03-26 18:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985858%27 HTTP/1.1" 200 None
2026-03-26 18:33:43 [ayvens.es] INFO: Saving data for 1985858: {'created_time': 1774550023.877119, 'last_price_update_time': 1774550023.877129, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985858') HTTP/1.1" 204 0
2026-03-26 18:33:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/631/0d5f6b67f7634ad49633cf3ca7dad5ca/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/198/72e201121f684f46af55973d8fbe89bd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:43 [ayvens.es] INFO: Found listing with ID: 1985867
2026-03-26 18:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985867%27 HTTP/1.1" 200 None
2026-03-26 18:33:43 [ayvens.es] INFO: Scrape type for 1985867: 1
2026-03-26 18:33:43 [ayvens.es] INFO: Extracting data for car ID: 1985867
2026-03-26 18:33:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 520342af-193a-559d-a5a0-ecd7b9a0af4d with identifier: 1985867
2026-03-26 18:33:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 520342af-193a-559d-a5a0-ecd7b9a0af4d with scrape type 1
2026-03-26 18:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 520342af-193a-559d-a5a0-ecd7b9a0af4d
2026-03-26 18:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F371%252F450ee12d8412401b9704fd81d8d355f7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/371/450ee12d8412401b9704fd81d8d355f7/images/large/1.jpg not downloaded yet
2026-03-26 18:33:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28e65f10>
2026-03-26 18:33:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81817674-390d-5cb7-b6f2-a8a1f5e3a0d5/81817674-390d-5cb7-b6f2-a8a1f5e3a0d5_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F491%252Fb968ae32f3704964817694874bbdca91%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/491/b968ae32f3704964817694874bbdca91/images/large/1.jpg saved to cache
2026-03-26 18:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 81817674-390d-5cb7-b6f2-a8a1f5e3a0d5
2026-03-26 18:33:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 81817674-390d-5cb7-b6f2-a8a1f5e3a0d5, skipping ID generation
2026-03-26 18:33:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81817674-390d-5cb7-b6f2-a8a1f5e3a0d5 with scrape type 1
2026-03-26 18:33:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 81817674-390d-5cb7-b6f2-a8a1f5e3a0d5 sending to next pipeline
2026-03-26 18:33:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 81817674-390d-5cb7-b6f2-a8a1f5e3a0d5, identifier: 1985859
2026-03-26 18:33:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c742d0>
2026-03-26 18:33:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cce5596e-ad0d-52cb-92e4-46c128fb3792/cce5596e-ad0d-52cb-92e4-46c128fb3792_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F999%252Fc44a61d478ff46868f58222365bbd8ed%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/999/c44a61d478ff46868f58222365bbd8ed/images/large/1.jpg saved to cache
2026-03-26 18:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cce5596e-ad0d-52cb-92e4-46c128fb3792
2026-03-26 18:33:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cce5596e-ad0d-52cb-92e4-46c128fb3792, skipping ID generation
2026-03-26 18:33:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cce5596e-ad0d-52cb-92e4-46c128fb3792 with scrape type 1
2026-03-26 18:33:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cce5596e-ad0d-52cb-92e4-46c128fb3792 sending to next pipeline
2026-03-26 18:33:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: cce5596e-ad0d-52cb-92e4-46c128fb3792, identifier: 1985857
2026-03-26 18:33:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c19350>
2026-03-26 18:33:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5524d492-b71b-5b4c-b557-88a3663ac1b9/5524d492-b71b-5b4c-b557-88a3663ac1b9_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F860%252Fe031ebce16cb4abd8fa90dc3b29a61a9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/860/e031ebce16cb4abd8fa90dc3b29a61a9/images/large/1.jpg saved to cache
2026-03-26 18:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5524d492-b71b-5b4c-b557-88a3663ac1b9
2026-03-26 18:33:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5524d492-b71b-5b4c-b557-88a3663ac1b9, skipping ID generation
2026-03-26 18:33:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5524d492-b71b-5b4c-b557-88a3663ac1b9 with scrape type 1
2026-03-26 18:33:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5524d492-b71b-5b4c-b557-88a3663ac1b9 sending to next pipeline
2026-03-26 18:33:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5524d492-b71b-5b4c-b557-88a3663ac1b9, identifier: 1985860
2026-03-26 18:33:44 [ayvens.es] INFO: Found listing with ID: 1985868
2026-03-26 18:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985868%27 HTTP/1.1" 200 None
2026-03-26 18:33:44 [ayvens.es] INFO: Scrape type for 1985868: 1
2026-03-26 18:33:44 [ayvens.es] INFO: Extracting data for car ID: 1985868
2026-03-26 18:33:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 573590e7-659b-5cd1-aef5-7718a8c70e21 with identifier: 1985868
2026-03-26 18:33:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 573590e7-659b-5cd1-aef5-7718a8c70e21 with scrape type 1
2026-03-26 18:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 573590e7-659b-5cd1-aef5-7718a8c70e21
2026-03-26 18:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F544%252Ffb8e8820f83548e9a4de79cdbc88436f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/544/fb8e8820f83548e9a4de79cdbc88436f/images/large/1.jpg not downloaded yet
2026-03-26 18:33:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 81817674-390d-5cb7-b6f2-a8a1f5e3a0d5 with identifier: 1985859
2026-03-26 18:33:44 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:33:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 81817674-390d-5cb7-b6f2-a8a1f5e3a0d5 with identifier: 1985859
2026-03-26 18:33:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 81817674-390d-5cb7-b6f2-a8a1f5e3a0d5 with identifier: 1985859 to the API
2026-03-26 18:33:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/491/b968ae32f3704964817694874bbdca91/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Azul denim',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '81817674-390d-5cb7-b6f2-a8a1f5e3a0d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLB',
 'odometer': 43092,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81817674-390d-5cb7-b6f2-a8a1f5e3a0d5/81817674-390d-5cb7-b6f2-a8a1f5e3a0d5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 381783,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/491/b968ae32f3704964817694874bbdca91/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLB 2.0 GLB 200 D DCT 110KW (150CV)',
 'transmission': 'manual',
 'trim': '2.0 GLB 200 D DCT 110KW (150CV)',
 'vin': None,
 'year': 2021}
2026-03-26 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985859%27 HTTP/1.1" 200 None
2026-03-26 18:33:45 [ayvens.es] INFO: Saving data for 1985859: {'created_time': 1774550025.061452, 'last_price_update_time': 1774550025.06147, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985859') HTTP/1.1" 204 0
2026-03-26 18:33:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: cce5596e-ad0d-52cb-92e4-46c128fb3792 with identifier: 1985857
2026-03-26 18:33:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: cce5596e-ad0d-52cb-92e4-46c128fb3792 with identifier: 1985857
2026-03-26 18:33:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: cce5596e-ad0d-52cb-92e4-46c128fb3792 with identifier: 1985857 to the API
2026-03-26 18:33:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/999/c44a61d478ff46868f58222365bbd8ed/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'cce5596e-ad0d-52cb-92e4-46c128fb3792',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '208',
 'odometer': 117105,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cce5596e-ad0d-52cb-92e4-46c128fb3792/cce5596e-ad0d-52cb-92e4-46c128fb3792_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 574861,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/999/c44a61d478ff46868f58222365bbd8ed/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 208 BlueHDi 73kW (100CV) Active',
 'transmission': 'manual',
 'trim': 'BlueHDi 73kW (100CV) Active',
 'vin': None,
 'year': 2022}
2026-03-26 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985857%27 HTTP/1.1" 200 None
2026-03-26 18:33:45 [ayvens.es] INFO: Saving data for 1985857: {'created_time': 1774550025.492686, 'last_price_update_time': 1774550025.492696, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985857') HTTP/1.1" 204 0
2026-03-26 18:33:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5524d492-b71b-5b4c-b557-88a3663ac1b9 with identifier: 1985860
2026-03-26 18:33:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:33:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5524d492-b71b-5b4c-b557-88a3663ac1b9 with identifier: 1985860
2026-03-26 18:33:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5524d492-b71b-5b4c-b557-88a3663ac1b9 with identifier: 1985860 to the API
2026-03-26 18:33:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/860/e031ebce16cb4abd8fa90dc3b29a61a9/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'color': 'Plata',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '5524d492-b71b-5b4c-b557-88a3663ac1b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 124741,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5524d492-b71b-5b4c-b557-88a3663ac1b9/5524d492-b71b-5b4c-b557-88a3663ac1b9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324415,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/860/e031ebce16cb4abd8fa90dc3b29a61a9/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI DIG-T 103kW N-Connecta',
 'transmission': 'manual',
 'trim': 'DIG-T 103kW N-Connecta',
 'vin': None,
 'year': 2021}
2026-03-26 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985860%27 HTTP/1.1" 200 None
2026-03-26 18:33:46 [ayvens.es] INFO: Saving data for 1985860: {'created_time': 1774550026.0396, 'last_price_update_time': 1774550026.039611, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985860') HTTP/1.1" 204 0
2026-03-26 18:33:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/423/969620452f7c49908acb0ded8a8ffc6e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:46 [ayvens.es] INFO: Found listing with ID: 1985869
2026-03-26 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985869%27 HTTP/1.1" 200 None
2026-03-26 18:33:46 [ayvens.es] INFO: Scrape type for 1985869: 1
2026-03-26 18:33:46 [ayvens.es] INFO: Extracting data for car ID: 1985869
2026-03-26 18:33:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3634926-e125-5718-a9bc-7555398d1c61 with identifier: 1985869
2026-03-26 18:33:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3634926-e125-5718-a9bc-7555398d1c61 with scrape type 1
2026-03-26 18:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c3634926-e125-5718-a9bc-7555398d1c61
2026-03-26 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F963%252F537afd1024994c7291822f84f9d9e090%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/963/537afd1024994c7291822f84f9d9e090/images/large/1.jpg not downloaded yet
2026-03-26 18:33:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/744/607c0dfc7e874440b484ba5cbb742a52/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a290ad210>
2026-03-26 18:33:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90b5f7f1-d64b-5602-ae70-ba0f2486e78a/90b5f7f1-d64b-5602-ae70-ba0f2486e78a_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F631%252F0d5f6b67f7634ad49633cf3ca7dad5ca%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/631/0d5f6b67f7634ad49633cf3ca7dad5ca/images/large/1.jpg saved to cache
2026-03-26 18:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 90b5f7f1-d64b-5602-ae70-ba0f2486e78a
2026-03-26 18:33:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 90b5f7f1-d64b-5602-ae70-ba0f2486e78a, skipping ID generation
2026-03-26 18:33:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90b5f7f1-d64b-5602-ae70-ba0f2486e78a with scrape type 1
2026-03-26 18:33:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 90b5f7f1-d64b-5602-ae70-ba0f2486e78a sending to next pipeline
2026-03-26 18:33:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 90b5f7f1-d64b-5602-ae70-ba0f2486e78a, identifier: 1985861
2026-03-26 18:33:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a282ff990>
2026-03-26 18:33:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d52b06a-05f5-5736-8e78-721f4aa068b0/9d52b06a-05f5-5736-8e78-721f4aa068b0_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F198%252F72e201121f684f46af55973d8fbe89bd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/198/72e201121f684f46af55973d8fbe89bd/images/large/1.jpg saved to cache
2026-03-26 18:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9d52b06a-05f5-5736-8e78-721f4aa068b0
2026-03-26 18:33:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9d52b06a-05f5-5736-8e78-721f4aa068b0, skipping ID generation
2026-03-26 18:33:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d52b06a-05f5-5736-8e78-721f4aa068b0 with scrape type 1
2026-03-26 18:33:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9d52b06a-05f5-5736-8e78-721f4aa068b0 sending to next pipeline
2026-03-26 18:33:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9d52b06a-05f5-5736-8e78-721f4aa068b0, identifier: 1985862
2026-03-26 18:33:46 [ayvens.es] INFO: Found listing with ID: 1985870
2026-03-26 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985870%27 HTTP/1.1" 200 None
2026-03-26 18:33:46 [ayvens.es] INFO: Scrape type for 1985870: 1
2026-03-26 18:33:46 [ayvens.es] INFO: Extracting data for car ID: 1985870
2026-03-26 18:33:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ad2230f-ab7a-5d22-8cfa-2467a3757e12 with identifier: 1985870
2026-03-26 18:33:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ad2230f-ab7a-5d22-8cfa-2467a3757e12 with scrape type 1
2026-03-26 18:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4ad2230f-ab7a-5d22-8cfa-2467a3757e12
2026-03-26 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F013%252F05acea50bcb54c16bb86d6a35ffb42ca%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/013/05acea50bcb54c16bb86d6a35ffb42ca/images/large/1.jpg not downloaded yet
2026-03-26 18:33:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 90b5f7f1-d64b-5602-ae70-ba0f2486e78a with identifier: 1985861
2026-03-26 18:33:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:33:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 90b5f7f1-d64b-5602-ae70-ba0f2486e78a with identifier: 1985861
2026-03-26 18:33:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 90b5f7f1-d64b-5602-ae70-ba0f2486e78a with identifier: 1985861 to the API
2026-03-26 18:33:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/631/0d5f6b67f7634ad49633cf3ca7dad5ca/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Metallic cooper',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '90b5f7f1-d64b-5602-ae70-ba0f2486e78a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008',
 'odometer': 33504,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90b5f7f1-d64b-5602-ae70-ba0f2486e78a/90b5f7f1-d64b-5602-ae70-ba0f2486e78a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 377716,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/631/0d5f6b67f7634ad49633cf3ca7dad5ca/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-25',
 'seats_number': 7,
 'seller_name': None,
 'title': 'PEUGEOT 5008 1.5 BlueHDi 96kW S&S Allure Pack EAT8',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi 96kW S&S Allure Pack EAT8',
 'vin': None,
 'year': 2023}
2026-03-26 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985861%27 HTTP/1.1" 200 None
2026-03-26 18:33:46 [ayvens.es] INFO: Saving data for 1985861: {'created_time': 1774550026.858267, 'last_price_update_time': 1774550026.858277, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985861') HTTP/1.1" 204 0
2026-03-26 18:33:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9d52b06a-05f5-5736-8e78-721f4aa068b0 with identifier: 1985862
2026-03-26 18:33:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9d52b06a-05f5-5736-8e78-721f4aa068b0 with identifier: 1985862
2026-03-26 18:33:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9d52b06a-05f5-5736-8e78-721f4aa068b0 with identifier: 1985862 to the API
2026-03-26 18:33:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/198/72e201121f684f46af55973d8fbe89bd/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.6L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '9d52b06a-05f5-5736-8e78-721f4aa068b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'BERLINGO',
 'odometer': 144315,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d52b06a-05f5-5736-8e78-721f4aa068b0/9d52b06a-05f5-5736-8e78-721f4aa068b0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 313460,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/198/72e201121f684f46af55973d8fbe89bd/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-17',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROËN BERLINGO Talla M BlueHDi 73kW CONTROL',
 'transmission': 'manual',
 'trim': 'Talla M BlueHDi 73kW CONTROL',
 'vin': None,
 'year': 2019}
2026-03-26 18:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985862%27 HTTP/1.1" 200 None
2026-03-26 18:33:47 [ayvens.es] INFO: Saving data for 1985862: {'created_time': 1774550027.298019, 'last_price_update_time': 1774550027.298029, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985862') HTTP/1.1" 204 0
2026-03-26 18:33:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/372/d0c9cdb6e4e946d9b84c52fd4e3d25c4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:47 [ayvens.es] INFO: Found listing with ID: 1985871
2026-03-26 18:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985871%27 HTTP/1.1" 200 None
2026-03-26 18:33:47 [ayvens.es] INFO: Scrape type for 1985871: 1
2026-03-26 18:33:47 [ayvens.es] INFO: Extracting data for car ID: 1985871
2026-03-26 18:33:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81c16025-2df4-5db9-b893-864c62a90421 with identifier: 1985871
2026-03-26 18:33:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81c16025-2df4-5db9-b893-864c62a90421 with scrape type 1
2026-03-26 18:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 81c16025-2df4-5db9-b893-864c62a90421
2026-03-26 18:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F476%252F03bc5104386e4710aa75e90bc3c8048d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/476/03bc5104386e4710aa75e90bc3c8048d/images/large/1.jpg not downloaded yet
2026-03-26 18:33:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/707/d10632d702fe497b9ed13f90159a3c55/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a2ab0cb50>
2026-03-26 18:33:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b929b84b-1e3a-549a-b566-6d6032aff4bf/b929b84b-1e3a-549a-b566-6d6032aff4bf_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F423%252F969620452f7c49908acb0ded8a8ffc6e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/423/969620452f7c49908acb0ded8a8ffc6e/images/large/1.jpg saved to cache
2026-03-26 18:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b929b84b-1e3a-549a-b566-6d6032aff4bf
2026-03-26 18:33:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b929b84b-1e3a-549a-b566-6d6032aff4bf, skipping ID generation
2026-03-26 18:33:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b929b84b-1e3a-549a-b566-6d6032aff4bf with scrape type 1
2026-03-26 18:33:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b929b84b-1e3a-549a-b566-6d6032aff4bf sending to next pipeline
2026-03-26 18:33:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b929b84b-1e3a-549a-b566-6d6032aff4bf, identifier: 1985863
2026-03-26 18:33:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a281f8850>
2026-03-26 18:33:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_531ca14b-3e35-5c73-9ca5-24811640801e/531ca14b-3e35-5c73-9ca5-24811640801e_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F744%252F607c0dfc7e874440b484ba5cbb742a52%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/744/607c0dfc7e874440b484ba5cbb742a52/images/large/1.jpg saved to cache
2026-03-26 18:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 531ca14b-3e35-5c73-9ca5-24811640801e
2026-03-26 18:33:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 531ca14b-3e35-5c73-9ca5-24811640801e, skipping ID generation
2026-03-26 18:33:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 531ca14b-3e35-5c73-9ca5-24811640801e with scrape type 1
2026-03-26 18:33:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 531ca14b-3e35-5c73-9ca5-24811640801e sending to next pipeline
2026-03-26 18:33:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 531ca14b-3e35-5c73-9ca5-24811640801e, identifier: 1985864
2026-03-26 18:33:47 [ayvens.es] INFO: Found listing with ID: 1985872
2026-03-26 18:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985872%27 HTTP/1.1" 200 None
2026-03-26 18:33:47 [ayvens.es] INFO: Scrape type for 1985872: 1
2026-03-26 18:33:47 [ayvens.es] INFO: Extracting data for car ID: 1985872
2026-03-26 18:33:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36e34e3b-464d-55dc-958c-1bba29519c67 with identifier: 1985872
2026-03-26 18:33:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36e34e3b-464d-55dc-958c-1bba29519c67 with scrape type 1
2026-03-26 18:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 36e34e3b-464d-55dc-958c-1bba29519c67
2026-03-26 18:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F782%252Fd1ce01f3270e4e2a963b2a6baa88b901%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/782/d1ce01f3270e4e2a963b2a6baa88b901/images/large/1.jpg not downloaded yet
2026-03-26 18:33:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b929b84b-1e3a-549a-b566-6d6032aff4bf with identifier: 1985863
2026-03-26 18:33:47 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:33:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b929b84b-1e3a-549a-b566-6d6032aff4bf with identifier: 1985863
2026-03-26 18:33:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b929b84b-1e3a-549a-b566-6d6032aff4bf with identifier: 1985863 to the API
2026-03-26 18:33:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/423/969620452f7c49908acb0ded8a8ffc6e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'Blanco polar',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.9L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b929b84b-1e3a-549a-b566-6d6032aff4bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'C-CLASS',
 'odometer': 100617,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b929b84b-1e3a-549a-b566-6d6032aff4bf/b929b84b-1e3a-549a-b566-6d6032aff4bf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353224,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/423/969620452f7c49908acb0ded8a8ffc6e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ C-CLASS C 220 d',
 'transmission': 'manual',
 'trim': 'C 220 d',
 'vin': None,
 'year': 2020}
2026-03-26 18:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985863%27 HTTP/1.1" 200 None
2026-03-26 18:33:48 [ayvens.es] INFO: Saving data for 1985863: {'created_time': 1774550028.027668, 'last_price_update_time': 1774550028.027678, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985863') HTTP/1.1" 204 0
2026-03-26 18:33:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 531ca14b-3e35-5c73-9ca5-24811640801e with identifier: 1985864
2026-03-26 18:33:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 531ca14b-3e35-5c73-9ca5-24811640801e with identifier: 1985864
2026-03-26 18:33:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 531ca14b-3e35-5c73-9ca5-24811640801e with identifier: 1985864 to the API
2026-03-26 18:33:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/744/607c0dfc7e874440b484ba5cbb742a52/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'color': 'Banquise blanco s',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '531ca14b-3e35-5c73-9ca5-24811640801e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'JUMPY',
 'odometer': 19231,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_531ca14b-3e35-5c73-9ca5-24811640801e/531ca14b-3e35-5c73-9ca5-24811640801e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 376240,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/744/607c0dfc7e874440b484ba5cbb742a52/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-29',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROËN JUMPY Talla XL BlueHDi 88KW (120CV) Confort',
 'transmission': 'manual',
 'trim': 'Talla XL BlueHDi 88KW (120CV) Confort',
 'vin': None,
 'year': 2020}
2026-03-26 18:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985864%27 HTTP/1.1" 200 None
2026-03-26 18:33:48 [ayvens.es] INFO: Saving data for 1985864: {'created_time': 1774550028.363446, 'last_price_update_time': 1774550028.363464, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985864') HTTP/1.1" 204 0
2026-03-26 18:33:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/371/450ee12d8412401b9704fd81d8d355f7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:48 [ayvens.es] INFO: Found listing with ID: 1985873
2026-03-26 18:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985873%27 HTTP/1.1" 200 None
2026-03-26 18:33:48 [ayvens.es] INFO: Scrape type for 1985873: 1
2026-03-26 18:33:48 [ayvens.es] INFO: Extracting data for car ID: 1985873
2026-03-26 18:33:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1dfe41b2-e3c2-513a-a2ca-5ccb4e00f2e9 with identifier: 1985873
2026-03-26 18:33:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1dfe41b2-e3c2-513a-a2ca-5ccb4e00f2e9 with scrape type 1
2026-03-26 18:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1dfe41b2-e3c2-513a-a2ca-5ccb4e00f2e9
2026-03-26 18:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F380%252F7c7c71dab33b4262b79b8759e808d172%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/380/7c7c71dab33b4262b79b8759e808d172/images/large/1.jpg not downloaded yet
2026-03-26 18:33:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c5e310>
2026-03-26 18:33:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_441d143c-1df5-568a-920c-fb1ded97785b/441d143c-1df5-568a-920c-fb1ded97785b_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F372%252Fd0c9cdb6e4e946d9b84c52fd4e3d25c4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/372/d0c9cdb6e4e946d9b84c52fd4e3d25c4/images/large/1.jpg saved to cache
2026-03-26 18:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 441d143c-1df5-568a-920c-fb1ded97785b
2026-03-26 18:33:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 441d143c-1df5-568a-920c-fb1ded97785b, skipping ID generation
2026-03-26 18:33:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 441d143c-1df5-568a-920c-fb1ded97785b with scrape type 1
2026-03-26 18:33:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 441d143c-1df5-568a-920c-fb1ded97785b sending to next pipeline
2026-03-26 18:33:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 441d143c-1df5-568a-920c-fb1ded97785b, identifier: 1985865
2026-03-26 18:33:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28ace390>
2026-03-26 18:33:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07bec2c4-d3aa-5972-bb19-426fef7424c9/07bec2c4-d3aa-5972-bb19-426fef7424c9_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F707%252Fd10632d702fe497b9ed13f90159a3c55%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/707/d10632d702fe497b9ed13f90159a3c55/images/large/1.jpg saved to cache
2026-03-26 18:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 07bec2c4-d3aa-5972-bb19-426fef7424c9
2026-03-26 18:33:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 07bec2c4-d3aa-5972-bb19-426fef7424c9, skipping ID generation
2026-03-26 18:33:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07bec2c4-d3aa-5972-bb19-426fef7424c9 with scrape type 1
2026-03-26 18:33:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 07bec2c4-d3aa-5972-bb19-426fef7424c9 sending to next pipeline
2026-03-26 18:33:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 07bec2c4-d3aa-5972-bb19-426fef7424c9, identifier: 1985866
2026-03-26 18:33:48 [ayvens.es] INFO: Found listing with ID: 1985874
2026-03-26 18:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985874%27 HTTP/1.1" 200 None
2026-03-26 18:33:48 [ayvens.es] INFO: Scrape type for 1985874: 1
2026-03-26 18:33:48 [ayvens.es] INFO: Extracting data for car ID: 1985874
2026-03-26 18:33:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12ca75de-4305-52a2-823a-ac5d47bd45c8 with identifier: 1985874
2026-03-26 18:33:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12ca75de-4305-52a2-823a-ac5d47bd45c8 with scrape type 1
2026-03-26 18:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 12ca75de-4305-52a2-823a-ac5d47bd45c8
2026-03-26 18:33:48 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 12ca75de-4305-52a2-823a-ac5d47bd45c8
2026-03-26 18:33:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 12ca75de-4305-52a2-823a-ac5d47bd45c8, identifier: 1985874
2026-03-26 18:33:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 441d143c-1df5-568a-920c-fb1ded97785b with identifier: 1985865
2026-03-26 18:33:48 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:33:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 441d143c-1df5-568a-920c-fb1ded97785b with identifier: 1985865
2026-03-26 18:33:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 441d143c-1df5-568a-920c-fb1ded97785b with identifier: 1985865 to the API
2026-03-26 18:33:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/372/d0c9cdb6e4e946d9b84c52fd4e3d25c4/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'Crystal pearl',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '441d143c-1df5-568a-920c-fb1ded97785b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS 4',
 'odometer': 61170,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_441d143c-1df5-568a-920c-fb1ded97785b/441d143c-1df5-568a-920c-fb1ded97785b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325997,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/372/d0c9cdb6e4e946d9b84c52fd4e3d25c4/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS 4 BlueHDi 130 auto BASTILLE +',
 'transmission': 'manual',
 'trim': 'BlueHDi 130 auto BASTILLE +',
 'vin': None,
 'year': 2022}
2026-03-26 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985865%27 HTTP/1.1" 200 None
2026-03-26 18:33:49 [ayvens.es] INFO: Saving data for 1985865: {'created_time': 1774550029.179756, 'last_price_update_time': 1774550029.179766, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985865') HTTP/1.1" 204 0
2026-03-26 18:33:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 07bec2c4-d3aa-5972-bb19-426fef7424c9 with identifier: 1985866
2026-03-26 18:33:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 07bec2c4-d3aa-5972-bb19-426fef7424c9 with identifier: 1985866
2026-03-26 18:33:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 07bec2c4-d3aa-5972-bb19-426fef7424c9 with identifier: 1985866 to the API
2026-03-26 18:33:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/707/d10632d702fe497b9ed13f90159a3c55/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'color': 'Blanco solido',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '07bec2c4-d3aa-5972-bb19-426fef7424c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 96379,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07bec2c4-d3aa-5972-bb19-426fef7424c9/07bec2c4-d3aa-5972-bb19-426fef7424c9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353340,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/707/d10632d702fe497b9ed13f90159a3c55/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI dCi 85 kW (115 CV) E6D ACENTA',
 'transmission': 'manual',
 'trim': 'dCi 85 kW (115 CV) E6D ACENTA',
 'vin': None,
 'year': 2021}
2026-03-26 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985866%27 HTTP/1.1" 200 None
2026-03-26 18:33:49 [ayvens.es] INFO: Saving data for 1985866: {'created_time': 1774550029.504295, 'last_price_update_time': 1774550029.504306, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985866') HTTP/1.1" 204 0
2026-03-26 18:33:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/544/fb8e8820f83548e9a4de79cdbc88436f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 12ca75de-4305-52a2-823a-ac5d47bd45c8 with identifier: 1985874
2026-03-26 18:33:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 12ca75de-4305-52a2-823a-ac5d47bd45c8 with identifier: 1985874
2026-03-26 18:33:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 12ca75de-4305-52a2-823a-ac5d47bd45c8 with identifier: 1985874 to the API
2026-03-26 18:33:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '12ca75de-4305-52a2-823a-ac5d47bd45c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '208',
 'odometer': 84979,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 208 BlueHDi 73kW (100CV) Active',
 'transmission': 'manual',
 'trim': 'BlueHDi 73kW (100CV) Active',
 'vin': None,
 'year': 2022}
2026-03-26 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985874%27 HTTP/1.1" 200 None
2026-03-26 18:33:49 [ayvens.es] INFO: Saving data for 1985874: {'created_time': 1774550029.850448, 'last_price_update_time': 1774550029.850457, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985874') HTTP/1.1" 204 0
2026-03-26 18:33:49 [ayvens.es] INFO: Found listing with ID: 1985875
2026-03-26 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985875%27 HTTP/1.1" 200 None
2026-03-26 18:33:49 [ayvens.es] INFO: Scrape type for 1985875: 1
2026-03-26 18:33:49 [ayvens.es] INFO: Extracting data for car ID: 1985875
2026-03-26 18:33:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa442f6e-7edb-5e0b-a8c9-c52b7db051eb with identifier: 1985875
2026-03-26 18:33:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa442f6e-7edb-5e0b-a8c9-c52b7db051eb with scrape type 1
2026-03-26 18:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item aa442f6e-7edb-5e0b-a8c9-c52b7db051eb
2026-03-26 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F559%252F368f45ad4cb54444b2f3b64d1d12b2c7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/559/368f45ad4cb54444b2f3b64d1d12b2c7/images/large/1.jpg not downloaded yet
2026-03-26 18:33:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28cae1d0>
2026-03-26 18:33:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_520342af-193a-559d-a5a0-ecd7b9a0af4d/520342af-193a-559d-a5a0-ecd7b9a0af4d_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F371%252F450ee12d8412401b9704fd81d8d355f7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/371/450ee12d8412401b9704fd81d8d355f7/images/large/1.jpg saved to cache
2026-03-26 18:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 520342af-193a-559d-a5a0-ecd7b9a0af4d
2026-03-26 18:33:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 520342af-193a-559d-a5a0-ecd7b9a0af4d, skipping ID generation
2026-03-26 18:33:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 520342af-193a-559d-a5a0-ecd7b9a0af4d with scrape type 1
2026-03-26 18:33:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 520342af-193a-559d-a5a0-ecd7b9a0af4d sending to next pipeline
2026-03-26 18:33:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 520342af-193a-559d-a5a0-ecd7b9a0af4d, identifier: 1985867
2026-03-26 18:33:50 [ayvens.es] INFO: Found listing with ID: 1985876
2026-03-26 18:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985876%27 HTTP/1.1" 200 None
2026-03-26 18:33:50 [ayvens.es] INFO: Scrape type for 1985876: 1
2026-03-26 18:33:50 [ayvens.es] INFO: Extracting data for car ID: 1985876
2026-03-26 18:33:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98243c0a-7a3a-5716-b9a6-04c26167ba1d with identifier: 1985876
2026-03-26 18:33:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98243c0a-7a3a-5716-b9a6-04c26167ba1d with scrape type 1
2026-03-26 18:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 98243c0a-7a3a-5716-b9a6-04c26167ba1d
2026-03-26 18:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F154%252F8c6716bcb88a4b298072996c6024ec45%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/154/8c6716bcb88a4b298072996c6024ec45/images/large/1.jpg not downloaded yet
2026-03-26 18:33:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 520342af-193a-559d-a5a0-ecd7b9a0af4d with identifier: 1985867
2026-03-26 18:33:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 520342af-193a-559d-a5a0-ecd7b9a0af4d with identifier: 1985867
2026-03-26 18:33:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 520342af-193a-559d-a5a0-ecd7b9a0af4d with identifier: 1985867 to the API
2026-03-26 18:33:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/371/450ee12d8412401b9704fd81d8d355f7/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '520342af-193a-559d-a5a0-ecd7b9a0af4d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'COMBO',
 'odometer': 83820,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_520342af-193a-559d-a5a0-ecd7b9a0af4d/520342af-193a-559d-a5a0-ecd7b9a0af4d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 304065,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/371/450ee12d8412401b9704fd81d8d355f7/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-23',
 'seats_number': 2,
 'seller_name': None,
 'title': 'OPEL COMBO 1.5 TD 75kW (100CV) Select L H1 650kg',
 'transmission': 'manual',
 'trim': '1.5 TD 75kW (100CV) Select L H1 650kg',
 'vin': None,
 'year': 2022}
2026-03-26 18:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985867%27 HTTP/1.1" 200 None
2026-03-26 18:33:50 [ayvens.es] INFO: Saving data for 1985867: {'created_time': 1774550030.395761, 'last_price_update_time': 1774550030.395772, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985867') HTTP/1.1" 204 0
2026-03-26 18:33:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/963/537afd1024994c7291822f84f9d9e090/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c47c50>
2026-03-26 18:33:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_573590e7-659b-5cd1-aef5-7718a8c70e21/573590e7-659b-5cd1-aef5-7718a8c70e21_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F544%252Ffb8e8820f83548e9a4de79cdbc88436f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/544/fb8e8820f83548e9a4de79cdbc88436f/images/large/1.jpg saved to cache
2026-03-26 18:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 573590e7-659b-5cd1-aef5-7718a8c70e21
2026-03-26 18:33:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 573590e7-659b-5cd1-aef5-7718a8c70e21, skipping ID generation
2026-03-26 18:33:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 573590e7-659b-5cd1-aef5-7718a8c70e21 with scrape type 1
2026-03-26 18:33:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 573590e7-659b-5cd1-aef5-7718a8c70e21 sending to next pipeline
2026-03-26 18:33:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 573590e7-659b-5cd1-aef5-7718a8c70e21, identifier: 1985868
2026-03-26 18:33:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/476/03bc5104386e4710aa75e90bc3c8048d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/013/05acea50bcb54c16bb86d6a35ffb42ca/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:50 [ayvens.es] INFO: Found listing with ID: 1985877
2026-03-26 18:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985877%27 HTTP/1.1" 200 None
2026-03-26 18:33:50 [ayvens.es] INFO: Scrape type for 1985877: 1
2026-03-26 18:33:50 [ayvens.es] INFO: Extracting data for car ID: 1985877
2026-03-26 18:33:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4fdc02fd-1e5c-56d7-99ec-7fb626fbe019 with identifier: 1985877
2026-03-26 18:33:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fdc02fd-1e5c-56d7-99ec-7fb626fbe019 with scrape type 1
2026-03-26 18:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4fdc02fd-1e5c-56d7-99ec-7fb626fbe019
2026-03-26 18:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F142%252F4a1d1d9f19194b03b4717e367097ccf3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/142/4a1d1d9f19194b03b4717e367097ccf3/images/large/1.jpg not downloaded yet
2026-03-26 18:33:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 573590e7-659b-5cd1-aef5-7718a8c70e21 with identifier: 1985868
2026-03-26 18:33:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 573590e7-659b-5cd1-aef5-7718a8c70e21 with identifier: 1985868
2026-03-26 18:33:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 573590e7-659b-5cd1-aef5-7718a8c70e21 with identifier: 1985868 to the API
2026-03-26 18:33:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/544/fb8e8820f83548e9a4de79cdbc88436f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Serie',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '573590e7-659b-5cd1-aef5-7718a8c70e21',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '208',
 'odometer': 206249,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_573590e7-659b-5cd1-aef5-7718a8c70e21/573590e7-659b-5cd1-aef5-7718a8c70e21_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325672,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/544/fb8e8820f83548e9a4de79cdbc88436f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 208 BlueHDi 73kW (100CV) Active',
 'transmission': 'manual',
 'trim': 'BlueHDi 73kW (100CV) Active',
 'vin': None,
 'year': 2022}
2026-03-26 18:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985868%27 HTTP/1.1" 200 None
2026-03-26 18:33:50 [ayvens.es] INFO: Saving data for 1985868: {'created_time': 1774550030.934695, 'last_price_update_time': 1774550030.934705, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985868') HTTP/1.1" 204 0
2026-03-26 18:33:50 [ayvens.es] INFO: Found listing with ID: 1985878
2026-03-26 18:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985878%27 HTTP/1.1" 200 None
2026-03-26 18:33:50 [ayvens.es] INFO: Scrape type for 1985878: 1
2026-03-26 18:33:50 [ayvens.es] INFO: Extracting data for car ID: 1985878
2026-03-26 18:33:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d08de886-159c-5e45-8587-e44e4e0e7d49 with identifier: 1985878
2026-03-26 18:33:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d08de886-159c-5e45-8587-e44e4e0e7d49 with scrape type 1
2026-03-26 18:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d08de886-159c-5e45-8587-e44e4e0e7d49
2026-03-26 18:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F592%252Fdb40c1619b4a413d8db0b15d448a1ab2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/592/db40c1619b4a413d8db0b15d448a1ab2/images/large/1.jpg not downloaded yet
2026-03-26 18:33:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/380/7c7c71dab33b4262b79b8759e808d172/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c5d950>
2026-03-26 18:33:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3634926-e125-5718-a9bc-7555398d1c61/c3634926-e125-5718-a9bc-7555398d1c61_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F963%252F537afd1024994c7291822f84f9d9e090%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/963/537afd1024994c7291822f84f9d9e090/images/large/1.jpg saved to cache
2026-03-26 18:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c3634926-e125-5718-a9bc-7555398d1c61
2026-03-26 18:33:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c3634926-e125-5718-a9bc-7555398d1c61, skipping ID generation
2026-03-26 18:33:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3634926-e125-5718-a9bc-7555398d1c61 with scrape type 1
2026-03-26 18:33:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c3634926-e125-5718-a9bc-7555398d1c61 sending to next pipeline
2026-03-26 18:33:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c3634926-e125-5718-a9bc-7555398d1c61, identifier: 1985869
2026-03-26 18:33:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28e6cb50>
2026-03-26 18:33:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81c16025-2df4-5db9-b893-864c62a90421/81c16025-2df4-5db9-b893-864c62a90421_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F476%252F03bc5104386e4710aa75e90bc3c8048d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/476/03bc5104386e4710aa75e90bc3c8048d/images/large/1.jpg saved to cache
2026-03-26 18:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 81c16025-2df4-5db9-b893-864c62a90421
2026-03-26 18:33:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 81c16025-2df4-5db9-b893-864c62a90421, skipping ID generation
2026-03-26 18:33:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81c16025-2df4-5db9-b893-864c62a90421 with scrape type 1
2026-03-26 18:33:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 81c16025-2df4-5db9-b893-864c62a90421 sending to next pipeline
2026-03-26 18:33:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 81c16025-2df4-5db9-b893-864c62a90421, identifier: 1985871
2026-03-26 18:33:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c27bd0>
2026-03-26 18:33:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ad2230f-ab7a-5d22-8cfa-2467a3757e12/4ad2230f-ab7a-5d22-8cfa-2467a3757e12_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F013%252F05acea50bcb54c16bb86d6a35ffb42ca%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/013/05acea50bcb54c16bb86d6a35ffb42ca/images/large/1.jpg saved to cache
2026-03-26 18:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4ad2230f-ab7a-5d22-8cfa-2467a3757e12
2026-03-26 18:33:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4ad2230f-ab7a-5d22-8cfa-2467a3757e12, skipping ID generation
2026-03-26 18:33:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ad2230f-ab7a-5d22-8cfa-2467a3757e12 with scrape type 1
2026-03-26 18:33:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4ad2230f-ab7a-5d22-8cfa-2467a3757e12 sending to next pipeline
2026-03-26 18:33:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4ad2230f-ab7a-5d22-8cfa-2467a3757e12, identifier: 1985870
2026-03-26 18:33:51 [ayvens.es] INFO: Found listing with ID: 1985879
2026-03-26 18:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985879%27 HTTP/1.1" 200 None
2026-03-26 18:33:51 [ayvens.es] INFO: Scrape type for 1985879: 1
2026-03-26 18:33:51 [ayvens.es] INFO: Extracting data for car ID: 1985879
2026-03-26 18:33:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ab48fc6-aab7-5d27-8185-d3b91296c94e with identifier: 1985879
2026-03-26 18:33:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ab48fc6-aab7-5d27-8185-d3b91296c94e with scrape type 1
2026-03-26 18:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0ab48fc6-aab7-5d27-8185-d3b91296c94e
2026-03-26 18:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F078%252F6e0694d3bba74232b2ec4870e9d43956%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/078/6e0694d3bba74232b2ec4870e9d43956/images/large/1.jpg not downloaded yet
2026-03-26 18:33:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c3634926-e125-5718-a9bc-7555398d1c61 with identifier: 1985869
2026-03-26 18:33:51 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:33:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c3634926-e125-5718-a9bc-7555398d1c61 with identifier: 1985869
2026-03-26 18:33:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c3634926-e125-5718-a9bc-7555398d1c61 with identifier: 1985869 to the API
2026-03-26 18:33:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/963/537afd1024994c7291822f84f9d9e090/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'Sapphire blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'c3634926-e125-5718-a9bc-7555398d1c61',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'JUKE',
 'odometer': 46741,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3634926-e125-5718-a9bc-7555398d1c61/c3634926-e125-5718-a9bc-7555398d1c61_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 540769,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/963/537afd1024994c7291822f84f9d9e090/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN JUKE DIG-T 84 kW (114 CV) 6M/T Acenta',
 'transmission': 'manual',
 'trim': 'DIG-T 84 kW (114 CV) 6M/T Acenta',
 'vin': None,
 'year': 2022}
2026-03-26 18:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985869%27 HTTP/1.1" 200 None
2026-03-26 18:33:51 [ayvens.es] INFO: Saving data for 1985869: {'created_time': 1774550031.949345, 'last_price_update_time': 1774550031.949354, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985869') HTTP/1.1" 204 0
2026-03-26 18:33:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 81c16025-2df4-5db9-b893-864c62a90421 with identifier: 1985871
2026-03-26 18:33:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 81c16025-2df4-5db9-b893-864c62a90421 with identifier: 1985871
2026-03-26 18:33:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 81c16025-2df4-5db9-b893-864c62a90421 with identifier: 1985871 to the API
2026-03-26 18:33:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/476/03bc5104386e4710aa75e90bc3c8048d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'Blanco banquise s',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '81c16025-2df4-5db9-b893-864c62a90421',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'BERLINGO',
 'odometer': 30885,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81c16025-2df4-5db9-b893-864c62a90421/81c16025-2df4-5db9-b893-864c62a90421_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 335566,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/476/03bc5104386e4710aa75e90bc3c8048d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-31',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROËN BERLINGO Talla M BlueHDi 100 CONTROL',
 'transmission': 'manual',
 'trim': 'Talla M BlueHDi 100 CONTROL',
 'vin': None,
 'year': 2022}
2026-03-26 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985871%27 HTTP/1.1" 200 None
2026-03-26 18:33:52 [ayvens.es] INFO: Saving data for 1985871: {'created_time': 1774550032.29317, 'last_price_update_time': 1774550032.29318, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985871') HTTP/1.1" 204 0
2026-03-26 18:33:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4ad2230f-ab7a-5d22-8cfa-2467a3757e12 with identifier: 1985870
2026-03-26 18:33:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4ad2230f-ab7a-5d22-8cfa-2467a3757e12 with identifier: 1985870
2026-03-26 18:33:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 4ad2230f-ab7a-5d22-8cfa-2467a3757e12 with identifier: 1985870 to the API
2026-03-26 18:33:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/013/05acea50bcb54c16bb86d6a35ffb42ca/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '4ad2230f-ab7a-5d22-8cfa-2467a3757e12',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 68538,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ad2230f-ab7a-5d22-8cfa-2467a3757e12/4ad2230f-ab7a-5d22-8cfa-2467a3757e12_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 365114,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/013/05acea50bcb54c16bb86d6a35ffb42ca/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.5 BlueHDi 96kW (130CV) S&S Active Pack',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi 96kW (130CV) S&S Active Pack',
 'vin': None,
 'year': 2022}
2026-03-26 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985870%27 HTTP/1.1" 200 None
2026-03-26 18:33:52 [ayvens.es] INFO: Saving data for 1985870: {'created_time': 1774550032.639072, 'last_price_update_time': 1774550032.639087, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985870') HTTP/1.1" 204 0
2026-03-26 18:33:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/782/d1ce01f3270e4e2a963b2a6baa88b901/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:52 [ayvens.es] INFO: Found listing with ID: 1985880
2026-03-26 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985880%27 HTTP/1.1" 200 None
2026-03-26 18:33:52 [ayvens.es] INFO: Scrape type for 1985880: 1
2026-03-26 18:33:52 [ayvens.es] INFO: Extracting data for car ID: 1985880
2026-03-26 18:33:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 444d9674-e011-5470-ad13-d30794681809 with identifier: 1985880
2026-03-26 18:33:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 444d9674-e011-5470-ad13-d30794681809 with scrape type 1
2026-03-26 18:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 444d9674-e011-5470-ad13-d30794681809
2026-03-26 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F416%252F970b7ae11ff247a7a6e0aab9c02e9191%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/416/970b7ae11ff247a7a6e0aab9c02e9191/images/large/1.jpg not downloaded yet
2026-03-26 18:33:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28356fd0>
2026-03-26 18:33:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1dfe41b2-e3c2-513a-a2ca-5ccb4e00f2e9/1dfe41b2-e3c2-513a-a2ca-5ccb4e00f2e9_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F380%252F7c7c71dab33b4262b79b8759e808d172%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/380/7c7c71dab33b4262b79b8759e808d172/images/large/1.jpg saved to cache
2026-03-26 18:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1dfe41b2-e3c2-513a-a2ca-5ccb4e00f2e9
2026-03-26 18:33:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1dfe41b2-e3c2-513a-a2ca-5ccb4e00f2e9, skipping ID generation
2026-03-26 18:33:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1dfe41b2-e3c2-513a-a2ca-5ccb4e00f2e9 with scrape type 1
2026-03-26 18:33:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1dfe41b2-e3c2-513a-a2ca-5ccb4e00f2e9 sending to next pipeline
2026-03-26 18:33:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1dfe41b2-e3c2-513a-a2ca-5ccb4e00f2e9, identifier: 1985873
2026-03-26 18:33:52 [ayvens.es] INFO: Found listing with ID: 1985881
2026-03-26 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985881%27 HTTP/1.1" 200 None
2026-03-26 18:33:52 [ayvens.es] INFO: Scrape type for 1985881: 1
2026-03-26 18:33:52 [ayvens.es] INFO: Extracting data for car ID: 1985881
2026-03-26 18:33:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 801f5f48-d438-56d9-9f85-cb1ea72be54e with identifier: 1985881
2026-03-26 18:33:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 801f5f48-d438-56d9-9f85-cb1ea72be54e with scrape type 1
2026-03-26 18:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 801f5f48-d438-56d9-9f85-cb1ea72be54e
2026-03-26 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F317%252Fbcb5efa40dd543e7859915f1b27f04af%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/317/bcb5efa40dd543e7859915f1b27f04af/images/large/1.jpg not downloaded yet
2026-03-26 18:33:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1dfe41b2-e3c2-513a-a2ca-5ccb4e00f2e9 with identifier: 1985873
2026-03-26 18:33:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1dfe41b2-e3c2-513a-a2ca-5ccb4e00f2e9 with identifier: 1985873
2026-03-26 18:33:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1dfe41b2-e3c2-513a-a2ca-5ccb4e00f2e9 with identifier: 1985873 to the API
2026-03-26 18:33:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/380/7c7c71dab33b4262b79b8759e808d172/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '1dfe41b2-e3c2-513a-a2ca-5ccb4e00f2e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'BERLINGO',
 'odometer': 220472,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dfe41b2-e3c2-513a-a2ca-5ccb4e00f2e9/1dfe41b2-e3c2-513a-a2ca-5ccb4e00f2e9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 320107,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/380/7c7c71dab33b4262b79b8759e808d172/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN BERLINGO Talla M BlueHDi 100 S&S FEEL',
 'transmission': 'manual',
 'trim': 'Talla M BlueHDi 100 S&S FEEL',
 'vin': None,
 'year': 2020}
2026-03-26 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985873%27 HTTP/1.1" 200 None
2026-03-26 18:33:55 [ayvens.es] INFO: Saving data for 1985873: {'created_time': 1774550035.046053, 'last_price_update_time': 1774550035.046062, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985873') HTTP/1.1" 204 0
2026-03-26 18:33:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/559/368f45ad4cb54444b2f3b64d1d12b2c7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/154/8c6716bcb88a4b298072996c6024ec45/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:55 [ayvens.es] INFO: Found listing with ID: 1985882
2026-03-26 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985882%27 HTTP/1.1" 200 None
2026-03-26 18:33:55 [ayvens.es] INFO: Scrape type for 1985882: 1
2026-03-26 18:33:55 [ayvens.es] INFO: Extracting data for car ID: 1985882
2026-03-26 18:33:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe3b00d4-bb11-5e08-920e-3dc9ed4e18e1 with identifier: 1985882
2026-03-26 18:33:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe3b00d4-bb11-5e08-920e-3dc9ed4e18e1 with scrape type 1
2026-03-26 18:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item fe3b00d4-bb11-5e08-920e-3dc9ed4e18e1
2026-03-26 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F706%252F331b7cd5f7534b68b5047cab4ea4a6de%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/706/331b7cd5f7534b68b5047cab4ea4a6de/images/large/1.jpg not downloaded yet
2026-03-26 18:33:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28356410>
2026-03-26 18:33:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36e34e3b-464d-55dc-958c-1bba29519c67/36e34e3b-464d-55dc-958c-1bba29519c67_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F782%252Fd1ce01f3270e4e2a963b2a6baa88b901%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/782/d1ce01f3270e4e2a963b2a6baa88b901/images/large/1.jpg saved to cache
2026-03-26 18:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 36e34e3b-464d-55dc-958c-1bba29519c67
2026-03-26 18:33:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 36e34e3b-464d-55dc-958c-1bba29519c67, skipping ID generation
2026-03-26 18:33:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36e34e3b-464d-55dc-958c-1bba29519c67 with scrape type 1
2026-03-26 18:33:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 36e34e3b-464d-55dc-958c-1bba29519c67 sending to next pipeline
2026-03-26 18:33:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 36e34e3b-464d-55dc-958c-1bba29519c67, identifier: 1985872
2026-03-26 18:33:55 [ayvens.es] INFO: Found listing with ID: 1985883
2026-03-26 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985883%27 HTTP/1.1" 200 None
2026-03-26 18:33:55 [ayvens.es] INFO: Scrape type for 1985883: 1
2026-03-26 18:33:55 [ayvens.es] INFO: Extracting data for car ID: 1985883
2026-03-26 18:33:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb6391a6-faf6-56c5-bf30-dd069f4e5a49 with identifier: 1985883
2026-03-26 18:33:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb6391a6-faf6-56c5-bf30-dd069f4e5a49 with scrape type 1
2026-03-26 18:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item cb6391a6-faf6-56c5-bf30-dd069f4e5a49
2026-03-26 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F490%252F0dc2fd3f5f4441168fadbce0d5c4e076%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/490/0dc2fd3f5f4441168fadbce0d5c4e076/images/large/1.jpg not downloaded yet
2026-03-26 18:33:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 36e34e3b-464d-55dc-958c-1bba29519c67 with identifier: 1985872
2026-03-26 18:33:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 36e34e3b-464d-55dc-958c-1bba29519c67 with identifier: 1985872
2026-03-26 18:33:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 36e34e3b-464d-55dc-958c-1bba29519c67 with identifier: 1985872 to the API
2026-03-26 18:33:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/782/d1ce01f3270e4e2a963b2a6baa88b901/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '36e34e3b-464d-55dc-958c-1bba29519c67',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '208',
 'odometer': 124811,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36e34e3b-464d-55dc-958c-1bba29519c67/36e34e3b-464d-55dc-958c-1bba29519c67_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 542466,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/782/d1ce01f3270e4e2a963b2a6baa88b901/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 208 5P ACTIVE BlueHDi 73kW (100CV)',
 'transmission': 'manual',
 'trim': '5P ACTIVE BlueHDi 73kW (100CV)',
 'vin': None,
 'year': 2019}
2026-03-26 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985872%27 HTTP/1.1" 200 None
2026-03-26 18:33:55 [ayvens.es] INFO: Saving data for 1985872: {'created_time': 1774550035.835617, 'last_price_update_time': 1774550035.835634, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985872') HTTP/1.1" 204 0
2026-03-26 18:33:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/142/4a1d1d9f19194b03b4717e367097ccf3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:55 [ayvens.es] INFO: Found listing with ID: 1985884
2026-03-26 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985884%27 HTTP/1.1" 200 None
2026-03-26 18:33:55 [ayvens.es] INFO: Scrape type for 1985884: 1
2026-03-26 18:33:55 [ayvens.es] INFO: Extracting data for car ID: 1985884
2026-03-26 18:33:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 925a0320-e794-5975-91f3-9d966e492194 with identifier: 1985884
2026-03-26 18:33:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 925a0320-e794-5975-91f3-9d966e492194 with scrape type 1
2026-03-26 18:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 925a0320-e794-5975-91f3-9d966e492194
2026-03-26 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F401%252Fcc9e26654dba4a80bcc271d399cbfe9a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/401/cc9e26654dba4a80bcc271d399cbfe9a/images/large/1.jpg not downloaded yet
2026-03-26 18:33:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28b01e50>
2026-03-26 18:33:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa442f6e-7edb-5e0b-a8c9-c52b7db051eb/aa442f6e-7edb-5e0b-a8c9-c52b7db051eb_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F559%252F368f45ad4cb54444b2f3b64d1d12b2c7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/559/368f45ad4cb54444b2f3b64d1d12b2c7/images/large/1.jpg saved to cache
2026-03-26 18:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aa442f6e-7edb-5e0b-a8c9-c52b7db051eb
2026-03-26 18:33:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aa442f6e-7edb-5e0b-a8c9-c52b7db051eb, skipping ID generation
2026-03-26 18:33:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa442f6e-7edb-5e0b-a8c9-c52b7db051eb with scrape type 1
2026-03-26 18:33:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aa442f6e-7edb-5e0b-a8c9-c52b7db051eb sending to next pipeline
2026-03-26 18:33:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: aa442f6e-7edb-5e0b-a8c9-c52b7db051eb, identifier: 1985875
2026-03-26 18:33:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a290342d0>
2026-03-26 18:33:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98243c0a-7a3a-5716-b9a6-04c26167ba1d/98243c0a-7a3a-5716-b9a6-04c26167ba1d_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F154%252F8c6716bcb88a4b298072996c6024ec45%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/154/8c6716bcb88a4b298072996c6024ec45/images/large/1.jpg saved to cache
2026-03-26 18:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 98243c0a-7a3a-5716-b9a6-04c26167ba1d
2026-03-26 18:33:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 98243c0a-7a3a-5716-b9a6-04c26167ba1d, skipping ID generation
2026-03-26 18:33:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98243c0a-7a3a-5716-b9a6-04c26167ba1d with scrape type 1
2026-03-26 18:33:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 98243c0a-7a3a-5716-b9a6-04c26167ba1d sending to next pipeline
2026-03-26 18:33:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 98243c0a-7a3a-5716-b9a6-04c26167ba1d, identifier: 1985876
2026-03-26 18:33:56 [ayvens.es] INFO: Found listing with ID: 1985885
2026-03-26 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985885%27 HTTP/1.1" 200 None
2026-03-26 18:33:56 [ayvens.es] INFO: Scrape type for 1985885: 1
2026-03-26 18:33:56 [ayvens.es] INFO: Extracting data for car ID: 1985885
2026-03-26 18:33:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b07cea9-7668-5762-ae64-a6de8e6f2076 with identifier: 1985885
2026-03-26 18:33:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b07cea9-7668-5762-ae64-a6de8e6f2076 with scrape type 1
2026-03-26 18:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9b07cea9-7668-5762-ae64-a6de8e6f2076
2026-03-26 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F571%252Fda32b8aad5154856a6d66666b86300d9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/571/da32b8aad5154856a6d66666b86300d9/images/large/1.jpg not downloaded yet
2026-03-26 18:33:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: aa442f6e-7edb-5e0b-a8c9-c52b7db051eb with identifier: 1985875
2026-03-26 18:33:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: aa442f6e-7edb-5e0b-a8c9-c52b7db051eb with identifier: 1985875
2026-03-26 18:33:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: aa442f6e-7edb-5e0b-a8c9-c52b7db051eb with identifier: 1985875 to the API
2026-03-26 18:33:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/559/368f45ad4cb54444b2f3b64d1d12b2c7/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'aa442f6e-7edb-5e0b-a8c9-c52b7db051eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 120163,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa442f6e-7edb-5e0b-a8c9-c52b7db051eb/aa442f6e-7edb-5e0b-a8c9-c52b7db051eb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 473507,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/559/368f45ad4cb54444b2f3b64d1d12b2c7/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 Allure BlueHDI 81kW (110CV)',
 'transmission': 'manual',
 'trim': 'Allure BlueHDI 81kW (110CV)',
 'vin': None,
 'year': 2021}
2026-03-26 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985875%27 HTTP/1.1" 200 None
2026-03-26 18:33:56 [ayvens.es] INFO: Saving data for 1985875: {'created_time': 1774550036.565727, 'last_price_update_time': 1774550036.565737, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985875') HTTP/1.1" 204 0
2026-03-26 18:33:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 98243c0a-7a3a-5716-b9a6-04c26167ba1d with identifier: 1985876
2026-03-26 18:33:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 98243c0a-7a3a-5716-b9a6-04c26167ba1d with identifier: 1985876
2026-03-26 18:33:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 98243c0a-7a3a-5716-b9a6-04c26167ba1d with identifier: 1985876 to the API
2026-03-26 18:33:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/154/8c6716bcb88a4b298072996c6024ec45/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'color': 'Blanco glaciar',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '98243c0a-7a3a-5716-b9a6-04c26167ba1d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'DACIA',
 'model': 'DUSTER',
 'odometer': 179002,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98243c0a-7a3a-5716-b9a6-04c26167ba1d/98243c0a-7a3a-5716-b9a6-04c26167ba1d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347552,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/154/8c6716bcb88a4b298072996c6024ec45/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DACIA DUSTER Expression Bl. dCi 85kW(115CV) 4X2',
 'transmission': 'manual',
 'trim': 'Expression Bl. dCi 85kW(115CV) 4X2',
 'vin': None,
 'year': 2023}
2026-03-26 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985876%27 HTTP/1.1" 200 None
2026-03-26 18:33:56 [ayvens.es] INFO: Saving data for 1985876: {'created_time': 1774550036.913257, 'last_price_update_time': 1774550036.913267, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985876') HTTP/1.1" 204 0
2026-03-26 18:33:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/078/6e0694d3bba74232b2ec4870e9d43956/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/592/db40c1619b4a413d8db0b15d448a1ab2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/416/970b7ae11ff247a7a6e0aab9c02e9191/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:56 [ayvens.es] INFO: Found listing with ID: 1985886
2026-03-26 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985886%27 HTTP/1.1" 200 None
2026-03-26 18:33:56 [ayvens.es] INFO: Scrape type for 1985886: 1
2026-03-26 18:33:56 [ayvens.es] INFO: Extracting data for car ID: 1985886
2026-03-26 18:33:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b718e571-b50f-527d-828a-0ba09b4b8b08 with identifier: 1985886
2026-03-26 18:33:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b718e571-b50f-527d-828a-0ba09b4b8b08 with scrape type 1
2026-03-26 18:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b718e571-b50f-527d-828a-0ba09b4b8b08
2026-03-26 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F883%252F940e5ca81139410b9a7ff62e943c444d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/883/940e5ca81139410b9a7ff62e943c444d/images/large/1.jpg not downloaded yet
2026-03-26 18:33:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a281fa890>
2026-03-26 18:33:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fdc02fd-1e5c-56d7-99ec-7fb626fbe019/4fdc02fd-1e5c-56d7-99ec-7fb626fbe019_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F142%252F4a1d1d9f19194b03b4717e367097ccf3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/142/4a1d1d9f19194b03b4717e367097ccf3/images/large/1.jpg saved to cache
2026-03-26 18:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4fdc02fd-1e5c-56d7-99ec-7fb626fbe019
2026-03-26 18:33:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4fdc02fd-1e5c-56d7-99ec-7fb626fbe019, skipping ID generation
2026-03-26 18:33:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fdc02fd-1e5c-56d7-99ec-7fb626fbe019 with scrape type 1
2026-03-26 18:33:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4fdc02fd-1e5c-56d7-99ec-7fb626fbe019 sending to next pipeline
2026-03-26 18:33:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4fdc02fd-1e5c-56d7-99ec-7fb626fbe019, identifier: 1985877
2026-03-26 18:33:57 [ayvens.es] INFO: Found listing with ID: 1985887
2026-03-26 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985887%27 HTTP/1.1" 200 None
2026-03-26 18:33:57 [ayvens.es] INFO: Scrape type for 1985887: 1
2026-03-26 18:33:57 [ayvens.es] INFO: Extracting data for car ID: 1985887
2026-03-26 18:33:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8147addc-bec7-521a-b3ab-eb0f163e2c9b with identifier: 1985887
2026-03-26 18:33:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8147addc-bec7-521a-b3ab-eb0f163e2c9b with scrape type 1
2026-03-26 18:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8147addc-bec7-521a-b3ab-eb0f163e2c9b
2026-03-26 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F925%252Fb22048e835784059b1848f04a56161f8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/925/b22048e835784059b1848f04a56161f8/images/large/1.jpg not downloaded yet
2026-03-26 18:33:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4fdc02fd-1e5c-56d7-99ec-7fb626fbe019 with identifier: 1985877
2026-03-26 18:33:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4fdc02fd-1e5c-56d7-99ec-7fb626fbe019 with identifier: 1985877
2026-03-26 18:33:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 4fdc02fd-1e5c-56d7-99ec-7fb626fbe019 with identifier: 1985877 to the API
2026-03-26 18:33:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/142/4a1d1d9f19194b03b4717e367097ccf3/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'Polar white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '4fdc02fd-1e5c-56d7-99ec-7fb626fbe019',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'I30',
 'odometer': 126084,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fdc02fd-1e5c-56d7-99ec-7fb626fbe019/4fdc02fd-1e5c-56d7-99ec-7fb626fbe019_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 514850,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/142/4a1d1d9f19194b03b4717e367097ccf3/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI I30 1.6 CRDI 85kW (116CV) Klass',
 'transmission': 'manual',
 'trim': '1.6 CRDI 85kW (116CV) Klass',
 'vin': None,
 'year': 2020}
2026-03-26 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985877%27 HTTP/1.1" 200 None
2026-03-26 18:33:57 [ayvens.es] INFO: Saving data for 1985877: {'created_time': 1774550037.518361, 'last_price_update_time': 1774550037.518372, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985877') HTTP/1.1" 204 0
2026-03-26 18:33:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/706/331b7cd5f7534b68b5047cab4ea4a6de/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:57 [ayvens.es] INFO: Found listing with ID: 1985888
2026-03-26 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985888%27 HTTP/1.1" 200 None
2026-03-26 18:33:57 [ayvens.es] INFO: Scrape type for 1985888: 1
2026-03-26 18:33:57 [ayvens.es] INFO: Extracting data for car ID: 1985888
2026-03-26 18:33:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5072cbae-ade6-5666-905e-a87f2bb70953 with identifier: 1985888
2026-03-26 18:33:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5072cbae-ade6-5666-905e-a87f2bb70953 with scrape type 1
2026-03-26 18:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5072cbae-ade6-5666-905e-a87f2bb70953
2026-03-26 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F861%252F02bbe488dd8c48448135aca290ec3481%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/861/02bbe488dd8c48448135aca290ec3481/images/large/1.jpg not downloaded yet
2026-03-26 18:33:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28ca7010>
2026-03-26 18:33:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ab48fc6-aab7-5d27-8185-d3b91296c94e/0ab48fc6-aab7-5d27-8185-d3b91296c94e_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F078%252F6e0694d3bba74232b2ec4870e9d43956%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/078/6e0694d3bba74232b2ec4870e9d43956/images/large/1.jpg saved to cache
2026-03-26 18:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0ab48fc6-aab7-5d27-8185-d3b91296c94e
2026-03-26 18:33:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0ab48fc6-aab7-5d27-8185-d3b91296c94e, skipping ID generation
2026-03-26 18:33:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ab48fc6-aab7-5d27-8185-d3b91296c94e with scrape type 1
2026-03-26 18:33:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0ab48fc6-aab7-5d27-8185-d3b91296c94e sending to next pipeline
2026-03-26 18:33:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0ab48fc6-aab7-5d27-8185-d3b91296c94e, identifier: 1985879
2026-03-26 18:33:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c56190>
2026-03-26 18:33:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d08de886-159c-5e45-8587-e44e4e0e7d49/d08de886-159c-5e45-8587-e44e4e0e7d49_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F592%252Fdb40c1619b4a413d8db0b15d448a1ab2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/592/db40c1619b4a413d8db0b15d448a1ab2/images/large/1.jpg saved to cache
2026-03-26 18:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d08de886-159c-5e45-8587-e44e4e0e7d49
2026-03-26 18:33:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d08de886-159c-5e45-8587-e44e4e0e7d49, skipping ID generation
2026-03-26 18:33:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d08de886-159c-5e45-8587-e44e4e0e7d49 with scrape type 1
2026-03-26 18:33:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d08de886-159c-5e45-8587-e44e4e0e7d49 sending to next pipeline
2026-03-26 18:33:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d08de886-159c-5e45-8587-e44e4e0e7d49, identifier: 1985878
2026-03-26 18:33:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28f82a10>
2026-03-26 18:33:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_444d9674-e011-5470-ad13-d30794681809/444d9674-e011-5470-ad13-d30794681809_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F416%252F970b7ae11ff247a7a6e0aab9c02e9191%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/416/970b7ae11ff247a7a6e0aab9c02e9191/images/large/1.jpg saved to cache
2026-03-26 18:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 444d9674-e011-5470-ad13-d30794681809
2026-03-26 18:33:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 444d9674-e011-5470-ad13-d30794681809, skipping ID generation
2026-03-26 18:33:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 444d9674-e011-5470-ad13-d30794681809 with scrape type 1
2026-03-26 18:33:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 444d9674-e011-5470-ad13-d30794681809 sending to next pipeline
2026-03-26 18:33:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 444d9674-e011-5470-ad13-d30794681809, identifier: 1985880
2026-03-26 18:33:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/317/bcb5efa40dd543e7859915f1b27f04af/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:58 [ayvens.es] INFO: Found listing with ID: 1985889
2026-03-26 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985889%27 HTTP/1.1" 200 None
2026-03-26 18:33:58 [ayvens.es] INFO: Scrape type for 1985889: 1
2026-03-26 18:33:58 [ayvens.es] INFO: Extracting data for car ID: 1985889
2026-03-26 18:33:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30c06971-7659-5b8c-922e-a02e5753630e with identifier: 1985889
2026-03-26 18:33:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30c06971-7659-5b8c-922e-a02e5753630e with scrape type 1
2026-03-26 18:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 30c06971-7659-5b8c-922e-a02e5753630e
2026-03-26 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F143%252Fbe37ca20c2d048a18cd92a5449cda225%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/143/be37ca20c2d048a18cd92a5449cda225/images/large/1.jpg not downloaded yet
2026-03-26 18:33:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0ab48fc6-aab7-5d27-8185-d3b91296c94e with identifier: 1985879
2026-03-26 18:33:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0ab48fc6-aab7-5d27-8185-d3b91296c94e with identifier: 1985879
2026-03-26 18:33:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0ab48fc6-aab7-5d27-8185-d3b91296c94e with identifier: 1985879 to the API
2026-03-26 18:33:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/078/6e0694d3bba74232b2ec4870e9d43956/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '0ab48fc6-aab7-5d27-8185-d3b91296c94e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'STONIC',
 'odometer': 41507,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ab48fc6-aab7-5d27-8185-d3b91296c94e/0ab48fc6-aab7-5d27-8185-d3b91296c94e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 514076,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/078/6e0694d3bba74232b2ec4870e9d43956/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA STONIC (O) 1.0 T-GDi 88kW (120CV) MHEV Drive DC',
 'transmission': 'manual',
 'trim': '(O) 1.0 T-GDi 88kW (120CV) MHEV Drive DC',
 'vin': None,
 'year': 2021}
2026-03-26 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985879%27 HTTP/1.1" 200 None
2026-03-26 18:33:58 [ayvens.es] INFO: Saving data for 1985879: {'created_time': 1774550038.418778, 'last_price_update_time': 1774550038.418788, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985879') HTTP/1.1" 204 0
2026-03-26 18:33:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d08de886-159c-5e45-8587-e44e4e0e7d49 with identifier: 1985878
2026-03-26 18:33:58 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:33:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d08de886-159c-5e45-8587-e44e4e0e7d49 with identifier: 1985878
2026-03-26 18:33:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d08de886-159c-5e45-8587-e44e4e0e7d49 with identifier: 1985878 to the API
2026-03-26 18:33:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/592/db40c1619b4a413d8db0b15d448a1ab2/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'color': 'Blanco ibis',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd08de886-159c-5e45-8587-e44e4e0e7d49',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3',
 'odometer': 78875,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d08de886-159c-5e45-8587-e44e4e0e7d49/d08de886-159c-5e45-8587-e44e4e0e7d49_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 602233,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/592/db40c1619b4a413d8db0b15d448a1ab2/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 Advanced 35 TDI 110kW (150CV) S tronic',
 'transmission': 'manual',
 'trim': 'Advanced 35 TDI 110kW (150CV) S tronic',
 'vin': None,
 'year': 2022}
2026-03-26 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985878%27 HTTP/1.1" 200 None
2026-03-26 18:33:58 [ayvens.es] INFO: Saving data for 1985878: {'created_time': 1774550038.753431, 'last_price_update_time': 1774550038.753442, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985878') HTTP/1.1" 204 0
2026-03-26 18:33:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 444d9674-e011-5470-ad13-d30794681809 with identifier: 1985880
2026-03-26 18:33:58 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:33:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 444d9674-e011-5470-ad13-d30794681809 with identifier: 1985880
2026-03-26 18:33:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 444d9674-e011-5470-ad13-d30794681809 with identifier: 1985880 to the API
2026-03-26 18:33:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/416/970b7ae11ff247a7a6e0aab9c02e9191/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Blanco banquise',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '444d9674-e011-5470-ad13-d30794681809',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'BERLINGO',
 'odometer': 278628,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_444d9674-e011-5470-ad13-d30794681809/444d9674-e011-5470-ad13-d30794681809_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 320670,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/416/970b7ae11ff247a7a6e0aab9c02e9191/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN BERLINGO Talla M BlueHDi 100 S&S LIVE',
 'transmission': 'manual',
 'trim': 'Talla M BlueHDi 100 S&S LIVE',
 'vin': None,
 'year': 2020}
2026-03-26 18:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985880%27 HTTP/1.1" 200 None
2026-03-26 18:33:59 [ayvens.es] INFO: Saving data for 1985880: {'created_time': 1774550039.092279, 'last_price_update_time': 1774550039.092291, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985880') HTTP/1.1" 204 0
2026-03-26 18:33:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/401/cc9e26654dba4a80bcc271d399cbfe9a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:59 [ayvens.es] INFO: Found listing with ID: 1985890
2026-03-26 18:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985890%27 HTTP/1.1" 200 None
2026-03-26 18:33:59 [ayvens.es] INFO: Scrape type for 1985890: 1
2026-03-26 18:33:59 [ayvens.es] INFO: Extracting data for car ID: 1985890
2026-03-26 18:33:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb1224b0-9042-5048-8dc4-36481e7cd881 with identifier: 1985890
2026-03-26 18:33:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb1224b0-9042-5048-8dc4-36481e7cd881 with scrape type 1
2026-03-26 18:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item bb1224b0-9042-5048-8dc4-36481e7cd881
2026-03-26 18:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F577%252F9e65461b274f4e9282215f76f21dbfab%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/577/9e65461b274f4e9282215f76f21dbfab/images/large/1.jpg not downloaded yet
2026-03-26 18:33:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c9e410>
2026-03-26 18:33:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe3b00d4-bb11-5e08-920e-3dc9ed4e18e1/fe3b00d4-bb11-5e08-920e-3dc9ed4e18e1_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F706%252F331b7cd5f7534b68b5047cab4ea4a6de%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/706/331b7cd5f7534b68b5047cab4ea4a6de/images/large/1.jpg saved to cache
2026-03-26 18:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fe3b00d4-bb11-5e08-920e-3dc9ed4e18e1
2026-03-26 18:33:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fe3b00d4-bb11-5e08-920e-3dc9ed4e18e1, skipping ID generation
2026-03-26 18:33:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe3b00d4-bb11-5e08-920e-3dc9ed4e18e1 with scrape type 1
2026-03-26 18:33:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fe3b00d4-bb11-5e08-920e-3dc9ed4e18e1 sending to next pipeline
2026-03-26 18:33:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: fe3b00d4-bb11-5e08-920e-3dc9ed4e18e1, identifier: 1985882
2026-03-26 18:33:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:33:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a282331d0>
2026-03-26 18:33:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:33:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:33:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:33:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_801f5f48-d438-56d9-9f85-cb1ea72be54e/801f5f48-d438-56d9-9f85-cb1ea72be54e_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F317%252Fbcb5efa40dd543e7859915f1b27f04af%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/317/bcb5efa40dd543e7859915f1b27f04af/images/large/1.jpg saved to cache
2026-03-26 18:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 801f5f48-d438-56d9-9f85-cb1ea72be54e
2026-03-26 18:33:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 801f5f48-d438-56d9-9f85-cb1ea72be54e, skipping ID generation
2026-03-26 18:33:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 801f5f48-d438-56d9-9f85-cb1ea72be54e with scrape type 1
2026-03-26 18:33:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 801f5f48-d438-56d9-9f85-cb1ea72be54e sending to next pipeline
2026-03-26 18:33:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 801f5f48-d438-56d9-9f85-cb1ea72be54e, identifier: 1985881
2026-03-26 18:33:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/490/0dc2fd3f5f4441168fadbce0d5c4e076/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:33:59 [ayvens.es] INFO: Found listing with ID: 1985891
2026-03-26 18:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985891%27 HTTP/1.1" 200 None
2026-03-26 18:33:59 [ayvens.es] INFO: Scrape type for 1985891: 1
2026-03-26 18:33:59 [ayvens.es] INFO: Extracting data for car ID: 1985891
2026-03-26 18:33:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a626683d-45c3-5607-9e6b-bf2e46ec570b with identifier: 1985891
2026-03-26 18:33:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a626683d-45c3-5607-9e6b-bf2e46ec570b with scrape type 1
2026-03-26 18:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a626683d-45c3-5607-9e6b-bf2e46ec570b
2026-03-26 18:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F003%252F584978d967bd4890ab10ddcd21309ef7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/003/584978d967bd4890ab10ddcd21309ef7/images/large/1.jpg not downloaded yet
2026-03-26 18:33:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: fe3b00d4-bb11-5e08-920e-3dc9ed4e18e1 with identifier: 1985882
2026-03-26 18:33:59 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:33:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: fe3b00d4-bb11-5e08-920e-3dc9ed4e18e1 with identifier: 1985882
2026-03-26 18:33:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: fe3b00d4-bb11-5e08-920e-3dc9ed4e18e1 with identifier: 1985882 to the API
2026-03-26 18:33:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:33:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:33:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/706/331b7cd5f7534b68b5047cab4ea4a6de/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'Azul chromet',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'fe3b00d4-bb11-5e08-920e-3dc9ed4e18e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': 115102,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe3b00d4-bb11-5e08-920e-3dc9ed4e18e1/fe3b00d4-bb11-5e08-920e-3dc9ed4e18e1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 384684,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/706/331b7cd5f7534b68b5047cab4ea4a6de/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FOCUS 1.5 Ecoblue 88kW Trend+',
 'transmission': 'manual',
 'trim': '1.5 Ecoblue 88kW Trend+',
 'vin': None,
 'year': 2020}
2026-03-26 18:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985882%27 HTTP/1.1" 200 None
2026-03-26 18:33:59 [ayvens.es] INFO: Saving data for 1985882: {'created_time': 1774550039.838849, 'last_price_update_time': 1774550039.838859, 'auction_closing_time': 1774612800.0}
2026-03-26 18:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985882') HTTP/1.1" 204 0
2026-03-26 18:33:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 801f5f48-d438-56d9-9f85-cb1ea72be54e with identifier: 1985881
2026-03-26 18:33:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 801f5f48-d438-56d9-9f85-cb1ea72be54e with identifier: 1985881
2026-03-26 18:33:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 801f5f48-d438-56d9-9f85-cb1ea72be54e with identifier: 1985881 to the API
2026-03-26 18:33:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/317/bcb5efa40dd543e7859915f1b27f04af/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'Blanco banquise',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '801f5f48-d438-56d9-9f85-cb1ea72be54e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 159767,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_801f5f48-d438-56d9-9f85-cb1ea72be54e/801f5f48-d438-56d9-9f85-cb1ea72be54e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 505145,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/317/bcb5efa40dd543e7859915f1b27f04af/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 Active Pack BlueHDI 81kW (110CV)',
 'transmission': 'manual',
 'trim': 'Active Pack BlueHDI 81kW (110CV)',
 'vin': None,
 'year': 2021}
2026-03-26 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985881%27 HTTP/1.1" 200 None
2026-03-26 18:34:00 [ayvens.es] INFO: Saving data for 1985881: {'created_time': 1774550040.290699, 'last_price_update_time': 1774550040.29071, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985881') HTTP/1.1" 204 0
2026-03-26 18:34:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/883/940e5ca81139410b9a7ff62e943c444d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/571/da32b8aad5154856a6d66666b86300d9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:00 [ayvens.es] INFO: Found listing with ID: 1985892
2026-03-26 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985892%27 HTTP/1.1" 200 None
2026-03-26 18:34:00 [ayvens.es] INFO: Scrape type for 1985892: 1
2026-03-26 18:34:00 [ayvens.es] INFO: Extracting data for car ID: 1985892
2026-03-26 18:34:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee3c81e3-fc51-5886-9729-d853fcd6bd4c with identifier: 1985892
2026-03-26 18:34:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee3c81e3-fc51-5886-9729-d853fcd6bd4c with scrape type 1
2026-03-26 18:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ee3c81e3-fc51-5886-9729-d853fcd6bd4c
2026-03-26 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F849%252F58781def108c4129a7691061c6474663%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/849/58781def108c4129a7691061c6474663/images/large/1.jpg not downloaded yet
2026-03-26 18:34:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a2834b210>
2026-03-26 18:34:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_925a0320-e794-5975-91f3-9d966e492194/925a0320-e794-5975-91f3-9d966e492194_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F401%252Fcc9e26654dba4a80bcc271d399cbfe9a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/401/cc9e26654dba4a80bcc271d399cbfe9a/images/large/1.jpg saved to cache
2026-03-26 18:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 925a0320-e794-5975-91f3-9d966e492194
2026-03-26 18:34:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 925a0320-e794-5975-91f3-9d966e492194, skipping ID generation
2026-03-26 18:34:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 925a0320-e794-5975-91f3-9d966e492194 with scrape type 1
2026-03-26 18:34:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 925a0320-e794-5975-91f3-9d966e492194 sending to next pipeline
2026-03-26 18:34:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 925a0320-e794-5975-91f3-9d966e492194, identifier: 1985884
2026-03-26 18:34:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a2834abd0>
2026-03-26 18:34:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb6391a6-faf6-56c5-bf30-dd069f4e5a49/cb6391a6-faf6-56c5-bf30-dd069f4e5a49_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F490%252F0dc2fd3f5f4441168fadbce0d5c4e076%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/490/0dc2fd3f5f4441168fadbce0d5c4e076/images/large/1.jpg saved to cache
2026-03-26 18:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cb6391a6-faf6-56c5-bf30-dd069f4e5a49
2026-03-26 18:34:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cb6391a6-faf6-56c5-bf30-dd069f4e5a49, skipping ID generation
2026-03-26 18:34:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb6391a6-faf6-56c5-bf30-dd069f4e5a49 with scrape type 1
2026-03-26 18:34:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cb6391a6-faf6-56c5-bf30-dd069f4e5a49 sending to next pipeline
2026-03-26 18:34:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: cb6391a6-faf6-56c5-bf30-dd069f4e5a49, identifier: 1985883
2026-03-26 18:34:00 [ayvens.es] INFO: Found listing with ID: 1985893
2026-03-26 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985893%27 HTTP/1.1" 200 None
2026-03-26 18:34:00 [ayvens.es] INFO: Scrape type for 1985893: 1
2026-03-26 18:34:00 [ayvens.es] INFO: Extracting data for car ID: 1985893
2026-03-26 18:34:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03e40df3-5443-5ef6-9843-b50577a5d091 with identifier: 1985893
2026-03-26 18:34:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03e40df3-5443-5ef6-9843-b50577a5d091 with scrape type 1
2026-03-26 18:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 03e40df3-5443-5ef6-9843-b50577a5d091
2026-03-26 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F644%252F33d6fe9e447a4b1d9bfab0b68b09e729%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/644/33d6fe9e447a4b1d9bfab0b68b09e729/images/large/1.jpg not downloaded yet
2026-03-26 18:34:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 925a0320-e794-5975-91f3-9d966e492194 with identifier: 1985884
2026-03-26 18:34:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 925a0320-e794-5975-91f3-9d966e492194 with identifier: 1985884
2026-03-26 18:34:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 925a0320-e794-5975-91f3-9d966e492194 with identifier: 1985884 to the API
2026-03-26 18:34:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/401/cc9e26654dba4a80bcc271d399cbfe9a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'Blanco banquise',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '925a0320-e794-5975-91f3-9d966e492194',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 180552,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_925a0320-e794-5975-91f3-9d966e492194/925a0320-e794-5975-91f3-9d966e492194_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 341203,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/401/cc9e26654dba4a80bcc271d399cbfe9a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 Active Pack BlueHDI 81kW (110CV)',
 'transmission': 'manual',
 'trim': 'Active Pack BlueHDI 81kW (110CV)',
 'vin': None,
 'year': 2021}
2026-03-26 18:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985884%27 HTTP/1.1" 200 None
2026-03-26 18:34:01 [ayvens.es] INFO: Saving data for 1985884: {'created_time': 1774550041.056318, 'last_price_update_time': 1774550041.056333, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985884') HTTP/1.1" 204 0
2026-03-26 18:34:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: cb6391a6-faf6-56c5-bf30-dd069f4e5a49 with identifier: 1985883
2026-03-26 18:34:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: cb6391a6-faf6-56c5-bf30-dd069f4e5a49 with identifier: 1985883
2026-03-26 18:34:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: cb6391a6-faf6-56c5-bf30-dd069f4e5a49 with identifier: 1985883 to the API
2026-03-26 18:34:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/490/0dc2fd3f5f4441168fadbce0d5c4e076/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'cb6391a6-faf6-56c5-bf30-dd069f4e5a49',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 60817,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb6391a6-faf6-56c5-bf30-dd069f4e5a49/cb6391a6-faf6-56c5-bf30-dd069f4e5a49_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 494940,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/490/0dc2fd3f5f4441168fadbce0d5c4e076/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 Active Puretech 100 S&S BVM6',
 'transmission': 'manual',
 'trim': 'Active Puretech 100 S&S BVM6',
 'vin': None,
 'year': 2020}
2026-03-26 18:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985883%27 HTTP/1.1" 200 None
2026-03-26 18:34:01 [ayvens.es] INFO: Saving data for 1985883: {'created_time': 1774550041.451866, 'last_price_update_time': 1774550041.451877, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985883') HTTP/1.1" 204 0
2026-03-26 18:34:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/861/02bbe488dd8c48448135aca290ec3481/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:01 [ayvens.es] INFO: Found listing with ID: 1985894
2026-03-26 18:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985894%27 HTTP/1.1" 200 None
2026-03-26 18:34:01 [ayvens.es] INFO: Scrape type for 1985894: 1
2026-03-26 18:34:01 [ayvens.es] INFO: Extracting data for car ID: 1985894
2026-03-26 18:34:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c19dd324-8bee-5942-87d5-18e91c7b1d2a with identifier: 1985894
2026-03-26 18:34:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c19dd324-8bee-5942-87d5-18e91c7b1d2a with scrape type 1
2026-03-26 18:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c19dd324-8bee-5942-87d5-18e91c7b1d2a
2026-03-26 18:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F897%252Faadc8bf4ebe84cf3aa4706ccee8d485c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/897/aadc8bf4ebe84cf3aa4706ccee8d485c/images/large/1.jpg not downloaded yet
2026-03-26 18:34:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28eb7c50>
2026-03-26 18:34:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b718e571-b50f-527d-828a-0ba09b4b8b08/b718e571-b50f-527d-828a-0ba09b4b8b08_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F883%252F940e5ca81139410b9a7ff62e943c444d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/883/940e5ca81139410b9a7ff62e943c444d/images/large/1.jpg saved to cache
2026-03-26 18:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b718e571-b50f-527d-828a-0ba09b4b8b08
2026-03-26 18:34:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b718e571-b50f-527d-828a-0ba09b4b8b08, skipping ID generation
2026-03-26 18:34:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b718e571-b50f-527d-828a-0ba09b4b8b08 with scrape type 1
2026-03-26 18:34:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b718e571-b50f-527d-828a-0ba09b4b8b08 sending to next pipeline
2026-03-26 18:34:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b718e571-b50f-527d-828a-0ba09b4b8b08, identifier: 1985886
2026-03-26 18:34:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28232050>
2026-03-26 18:34:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b07cea9-7668-5762-ae64-a6de8e6f2076/9b07cea9-7668-5762-ae64-a6de8e6f2076_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F571%252Fda32b8aad5154856a6d66666b86300d9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/571/da32b8aad5154856a6d66666b86300d9/images/large/1.jpg saved to cache
2026-03-26 18:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9b07cea9-7668-5762-ae64-a6de8e6f2076
2026-03-26 18:34:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9b07cea9-7668-5762-ae64-a6de8e6f2076, skipping ID generation
2026-03-26 18:34:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b07cea9-7668-5762-ae64-a6de8e6f2076 with scrape type 1
2026-03-26 18:34:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9b07cea9-7668-5762-ae64-a6de8e6f2076 sending to next pipeline
2026-03-26 18:34:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9b07cea9-7668-5762-ae64-a6de8e6f2076, identifier: 1985885
2026-03-26 18:34:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b718e571-b50f-527d-828a-0ba09b4b8b08 with identifier: 1985886
2026-03-26 18:34:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b718e571-b50f-527d-828a-0ba09b4b8b08 with identifier: 1985886
2026-03-26 18:34:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b718e571-b50f-527d-828a-0ba09b4b8b08 with identifier: 1985886 to the API
2026-03-26 18:34:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/883/940e5ca81139410b9a7ff62e943c444d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'Blanco banquise',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b718e571-b50f-527d-828a-0ba09b4b8b08',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 120323,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b718e571-b50f-527d-828a-0ba09b4b8b08/b718e571-b50f-527d-828a-0ba09b4b8b08_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 356083,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/883/940e5ca81139410b9a7ff62e943c444d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 Active BlueHDI 81kW (110CV)',
 'transmission': 'manual',
 'trim': 'Active BlueHDI 81kW (110CV)',
 'vin': None,
 'year': 2021}
2026-03-26 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985886%27 HTTP/1.1" 200 None
2026-03-26 18:34:02 [ayvens.es] INFO: Saving data for 1985886: {'created_time': 1774550042.168999, 'last_price_update_time': 1774550042.169008, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985886') HTTP/1.1" 204 0
2026-03-26 18:34:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9b07cea9-7668-5762-ae64-a6de8e6f2076 with identifier: 1985885
2026-03-26 18:34:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9b07cea9-7668-5762-ae64-a6de8e6f2076 with identifier: 1985885
2026-03-26 18:34:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9b07cea9-7668-5762-ae64-a6de8e6f2076 with identifier: 1985885 to the API
2026-03-26 18:34:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/571/da32b8aad5154856a6d66666b86300d9/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'Blanco banquise',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '9b07cea9-7668-5762-ae64-a6de8e6f2076',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 67902,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b07cea9-7668-5762-ae64-a6de8e6f2076/9b07cea9-7668-5762-ae64-a6de8e6f2076_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 315445,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/571/da32b8aad5154856a6d66666b86300d9/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 Active Pack BlueHDI 81kW (110CV)',
 'transmission': 'manual',
 'trim': 'Active Pack BlueHDI 81kW (110CV)',
 'vin': None,
 'year': 2021}
2026-03-26 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985885%27 HTTP/1.1" 200 None
2026-03-26 18:34:02 [ayvens.es] INFO: Saving data for 1985885: {'created_time': 1774550042.517856, 'last_price_update_time': 1774550042.517867, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985885') HTTP/1.1" 204 0
2026-03-26 18:34:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/925/b22048e835784059b1848f04a56161f8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:02 [ayvens.es] INFO: Found listing with ID: 1985895
2026-03-26 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985895%27 HTTP/1.1" 200 None
2026-03-26 18:34:02 [ayvens.es] INFO: Scrape type for 1985895: 1
2026-03-26 18:34:02 [ayvens.es] INFO: Extracting data for car ID: 1985895
2026-03-26 18:34:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf5a6666-3aa4-5b81-84a4-c00c0ef48956 with identifier: 1985895
2026-03-26 18:34:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf5a6666-3aa4-5b81-84a4-c00c0ef48956 with scrape type 1
2026-03-26 18:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item cf5a6666-3aa4-5b81-84a4-c00c0ef48956
2026-03-26 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F852%252F5e11b4c6be2c433a90923b237b54678b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/852/5e11b4c6be2c433a90923b237b54678b/images/large/1.jpg not downloaded yet
2026-03-26 18:34:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/143/be37ca20c2d048a18cd92a5449cda225/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c9d490>
2026-03-26 18:34:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5072cbae-ade6-5666-905e-a87f2bb70953/5072cbae-ade6-5666-905e-a87f2bb70953_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F861%252F02bbe488dd8c48448135aca290ec3481%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/861/02bbe488dd8c48448135aca290ec3481/images/large/1.jpg saved to cache
2026-03-26 18:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5072cbae-ade6-5666-905e-a87f2bb70953
2026-03-26 18:34:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5072cbae-ade6-5666-905e-a87f2bb70953, skipping ID generation
2026-03-26 18:34:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5072cbae-ade6-5666-905e-a87f2bb70953 with scrape type 1
2026-03-26 18:34:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5072cbae-ade6-5666-905e-a87f2bb70953 sending to next pipeline
2026-03-26 18:34:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5072cbae-ade6-5666-905e-a87f2bb70953, identifier: 1985888
2026-03-26 18:34:02 [ayvens.es] INFO: Found listing with ID: 1985896
2026-03-26 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985896%27 HTTP/1.1" 200 None
2026-03-26 18:34:02 [ayvens.es] INFO: Scrape type for 1985896: 1
2026-03-26 18:34:02 [ayvens.es] INFO: Extracting data for car ID: 1985896
2026-03-26 18:34:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02b1c168-d5ef-5371-b050-860cb5cded97 with identifier: 1985896
2026-03-26 18:34:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02b1c168-d5ef-5371-b050-860cb5cded97 with scrape type 1
2026-03-26 18:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 02b1c168-d5ef-5371-b050-860cb5cded97
2026-03-26 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F416%252Ff386d1046b2f45d28c4f19a9601384a9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/416/f386d1046b2f45d28c4f19a9601384a9/images/large/1.jpg not downloaded yet
2026-03-26 18:34:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5072cbae-ade6-5666-905e-a87f2bb70953 with identifier: 1985888
2026-03-26 18:34:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5072cbae-ade6-5666-905e-a87f2bb70953 with identifier: 1985888
2026-03-26 18:34:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5072cbae-ade6-5666-905e-a87f2bb70953 with identifier: 1985888 to the API
2026-03-26 18:34:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/861/02bbe488dd8c48448135aca290ec3481/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 186,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.3L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '5072cbae-ade6-5666-905e-a87f2bb70953',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'DUCATO',
 'odometer': 70454,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5072cbae-ade6-5666-905e-a87f2bb70953/5072cbae-ade6-5666-905e-a87f2bb70953_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332023,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/861/02bbe488dd8c48448135aca290ec3481/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-31',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FIAT DUCATO 30 L1 H1 2.3 1 (103 kW) Euro 6d-temp',
 'transmission': 'manual',
 'trim': '30 L1 H1 2.3 1 (103 kW) Euro 6d-temp',
 'vin': None,
 'year': 2020}
2026-03-26 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985888%27 HTTP/1.1" 200 None
2026-03-26 18:34:03 [ayvens.es] INFO: Saving data for 1985888: {'created_time': 1774550043.081807, 'last_price_update_time': 1774550043.081821, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985888') HTTP/1.1" 204 0
2026-03-26 18:34:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/849/58781def108c4129a7691061c6474663/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:03 [ayvens.es] INFO: Found listing with ID: 1985897
2026-03-26 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985897%27 HTTP/1.1" 200 None
2026-03-26 18:34:03 [ayvens.es] INFO: Scrape type for 1985897: 1
2026-03-26 18:34:03 [ayvens.es] INFO: Extracting data for car ID: 1985897
2026-03-26 18:34:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d457c791-4a19-5ab0-abee-1b014bf20a5d with identifier: 1985897
2026-03-26 18:34:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d457c791-4a19-5ab0-abee-1b014bf20a5d with scrape type 1
2026-03-26 18:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d457c791-4a19-5ab0-abee-1b014bf20a5d
2026-03-26 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F715%252F007d8fe3e2f74eb0af6cf9cd9c70b8df%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/715/007d8fe3e2f74eb0af6cf9cd9c70b8df/images/large/1.jpg not downloaded yet
2026-03-26 18:34:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a29060350>
2026-03-26 18:34:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8147addc-bec7-521a-b3ab-eb0f163e2c9b/8147addc-bec7-521a-b3ab-eb0f163e2c9b_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F925%252Fb22048e835784059b1848f04a56161f8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/925/b22048e835784059b1848f04a56161f8/images/large/1.jpg saved to cache
2026-03-26 18:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8147addc-bec7-521a-b3ab-eb0f163e2c9b
2026-03-26 18:34:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8147addc-bec7-521a-b3ab-eb0f163e2c9b, skipping ID generation
2026-03-26 18:34:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8147addc-bec7-521a-b3ab-eb0f163e2c9b with scrape type 1
2026-03-26 18:34:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8147addc-bec7-521a-b3ab-eb0f163e2c9b sending to next pipeline
2026-03-26 18:34:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8147addc-bec7-521a-b3ab-eb0f163e2c9b, identifier: 1985887
2026-03-26 18:34:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28fe0e90>
2026-03-26 18:34:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30c06971-7659-5b8c-922e-a02e5753630e/30c06971-7659-5b8c-922e-a02e5753630e_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F143%252Fbe37ca20c2d048a18cd92a5449cda225%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/143/be37ca20c2d048a18cd92a5449cda225/images/large/1.jpg saved to cache
2026-03-26 18:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 30c06971-7659-5b8c-922e-a02e5753630e
2026-03-26 18:34:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 30c06971-7659-5b8c-922e-a02e5753630e, skipping ID generation
2026-03-26 18:34:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30c06971-7659-5b8c-922e-a02e5753630e with scrape type 1
2026-03-26 18:34:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 30c06971-7659-5b8c-922e-a02e5753630e sending to next pipeline
2026-03-26 18:34:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 30c06971-7659-5b8c-922e-a02e5753630e, identifier: 1985889
2026-03-26 18:34:03 [ayvens.es] INFO: Found listing with ID: 1985898
2026-03-26 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985898%27 HTTP/1.1" 200 None
2026-03-26 18:34:03 [ayvens.es] INFO: Scrape type for 1985898: 1
2026-03-26 18:34:03 [ayvens.es] INFO: Extracting data for car ID: 1985898
2026-03-26 18:34:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2d7589b-5c59-5854-9fab-56b61ccf2ab6 with identifier: 1985898
2026-03-26 18:34:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2d7589b-5c59-5854-9fab-56b61ccf2ab6 with scrape type 1
2026-03-26 18:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c2d7589b-5c59-5854-9fab-56b61ccf2ab6
2026-03-26 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F957%252Fc3648b439b1848e991a6030c3b20497e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/957/c3648b439b1848e991a6030c3b20497e/images/large/1.jpg not downloaded yet
2026-03-26 18:34:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8147addc-bec7-521a-b3ab-eb0f163e2c9b with identifier: 1985887
2026-03-26 18:34:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8147addc-bec7-521a-b3ab-eb0f163e2c9b with identifier: 1985887
2026-03-26 18:34:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8147addc-bec7-521a-b3ab-eb0f163e2c9b with identifier: 1985887 to the API
2026-03-26 18:34:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/925/b22048e835784059b1848f04a56161f8/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 94,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '8147addc-bec7-521a-b3ab-eb0f163e2c9b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': 114919,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8147addc-bec7-521a-b3ab-eb0f163e2c9b/8147addc-bec7-521a-b3ab-eb0f163e2c9b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 521643,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/925/b22048e835784059b1848f04a56161f8/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FOCUS (O) 1.5 Ecoblue 88kW Trend+',
 'transmission': 'manual',
 'trim': '(O) 1.5 Ecoblue 88kW Trend+',
 'vin': None,
 'year': 2018}
2026-03-26 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985887%27 HTTP/1.1" 200 None
2026-03-26 18:34:03 [ayvens.es] INFO: Saving data for 1985887: {'created_time': 1774550043.931424, 'last_price_update_time': 1774550043.931434, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985887') HTTP/1.1" 204 0
2026-03-26 18:34:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 30c06971-7659-5b8c-922e-a02e5753630e with identifier: 1985889
2026-03-26 18:34:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 30c06971-7659-5b8c-922e-a02e5753630e with identifier: 1985889
2026-03-26 18:34:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 30c06971-7659-5b8c-922e-a02e5753630e with identifier: 1985889 to the API
2026-03-26 18:34:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/143/be37ca20c2d048a18cd92a5449cda225/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '30c06971-7659-5b8c-922e-a02e5753630e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'BERLINGO',
 'odometer': 69191,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30c06971-7659-5b8c-922e-a02e5753630e/30c06971-7659-5b8c-922e-a02e5753630e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 314443,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/143/be37ca20c2d048a18cd92a5449cda225/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-28',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROËN BERLINGO Talla M BlueHDi 100 CONTROL',
 'transmission': 'manual',
 'trim': 'Talla M BlueHDi 100 CONTROL',
 'vin': None,
 'year': 2021}
2026-03-26 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985889%27 HTTP/1.1" 200 None
2026-03-26 18:34:04 [ayvens.es] INFO: Saving data for 1985889: {'created_time': 1774550044.292328, 'last_price_update_time': 1774550044.29234, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985889') HTTP/1.1" 204 0
2026-03-26 18:34:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/577/9e65461b274f4e9282215f76f21dbfab/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/003/584978d967bd4890ab10ddcd21309ef7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/897/aadc8bf4ebe84cf3aa4706ccee8d485c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:04 [ayvens.es] INFO: Found listing with ID: 1985899
2026-03-26 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985899%27 HTTP/1.1" 200 None
2026-03-26 18:34:04 [ayvens.es] INFO: Scrape type for 1985899: 1
2026-03-26 18:34:04 [ayvens.es] INFO: Extracting data for car ID: 1985899
2026-03-26 18:34:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5805dbb1-36ae-533f-acf6-9705e67c0085 with identifier: 1985899
2026-03-26 18:34:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5805dbb1-36ae-533f-acf6-9705e67c0085 with scrape type 1
2026-03-26 18:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5805dbb1-36ae-533f-acf6-9705e67c0085
2026-03-26 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F207%252Fb03dab0025d149048e92c858012547cb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/207/b03dab0025d149048e92c858012547cb/images/large/1.jpg not downloaded yet
2026-03-26 18:34:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a282fe890>
2026-03-26 18:34:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee3c81e3-fc51-5886-9729-d853fcd6bd4c/ee3c81e3-fc51-5886-9729-d853fcd6bd4c_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F849%252F58781def108c4129a7691061c6474663%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/849/58781def108c4129a7691061c6474663/images/large/1.jpg saved to cache
2026-03-26 18:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ee3c81e3-fc51-5886-9729-d853fcd6bd4c
2026-03-26 18:34:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ee3c81e3-fc51-5886-9729-d853fcd6bd4c, skipping ID generation
2026-03-26 18:34:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee3c81e3-fc51-5886-9729-d853fcd6bd4c with scrape type 1
2026-03-26 18:34:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ee3c81e3-fc51-5886-9729-d853fcd6bd4c sending to next pipeline
2026-03-26 18:34:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ee3c81e3-fc51-5886-9729-d853fcd6bd4c, identifier: 1985892
2026-03-26 18:34:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/644/33d6fe9e447a4b1d9bfab0b68b09e729/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:04 [ayvens.es] INFO: Found listing with ID: 1985900
2026-03-26 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985900%27 HTTP/1.1" 200 None
2026-03-26 18:34:04 [ayvens.es] INFO: Scrape type for 1985900: 1
2026-03-26 18:34:04 [ayvens.es] INFO: Extracting data for car ID: 1985900
2026-03-26 18:34:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7680b0f4-c7d9-521d-bbef-ae422b1d3c50 with identifier: 1985900
2026-03-26 18:34:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7680b0f4-c7d9-521d-bbef-ae422b1d3c50 with scrape type 1
2026-03-26 18:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7680b0f4-c7d9-521d-bbef-ae422b1d3c50
2026-03-26 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F480%252F304a7f51bd514ef99de40f87d58318ce%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/480/304a7f51bd514ef99de40f87d58318ce/images/large/1.jpg not downloaded yet
2026-03-26 18:34:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ee3c81e3-fc51-5886-9729-d853fcd6bd4c with identifier: 1985892
2026-03-26 18:34:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ee3c81e3-fc51-5886-9729-d853fcd6bd4c with identifier: 1985892
2026-03-26 18:34:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ee3c81e3-fc51-5886-9729-d853fcd6bd4c with identifier: 1985892 to the API
2026-03-26 18:34:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/849/58781def108c4129a7691061c6474663/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ee3c81e3-fc51-5886-9729-d853fcd6bd4c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': 194428,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee3c81e3-fc51-5886-9729-d853fcd6bd4c/ee3c81e3-fc51-5886-9729-d853fcd6bd4c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 322863,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/849/58781def108c4129a7691061c6474663/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FOCUS 1.5 Ecoblue 88kW Trend+ SB',
 'transmission': 'manual',
 'trim': '1.5 Ecoblue 88kW Trend+ SB',
 'vin': None,
 'year': 2022}
2026-03-26 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985892%27 HTTP/1.1" 200 None
2026-03-26 18:34:04 [ayvens.es] INFO: Saving data for 1985892: {'created_time': 1774550044.864914, 'last_price_update_time': 1774550044.864925, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985892') HTTP/1.1" 204 0
2026-03-26 18:34:04 [ayvens.es] INFO: Found listing with ID: 1985901
2026-03-26 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985901%27 HTTP/1.1" 200 None
2026-03-26 18:34:04 [ayvens.es] INFO: Scrape type for 1985901: 1
2026-03-26 18:34:04 [ayvens.es] INFO: Extracting data for car ID: 1985901
2026-03-26 18:34:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d128b111-90d0-51d8-93af-ef4ed28ce25b with identifier: 1985901
2026-03-26 18:34:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d128b111-90d0-51d8-93af-ef4ed28ce25b with scrape type 1
2026-03-26 18:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d128b111-90d0-51d8-93af-ef4ed28ce25b
2026-03-26 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F617%252Fb5423ad430a64ccc948f8cb96c10116d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/617/b5423ad430a64ccc948f8cb96c10116d/images/large/1.jpg not downloaded yet
2026-03-26 18:34:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c2b850>
2026-03-26 18:34:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb1224b0-9042-5048-8dc4-36481e7cd881/bb1224b0-9042-5048-8dc4-36481e7cd881_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F577%252F9e65461b274f4e9282215f76f21dbfab%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/577/9e65461b274f4e9282215f76f21dbfab/images/large/1.jpg saved to cache
2026-03-26 18:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bb1224b0-9042-5048-8dc4-36481e7cd881
2026-03-26 18:34:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bb1224b0-9042-5048-8dc4-36481e7cd881, skipping ID generation
2026-03-26 18:34:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb1224b0-9042-5048-8dc4-36481e7cd881 with scrape type 1
2026-03-26 18:34:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bb1224b0-9042-5048-8dc4-36481e7cd881 sending to next pipeline
2026-03-26 18:34:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: bb1224b0-9042-5048-8dc4-36481e7cd881, identifier: 1985890
2026-03-26 18:34:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28e55d90>
2026-03-26 18:34:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a626683d-45c3-5607-9e6b-bf2e46ec570b/a626683d-45c3-5607-9e6b-bf2e46ec570b_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F003%252F584978d967bd4890ab10ddcd21309ef7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/003/584978d967bd4890ab10ddcd21309ef7/images/large/1.jpg saved to cache
2026-03-26 18:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a626683d-45c3-5607-9e6b-bf2e46ec570b
2026-03-26 18:34:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a626683d-45c3-5607-9e6b-bf2e46ec570b, skipping ID generation
2026-03-26 18:34:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a626683d-45c3-5607-9e6b-bf2e46ec570b with scrape type 1
2026-03-26 18:34:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a626683d-45c3-5607-9e6b-bf2e46ec570b sending to next pipeline
2026-03-26 18:34:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a626683d-45c3-5607-9e6b-bf2e46ec570b, identifier: 1985891
2026-03-26 18:34:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a2834ba10>
2026-03-26 18:34:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c19dd324-8bee-5942-87d5-18e91c7b1d2a/c19dd324-8bee-5942-87d5-18e91c7b1d2a_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F897%252Faadc8bf4ebe84cf3aa4706ccee8d485c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/897/aadc8bf4ebe84cf3aa4706ccee8d485c/images/large/1.jpg saved to cache
2026-03-26 18:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c19dd324-8bee-5942-87d5-18e91c7b1d2a
2026-03-26 18:34:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c19dd324-8bee-5942-87d5-18e91c7b1d2a, skipping ID generation
2026-03-26 18:34:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c19dd324-8bee-5942-87d5-18e91c7b1d2a with scrape type 1
2026-03-26 18:34:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c19dd324-8bee-5942-87d5-18e91c7b1d2a sending to next pipeline
2026-03-26 18:34:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c19dd324-8bee-5942-87d5-18e91c7b1d2a, identifier: 1985894
2026-03-26 18:34:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a290a6510>
2026-03-26 18:34:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03e40df3-5443-5ef6-9843-b50577a5d091/03e40df3-5443-5ef6-9843-b50577a5d091_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F644%252F33d6fe9e447a4b1d9bfab0b68b09e729%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/644/33d6fe9e447a4b1d9bfab0b68b09e729/images/large/1.jpg saved to cache
2026-03-26 18:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 03e40df3-5443-5ef6-9843-b50577a5d091
2026-03-26 18:34:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 03e40df3-5443-5ef6-9843-b50577a5d091, skipping ID generation
2026-03-26 18:34:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03e40df3-5443-5ef6-9843-b50577a5d091 with scrape type 1
2026-03-26 18:34:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 03e40df3-5443-5ef6-9843-b50577a5d091 sending to next pipeline
2026-03-26 18:34:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 03e40df3-5443-5ef6-9843-b50577a5d091, identifier: 1985893
2026-03-26 18:34:05 [ayvens.es] INFO: Found listing with ID: 1985902
2026-03-26 18:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985902%27 HTTP/1.1" 200 None
2026-03-26 18:34:05 [ayvens.es] INFO: Scrape type for 1985902: 1
2026-03-26 18:34:05 [ayvens.es] INFO: Extracting data for car ID: 1985902
2026-03-26 18:34:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c32065ef-0148-59a5-9c8c-f66f98e3df5c with identifier: 1985902
2026-03-26 18:34:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c32065ef-0148-59a5-9c8c-f66f98e3df5c with scrape type 1
2026-03-26 18:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c32065ef-0148-59a5-9c8c-f66f98e3df5c
2026-03-26 18:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F974%252Ffa62559cc6524f1b8a240b7d528eef80%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/974/fa62559cc6524f1b8a240b7d528eef80/images/large/1.jpg not downloaded yet
2026-03-26 18:34:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: bb1224b0-9042-5048-8dc4-36481e7cd881 with identifier: 1985890
2026-03-26 18:34:05 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:34:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: bb1224b0-9042-5048-8dc4-36481e7cd881 with identifier: 1985890
2026-03-26 18:34:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: bb1224b0-9042-5048-8dc4-36481e7cd881 with identifier: 1985890 to the API
2026-03-26 18:34:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/577/9e65461b274f4e9282215f76f21dbfab/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'Azul metalizado',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'bb1224b0-9042-5048-8dc4-36481e7cd881',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'MONDEO',
 'odometer': 153216,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb1224b0-9042-5048-8dc4-36481e7cd881/bb1224b0-9042-5048-8dc4-36481e7cd881_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672085,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/577/9e65461b274f4e9282215f76f21dbfab/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD MONDEO 2.0 TDCi 88kW (120CV) Trend',
 'transmission': 'manual',
 'trim': '2.0 TDCi 88kW (120CV) Trend',
 'vin': None,
 'year': 2021}
2026-03-26 18:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985890%27 HTTP/1.1" 200 None
2026-03-26 18:34:05 [ayvens.es] INFO: Saving data for 1985890: {'created_time': 1774550045.980672, 'last_price_update_time': 1774550045.980683, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985890') HTTP/1.1" 204 0
2026-03-26 18:34:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a626683d-45c3-5607-9e6b-bf2e46ec570b with identifier: 1985891
2026-03-26 18:34:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a626683d-45c3-5607-9e6b-bf2e46ec570b with identifier: 1985891
2026-03-26 18:34:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a626683d-45c3-5607-9e6b-bf2e46ec570b with identifier: 1985891 to the API
2026-03-26 18:34:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/003/584978d967bd4890ab10ddcd21309ef7/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a626683d-45c3-5607-9e6b-bf2e46ec570b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '208',
 'odometer': 92039,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a626683d-45c3-5607-9e6b-bf2e46ec570b/a626683d-45c3-5607-9e6b-bf2e46ec570b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 463391,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/003/584978d967bd4890ab10ddcd21309ef7/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 208 BlueHDi 73kW (100CV) Active',
 'transmission': 'manual',
 'trim': 'BlueHDi 73kW (100CV) Active',
 'vin': None,
 'year': 2022}
2026-03-26 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985891%27 HTTP/1.1" 200 None
2026-03-26 18:34:06 [ayvens.es] INFO: Saving data for 1985891: {'created_time': 1774550046.296226, 'last_price_update_time': 1774550046.296236, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985891') HTTP/1.1" 204 0
2026-03-26 18:34:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c19dd324-8bee-5942-87d5-18e91c7b1d2a with identifier: 1985894
2026-03-26 18:34:06 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:34:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c19dd324-8bee-5942-87d5-18e91c7b1d2a with identifier: 1985894
2026-03-26 18:34:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c19dd324-8bee-5942-87d5-18e91c7b1d2a with identifier: 1985894 to the API
2026-03-26 18:34:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/897/aadc8bf4ebe84cf3aa4706ccee8d485c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'Alpinwei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c19dd324-8bee-5942-87d5-18e91c7b1d2a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'SERIES 3',
 'odometer': 161466,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c19dd324-8bee-5942-87d5-18e91c7b1d2a/c19dd324-8bee-5942-87d5-18e91c7b1d2a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 300947,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/897/aadc8bf4ebe84cf3aa4706ccee8d485c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW SERIES 3 318d Auto.Touring',
 'transmission': 'manual',
 'trim': '318d Auto.Touring',
 'vin': None,
 'year': 2021}
2026-03-26 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985894%27 HTTP/1.1" 200 None
2026-03-26 18:34:06 [ayvens.es] INFO: Saving data for 1985894: {'created_time': 1774550046.663154, 'last_price_update_time': 1774550046.663165, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985894') HTTP/1.1" 204 0
2026-03-26 18:34:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 03e40df3-5443-5ef6-9843-b50577a5d091 with identifier: 1985893
2026-03-26 18:34:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 03e40df3-5443-5ef6-9843-b50577a5d091 with identifier: 1985893
2026-03-26 18:34:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 03e40df3-5443-5ef6-9843-b50577a5d091 with identifier: 1985893 to the API
2026-03-26 18:34:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/644/33d6fe9e447a4b1d9bfab0b68b09e729/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '03e40df3-5443-5ef6-9843-b50577a5d091',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FIESTA',
 'odometer': 65489,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03e40df3-5443-5ef6-9843-b50577a5d091/03e40df3-5443-5ef6-9843-b50577a5d091_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 494854,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/644/33d6fe9e447a4b1d9bfab0b68b09e729/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FIESTA 1.0 EcoBoost 74kW Trend S/S 5p',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost 74kW Trend S/S 5p',
 'vin': None,
 'year': 2019}
2026-03-26 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985893%27 HTTP/1.1" 200 None
2026-03-26 18:34:06 [ayvens.es] INFO: Saving data for 1985893: {'created_time': 1774550046.979354, 'last_price_update_time': 1774550046.979365, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985893') HTTP/1.1" 204 0
2026-03-26 18:34:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/852/5e11b4c6be2c433a90923b237b54678b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:07 [scrapy.extensions.logstats] INFO: Crawled 6 pages (at -1 pages/min), scraped 351 items (at 101 items/min)
2026-03-26 18:34:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 177MiB
2026-03-26 18:34:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/416/f386d1046b2f45d28c4f19a9601384a9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/715/007d8fe3e2f74eb0af6cf9cd9c70b8df/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:07 [ayvens.es] INFO: Found listing with ID: 1985903
2026-03-26 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985903%27 HTTP/1.1" 200 None
2026-03-26 18:34:07 [ayvens.es] INFO: Scrape type for 1985903: 1
2026-03-26 18:34:07 [ayvens.es] INFO: Extracting data for car ID: 1985903
2026-03-26 18:34:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ab48da2-55b9-552e-9161-f55cd445adbc with identifier: 1985903
2026-03-26 18:34:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ab48da2-55b9-552e-9161-f55cd445adbc with scrape type 1
2026-03-26 18:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0ab48da2-55b9-552e-9161-f55cd445adbc
2026-03-26 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F814%252Fa549c32d235f481c8fbc630657d07a4c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/814/a549c32d235f481c8fbc630657d07a4c/images/large/1.jpg not downloaded yet
2026-03-26 18:34:07 [ayvens.es] INFO: Found listing with ID: 1985904
2026-03-26 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985904%27 HTTP/1.1" 200 None
2026-03-26 18:34:07 [ayvens.es] INFO: Scrape type for 1985904: 1
2026-03-26 18:34:07 [ayvens.es] INFO: Extracting data for car ID: 1985904
2026-03-26 18:34:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 835e987b-8d3c-5524-8046-e0e3a3f0c1ec with identifier: 1985904
2026-03-26 18:34:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 835e987b-8d3c-5524-8046-e0e3a3f0c1ec with scrape type 1
2026-03-26 18:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 835e987b-8d3c-5524-8046-e0e3a3f0c1ec
2026-03-26 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F248%252F3f334ea91a9e4ce5854a790890b892d6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/248/3f334ea91a9e4ce5854a790890b892d6/images/large/1.jpg not downloaded yet
2026-03-26 18:34:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/957/c3648b439b1848e991a6030c3b20497e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:07 [ayvens.es] INFO: Found listing with ID: 1985905
2026-03-26 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985905%27 HTTP/1.1" 200 None
2026-03-26 18:34:07 [ayvens.es] INFO: Scrape type for 1985905: 1
2026-03-26 18:34:07 [ayvens.es] INFO: Extracting data for car ID: 1985905
2026-03-26 18:34:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1351f9f3-1625-57dd-a64c-26440609e93c with identifier: 1985905
2026-03-26 18:34:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1351f9f3-1625-57dd-a64c-26440609e93c with scrape type 1
2026-03-26 18:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1351f9f3-1625-57dd-a64c-26440609e93c
2026-03-26 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F340%252Fbc79ab91491d446e980e1cab35ae2102%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/340/bc79ab91491d446e980e1cab35ae2102/images/large/1.jpg not downloaded yet
2026-03-26 18:34:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/207/b03dab0025d149048e92c858012547cb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:07 [ayvens.es] INFO: Found listing with ID: 1985906
2026-03-26 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985906%27 HTTP/1.1" 200 None
2026-03-26 18:34:07 [ayvens.es] INFO: Scrape type for 1985906: 1
2026-03-26 18:34:07 [ayvens.es] INFO: Extracting data for car ID: 1985906
2026-03-26 18:34:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 459e4fa4-66e8-591a-810a-17d36032e397 with identifier: 1985906
2026-03-26 18:34:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 459e4fa4-66e8-591a-810a-17d36032e397 with scrape type 1
2026-03-26 18:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 459e4fa4-66e8-591a-810a-17d36032e397
2026-03-26 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F161%252F7f4078ac874a48ae88b068bb06b8527d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/161/7f4078ac874a48ae88b068bb06b8527d/images/large/1.jpg not downloaded yet
2026-03-26 18:34:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28dbe350>
2026-03-26 18:34:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf5a6666-3aa4-5b81-84a4-c00c0ef48956/cf5a6666-3aa4-5b81-84a4-c00c0ef48956_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F852%252F5e11b4c6be2c433a90923b237b54678b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/852/5e11b4c6be2c433a90923b237b54678b/images/large/1.jpg saved to cache
2026-03-26 18:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cf5a6666-3aa4-5b81-84a4-c00c0ef48956
2026-03-26 18:34:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cf5a6666-3aa4-5b81-84a4-c00c0ef48956, skipping ID generation
2026-03-26 18:34:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf5a6666-3aa4-5b81-84a4-c00c0ef48956 with scrape type 1
2026-03-26 18:34:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cf5a6666-3aa4-5b81-84a4-c00c0ef48956 sending to next pipeline
2026-03-26 18:34:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: cf5a6666-3aa4-5b81-84a4-c00c0ef48956, identifier: 1985895
2026-03-26 18:34:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a2833ca10>
2026-03-26 18:34:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02b1c168-d5ef-5371-b050-860cb5cded97/02b1c168-d5ef-5371-b050-860cb5cded97_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F416%252Ff386d1046b2f45d28c4f19a9601384a9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/416/f386d1046b2f45d28c4f19a9601384a9/images/large/1.jpg saved to cache
2026-03-26 18:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 02b1c168-d5ef-5371-b050-860cb5cded97
2026-03-26 18:34:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 02b1c168-d5ef-5371-b050-860cb5cded97, skipping ID generation
2026-03-26 18:34:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02b1c168-d5ef-5371-b050-860cb5cded97 with scrape type 1
2026-03-26 18:34:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 02b1c168-d5ef-5371-b050-860cb5cded97 sending to next pipeline
2026-03-26 18:34:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 02b1c168-d5ef-5371-b050-860cb5cded97, identifier: 1985896
2026-03-26 18:34:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28207b10>
2026-03-26 18:34:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d457c791-4a19-5ab0-abee-1b014bf20a5d/d457c791-4a19-5ab0-abee-1b014bf20a5d_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F715%252F007d8fe3e2f74eb0af6cf9cd9c70b8df%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/715/007d8fe3e2f74eb0af6cf9cd9c70b8df/images/large/1.jpg saved to cache
2026-03-26 18:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d457c791-4a19-5ab0-abee-1b014bf20a5d
2026-03-26 18:34:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d457c791-4a19-5ab0-abee-1b014bf20a5d, skipping ID generation
2026-03-26 18:34:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d457c791-4a19-5ab0-abee-1b014bf20a5d with scrape type 1
2026-03-26 18:34:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d457c791-4a19-5ab0-abee-1b014bf20a5d sending to next pipeline
2026-03-26 18:34:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d457c791-4a19-5ab0-abee-1b014bf20a5d, identifier: 1985897
2026-03-26 18:34:07 [ayvens.es] INFO: Found listing with ID: 1985907
2026-03-26 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985907%27 HTTP/1.1" 200 None
2026-03-26 18:34:07 [ayvens.es] INFO: Scrape type for 1985907: 1
2026-03-26 18:34:07 [ayvens.es] INFO: Extracting data for car ID: 1985907
2026-03-26 18:34:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcc18d9c-bf22-5a04-a812-8edd748e82f5 with identifier: 1985907
2026-03-26 18:34:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcc18d9c-bf22-5a04-a812-8edd748e82f5 with scrape type 1
2026-03-26 18:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item fcc18d9c-bf22-5a04-a812-8edd748e82f5
2026-03-26 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F637%252Faa54c92a9296484f8e35248e16a095b6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/637/aa54c92a9296484f8e35248e16a095b6/images/large/1.jpg not downloaded yet
2026-03-26 18:34:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: cf5a6666-3aa4-5b81-84a4-c00c0ef48956 with identifier: 1985895
2026-03-26 18:34:07 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:34:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: cf5a6666-3aa4-5b81-84a4-c00c0ef48956 with identifier: 1985895
2026-03-26 18:34:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: cf5a6666-3aa4-5b81-84a4-c00c0ef48956 with identifier: 1985895 to the API
2026-03-26 18:34:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/852/5e11b4c6be2c433a90923b237b54678b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Mineralgrau',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'cf5a6666-3aa4-5b81-84a4-c00c0ef48956',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 144606,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf5a6666-3aa4-5b81-84a4-c00c0ef48956/cf5a6666-3aa4-5b81-84a4-c00c0ef48956_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 554677,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/852/5e11b4c6be2c433a90923b237b54678b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 sDrive18d',
 'transmission': 'manual',
 'trim': 'sDrive18d',
 'vin': None,
 'year': 2022}
2026-03-26 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985895%27 HTTP/1.1" 200 None
2026-03-26 18:34:07 [ayvens.es] INFO: Saving data for 1985895: {'created_time': 1774550047.964143, 'last_price_update_time': 1774550047.964153, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985895') HTTP/1.1" 204 0
2026-03-26 18:34:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 02b1c168-d5ef-5371-b050-860cb5cded97 with identifier: 1985896
2026-03-26 18:34:08 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:34:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 02b1c168-d5ef-5371-b050-860cb5cded97 with identifier: 1985896
2026-03-26 18:34:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 02b1c168-d5ef-5371-b050-860cb5cded97 with identifier: 1985896 to the API
2026-03-26 18:34:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/416/f386d1046b2f45d28c4f19a9601384a9/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 169,
 'color': 'Plata florete metal',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '02b1c168-d5ef-5371-b050-860cb5cded97',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q5 SPORTBACK',
 'odometer': 75562,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02b1c168-d5ef-5371-b050-860cb5cded97/02b1c168-d5ef-5371-b050-860cb5cded97_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 551269,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/416/f386d1046b2f45d28c4f19a9601384a9/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q5 SPORTBACK S line 40 TDI 150kW quattro-ultra',
 'transmission': 'manual',
 'trim': 'S line 40 TDI 150kW quattro-ultra',
 'vin': None,
 'year': 2022}
2026-03-26 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985896%27 HTTP/1.1" 200 None
2026-03-26 18:34:08 [ayvens.es] INFO: Saving data for 1985896: {'created_time': 1774550048.353911, 'last_price_update_time': 1774550048.353922, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985896') HTTP/1.1" 204 0
2026-03-26 18:34:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d457c791-4a19-5ab0-abee-1b014bf20a5d with identifier: 1985897
2026-03-26 18:34:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d457c791-4a19-5ab0-abee-1b014bf20a5d with identifier: 1985897
2026-03-26 18:34:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d457c791-4a19-5ab0-abee-1b014bf20a5d with identifier: 1985897 to the API
2026-03-26 18:34:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/715/007d8fe3e2f74eb0af6cf9cd9c70b8df/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd457c791-4a19-5ab0-abee-1b014bf20a5d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'COMBO',
 'odometer': 99839,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d457c791-4a19-5ab0-abee-1b014bf20a5d/d457c791-4a19-5ab0-abee-1b014bf20a5d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 369076,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/715/007d8fe3e2f74eb0af6cf9cd9c70b8df/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL COMBO 1.5 TD 75kW Business Edition Plus L1 N1',
 'transmission': 'manual',
 'trim': '1.5 TD 75kW Business Edition Plus L1 N1',
 'vin': None,
 'year': 2022}
2026-03-26 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985897%27 HTTP/1.1" 200 None
2026-03-26 18:34:08 [ayvens.es] INFO: Saving data for 1985897: {'created_time': 1774550048.694359, 'last_price_update_time': 1774550048.69437, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985897') HTTP/1.1" 204 0
2026-03-26 18:34:08 [ayvens.es] INFO: Found listing with ID: 1985908
2026-03-26 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985908%27 HTTP/1.1" 200 None
2026-03-26 18:34:08 [ayvens.es] INFO: Scrape type for 1985908: 1
2026-03-26 18:34:08 [ayvens.es] INFO: Extracting data for car ID: 1985908
2026-03-26 18:34:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b1d3df5-30f4-5c21-9480-9a35ab537eb9 with identifier: 1985908
2026-03-26 18:34:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b1d3df5-30f4-5c21-9480-9a35ab537eb9 with scrape type 1
2026-03-26 18:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3b1d3df5-30f4-5c21-9480-9a35ab537eb9
2026-03-26 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F846%252Fa7de499fe08e413395117cf2a7962e99%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/846/a7de499fe08e413395117cf2a7962e99/images/large/1.jpg not downloaded yet
2026-03-26 18:34:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/617/b5423ad430a64ccc948f8cb96c10116d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28349fd0>
2026-03-26 18:34:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2d7589b-5c59-5854-9fab-56b61ccf2ab6/c2d7589b-5c59-5854-9fab-56b61ccf2ab6_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F957%252Fc3648b439b1848e991a6030c3b20497e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/957/c3648b439b1848e991a6030c3b20497e/images/large/1.jpg saved to cache
2026-03-26 18:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c2d7589b-5c59-5854-9fab-56b61ccf2ab6
2026-03-26 18:34:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c2d7589b-5c59-5854-9fab-56b61ccf2ab6, skipping ID generation
2026-03-26 18:34:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2d7589b-5c59-5854-9fab-56b61ccf2ab6 with scrape type 1
2026-03-26 18:34:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c2d7589b-5c59-5854-9fab-56b61ccf2ab6 sending to next pipeline
2026-03-26 18:34:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c2d7589b-5c59-5854-9fab-56b61ccf2ab6, identifier: 1985898
2026-03-26 18:34:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a283d3910>
2026-03-26 18:34:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5805dbb1-36ae-533f-acf6-9705e67c0085/5805dbb1-36ae-533f-acf6-9705e67c0085_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F207%252Fb03dab0025d149048e92c858012547cb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/207/b03dab0025d149048e92c858012547cb/images/large/1.jpg saved to cache
2026-03-26 18:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5805dbb1-36ae-533f-acf6-9705e67c0085
2026-03-26 18:34:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5805dbb1-36ae-533f-acf6-9705e67c0085, skipping ID generation
2026-03-26 18:34:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5805dbb1-36ae-533f-acf6-9705e67c0085 with scrape type 1
2026-03-26 18:34:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5805dbb1-36ae-533f-acf6-9705e67c0085 sending to next pipeline
2026-03-26 18:34:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5805dbb1-36ae-533f-acf6-9705e67c0085, identifier: 1985899
2026-03-26 18:34:09 [ayvens.es] INFO: Found listing with ID: 1985909
2026-03-26 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985909%27 HTTP/1.1" 200 None
2026-03-26 18:34:09 [ayvens.es] INFO: Scrape type for 1985909: 1
2026-03-26 18:34:09 [ayvens.es] INFO: Extracting data for car ID: 1985909
2026-03-26 18:34:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 522de01c-9f6e-5ea6-836b-f6c709015944 with identifier: 1985909
2026-03-26 18:34:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 522de01c-9f6e-5ea6-836b-f6c709015944 with scrape type 1
2026-03-26 18:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 522de01c-9f6e-5ea6-836b-f6c709015944
2026-03-26 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F639%252F46b72efdbd054c5a81ced6b7089fb786%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/639/46b72efdbd054c5a81ced6b7089fb786/images/large/1.jpg not downloaded yet
2026-03-26 18:34:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c2d7589b-5c59-5854-9fab-56b61ccf2ab6 with identifier: 1985898
2026-03-26 18:34:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c2d7589b-5c59-5854-9fab-56b61ccf2ab6 with identifier: 1985898
2026-03-26 18:34:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c2d7589b-5c59-5854-9fab-56b61ccf2ab6 with identifier: 1985898 to the API
2026-03-26 18:34:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/957/c3648b439b1848e991a6030c3b20497e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'Blanco glaciar',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c2d7589b-5c59-5854-9fab-56b61ccf2ab6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'DACIA',
 'model': 'DUSTER',
 'odometer': 28570,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2d7589b-5c59-5854-9fab-56b61ccf2ab6/c2d7589b-5c59-5854-9fab-56b61ccf2ab6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353913,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/957/c3648b439b1848e991a6030c3b20497e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DACIA DUSTER Comfort Blue dCi 85kW (115CV) 4X4',
 'transmission': 'manual',
 'trim': 'Comfort Blue dCi 85kW (115CV) 4X4',
 'vin': None,
 'year': 2022}
2026-03-26 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985898%27 HTTP/1.1" 200 None
2026-03-26 18:34:09 [ayvens.es] INFO: Saving data for 1985898: {'created_time': 1774550049.446302, 'last_price_update_time': 1774550049.446317, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985898') HTTP/1.1" 204 0
2026-03-26 18:34:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5805dbb1-36ae-533f-acf6-9705e67c0085 with identifier: 1985899
2026-03-26 18:34:09 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:34:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5805dbb1-36ae-533f-acf6-9705e67c0085 with identifier: 1985899
2026-03-26 18:34:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5805dbb1-36ae-533f-acf6-9705e67c0085 with identifier: 1985899 to the API
2026-03-26 18:34:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/207/b03dab0025d149048e92c858012547cb/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'Yulong white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '5805dbb1-36ae-533f-acf6-9705e67c0085',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER EVOQUE',
 'odometer': 50060,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5805dbb1-36ae-533f-acf6-9705e67c0085/5805dbb1-36ae-533f-acf6-9705e67c0085_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 513851,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/207/b03dab0025d149048e92c858012547cb/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER RANGE ROVER EVOQUE 2.0 D163 AUTO 4WD MHEV',
 'transmission': 'manual',
 'trim': '2.0 D163 AUTO 4WD MHEV',
 'vin': None,
 'year': 2020}
2026-03-26 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985899%27 HTTP/1.1" 200 None
2026-03-26 18:34:10 [ayvens.es] INFO: Saving data for 1985899: {'created_time': 1774550050.542667, 'last_price_update_time': 1774550050.542677, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985899') HTTP/1.1" 204 0
2026-03-26 18:34:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/480/304a7f51bd514ef99de40f87d58318ce/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/974/fa62559cc6524f1b8a240b7d528eef80/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/814/a549c32d235f481c8fbc630657d07a4c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:10 [ayvens.es] INFO: Found listing with ID: 1985910
2026-03-26 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985910%27 HTTP/1.1" 200 None
2026-03-26 18:34:10 [ayvens.es] INFO: Scrape type for 1985910: 1
2026-03-26 18:34:10 [ayvens.es] INFO: Extracting data for car ID: 1985910
2026-03-26 18:34:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96003dbb-e8cb-5cec-a3f3-2fa041572201 with identifier: 1985910
2026-03-26 18:34:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96003dbb-e8cb-5cec-a3f3-2fa041572201 with scrape type 1
2026-03-26 18:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 96003dbb-e8cb-5cec-a3f3-2fa041572201
2026-03-26 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F384%252F9d9eccf31e104860906728b30c3a1ae7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/384/9d9eccf31e104860906728b30c3a1ae7/images/large/1.jpg not downloaded yet
2026-03-26 18:34:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/340/bc79ab91491d446e980e1cab35ae2102/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28f83d90>
2026-03-26 18:34:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d128b111-90d0-51d8-93af-ef4ed28ce25b/d128b111-90d0-51d8-93af-ef4ed28ce25b_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F617%252Fb5423ad430a64ccc948f8cb96c10116d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/617/b5423ad430a64ccc948f8cb96c10116d/images/large/1.jpg saved to cache
2026-03-26 18:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d128b111-90d0-51d8-93af-ef4ed28ce25b
2026-03-26 18:34:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d128b111-90d0-51d8-93af-ef4ed28ce25b, skipping ID generation
2026-03-26 18:34:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d128b111-90d0-51d8-93af-ef4ed28ce25b with scrape type 1
2026-03-26 18:34:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d128b111-90d0-51d8-93af-ef4ed28ce25b sending to next pipeline
2026-03-26 18:34:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d128b111-90d0-51d8-93af-ef4ed28ce25b, identifier: 1985901
2026-03-26 18:34:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/248/3f334ea91a9e4ce5854a790890b892d6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:10 [ayvens.es] INFO: Found listing with ID: 1985911
2026-03-26 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985911%27 HTTP/1.1" 200 None
2026-03-26 18:34:10 [ayvens.es] INFO: Scrape type for 1985911: 1
2026-03-26 18:34:10 [ayvens.es] INFO: Extracting data for car ID: 1985911
2026-03-26 18:34:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 698dbb5d-f54b-5cb7-b116-fae9b838cb82 with identifier: 1985911
2026-03-26 18:34:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 698dbb5d-f54b-5cb7-b116-fae9b838cb82 with scrape type 1
2026-03-26 18:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 698dbb5d-f54b-5cb7-b116-fae9b838cb82
2026-03-26 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F718%252F5fae8876e25d45b1b5f5de12a85cad9b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/718/5fae8876e25d45b1b5f5de12a85cad9b/images/large/1.jpg not downloaded yet
2026-03-26 18:34:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d128b111-90d0-51d8-93af-ef4ed28ce25b with identifier: 1985901
2026-03-26 18:34:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d128b111-90d0-51d8-93af-ef4ed28ce25b with identifier: 1985901
2026-03-26 18:34:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d128b111-90d0-51d8-93af-ef4ed28ce25b with identifier: 1985901 to the API
2026-03-26 18:34:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/617/b5423ad430a64ccc948f8cb96c10116d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Gris platinum',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd128b111-90d0-51d8-93af-ef4ed28ce25b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 95506,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d128b111-90d0-51d8-93af-ef4ed28ce25b/d128b111-90d0-51d8-93af-ef4ed28ce25b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 346782,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/617/b5423ad430a64ccc948f8cb96c10116d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.5 BlueHDi 96kW (130CV) S&S Active Pack',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi 96kW (130CV) S&S Active Pack',
 'vin': None,
 'year': 2022}
2026-03-26 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985901%27 HTTP/1.1" 200 None
2026-03-26 18:34:11 [ayvens.es] INFO: Saving data for 1985901: {'created_time': 1774550051.219899, 'last_price_update_time': 1774550051.219909, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985901') HTTP/1.1" 204 0
2026-03-26 18:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/161/7f4078ac874a48ae88b068bb06b8527d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:11 [ayvens.es] INFO: Found listing with ID: 1985912
2026-03-26 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985912%27 HTTP/1.1" 200 None
2026-03-26 18:34:11 [ayvens.es] INFO: Scrape type for 1985912: 1
2026-03-26 18:34:11 [ayvens.es] INFO: Extracting data for car ID: 1985912
2026-03-26 18:34:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec878e9c-1b40-5110-b31c-f4595fbc03ba with identifier: 1985912
2026-03-26 18:34:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec878e9c-1b40-5110-b31c-f4595fbc03ba with scrape type 1
2026-03-26 18:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ec878e9c-1b40-5110-b31c-f4595fbc03ba
2026-03-26 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F995%252F0a39553d432743419c080e22a546bd3f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/995/0a39553d432743419c080e22a546bd3f/images/large/1.jpg not downloaded yet
2026-03-26 18:34:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28328d90>
2026-03-26 18:34:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7680b0f4-c7d9-521d-bbef-ae422b1d3c50/7680b0f4-c7d9-521d-bbef-ae422b1d3c50_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F480%252F304a7f51bd514ef99de40f87d58318ce%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/480/304a7f51bd514ef99de40f87d58318ce/images/large/1.jpg saved to cache
2026-03-26 18:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7680b0f4-c7d9-521d-bbef-ae422b1d3c50
2026-03-26 18:34:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7680b0f4-c7d9-521d-bbef-ae422b1d3c50, skipping ID generation
2026-03-26 18:34:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7680b0f4-c7d9-521d-bbef-ae422b1d3c50 with scrape type 1
2026-03-26 18:34:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7680b0f4-c7d9-521d-bbef-ae422b1d3c50 sending to next pipeline
2026-03-26 18:34:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7680b0f4-c7d9-521d-bbef-ae422b1d3c50, identifier: 1985900
2026-03-26 18:34:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28e6f010>
2026-03-26 18:34:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c32065ef-0148-59a5-9c8c-f66f98e3df5c/c32065ef-0148-59a5-9c8c-f66f98e3df5c_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F974%252Ffa62559cc6524f1b8a240b7d528eef80%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/974/fa62559cc6524f1b8a240b7d528eef80/images/large/1.jpg saved to cache
2026-03-26 18:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c32065ef-0148-59a5-9c8c-f66f98e3df5c
2026-03-26 18:34:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c32065ef-0148-59a5-9c8c-f66f98e3df5c, skipping ID generation
2026-03-26 18:34:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c32065ef-0148-59a5-9c8c-f66f98e3df5c with scrape type 1
2026-03-26 18:34:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c32065ef-0148-59a5-9c8c-f66f98e3df5c sending to next pipeline
2026-03-26 18:34:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c32065ef-0148-59a5-9c8c-f66f98e3df5c, identifier: 1985902
2026-03-26 18:34:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28328590>
2026-03-26 18:34:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ab48da2-55b9-552e-9161-f55cd445adbc/0ab48da2-55b9-552e-9161-f55cd445adbc_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F814%252Fa549c32d235f481c8fbc630657d07a4c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/814/a549c32d235f481c8fbc630657d07a4c/images/large/1.jpg saved to cache
2026-03-26 18:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0ab48da2-55b9-552e-9161-f55cd445adbc
2026-03-26 18:34:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0ab48da2-55b9-552e-9161-f55cd445adbc, skipping ID generation
2026-03-26 18:34:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ab48da2-55b9-552e-9161-f55cd445adbc with scrape type 1
2026-03-26 18:34:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0ab48da2-55b9-552e-9161-f55cd445adbc sending to next pipeline
2026-03-26 18:34:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0ab48da2-55b9-552e-9161-f55cd445adbc, identifier: 1985903
2026-03-26 18:34:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a283cb490>
2026-03-26 18:34:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1351f9f3-1625-57dd-a64c-26440609e93c/1351f9f3-1625-57dd-a64c-26440609e93c_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F340%252Fbc79ab91491d446e980e1cab35ae2102%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/340/bc79ab91491d446e980e1cab35ae2102/images/large/1.jpg saved to cache
2026-03-26 18:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1351f9f3-1625-57dd-a64c-26440609e93c
2026-03-26 18:34:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1351f9f3-1625-57dd-a64c-26440609e93c, skipping ID generation
2026-03-26 18:34:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1351f9f3-1625-57dd-a64c-26440609e93c with scrape type 1
2026-03-26 18:34:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1351f9f3-1625-57dd-a64c-26440609e93c sending to next pipeline
2026-03-26 18:34:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1351f9f3-1625-57dd-a64c-26440609e93c, identifier: 1985905
2026-03-26 18:34:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a283cb5d0>
2026-03-26 18:34:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_835e987b-8d3c-5524-8046-e0e3a3f0c1ec/835e987b-8d3c-5524-8046-e0e3a3f0c1ec_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F248%252F3f334ea91a9e4ce5854a790890b892d6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/248/3f334ea91a9e4ce5854a790890b892d6/images/large/1.jpg saved to cache
2026-03-26 18:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 835e987b-8d3c-5524-8046-e0e3a3f0c1ec
2026-03-26 18:34:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 835e987b-8d3c-5524-8046-e0e3a3f0c1ec, skipping ID generation
2026-03-26 18:34:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 835e987b-8d3c-5524-8046-e0e3a3f0c1ec with scrape type 1
2026-03-26 18:34:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 835e987b-8d3c-5524-8046-e0e3a3f0c1ec sending to next pipeline
2026-03-26 18:34:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 835e987b-8d3c-5524-8046-e0e3a3f0c1ec, identifier: 1985904
2026-03-26 18:34:12 [ayvens.es] INFO: Found listing with ID: 1985913
2026-03-26 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985913%27 HTTP/1.1" 200 None
2026-03-26 18:34:12 [ayvens.es] INFO: Scrape type for 1985913: 1
2026-03-26 18:34:12 [ayvens.es] INFO: Extracting data for car ID: 1985913
2026-03-26 18:34:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 649fbe8c-25f4-5a63-91f5-82c1415d5c8a with identifier: 1985913
2026-03-26 18:34:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 649fbe8c-25f4-5a63-91f5-82c1415d5c8a with scrape type 1
2026-03-26 18:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 649fbe8c-25f4-5a63-91f5-82c1415d5c8a
2026-03-26 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F960%252F701a0457078a4c138c8ace996a90b87c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/960/701a0457078a4c138c8ace996a90b87c/images/large/1.jpg not downloaded yet
2026-03-26 18:34:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7680b0f4-c7d9-521d-bbef-ae422b1d3c50 with identifier: 1985900
2026-03-26 18:34:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7680b0f4-c7d9-521d-bbef-ae422b1d3c50 with identifier: 1985900
2026-03-26 18:34:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7680b0f4-c7d9-521d-bbef-ae422b1d3c50 with identifier: 1985900 to the API
2026-03-26 18:34:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/480/304a7f51bd514ef99de40f87d58318ce/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '7680b0f4-c7d9-521d-bbef-ae422b1d3c50',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'CORSA',
 'odometer': 87687,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7680b0f4-c7d9-521d-bbef-ae422b1d3c50/7680b0f4-c7d9-521d-bbef-ae422b1d3c50_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 346544,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/480/304a7f51bd514ef99de40f87d58318ce/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL CORSA 1.2T XHL 74kW (100CV) Edition',
 'transmission': 'manual',
 'trim': '1.2T XHL 74kW (100CV) Edition',
 'vin': None,
 'year': 2021}
2026-03-26 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985900%27 HTTP/1.1" 200 None
2026-03-26 18:34:12 [ayvens.es] INFO: Saving data for 1985900: {'created_time': 1774550052.604668, 'last_price_update_time': 1774550052.60468, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985900') HTTP/1.1" 204 0
2026-03-26 18:34:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c32065ef-0148-59a5-9c8c-f66f98e3df5c with identifier: 1985902
2026-03-26 18:34:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c32065ef-0148-59a5-9c8c-f66f98e3df5c with identifier: 1985902
2026-03-26 18:34:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c32065ef-0148-59a5-9c8c-f66f98e3df5c with identifier: 1985902 to the API
2026-03-26 18:34:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/974/fa62559cc6524f1b8a240b7d528eef80/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'Gris platinum',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c32065ef-0148-59a5-9c8c-f66f98e3df5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 215317,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c32065ef-0148-59a5-9c8c-f66f98e3df5c/c32065ef-0148-59a5-9c8c-f66f98e3df5c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 349045,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/974/fa62559cc6524f1b8a240b7d528eef80/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.5 BlueHDi 96kW S&S GT Line EAT8',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi 96kW S&S GT Line EAT8',
 'vin': None,
 'year': 2019}
2026-03-26 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985902%27 HTTP/1.1" 200 None
2026-03-26 18:34:12 [ayvens.es] INFO: Saving data for 1985902: {'created_time': 1774550052.940092, 'last_price_update_time': 1774550052.940105, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985902') HTTP/1.1" 204 0
2026-03-26 18:34:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0ab48da2-55b9-552e-9161-f55cd445adbc with identifier: 1985903
2026-03-26 18:34:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0ab48da2-55b9-552e-9161-f55cd445adbc with identifier: 1985903
2026-03-26 18:34:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0ab48da2-55b9-552e-9161-f55cd445adbc with identifier: 1985903 to the API
2026-03-26 18:34:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/814/a549c32d235f481c8fbc630657d07a4c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '0ab48da2-55b9-552e-9161-f55cd445adbc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FIESTA',
 'odometer': 219056,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ab48da2-55b9-552e-9161-f55cd445adbc/0ab48da2-55b9-552e-9161-f55cd445adbc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344018,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/814/a549c32d235f481c8fbc630657d07a4c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FIESTA 1.5 TDCi 63kW Trend 5p',
 'transmission': 'manual',
 'trim': '1.5 TDCi 63kW Trend 5p',
 'vin': None,
 'year': 2018}
2026-03-26 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985903%27 HTTP/1.1" 200 None
2026-03-26 18:34:14 [ayvens.es] INFO: Saving data for 1985903: {'created_time': 1774550054.118131, 'last_price_update_time': 1774550054.118142, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985903') HTTP/1.1" 204 0
2026-03-26 18:34:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1351f9f3-1625-57dd-a64c-26440609e93c with identifier: 1985905
2026-03-26 18:34:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1351f9f3-1625-57dd-a64c-26440609e93c with identifier: 1985905
2026-03-26 18:34:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1351f9f3-1625-57dd-a64c-26440609e93c with identifier: 1985905 to the API
2026-03-26 18:34:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/340/bc79ab91491d446e980e1cab35ae2102/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '1351f9f3-1625-57dd-a64c-26440609e93c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 112639,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1351f9f3-1625-57dd-a64c-26440609e93c/1351f9f3-1625-57dd-a64c-26440609e93c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 338914,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/340/bc79ab91491d446e980e1cab35ae2102/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI dCi 85 kW (115 CV) E6D ACENTA',
 'transmission': 'manual',
 'trim': 'dCi 85 kW (115 CV) E6D ACENTA',
 'vin': None,
 'year': 2020}
2026-03-26 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985905%27 HTTP/1.1" 200 None
2026-03-26 18:34:14 [ayvens.es] INFO: Saving data for 1985905: {'created_time': 1774550054.431522, 'last_price_update_time': 1774550054.431532, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985905') HTTP/1.1" 204 0
2026-03-26 18:34:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 835e987b-8d3c-5524-8046-e0e3a3f0c1ec with identifier: 1985904
2026-03-26 18:34:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 835e987b-8d3c-5524-8046-e0e3a3f0c1ec with identifier: 1985904
2026-03-26 18:34:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 835e987b-8d3c-5524-8046-e0e3a3f0c1ec with identifier: 1985904 to the API
2026-03-26 18:34:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/248/3f334ea91a9e4ce5854a790890b892d6/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'color': 'Gris nano',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '835e987b-8d3c-5524-8046-e0e3a3f0c1ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3',
 'odometer': 201539,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_835e987b-8d3c-5524-8046-e0e3a3f0c1ec/835e987b-8d3c-5524-8046-e0e3a3f0c1ec_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 507590,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/248/3f334ea91a9e4ce5854a790890b892d6/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 Advanced 35 TDI 110kW (150CV) S tronic',
 'transmission': 'manual',
 'trim': 'Advanced 35 TDI 110kW (150CV) S tronic',
 'vin': None,
 'year': 2022}
2026-03-26 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985904%27 HTTP/1.1" 200 None
2026-03-26 18:34:14 [ayvens.es] INFO: Saving data for 1985904: {'created_time': 1774550054.848231, 'last_price_update_time': 1774550054.848252, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985904') HTTP/1.1" 204 0
2026-03-26 18:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/637/aa54c92a9296484f8e35248e16a095b6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:14 [ayvens.es] INFO: Found listing with ID: 1985914
2026-03-26 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985914%27 HTTP/1.1" 200 None
2026-03-26 18:34:14 [ayvens.es] INFO: Scrape type for 1985914: 1
2026-03-26 18:34:14 [ayvens.es] INFO: Extracting data for car ID: 1985914
2026-03-26 18:34:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56803905-4ed3-5899-9428-91fe7173270d with identifier: 1985914
2026-03-26 18:34:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56803905-4ed3-5899-9428-91fe7173270d with scrape type 1
2026-03-26 18:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 56803905-4ed3-5899-9428-91fe7173270d
2026-03-26 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F906%252F4ec63785a7fc4c6e8b5a358184fa30f0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/906/4ec63785a7fc4c6e8b5a358184fa30f0/images/large/1.jpg not downloaded yet
2026-03-26 18:34:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a2ab0f110>
2026-03-26 18:34:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_459e4fa4-66e8-591a-810a-17d36032e397/459e4fa4-66e8-591a-810a-17d36032e397_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F161%252F7f4078ac874a48ae88b068bb06b8527d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/161/7f4078ac874a48ae88b068bb06b8527d/images/large/1.jpg saved to cache
2026-03-26 18:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 459e4fa4-66e8-591a-810a-17d36032e397
2026-03-26 18:34:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 459e4fa4-66e8-591a-810a-17d36032e397, skipping ID generation
2026-03-26 18:34:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 459e4fa4-66e8-591a-810a-17d36032e397 with scrape type 1
2026-03-26 18:34:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 459e4fa4-66e8-591a-810a-17d36032e397 sending to next pipeline
2026-03-26 18:34:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 459e4fa4-66e8-591a-810a-17d36032e397, identifier: 1985906
2026-03-26 18:34:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/846/a7de499fe08e413395117cf2a7962e99/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:15 [ayvens.es] INFO: Found listing with ID: 1985915
2026-03-26 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985915%27 HTTP/1.1" 200 None
2026-03-26 18:34:15 [ayvens.es] INFO: Scrape type for 1985915: 1
2026-03-26 18:34:15 [ayvens.es] INFO: Extracting data for car ID: 1985915
2026-03-26 18:34:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 169d7264-a5a3-57eb-9c65-2a29475a1710 with identifier: 1985915
2026-03-26 18:34:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 169d7264-a5a3-57eb-9c65-2a29475a1710 with scrape type 1
2026-03-26 18:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 169d7264-a5a3-57eb-9c65-2a29475a1710
2026-03-26 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F874%252F430de2228c7345a2aab25c5b5f2150f2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/874/430de2228c7345a2aab25c5b5f2150f2/images/large/1.jpg not downloaded yet
2026-03-26 18:34:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 459e4fa4-66e8-591a-810a-17d36032e397 with identifier: 1985906
2026-03-26 18:34:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 459e4fa4-66e8-591a-810a-17d36032e397 with identifier: 1985906
2026-03-26 18:34:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 459e4fa4-66e8-591a-810a-17d36032e397 with identifier: 1985906 to the API
2026-03-26 18:34:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/161/7f4078ac874a48ae88b068bb06b8527d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '459e4fa4-66e8-591a-810a-17d36032e397',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 136171,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_459e4fa4-66e8-591a-810a-17d36032e397/459e4fa4-66e8-591a-810a-17d36032e397_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 339717,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/161/7f4078ac874a48ae88b068bb06b8527d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 Active BlueHDI 81kW (110CV)',
 'transmission': 'manual',
 'trim': 'Active BlueHDI 81kW (110CV)',
 'vin': None,
 'year': 2021}
2026-03-26 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985906%27 HTTP/1.1" 200 None
2026-03-26 18:34:15 [ayvens.es] INFO: Saving data for 1985906: {'created_time': 1774550055.663737, 'last_price_update_time': 1774550055.663749, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985906') HTTP/1.1" 204 0
2026-03-26 18:34:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/639/46b72efdbd054c5a81ced6b7089fb786/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/384/9d9eccf31e104860906728b30c3a1ae7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:15 [ayvens.es] INFO: Found listing with ID: 1985916
2026-03-26 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985916%27 HTTP/1.1" 200 None
2026-03-26 18:34:15 [ayvens.es] INFO: Scrape type for 1985916: 1
2026-03-26 18:34:15 [ayvens.es] INFO: Extracting data for car ID: 1985916
2026-03-26 18:34:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07be7485-ee54-5415-b010-28985834da20 with identifier: 1985916
2026-03-26 18:34:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07be7485-ee54-5415-b010-28985834da20 with scrape type 1
2026-03-26 18:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 07be7485-ee54-5415-b010-28985834da20
2026-03-26 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F351%252F994565e9182e495ab10e501a879c311e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/351/994565e9182e495ab10e501a879c311e/images/large/1.jpg not downloaded yet
2026-03-26 18:34:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/718/5fae8876e25d45b1b5f5de12a85cad9b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a2ab0c190>
2026-03-26 18:34:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcc18d9c-bf22-5a04-a812-8edd748e82f5/fcc18d9c-bf22-5a04-a812-8edd748e82f5_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F637%252Faa54c92a9296484f8e35248e16a095b6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/637/aa54c92a9296484f8e35248e16a095b6/images/large/1.jpg saved to cache
2026-03-26 18:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fcc18d9c-bf22-5a04-a812-8edd748e82f5
2026-03-26 18:34:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fcc18d9c-bf22-5a04-a812-8edd748e82f5, skipping ID generation
2026-03-26 18:34:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcc18d9c-bf22-5a04-a812-8edd748e82f5 with scrape type 1
2026-03-26 18:34:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fcc18d9c-bf22-5a04-a812-8edd748e82f5 sending to next pipeline
2026-03-26 18:34:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: fcc18d9c-bf22-5a04-a812-8edd748e82f5, identifier: 1985907
2026-03-26 18:34:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a2ab0cb90>
2026-03-26 18:34:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b1d3df5-30f4-5c21-9480-9a35ab537eb9/3b1d3df5-30f4-5c21-9480-9a35ab537eb9_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F846%252Fa7de499fe08e413395117cf2a7962e99%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/846/a7de499fe08e413395117cf2a7962e99/images/large/1.jpg saved to cache
2026-03-26 18:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3b1d3df5-30f4-5c21-9480-9a35ab537eb9
2026-03-26 18:34:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3b1d3df5-30f4-5c21-9480-9a35ab537eb9, skipping ID generation
2026-03-26 18:34:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b1d3df5-30f4-5c21-9480-9a35ab537eb9 with scrape type 1
2026-03-26 18:34:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3b1d3df5-30f4-5c21-9480-9a35ab537eb9 sending to next pipeline
2026-03-26 18:34:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3b1d3df5-30f4-5c21-9480-9a35ab537eb9, identifier: 1985908
2026-03-26 18:34:16 [ayvens.es] INFO: Found listing with ID: 1985917
2026-03-26 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985917%27 HTTP/1.1" 200 None
2026-03-26 18:34:16 [ayvens.es] INFO: Scrape type for 1985917: 1
2026-03-26 18:34:16 [ayvens.es] INFO: Extracting data for car ID: 1985917
2026-03-26 18:34:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ede5d12d-3075-59a8-9d58-e4d586258c5e with identifier: 1985917
2026-03-26 18:34:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ede5d12d-3075-59a8-9d58-e4d586258c5e with scrape type 1
2026-03-26 18:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item ede5d12d-3075-59a8-9d58-e4d586258c5e
2026-03-26 18:34:16 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item ede5d12d-3075-59a8-9d58-e4d586258c5e
2026-03-26 18:34:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ede5d12d-3075-59a8-9d58-e4d586258c5e, identifier: 1985917
2026-03-26 18:34:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: fcc18d9c-bf22-5a04-a812-8edd748e82f5 with identifier: 1985907
2026-03-26 18:34:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: fcc18d9c-bf22-5a04-a812-8edd748e82f5 with identifier: 1985907
2026-03-26 18:34:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: fcc18d9c-bf22-5a04-a812-8edd748e82f5 with identifier: 1985907 to the API
2026-03-26 18:34:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/637/aa54c92a9296484f8e35248e16a095b6/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 166,
 'color': 'Alpinwei',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '3.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'fcc18d9c-bf22-5a04-a812-8edd748e82f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'SERIES 3',
 'odometer': 129176,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcc18d9c-bf22-5a04-a812-8edd748e82f5/fcc18d9c-bf22-5a04-a812-8edd748e82f5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 514526,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/637/aa54c92a9296484f8e35248e16a095b6/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW SERIES 3 330d xDrive Touring',
 'transmission': 'manual',
 'trim': '330d xDrive Touring',
 'vin': None,
 'year': 2021}
2026-03-26 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985907%27 HTTP/1.1" 200 None
2026-03-26 18:34:16 [ayvens.es] INFO: Saving data for 1985907: {'created_time': 1774550056.694913, 'last_price_update_time': 1774550056.694924, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985907') HTTP/1.1" 204 0
2026-03-26 18:34:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3b1d3df5-30f4-5c21-9480-9a35ab537eb9 with identifier: 1985908
2026-03-26 18:34:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3b1d3df5-30f4-5c21-9480-9a35ab537eb9 with identifier: 1985908
2026-03-26 18:34:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3b1d3df5-30f4-5c21-9480-9a35ab537eb9 with identifier: 1985908 to the API
2026-03-26 18:34:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/846/a7de499fe08e413395117cf2a7962e99/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '3b1d3df5-30f4-5c21-9480-9a35ab537eb9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'COMBO',
 'odometer': 56224,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b1d3df5-30f4-5c21-9480-9a35ab537eb9/3b1d3df5-30f4-5c21-9480-9a35ab537eb9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 468172,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/846/a7de499fe08e413395117cf2a7962e99/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-08',
 'seats_number': 2,
 'seller_name': None,
 'title': 'OPEL COMBO 1.5 TD 75kW (100CV) Express L H1 650kg',
 'transmission': 'manual',
 'trim': '1.5 TD 75kW (100CV) Express L H1 650kg',
 'vin': None,
 'year': 2021}
2026-03-26 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985908%27 HTTP/1.1" 200 None
2026-03-26 18:34:17 [ayvens.es] INFO: Saving data for 1985908: {'created_time': 1774550057.054594, 'last_price_update_time': 1774550057.054606, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985908') HTTP/1.1" 204 0
2026-03-26 18:34:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ede5d12d-3075-59a8-9d58-e4d586258c5e with identifier: 1985917
2026-03-26 18:34:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ede5d12d-3075-59a8-9d58-e4d586258c5e with identifier: 1985917
2026-03-26 18:34:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ede5d12d-3075-59a8-9d58-e4d586258c5e with identifier: 1985917 to the API
2026-03-26 18:34:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ede5d12d-3075-59a8-9d58-e4d586258c5e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'BERLINGO',
 'odometer': 96874,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN BERLINGO Talla M BlueHDi 100 S&S FEEL',
 'transmission': 'manual',
 'trim': 'Talla M BlueHDi 100 S&S FEEL',
 'vin': None,
 'year': 2021}
2026-03-26 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985917%27 HTTP/1.1" 200 None
2026-03-26 18:34:17 [ayvens.es] INFO: Saving data for 1985917: {'created_time': 1774550057.38821, 'last_price_update_time': 1774550057.388221, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985917') HTTP/1.1" 204 0
2026-03-26 18:34:17 [ayvens.es] INFO: Found listing with ID: 1985918
2026-03-26 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985918%27 HTTP/1.1" 200 None
2026-03-26 18:34:17 [ayvens.es] INFO: Scrape type for 1985918: 1
2026-03-26 18:34:17 [ayvens.es] INFO: Extracting data for car ID: 1985918
2026-03-26 18:34:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 565e95af-fd4a-5314-8654-859cb58a9c39 with identifier: 1985918
2026-03-26 18:34:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 565e95af-fd4a-5314-8654-859cb58a9c39 with scrape type 1
2026-03-26 18:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 565e95af-fd4a-5314-8654-859cb58a9c39
2026-03-26 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F641%252F8ed5fddd05ea493790d258423cae7594%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/641/8ed5fddd05ea493790d258423cae7594/images/large/1.jpg not downloaded yet
2026-03-26 18:34:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a29035c10>
2026-03-26 18:34:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_522de01c-9f6e-5ea6-836b-f6c709015944/522de01c-9f6e-5ea6-836b-f6c709015944_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F639%252F46b72efdbd054c5a81ced6b7089fb786%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/639/46b72efdbd054c5a81ced6b7089fb786/images/large/1.jpg saved to cache
2026-03-26 18:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 522de01c-9f6e-5ea6-836b-f6c709015944
2026-03-26 18:34:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 522de01c-9f6e-5ea6-836b-f6c709015944, skipping ID generation
2026-03-26 18:34:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 522de01c-9f6e-5ea6-836b-f6c709015944 with scrape type 1
2026-03-26 18:34:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 522de01c-9f6e-5ea6-836b-f6c709015944 sending to next pipeline
2026-03-26 18:34:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 522de01c-9f6e-5ea6-836b-f6c709015944, identifier: 1985909
2026-03-26 18:34:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c6f3d0>
2026-03-26 18:34:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96003dbb-e8cb-5cec-a3f3-2fa041572201/96003dbb-e8cb-5cec-a3f3-2fa041572201_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F384%252F9d9eccf31e104860906728b30c3a1ae7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/384/9d9eccf31e104860906728b30c3a1ae7/images/large/1.jpg saved to cache
2026-03-26 18:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 96003dbb-e8cb-5cec-a3f3-2fa041572201
2026-03-26 18:34:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 96003dbb-e8cb-5cec-a3f3-2fa041572201, skipping ID generation
2026-03-26 18:34:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96003dbb-e8cb-5cec-a3f3-2fa041572201 with scrape type 1
2026-03-26 18:34:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 96003dbb-e8cb-5cec-a3f3-2fa041572201 sending to next pipeline
2026-03-26 18:34:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 96003dbb-e8cb-5cec-a3f3-2fa041572201, identifier: 1985910
2026-03-26 18:34:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28e5db50>
2026-03-26 18:34:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_698dbb5d-f54b-5cb7-b116-fae9b838cb82/698dbb5d-f54b-5cb7-b116-fae9b838cb82_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F718%252F5fae8876e25d45b1b5f5de12a85cad9b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/718/5fae8876e25d45b1b5f5de12a85cad9b/images/large/1.jpg saved to cache
2026-03-26 18:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 698dbb5d-f54b-5cb7-b116-fae9b838cb82
2026-03-26 18:34:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 698dbb5d-f54b-5cb7-b116-fae9b838cb82, skipping ID generation
2026-03-26 18:34:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 698dbb5d-f54b-5cb7-b116-fae9b838cb82 with scrape type 1
2026-03-26 18:34:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 698dbb5d-f54b-5cb7-b116-fae9b838cb82 sending to next pipeline
2026-03-26 18:34:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 698dbb5d-f54b-5cb7-b116-fae9b838cb82, identifier: 1985911
2026-03-26 18:34:18 [ayvens.es] INFO: Found listing with ID: 1985919
2026-03-26 18:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985919%27 HTTP/1.1" 200 None
2026-03-26 18:34:18 [ayvens.es] INFO: Scrape type for 1985919: 1
2026-03-26 18:34:18 [ayvens.es] INFO: Extracting data for car ID: 1985919
2026-03-26 18:34:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27134a3d-f5de-54e9-8cc6-bf841cdf96bc with identifier: 1985919
2026-03-26 18:34:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27134a3d-f5de-54e9-8cc6-bf841cdf96bc with scrape type 1
2026-03-26 18:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 27134a3d-f5de-54e9-8cc6-bf841cdf96bc
2026-03-26 18:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F762%252Fd0320325f0324a8b9ff2e81b98585a82%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/762/d0320325f0324a8b9ff2e81b98585a82/images/large/1.jpg not downloaded yet
2026-03-26 18:34:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 522de01c-9f6e-5ea6-836b-f6c709015944 with identifier: 1985909
2026-03-26 18:34:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 522de01c-9f6e-5ea6-836b-f6c709015944 with identifier: 1985909
2026-03-26 18:34:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 522de01c-9f6e-5ea6-836b-f6c709015944 with identifier: 1985909 to the API
2026-03-26 18:34:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/639/46b72efdbd054c5a81ced6b7089fb786/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '522de01c-9f6e-5ea6-836b-f6c709015944',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FIESTA',
 'odometer': 40258,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_522de01c-9f6e-5ea6-836b-f6c709015944/522de01c-9f6e-5ea6-836b-f6c709015944_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 488629,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/639/46b72efdbd054c5a81ced6b7089fb786/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FIESTA 1.0 EcoBoost 74kW Trend S/S 5p',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost 74kW Trend S/S 5p',
 'vin': None,
 'year': 2019}
2026-03-26 18:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985909%27 HTTP/1.1" 200 None
2026-03-26 18:34:18 [ayvens.es] INFO: Saving data for 1985909: {'created_time': 1774550058.394002, 'last_price_update_time': 1774550058.394016, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985909') HTTP/1.1" 204 0
2026-03-26 18:34:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 96003dbb-e8cb-5cec-a3f3-2fa041572201 with identifier: 1985910
2026-03-26 18:34:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 96003dbb-e8cb-5cec-a3f3-2fa041572201 with identifier: 1985910
2026-03-26 18:34:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 96003dbb-e8cb-5cec-a3f3-2fa041572201 with identifier: 1985910 to the API
2026-03-26 18:34:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/384/9d9eccf31e104860906728b30c3a1ae7/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 100,
 'color': 'Blanco everest',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '96003dbb-e8cb-5cec-a3f3-2fa041572201',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 207743,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96003dbb-e8cb-5cec-a3f3-2fa041572201/96003dbb-e8cb-5cec-a3f3-2fa041572201_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324260,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/384/9d9eccf31e104860906728b30c3a1ae7/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI dCi 85 kW (115 CV) E6D ACENTA',
 'transmission': 'manual',
 'trim': 'dCi 85 kW (115 CV) E6D ACENTA',
 'vin': None,
 'year': 2019}
2026-03-26 18:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985910%27 HTTP/1.1" 200 None
2026-03-26 18:34:18 [ayvens.es] INFO: Saving data for 1985910: {'created_time': 1774550058.815991, 'last_price_update_time': 1774550058.816004, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985910') HTTP/1.1" 204 0
2026-03-26 18:34:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 698dbb5d-f54b-5cb7-b116-fae9b838cb82 with identifier: 1985911
2026-03-26 18:34:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 698dbb5d-f54b-5cb7-b116-fae9b838cb82 with identifier: 1985911
2026-03-26 18:34:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 698dbb5d-f54b-5cb7-b116-fae9b838cb82 with identifier: 1985911 to the API
2026-03-26 18:34:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/718/5fae8876e25d45b1b5f5de12a85cad9b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Serie',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '698dbb5d-f54b-5cb7-b116-fae9b838cb82',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '208',
 'odometer': 184494,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_698dbb5d-f54b-5cb7-b116-fae9b838cb82/698dbb5d-f54b-5cb7-b116-fae9b838cb82_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 345490,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/718/5fae8876e25d45b1b5f5de12a85cad9b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 208 BlueHDi 73kW (100CV) Active',
 'transmission': 'manual',
 'trim': 'BlueHDi 73kW (100CV) Active',
 'vin': None,
 'year': 2022}
2026-03-26 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985911%27 HTTP/1.1" 200 None
2026-03-26 18:34:19 [ayvens.es] INFO: Saving data for 1985911: {'created_time': 1774550059.180209, 'last_price_update_time': 1774550059.180219, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985911') HTTP/1.1" 204 0
2026-03-26 18:34:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/906/4ec63785a7fc4c6e8b5a358184fa30f0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/995/0a39553d432743419c080e22a546bd3f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/960/701a0457078a4c138c8ace996a90b87c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:19 [ayvens.es] INFO: Found listing with ID: 1985920
2026-03-26 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985920%27 HTTP/1.1" 200 None
2026-03-26 18:34:19 [ayvens.es] INFO: Scrape type for 1985920: 1
2026-03-26 18:34:19 [ayvens.es] INFO: Extracting data for car ID: 1985920
2026-03-26 18:34:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5e987b0-a578-59d6-baea-46b41b141a72 with identifier: 1985920
2026-03-26 18:34:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5e987b0-a578-59d6-baea-46b41b141a72 with scrape type 1
2026-03-26 18:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c5e987b0-a578-59d6-baea-46b41b141a72
2026-03-26 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F616%252Fbaba04693cb44f438e0ad060caee029d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/616/baba04693cb44f438e0ad060caee029d/images/large/1.jpg not downloaded yet
2026-03-26 18:34:19 [ayvens.es] INFO: Found listing with ID: 1985921
2026-03-26 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985921%27 HTTP/1.1" 200 None
2026-03-26 18:34:19 [ayvens.es] INFO: Scrape type for 1985921: 1
2026-03-26 18:34:19 [ayvens.es] INFO: Extracting data for car ID: 1985921
2026-03-26 18:34:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 681cd477-e9fe-5237-8cbb-367e471f7e0a with identifier: 1985921
2026-03-26 18:34:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 681cd477-e9fe-5237-8cbb-367e471f7e0a with scrape type 1
2026-03-26 18:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 681cd477-e9fe-5237-8cbb-367e471f7e0a
2026-03-26 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F494%252F46f01baef86e41e5992675863f6719fc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/494/46f01baef86e41e5992675863f6719fc/images/large/1.jpg not downloaded yet
2026-03-26 18:34:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/874/430de2228c7345a2aab25c5b5f2150f2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28ac6b90>
2026-03-26 18:34:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56803905-4ed3-5899-9428-91fe7173270d/56803905-4ed3-5899-9428-91fe7173270d_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F906%252F4ec63785a7fc4c6e8b5a358184fa30f0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/906/4ec63785a7fc4c6e8b5a358184fa30f0/images/large/1.jpg saved to cache
2026-03-26 18:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 56803905-4ed3-5899-9428-91fe7173270d
2026-03-26 18:34:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 56803905-4ed3-5899-9428-91fe7173270d, skipping ID generation
2026-03-26 18:34:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56803905-4ed3-5899-9428-91fe7173270d with scrape type 1
2026-03-26 18:34:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 56803905-4ed3-5899-9428-91fe7173270d sending to next pipeline
2026-03-26 18:34:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 56803905-4ed3-5899-9428-91fe7173270d, identifier: 1985914
2026-03-26 18:34:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28d31f10>
2026-03-26 18:34:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec878e9c-1b40-5110-b31c-f4595fbc03ba/ec878e9c-1b40-5110-b31c-f4595fbc03ba_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F995%252F0a39553d432743419c080e22a546bd3f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/995/0a39553d432743419c080e22a546bd3f/images/large/1.jpg saved to cache
2026-03-26 18:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ec878e9c-1b40-5110-b31c-f4595fbc03ba
2026-03-26 18:34:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ec878e9c-1b40-5110-b31c-f4595fbc03ba, skipping ID generation
2026-03-26 18:34:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec878e9c-1b40-5110-b31c-f4595fbc03ba with scrape type 1
2026-03-26 18:34:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ec878e9c-1b40-5110-b31c-f4595fbc03ba sending to next pipeline
2026-03-26 18:34:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ec878e9c-1b40-5110-b31c-f4595fbc03ba, identifier: 1985912
2026-03-26 18:34:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a290aecd0>
2026-03-26 18:34:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_649fbe8c-25f4-5a63-91f5-82c1415d5c8a/649fbe8c-25f4-5a63-91f5-82c1415d5c8a_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F960%252F701a0457078a4c138c8ace996a90b87c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/960/701a0457078a4c138c8ace996a90b87c/images/large/1.jpg saved to cache
2026-03-26 18:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 649fbe8c-25f4-5a63-91f5-82c1415d5c8a
2026-03-26 18:34:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 649fbe8c-25f4-5a63-91f5-82c1415d5c8a, skipping ID generation
2026-03-26 18:34:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 649fbe8c-25f4-5a63-91f5-82c1415d5c8a with scrape type 1
2026-03-26 18:34:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 649fbe8c-25f4-5a63-91f5-82c1415d5c8a sending to next pipeline
2026-03-26 18:34:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 649fbe8c-25f4-5a63-91f5-82c1415d5c8a, identifier: 1985913
2026-03-26 18:34:19 [ayvens.es] INFO: Found listing with ID: 1985922
2026-03-26 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985922%27 HTTP/1.1" 200 None
2026-03-26 18:34:19 [ayvens.es] INFO: Scrape type for 1985922: 1
2026-03-26 18:34:19 [ayvens.es] INFO: Extracting data for car ID: 1985922
2026-03-26 18:34:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5710c43a-5c21-5cc8-b05e-963dddbaaacc with identifier: 1985922
2026-03-26 18:34:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5710c43a-5c21-5cc8-b05e-963dddbaaacc with scrape type 1
2026-03-26 18:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5710c43a-5c21-5cc8-b05e-963dddbaaacc
2026-03-26 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F912%252Ffa5fa09c759949bfa6da1852586361b0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/912/fa5fa09c759949bfa6da1852586361b0/images/large/1.jpg not downloaded yet
2026-03-26 18:34:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 56803905-4ed3-5899-9428-91fe7173270d with identifier: 1985914
2026-03-26 18:34:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:34:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 56803905-4ed3-5899-9428-91fe7173270d with identifier: 1985914
2026-03-26 18:34:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 56803905-4ed3-5899-9428-91fe7173270d with identifier: 1985914 to the API
2026-03-26 18:34:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/906/4ec63785a7fc4c6e8b5a358184fa30f0/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Sapporo white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '56803905-4ed3-5899-9428-91fe7173270d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 140659,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56803905-4ed3-5899-9428-91fe7173270d/56803905-4ed3-5899-9428-91fe7173270d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 321786,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/906/4ec63785a7fc4c6e8b5a358184fa30f0/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI DIG-T 103kW (140CV) mHEV 4x2 Acenta',
 'transmission': 'manual',
 'trim': 'DIG-T 103kW (140CV) mHEV 4x2 Acenta',
 'vin': None,
 'year': 2021}
2026-03-26 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985914%27 HTTP/1.1" 200 None
2026-03-26 18:34:20 [ayvens.es] INFO: Saving data for 1985914: {'created_time': 1774550060.205275, 'last_price_update_time': 1774550060.205287, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985914') HTTP/1.1" 204 0
2026-03-26 18:34:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ec878e9c-1b40-5110-b31c-f4595fbc03ba with identifier: 1985912
2026-03-26 18:34:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:34:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ec878e9c-1b40-5110-b31c-f4595fbc03ba with identifier: 1985912
2026-03-26 18:34:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ec878e9c-1b40-5110-b31c-f4595fbc03ba with identifier: 1985912 to the API
2026-03-26 18:34:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/995/0a39553d432743419c080e22a546bd3f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 169,
 'color': 'Phantom black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.2L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ec878e9c-1b40-5110-b31c-f4595fbc03ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'SANTA FE',
 'odometer': 198805,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec878e9c-1b40-5110-b31c-f4595fbc03ba/ec878e9c-1b40-5110-b31c-f4595fbc03ba_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 631711,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/995/0a39553d432743419c080e22a546bd3f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-16',
 'seats_number': 7,
 'seller_name': None,
 'title': 'HYUNDAI SANTA FE 2.2 CRDi Klass 4x2 DK',
 'transmission': 'manual',
 'trim': '2.2 CRDi Klass 4x2 DK',
 'vin': None,
 'year': 2021}
2026-03-26 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985912%27 HTTP/1.1" 200 None
2026-03-26 18:34:20 [ayvens.es] INFO: Saving data for 1985912: {'created_time': 1774550060.541658, 'last_price_update_time': 1774550060.541668, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985912') HTTP/1.1" 204 0
2026-03-26 18:34:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 649fbe8c-25f4-5a63-91f5-82c1415d5c8a with identifier: 1985913
2026-03-26 18:34:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 649fbe8c-25f4-5a63-91f5-82c1415d5c8a with identifier: 1985913
2026-03-26 18:34:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 649fbe8c-25f4-5a63-91f5-82c1415d5c8a with identifier: 1985913 to the API
2026-03-26 18:34:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/960/701a0457078a4c138c8ace996a90b87c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'Blanco blanquise',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '649fbe8c-25f4-5a63-91f5-82c1415d5c8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '208',
 'odometer': 135063,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_649fbe8c-25f4-5a63-91f5-82c1415d5c8a/649fbe8c-25f4-5a63-91f5-82c1415d5c8a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354010,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/960/701a0457078a4c138c8ace996a90b87c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 208 5P ACTIVE PureTech 60kW (82CV)',
 'transmission': 'manual',
 'trim': '5P ACTIVE PureTech 60kW (82CV)',
 'vin': None,
 'year': 2019}
2026-03-26 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985913%27 HTTP/1.1" 200 None
2026-03-26 18:34:20 [ayvens.es] INFO: Saving data for 1985913: {'created_time': 1774550060.858782, 'last_price_update_time': 1774550060.858791, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985913') HTTP/1.1" 204 0
2026-03-26 18:34:20 [ayvens.es] INFO: Found listing with ID: 1985923
2026-03-26 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985923%27 HTTP/1.1" 200 None
2026-03-26 18:34:20 [ayvens.es] INFO: Scrape type for 1985923: 1
2026-03-26 18:34:20 [ayvens.es] INFO: Extracting data for car ID: 1985923
2026-03-26 18:34:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1edcea86-b3f1-50d1-b831-7a255a2ebe78 with identifier: 1985923
2026-03-26 18:34:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1edcea86-b3f1-50d1-b831-7a255a2ebe78 with scrape type 1
2026-03-26 18:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1edcea86-b3f1-50d1-b831-7a255a2ebe78
2026-03-26 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F046%252F7bb4e54ceb93468da77544fd84020c4d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/046/7bb4e54ceb93468da77544fd84020c4d/images/large/1.jpg not downloaded yet
2026-03-26 18:34:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a2832fc50>
2026-03-26 18:34:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_169d7264-a5a3-57eb-9c65-2a29475a1710/169d7264-a5a3-57eb-9c65-2a29475a1710_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F874%252F430de2228c7345a2aab25c5b5f2150f2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/874/430de2228c7345a2aab25c5b5f2150f2/images/large/1.jpg saved to cache
2026-03-26 18:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 169d7264-a5a3-57eb-9c65-2a29475a1710
2026-03-26 18:34:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 169d7264-a5a3-57eb-9c65-2a29475a1710, skipping ID generation
2026-03-26 18:34:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 169d7264-a5a3-57eb-9c65-2a29475a1710 with scrape type 1
2026-03-26 18:34:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 169d7264-a5a3-57eb-9c65-2a29475a1710 sending to next pipeline
2026-03-26 18:34:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 169d7264-a5a3-57eb-9c65-2a29475a1710, identifier: 1985915
2026-03-26 18:34:21 [ayvens.es] INFO: Found listing with ID: 1985924
2026-03-26 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985924%27 HTTP/1.1" 200 None
2026-03-26 18:34:21 [ayvens.es] INFO: Scrape type for 1985924: 1
2026-03-26 18:34:21 [ayvens.es] INFO: Extracting data for car ID: 1985924
2026-03-26 18:34:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6fecb344-051e-5564-b6f8-b0a94ab07fca with identifier: 1985924
2026-03-26 18:34:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fecb344-051e-5564-b6f8-b0a94ab07fca with scrape type 1
2026-03-26 18:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6fecb344-051e-5564-b6f8-b0a94ab07fca
2026-03-26 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F956%252F8562ed47a0dd4c12b90e0b7f54e945af%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/956/8562ed47a0dd4c12b90e0b7f54e945af/images/large/1.jpg not downloaded yet
2026-03-26 18:34:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 169d7264-a5a3-57eb-9c65-2a29475a1710 with identifier: 1985915
2026-03-26 18:34:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 169d7264-a5a3-57eb-9c65-2a29475a1710 with identifier: 1985915
2026-03-26 18:34:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 169d7264-a5a3-57eb-9c65-2a29475a1710 with identifier: 1985915 to the API
2026-03-26 18:34:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/874/430de2228c7345a2aab25c5b5f2150f2/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 98,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '169d7264-a5a3-57eb-9c65-2a29475a1710',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'TIPO',
 'odometer': 68413,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_169d7264-a5a3-57eb-9c65-2a29475a1710/169d7264-a5a3-57eb-9c65-2a29475a1710_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 452348,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/874/430de2228c7345a2aab25c5b5f2150f2/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FIAT TIPO (E) 1.6 16v Business 120cv Multijet II',
 'transmission': 'manual',
 'trim': '(E) 1.6 16v Business 120cv Multijet II',
 'vin': None,
 'year': 2018}
2026-03-26 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985915%27 HTTP/1.1" 200 None
2026-03-26 18:34:21 [ayvens.es] INFO: Saving data for 1985915: {'created_time': 1774550061.425015, 'last_price_update_time': 1774550061.425024, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985915') HTTP/1.1" 204 0
2026-03-26 18:34:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/351/994565e9182e495ab10e501a879c311e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/641/8ed5fddd05ea493790d258423cae7594/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:21 [ayvens.es] INFO: Found listing with ID: 1985925
2026-03-26 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985925%27 HTTP/1.1" 200 None
2026-03-26 18:34:21 [ayvens.es] INFO: Scrape type for 1985925: 1
2026-03-26 18:34:21 [ayvens.es] INFO: Extracting data for car ID: 1985925
2026-03-26 18:34:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8310567d-aee5-5897-80b2-16623c28ca00 with identifier: 1985925
2026-03-26 18:34:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8310567d-aee5-5897-80b2-16623c28ca00 with scrape type 1
2026-03-26 18:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8310567d-aee5-5897-80b2-16623c28ca00
2026-03-26 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F824%252Fdef4d286ef9c48389c6c78ee4004409c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/824/def4d286ef9c48389c6c78ee4004409c/images/large/1.jpg not downloaded yet
2026-03-26 18:34:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/616/baba04693cb44f438e0ad060caee029d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:21 [ayvens.es] INFO: Found listing with ID: 1985926
2026-03-26 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985926%27 HTTP/1.1" 200 None
2026-03-26 18:34:21 [ayvens.es] INFO: Scrape type for 1985926: 1
2026-03-26 18:34:21 [ayvens.es] INFO: Extracting data for car ID: 1985926
2026-03-26 18:34:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f0b0ba7-9cfb-5c77-b3d1-414ae1f1d093 with identifier: 1985926
2026-03-26 18:34:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f0b0ba7-9cfb-5c77-b3d1-414ae1f1d093 with scrape type 1
2026-03-26 18:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5f0b0ba7-9cfb-5c77-b3d1-414ae1f1d093
2026-03-26 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F997%252Fcba0847b87ee436297a43d4293561332%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/997/cba0847b87ee436297a43d4293561332/images/large/1.jpg not downloaded yet
2026-03-26 18:34:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/762/d0320325f0324a8b9ff2e81b98585a82/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:21 [ayvens.es] INFO: Found listing with ID: 1985927
2026-03-26 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985927%27 HTTP/1.1" 200 None
2026-03-26 18:34:21 [ayvens.es] INFO: Scrape type for 1985927: 1
2026-03-26 18:34:21 [ayvens.es] INFO: Extracting data for car ID: 1985927
2026-03-26 18:34:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0fea2138-8f00-5491-9d39-7697b2c48dbe with identifier: 1985927
2026-03-26 18:34:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fea2138-8f00-5491-9d39-7697b2c48dbe with scrape type 1
2026-03-26 18:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0fea2138-8f00-5491-9d39-7697b2c48dbe
2026-03-26 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F300%252F1831d33507fd4fbf9d9d42aac889536d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/300/1831d33507fd4fbf9d9d42aac889536d/images/large/1.jpg not downloaded yet
2026-03-26 18:34:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/494/46f01baef86e41e5992675863f6719fc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/912/fa5fa09c759949bfa6da1852586361b0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:21 [ayvens.es] INFO: Found listing with ID: 1985928
2026-03-26 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985928%27 HTTP/1.1" 200 None
2026-03-26 18:34:21 [ayvens.es] INFO: Scrape type for 1985928: 1
2026-03-26 18:34:21 [ayvens.es] INFO: Extracting data for car ID: 1985928
2026-03-26 18:34:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d51b6a86-c20c-5a9d-8a7b-3772ecef1e40 with identifier: 1985928
2026-03-26 18:34:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d51b6a86-c20c-5a9d-8a7b-3772ecef1e40 with scrape type 1
2026-03-26 18:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d51b6a86-c20c-5a9d-8a7b-3772ecef1e40
2026-03-26 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F210%252F2cc3172e1978433eb42b6b1061589bbf%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/210/2cc3172e1978433eb42b6b1061589bbf/images/large/1.jpg not downloaded yet
2026-03-26 18:34:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28ab9010>
2026-03-26 18:34:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07be7485-ee54-5415-b010-28985834da20/07be7485-ee54-5415-b010-28985834da20_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F351%252F994565e9182e495ab10e501a879c311e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/351/994565e9182e495ab10e501a879c311e/images/large/1.jpg saved to cache
2026-03-26 18:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 07be7485-ee54-5415-b010-28985834da20
2026-03-26 18:34:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 07be7485-ee54-5415-b010-28985834da20, skipping ID generation
2026-03-26 18:34:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07be7485-ee54-5415-b010-28985834da20 with scrape type 1
2026-03-26 18:34:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 07be7485-ee54-5415-b010-28985834da20 sending to next pipeline
2026-03-26 18:34:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 07be7485-ee54-5415-b010-28985834da20, identifier: 1985916
2026-03-26 18:34:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c6d2d0>
2026-03-26 18:34:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_565e95af-fd4a-5314-8654-859cb58a9c39/565e95af-fd4a-5314-8654-859cb58a9c39_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F641%252F8ed5fddd05ea493790d258423cae7594%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/641/8ed5fddd05ea493790d258423cae7594/images/large/1.jpg saved to cache
2026-03-26 18:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 565e95af-fd4a-5314-8654-859cb58a9c39
2026-03-26 18:34:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 565e95af-fd4a-5314-8654-859cb58a9c39, skipping ID generation
2026-03-26 18:34:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 565e95af-fd4a-5314-8654-859cb58a9c39 with scrape type 1
2026-03-26 18:34:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 565e95af-fd4a-5314-8654-859cb58a9c39 sending to next pipeline
2026-03-26 18:34:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 565e95af-fd4a-5314-8654-859cb58a9c39, identifier: 1985918
2026-03-26 18:34:21 [ayvens.es] INFO: Found listing with ID: 1985929
2026-03-26 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985929%27 HTTP/1.1" 200 None
2026-03-26 18:34:21 [ayvens.es] INFO: Scrape type for 1985929: 1
2026-03-26 18:34:21 [ayvens.es] INFO: Extracting data for car ID: 1985929
2026-03-26 18:34:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd68a749-4dbd-5b28-a0dd-c1b268cab7e7 with identifier: 1985929
2026-03-26 18:34:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd68a749-4dbd-5b28-a0dd-c1b268cab7e7 with scrape type 1
2026-03-26 18:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item cd68a749-4dbd-5b28-a0dd-c1b268cab7e7
2026-03-26 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F420%252Fd9eabd2109ec4242b9cdf4cd05e5b9ee%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/420/d9eabd2109ec4242b9cdf4cd05e5b9ee/images/large/1.jpg not downloaded yet
2026-03-26 18:34:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 07be7485-ee54-5415-b010-28985834da20 with identifier: 1985916
2026-03-26 18:34:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:34:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 07be7485-ee54-5415-b010-28985834da20 with identifier: 1985916
2026-03-26 18:34:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 07be7485-ee54-5415-b010-28985834da20 with identifier: 1985916 to the API
2026-03-26 18:34:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/351/994565e9182e495ab10e501a879c311e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'White sand',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '07be7485-ee54-5415-b010-28985834da20',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'TUCSON',
 'odometer': 69102,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07be7485-ee54-5415-b010-28985834da20/07be7485-ee54-5415-b010-28985834da20_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655451,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/351/994565e9182e495ab10e501a879c311e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI TUCSON 1.6 CRDI 85kW (116CV) 48V SLE 4X2',
 'transmission': 'manual',
 'trim': '1.6 CRDI 85kW (116CV) 48V SLE 4X2',
 'vin': None,
 'year': 2020}
2026-03-26 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985916%27 HTTP/1.1" 200 None
2026-03-26 18:34:22 [ayvens.es] INFO: Saving data for 1985916: {'created_time': 1774550062.340233, 'last_price_update_time': 1774550062.340243, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985916') HTTP/1.1" 204 0
2026-03-26 18:34:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 565e95af-fd4a-5314-8654-859cb58a9c39 with identifier: 1985918
2026-03-26 18:34:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 565e95af-fd4a-5314-8654-859cb58a9c39 with identifier: 1985918
2026-03-26 18:34:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 565e95af-fd4a-5314-8654-859cb58a9c39 with identifier: 1985918 to the API
2026-03-26 18:34:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/641/8ed5fddd05ea493790d258423cae7594/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '565e95af-fd4a-5314-8654-859cb58a9c39',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 175780,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_565e95af-fd4a-5314-8654-859cb58a9c39/565e95af-fd4a-5314-8654-859cb58a9c39_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 337425,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/641/8ed5fddd05ea493790d258423cae7594/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 Active BlueHDI 81kW (110CV)',
 'transmission': 'manual',
 'trim': 'Active BlueHDI 81kW (110CV)',
 'vin': None,
 'year': 2021}
2026-03-26 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985918%27 HTTP/1.1" 200 None
2026-03-26 18:34:22 [ayvens.es] INFO: Saving data for 1985918: {'created_time': 1774550062.680029, 'last_price_update_time': 1774550062.680041, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985918') HTTP/1.1" 204 0
2026-03-26 18:34:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c81990>
2026-03-26 18:34:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5e987b0-a578-59d6-baea-46b41b141a72/c5e987b0-a578-59d6-baea-46b41b141a72_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F616%252Fbaba04693cb44f438e0ad060caee029d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/616/baba04693cb44f438e0ad060caee029d/images/large/1.jpg saved to cache
2026-03-26 18:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c5e987b0-a578-59d6-baea-46b41b141a72
2026-03-26 18:34:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c5e987b0-a578-59d6-baea-46b41b141a72, skipping ID generation
2026-03-26 18:34:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5e987b0-a578-59d6-baea-46b41b141a72 with scrape type 1
2026-03-26 18:34:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c5e987b0-a578-59d6-baea-46b41b141a72 sending to next pipeline
2026-03-26 18:34:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c5e987b0-a578-59d6-baea-46b41b141a72, identifier: 1985920
2026-03-26 18:34:22 [ayvens.es] INFO: Found listing with ID: 1985930
2026-03-26 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985930%27 HTTP/1.1" 200 None
2026-03-26 18:34:22 [ayvens.es] INFO: Scrape type for 1985930: 1
2026-03-26 18:34:22 [ayvens.es] INFO: Extracting data for car ID: 1985930
2026-03-26 18:34:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c3f5d23-6d52-58a7-bab3-e889afaa45fd with identifier: 1985930
2026-03-26 18:34:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c3f5d23-6d52-58a7-bab3-e889afaa45fd with scrape type 1
2026-03-26 18:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9c3f5d23-6d52-58a7-bab3-e889afaa45fd
2026-03-26 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F753%252F273f17fe13ac44f28954842d6194ae91%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/753/273f17fe13ac44f28954842d6194ae91/images/large/1.jpg not downloaded yet
2026-03-26 18:34:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c5e987b0-a578-59d6-baea-46b41b141a72 with identifier: 1985920
2026-03-26 18:34:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c5e987b0-a578-59d6-baea-46b41b141a72 with identifier: 1985920
2026-03-26 18:34:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c5e987b0-a578-59d6-baea-46b41b141a72 with identifier: 1985920 to the API
2026-03-26 18:34:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/616/baba04693cb44f438e0ad060caee029d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Sapporo white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'c5e987b0-a578-59d6-baea-46b41b141a72',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 59849,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5e987b0-a578-59d6-baea-46b41b141a72/c5e987b0-a578-59d6-baea-46b41b141a72_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329296,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/616/baba04693cb44f438e0ad060caee029d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI DIG-T 116kW Xtronic N-Connecta',
 'transmission': 'manual',
 'trim': 'DIG-T 116kW Xtronic N-Connecta',
 'vin': None,
 'year': 2023}
2026-03-26 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985920%27 HTTP/1.1" 200 None
2026-03-26 18:34:23 [ayvens.es] INFO: Saving data for 1985920: {'created_time': 1774550063.254627, 'last_price_update_time': 1774550063.254637, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985920') HTTP/1.1" 204 0
2026-03-26 18:34:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c373d0>
2026-03-26 18:34:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27134a3d-f5de-54e9-8cc6-bf841cdf96bc/27134a3d-f5de-54e9-8cc6-bf841cdf96bc_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F762%252Fd0320325f0324a8b9ff2e81b98585a82%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/762/d0320325f0324a8b9ff2e81b98585a82/images/large/1.jpg saved to cache
2026-03-26 18:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 27134a3d-f5de-54e9-8cc6-bf841cdf96bc
2026-03-26 18:34:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 27134a3d-f5de-54e9-8cc6-bf841cdf96bc, skipping ID generation
2026-03-26 18:34:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27134a3d-f5de-54e9-8cc6-bf841cdf96bc with scrape type 1
2026-03-26 18:34:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 27134a3d-f5de-54e9-8cc6-bf841cdf96bc sending to next pipeline
2026-03-26 18:34:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 27134a3d-f5de-54e9-8cc6-bf841cdf96bc, identifier: 1985919
2026-03-26 18:34:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28394710>
2026-03-26 18:34:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_681cd477-e9fe-5237-8cbb-367e471f7e0a/681cd477-e9fe-5237-8cbb-367e471f7e0a_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F494%252F46f01baef86e41e5992675863f6719fc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/494/46f01baef86e41e5992675863f6719fc/images/large/1.jpg saved to cache
2026-03-26 18:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 681cd477-e9fe-5237-8cbb-367e471f7e0a
2026-03-26 18:34:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 681cd477-e9fe-5237-8cbb-367e471f7e0a, skipping ID generation
2026-03-26 18:34:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 681cd477-e9fe-5237-8cbb-367e471f7e0a with scrape type 1
2026-03-26 18:34:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 681cd477-e9fe-5237-8cbb-367e471f7e0a sending to next pipeline
2026-03-26 18:34:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 681cd477-e9fe-5237-8cbb-367e471f7e0a, identifier: 1985921
2026-03-26 18:34:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c30910>
2026-03-26 18:34:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5710c43a-5c21-5cc8-b05e-963dddbaaacc/5710c43a-5c21-5cc8-b05e-963dddbaaacc_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F912%252Ffa5fa09c759949bfa6da1852586361b0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/912/fa5fa09c759949bfa6da1852586361b0/images/large/1.jpg saved to cache
2026-03-26 18:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5710c43a-5c21-5cc8-b05e-963dddbaaacc
2026-03-26 18:34:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5710c43a-5c21-5cc8-b05e-963dddbaaacc, skipping ID generation
2026-03-26 18:34:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5710c43a-5c21-5cc8-b05e-963dddbaaacc with scrape type 1
2026-03-26 18:34:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5710c43a-5c21-5cc8-b05e-963dddbaaacc sending to next pipeline
2026-03-26 18:34:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5710c43a-5c21-5cc8-b05e-963dddbaaacc, identifier: 1985922
2026-03-26 18:34:23 [ayvens.es] INFO: Found listing with ID: 1985931
2026-03-26 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985931%27 HTTP/1.1" 200 None
2026-03-26 18:34:23 [ayvens.es] INFO: Scrape type for 1985931: 1
2026-03-26 18:34:23 [ayvens.es] INFO: Extracting data for car ID: 1985931
2026-03-26 18:34:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73526f6a-16aa-581f-9b2e-e927bed287e0 with identifier: 1985931
2026-03-26 18:34:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73526f6a-16aa-581f-9b2e-e927bed287e0 with scrape type 1
2026-03-26 18:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 73526f6a-16aa-581f-9b2e-e927bed287e0
2026-03-26 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F049%252Ff607828cfe474829a2da43323dbcbc99%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/049/f607828cfe474829a2da43323dbcbc99/images/large/1.jpg not downloaded yet
2026-03-26 18:34:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 27134a3d-f5de-54e9-8cc6-bf841cdf96bc with identifier: 1985919
2026-03-26 18:34:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 27134a3d-f5de-54e9-8cc6-bf841cdf96bc with identifier: 1985919
2026-03-26 18:34:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 27134a3d-f5de-54e9-8cc6-bf841cdf96bc with identifier: 1985919 to the API
2026-03-26 18:34:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/762/d0320325f0324a8b9ff2e81b98585a82/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 96,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '27134a3d-f5de-54e9-8cc6-bf841cdf96bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C3',
 'odometer': 116040,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27134a3d-f5de-54e9-8cc6-bf841cdf96bc/27134a3d-f5de-54e9-8cc6-bf841cdf96bc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 556217,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/762/d0320325f0324a8b9ff2e81b98585a82/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C3 BlueHDi 73KW (100CV) S&S FEEL',
 'transmission': 'manual',
 'trim': 'BlueHDi 73KW (100CV) S&S FEEL',
 'vin': None,
 'year': 2019}
2026-03-26 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985919%27 HTTP/1.1" 200 None
2026-03-26 18:34:24 [ayvens.es] INFO: Saving data for 1985919: {'created_time': 1774550064.199701, 'last_price_update_time': 1774550064.199712, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985919') HTTP/1.1" 204 0
2026-03-26 18:34:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 681cd477-e9fe-5237-8cbb-367e471f7e0a with identifier: 1985921
2026-03-26 18:34:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:34:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 681cd477-e9fe-5237-8cbb-367e471f7e0a with identifier: 1985921
2026-03-26 18:34:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 681cd477-e9fe-5237-8cbb-367e471f7e0a with identifier: 1985921 to the API
2026-03-26 18:34:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/494/46f01baef86e41e5992675863f6719fc/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 168,
 'color': 'Eiger grey',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '681cd477-e9fe-5237-8cbb-367e471f7e0a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER VELAR',
 'odometer': 94413,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_681cd477-e9fe-5237-8cbb-367e471f7e0a/681cd477-e9fe-5237-8cbb-367e471f7e0a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 400748,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/494/46f01baef86e41e5992675863f6719fc/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER RANGE ROVER VELAR 2.0D I4 150kW (204CV) S 4WD Auto',
 'transmission': 'manual',
 'trim': '2.0D I4 150kW (204CV) S 4WD Auto',
 'vin': None,
 'year': 2022}
2026-03-26 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985921%27 HTTP/1.1" 200 None
2026-03-26 18:34:24 [ayvens.es] INFO: Saving data for 1985921: {'created_time': 1774550064.547776, 'last_price_update_time': 1774550064.547786, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985921') HTTP/1.1" 204 0
2026-03-26 18:34:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5710c43a-5c21-5cc8-b05e-963dddbaaacc with identifier: 1985922
2026-03-26 18:34:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5710c43a-5c21-5cc8-b05e-963dddbaaacc with identifier: 1985922
2026-03-26 18:34:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5710c43a-5c21-5cc8-b05e-963dddbaaacc with identifier: 1985922 to the API
2026-03-26 18:34:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/912/fa5fa09c759949bfa6da1852586361b0/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '5710c43a-5c21-5cc8-b05e-963dddbaaacc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '208',
 'odometer': 69258,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5710c43a-5c21-5cc8-b05e-963dddbaaacc/5710c43a-5c21-5cc8-b05e-963dddbaaacc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 326795,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/912/fa5fa09c759949bfa6da1852586361b0/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 208 BlueHDi 73kW (100CV) Active',
 'transmission': 'manual',
 'trim': 'BlueHDi 73kW (100CV) Active',
 'vin': None,
 'year': 2022}
2026-03-26 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985922%27 HTTP/1.1" 200 None
2026-03-26 18:34:24 [ayvens.es] INFO: Saving data for 1985922: {'created_time': 1774550064.895193, 'last_price_update_time': 1774550064.895203, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985922') HTTP/1.1" 204 0
2026-03-26 18:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/997/cba0847b87ee436297a43d4293561332/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/956/8562ed47a0dd4c12b90e0b7f54e945af/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/824/def4d286ef9c48389c6c78ee4004409c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:24 [ayvens.es] INFO: Found listing with ID: 1985932
2026-03-26 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985932%27 HTTP/1.1" 200 None
2026-03-26 18:34:24 [ayvens.es] INFO: Scrape type for 1985932: 1
2026-03-26 18:34:24 [ayvens.es] INFO: Extracting data for car ID: 1985932
2026-03-26 18:34:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 128b6dfe-b465-5500-a1ea-25c049fbc4d8 with identifier: 1985932
2026-03-26 18:34:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 128b6dfe-b465-5500-a1ea-25c049fbc4d8 with scrape type 1
2026-03-26 18:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 128b6dfe-b465-5500-a1ea-25c049fbc4d8
2026-03-26 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F643%252F542f15a6ce8648ff99a13fa78d822392%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/643/542f15a6ce8648ff99a13fa78d822392/images/large/1.jpg not downloaded yet
2026-03-26 18:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/300/1831d33507fd4fbf9d9d42aac889536d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/046/7bb4e54ceb93468da77544fd84020c4d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:24 [ayvens.es] INFO: Found listing with ID: 1985933
2026-03-26 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985933%27 HTTP/1.1" 200 None
2026-03-26 18:34:25 [ayvens.es] INFO: Scrape type for 1985933: 1
2026-03-26 18:34:25 [ayvens.es] INFO: Extracting data for car ID: 1985933
2026-03-26 18:34:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94f48d3e-e3b7-5149-95d6-d6c04a3311a4 with identifier: 1985933
2026-03-26 18:34:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94f48d3e-e3b7-5149-95d6-d6c04a3311a4 with scrape type 1
2026-03-26 18:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 94f48d3e-e3b7-5149-95d6-d6c04a3311a4
2026-03-26 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F812%252F920dbada881a455590154e5b852f9566%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/812/920dbada881a455590154e5b852f9566/images/large/1.jpg not downloaded yet
2026-03-26 18:34:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/210/2cc3172e1978433eb42b6b1061589bbf/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:25 [ayvens.es] INFO: Found listing with ID: 1985934
2026-03-26 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985934%27 HTTP/1.1" 200 None
2026-03-26 18:34:25 [ayvens.es] INFO: Scrape type for 1985934: 1
2026-03-26 18:34:25 [ayvens.es] INFO: Extracting data for car ID: 1985934
2026-03-26 18:34:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df1543a6-2d49-580c-a384-599e70c90b65 with identifier: 1985934
2026-03-26 18:34:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df1543a6-2d49-580c-a384-599e70c90b65 with scrape type 1
2026-03-26 18:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item df1543a6-2d49-580c-a384-599e70c90b65
2026-03-26 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F815%252F24e6d2ffac9f43549894b2ac126ab790%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/815/24e6d2ffac9f43549894b2ac126ab790/images/large/1.jpg not downloaded yet
2026-03-26 18:34:25 [ayvens.es] INFO: Found listing with ID: 1985935
2026-03-26 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985935%27 HTTP/1.1" 200 None
2026-03-26 18:34:25 [ayvens.es] INFO: Scrape type for 1985935: 1
2026-03-26 18:34:25 [ayvens.es] INFO: Extracting data for car ID: 1985935
2026-03-26 18:34:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f94f7bb-2673-5c00-b7d7-995d6daf4e0c with identifier: 1985935
2026-03-26 18:34:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f94f7bb-2673-5c00-b7d7-995d6daf4e0c with scrape type 1
2026-03-26 18:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3f94f7bb-2673-5c00-b7d7-995d6daf4e0c
2026-03-26 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F574%252F9a9804e4b6604e02a35b0220f9252d08%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/574/9a9804e4b6604e02a35b0220f9252d08/images/large/1.jpg not downloaded yet
2026-03-26 18:34:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/420/d9eabd2109ec4242b9cdf4cd05e5b9ee/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a29031350>
2026-03-26 18:34:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f0b0ba7-9cfb-5c77-b3d1-414ae1f1d093/5f0b0ba7-9cfb-5c77-b3d1-414ae1f1d093_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F997%252Fcba0847b87ee436297a43d4293561332%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/997/cba0847b87ee436297a43d4293561332/images/large/1.jpg saved to cache
2026-03-26 18:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5f0b0ba7-9cfb-5c77-b3d1-414ae1f1d093
2026-03-26 18:34:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5f0b0ba7-9cfb-5c77-b3d1-414ae1f1d093, skipping ID generation
2026-03-26 18:34:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f0b0ba7-9cfb-5c77-b3d1-414ae1f1d093 with scrape type 1
2026-03-26 18:34:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5f0b0ba7-9cfb-5c77-b3d1-414ae1f1d093 sending to next pipeline
2026-03-26 18:34:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5f0b0ba7-9cfb-5c77-b3d1-414ae1f1d093, identifier: 1985926
2026-03-26 18:34:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a283dcb10>
2026-03-26 18:34:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fecb344-051e-5564-b6f8-b0a94ab07fca/6fecb344-051e-5564-b6f8-b0a94ab07fca_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F956%252F8562ed47a0dd4c12b90e0b7f54e945af%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/956/8562ed47a0dd4c12b90e0b7f54e945af/images/large/1.jpg saved to cache
2026-03-26 18:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6fecb344-051e-5564-b6f8-b0a94ab07fca
2026-03-26 18:34:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6fecb344-051e-5564-b6f8-b0a94ab07fca, skipping ID generation
2026-03-26 18:34:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fecb344-051e-5564-b6f8-b0a94ab07fca with scrape type 1
2026-03-26 18:34:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6fecb344-051e-5564-b6f8-b0a94ab07fca sending to next pipeline
2026-03-26 18:34:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6fecb344-051e-5564-b6f8-b0a94ab07fca, identifier: 1985924
2026-03-26 18:34:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a283e6050>
2026-03-26 18:34:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8310567d-aee5-5897-80b2-16623c28ca00/8310567d-aee5-5897-80b2-16623c28ca00_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F824%252Fdef4d286ef9c48389c6c78ee4004409c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/824/def4d286ef9c48389c6c78ee4004409c/images/large/1.jpg saved to cache
2026-03-26 18:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8310567d-aee5-5897-80b2-16623c28ca00
2026-03-26 18:34:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8310567d-aee5-5897-80b2-16623c28ca00, skipping ID generation
2026-03-26 18:34:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8310567d-aee5-5897-80b2-16623c28ca00 with scrape type 1
2026-03-26 18:34:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8310567d-aee5-5897-80b2-16623c28ca00 sending to next pipeline
2026-03-26 18:34:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8310567d-aee5-5897-80b2-16623c28ca00, identifier: 1985925
2026-03-26 18:34:25 [ayvens.es] INFO: Found listing with ID: 1985936
2026-03-26 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985936%27 HTTP/1.1" 200 None
2026-03-26 18:34:25 [ayvens.es] INFO: Scrape type for 1985936: 1
2026-03-26 18:34:25 [ayvens.es] INFO: Extracting data for car ID: 1985936
2026-03-26 18:34:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 900ade25-b85b-5235-9ca6-a354356aa3ae with identifier: 1985936
2026-03-26 18:34:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 900ade25-b85b-5235-9ca6-a354356aa3ae with scrape type 1
2026-03-26 18:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 900ade25-b85b-5235-9ca6-a354356aa3ae
2026-03-26 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F233%252F202dca3a1a4a4f2d8c66e272f2078eca%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/233/202dca3a1a4a4f2d8c66e272f2078eca/images/large/1.jpg not downloaded yet
2026-03-26 18:34:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5f0b0ba7-9cfb-5c77-b3d1-414ae1f1d093 with identifier: 1985926
2026-03-26 18:34:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5f0b0ba7-9cfb-5c77-b3d1-414ae1f1d093 with identifier: 1985926
2026-03-26 18:34:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5f0b0ba7-9cfb-5c77-b3d1-414ae1f1d093 with identifier: 1985926 to the API
2026-03-26 18:34:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/997/cba0847b87ee436297a43d4293561332/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '5f0b0ba7-9cfb-5c77-b3d1-414ae1f1d093',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO',
 'odometer': 197199,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f0b0ba7-9cfb-5c77-b3d1-414ae1f1d093/5f0b0ba7-9cfb-5c77-b3d1-414ae1f1d093_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 295207,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/997/cba0847b87ee436297a43d4293561332/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT KANGOO Profesional M1-AF Blue dCi 70 kW (95 CV)',
 'transmission': 'manual',
 'trim': 'Profesional M1-AF Blue dCi 70 kW (95 CV)',
 'vin': None,
 'year': 2020}
2026-03-26 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985926%27 HTTP/1.1" 200 None
2026-03-26 18:34:26 [ayvens.es] INFO: Saving data for 1985926: {'created_time': 1774550066.80146, 'last_price_update_time': 1774550066.801471, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985926') HTTP/1.1" 204 0
2026-03-26 18:34:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6fecb344-051e-5564-b6f8-b0a94ab07fca with identifier: 1985924
2026-03-26 18:34:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6fecb344-051e-5564-b6f8-b0a94ab07fca with identifier: 1985924
2026-03-26 18:34:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 6fecb344-051e-5564-b6f8-b0a94ab07fca with identifier: 1985924 to the API
2026-03-26 18:34:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/956/8562ed47a0dd4c12b90e0b7f54e945af/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '6fecb344-051e-5564-b6f8-b0a94ab07fca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 211757,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fecb344-051e-5564-b6f8-b0a94ab07fca/6fecb344-051e-5564-b6f8-b0a94ab07fca_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 310184,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/956/8562ed47a0dd4c12b90e0b7f54e945af/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-04',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS Profesional Blue dCi 70kW (95CV)',
 'transmission': 'manual',
 'trim': 'Profesional Blue dCi 70kW (95CV)',
 'vin': None,
 'year': 2020}
2026-03-26 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985924%27 HTTP/1.1" 200 None
2026-03-26 18:34:27 [ayvens.es] INFO: Saving data for 1985924: {'created_time': 1774550067.166627, 'last_price_update_time': 1774550067.166637, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985924') HTTP/1.1" 204 0
2026-03-26 18:34:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8310567d-aee5-5897-80b2-16623c28ca00 with identifier: 1985925
2026-03-26 18:34:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8310567d-aee5-5897-80b2-16623c28ca00 with identifier: 1985925
2026-03-26 18:34:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8310567d-aee5-5897-80b2-16623c28ca00 with identifier: 1985925 to the API
2026-03-26 18:34:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/824/def4d286ef9c48389c6c78ee4004409c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'color': 'Blanco suave',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '8310567d-aee5-5897-80b2-16623c28ca00',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 204262,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8310567d-aee5-5897-80b2-16623c28ca00/8310567d-aee5-5897-80b2-16623c28ca00_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 333683,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/824/def4d286ef9c48389c6c78ee4004409c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON 2.0 TDI 85kW S&S Style Go',
 'transmission': 'manual',
 'trim': '2.0 TDI 85kW S&S Style Go',
 'vin': None,
 'year': 2021}
2026-03-26 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985925%27 HTTP/1.1" 200 None
2026-03-26 18:34:27 [ayvens.es] INFO: Saving data for 1985925: {'created_time': 1774550067.460003, 'last_price_update_time': 1774550067.460013, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985925') HTTP/1.1" 204 0
2026-03-26 18:34:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28aba3d0>
2026-03-26 18:34:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fea2138-8f00-5491-9d39-7697b2c48dbe/0fea2138-8f00-5491-9d39-7697b2c48dbe_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F300%252F1831d33507fd4fbf9d9d42aac889536d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/300/1831d33507fd4fbf9d9d42aac889536d/images/large/1.jpg saved to cache
2026-03-26 18:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0fea2138-8f00-5491-9d39-7697b2c48dbe
2026-03-26 18:34:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0fea2138-8f00-5491-9d39-7697b2c48dbe, skipping ID generation
2026-03-26 18:34:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fea2138-8f00-5491-9d39-7697b2c48dbe with scrape type 1
2026-03-26 18:34:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0fea2138-8f00-5491-9d39-7697b2c48dbe sending to next pipeline
2026-03-26 18:34:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0fea2138-8f00-5491-9d39-7697b2c48dbe, identifier: 1985927
2026-03-26 18:34:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28f83690>
2026-03-26 18:34:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1edcea86-b3f1-50d1-b831-7a255a2ebe78/1edcea86-b3f1-50d1-b831-7a255a2ebe78_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F046%252F7bb4e54ceb93468da77544fd84020c4d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/046/7bb4e54ceb93468da77544fd84020c4d/images/large/1.jpg saved to cache
2026-03-26 18:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1edcea86-b3f1-50d1-b831-7a255a2ebe78
2026-03-26 18:34:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1edcea86-b3f1-50d1-b831-7a255a2ebe78, skipping ID generation
2026-03-26 18:34:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1edcea86-b3f1-50d1-b831-7a255a2ebe78 with scrape type 1
2026-03-26 18:34:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1edcea86-b3f1-50d1-b831-7a255a2ebe78 sending to next pipeline
2026-03-26 18:34:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1edcea86-b3f1-50d1-b831-7a255a2ebe78, identifier: 1985923
2026-03-26 18:34:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c29b50>
2026-03-26 18:34:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d51b6a86-c20c-5a9d-8a7b-3772ecef1e40/d51b6a86-c20c-5a9d-8a7b-3772ecef1e40_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F210%252F2cc3172e1978433eb42b6b1061589bbf%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/210/2cc3172e1978433eb42b6b1061589bbf/images/large/1.jpg saved to cache
2026-03-26 18:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d51b6a86-c20c-5a9d-8a7b-3772ecef1e40
2026-03-26 18:34:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d51b6a86-c20c-5a9d-8a7b-3772ecef1e40, skipping ID generation
2026-03-26 18:34:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d51b6a86-c20c-5a9d-8a7b-3772ecef1e40 with scrape type 1
2026-03-26 18:34:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d51b6a86-c20c-5a9d-8a7b-3772ecef1e40 sending to next pipeline
2026-03-26 18:34:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d51b6a86-c20c-5a9d-8a7b-3772ecef1e40, identifier: 1985928
2026-03-26 18:34:27 [ayvens.es] INFO: Found listing with ID: 1985937
2026-03-26 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985937%27 HTTP/1.1" 200 None
2026-03-26 18:34:27 [ayvens.es] INFO: Scrape type for 1985937: 1
2026-03-26 18:34:27 [ayvens.es] INFO: Extracting data for car ID: 1985937
2026-03-26 18:34:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0f63492-7fe2-526e-bbdb-064221f4d7fa with identifier: 1985937
2026-03-26 18:34:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0f63492-7fe2-526e-bbdb-064221f4d7fa with scrape type 1
2026-03-26 18:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e0f63492-7fe2-526e-bbdb-064221f4d7fa
2026-03-26 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F716%252Fd3480518ab97446d829f6121879c0ccf%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/716/d3480518ab97446d829f6121879c0ccf/images/large/1.jpg not downloaded yet
2026-03-26 18:34:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0fea2138-8f00-5491-9d39-7697b2c48dbe with identifier: 1985927
2026-03-26 18:34:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0fea2138-8f00-5491-9d39-7697b2c48dbe with identifier: 1985927
2026-03-26 18:34:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0fea2138-8f00-5491-9d39-7697b2c48dbe with identifier: 1985927 to the API
2026-03-26 18:34:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/300/1831d33507fd4fbf9d9d42aac889536d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 260,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.3L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '0fea2138-8f00-5491-9d39-7697b2c48dbe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MASTER',
 'odometer': 176035,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fea2138-8f00-5491-9d39-7697b2c48dbe/0fea2138-8f00-5491-9d39-7697b2c48dbe_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 343201,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/300/1831d33507fd4fbf9d9d42aac889536d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-25',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT MASTER 3T5 VAN STD FWD 130 E6 L3H2',
 'transmission': 'manual',
 'trim': '3T5 VAN STD FWD 130 E6 L3H2',
 'vin': None,
 'year': 2020}
2026-03-26 18:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985927%27 HTTP/1.1" 200 None
2026-03-26 18:34:28 [ayvens.es] INFO: Saving data for 1985927: {'created_time': 1774550068.276087, 'last_price_update_time': 1774550068.2761, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985927') HTTP/1.1" 204 0
2026-03-26 18:34:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1edcea86-b3f1-50d1-b831-7a255a2ebe78 with identifier: 1985923
2026-03-26 18:34:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1edcea86-b3f1-50d1-b831-7a255a2ebe78 with identifier: 1985923
2026-03-26 18:34:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1edcea86-b3f1-50d1-b831-7a255a2ebe78 with identifier: 1985923 to the API
2026-03-26 18:34:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/046/7bb4e54ceb93468da77544fd84020c4d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '1edcea86-b3f1-50d1-b831-7a255a2ebe78',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'CORSA',
 'odometer': 80053,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1edcea86-b3f1-50d1-b831-7a255a2ebe78/1edcea86-b3f1-50d1-b831-7a255a2ebe78_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 490938,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/046/7bb4e54ceb93468da77544fd84020c4d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL CORSA 1.4 66kW (90CV) Selective Pro',
 'transmission': 'manual',
 'trim': '1.4 66kW (90CV) Selective Pro',
 'vin': None,
 'year': 2019}
2026-03-26 18:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985923%27 HTTP/1.1" 200 None
2026-03-26 18:34:28 [ayvens.es] INFO: Saving data for 1985923: {'created_time': 1774550068.621851, 'last_price_update_time': 1774550068.621861, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985923') HTTP/1.1" 204 0
2026-03-26 18:34:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d51b6a86-c20c-5a9d-8a7b-3772ecef1e40 with identifier: 1985928
2026-03-26 18:34:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d51b6a86-c20c-5a9d-8a7b-3772ecef1e40 with identifier: 1985928
2026-03-26 18:34:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d51b6a86-c20c-5a9d-8a7b-3772ecef1e40 with identifier: 1985928 to the API
2026-03-26 18:34:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/210/2cc3172e1978433eb42b6b1061589bbf/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'Plata pirita',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd51b6a86-c20c-5a9d-8a7b-3772ecef1e40',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT',
 'odometer': 114522,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d51b6a86-c20c-5a9d-8a7b-3772ecef1e40/d51b6a86-c20c-5a9d-8a7b-3772ecef1e40_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 312385,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/210/2cc3172e1978433eb42b6b1061589bbf/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT Executive 2.0 TDI 110kW (150CV)',
 'transmission': 'manual',
 'trim': 'Executive 2.0 TDI 110kW (150CV)',
 'vin': None,
 'year': 2020}
2026-03-26 18:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985928%27 HTTP/1.1" 200 None
2026-03-26 18:34:28 [ayvens.es] INFO: Saving data for 1985928: {'created_time': 1774550068.929185, 'last_price_update_time': 1774550068.929195, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985928') HTTP/1.1" 204 0
2026-03-26 18:34:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28caf410>
2026-03-26 18:34:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd68a749-4dbd-5b28-a0dd-c1b268cab7e7/cd68a749-4dbd-5b28-a0dd-c1b268cab7e7_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F420%252Fd9eabd2109ec4242b9cdf4cd05e5b9ee%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/420/d9eabd2109ec4242b9cdf4cd05e5b9ee/images/large/1.jpg saved to cache
2026-03-26 18:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cd68a749-4dbd-5b28-a0dd-c1b268cab7e7
2026-03-26 18:34:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cd68a749-4dbd-5b28-a0dd-c1b268cab7e7, skipping ID generation
2026-03-26 18:34:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd68a749-4dbd-5b28-a0dd-c1b268cab7e7 with scrape type 1
2026-03-26 18:34:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cd68a749-4dbd-5b28-a0dd-c1b268cab7e7 sending to next pipeline
2026-03-26 18:34:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: cd68a749-4dbd-5b28-a0dd-c1b268cab7e7, identifier: 1985929
2026-03-26 18:34:29 [ayvens.es] INFO: Found listing with ID: 1985938
2026-03-26 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985938%27 HTTP/1.1" 200 None
2026-03-26 18:34:29 [ayvens.es] INFO: Scrape type for 1985938: 1
2026-03-26 18:34:29 [ayvens.es] INFO: Extracting data for car ID: 1985938
2026-03-26 18:34:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fc0de46-af2b-5680-a07c-6d502dce14f5 with identifier: 1985938
2026-03-26 18:34:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fc0de46-af2b-5680-a07c-6d502dce14f5 with scrape type 1
2026-03-26 18:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1fc0de46-af2b-5680-a07c-6d502dce14f5
2026-03-26 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F381%252F5bb425fa7705443bacf0e1e6be67d826%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/381/5bb425fa7705443bacf0e1e6be67d826/images/large/1.jpg not downloaded yet
2026-03-26 18:34:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: cd68a749-4dbd-5b28-a0dd-c1b268cab7e7 with identifier: 1985929
2026-03-26 18:34:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: cd68a749-4dbd-5b28-a0dd-c1b268cab7e7 with identifier: 1985929
2026-03-26 18:34:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: cd68a749-4dbd-5b28-a0dd-c1b268cab7e7 with identifier: 1985929 to the API
2026-03-26 18:34:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/420/d9eabd2109ec4242b9cdf4cd05e5b9ee/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'cd68a749-4dbd-5b28-a0dd-c1b268cab7e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 135753,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd68a749-4dbd-5b28-a0dd-c1b268cab7e7/cd68a749-4dbd-5b28-a0dd-c1b268cab7e7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 495710,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/420/d9eabd2109ec4242b9cdf4cd05e5b9ee/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-17',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS Profesional dCi 55 kW (75 CV)',
 'transmission': 'manual',
 'trim': 'Profesional dCi 55 kW (75 CV)',
 'vin': None,
 'year': 2019}
2026-03-26 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985929%27 HTTP/1.1" 200 None
2026-03-26 18:34:29 [ayvens.es] INFO: Saving data for 1985929: {'created_time': 1774550069.447963, 'last_price_update_time': 1774550069.447974, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985929') HTTP/1.1" 204 0
2026-03-26 18:34:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/753/273f17fe13ac44f28954842d6194ae91/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/643/542f15a6ce8648ff99a13fa78d822392/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/812/920dbada881a455590154e5b852f9566/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:29 [ayvens.es] INFO: Found listing with ID: 1985939
2026-03-26 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985939%27 HTTP/1.1" 200 None
2026-03-26 18:34:29 [ayvens.es] INFO: Scrape type for 1985939: 1
2026-03-26 18:34:29 [ayvens.es] INFO: Extracting data for car ID: 1985939
2026-03-26 18:34:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b29dc4e2-0f55-5fdf-84c0-aaab7b85555d with identifier: 1985939
2026-03-26 18:34:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b29dc4e2-0f55-5fdf-84c0-aaab7b85555d with scrape type 1
2026-03-26 18:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b29dc4e2-0f55-5fdf-84c0-aaab7b85555d
2026-03-26 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F235%252F5e23f71f9b1b4cb688e4cc25500002fb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/235/5e23f71f9b1b4cb688e4cc25500002fb/images/large/1.jpg not downloaded yet
2026-03-26 18:34:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/815/24e6d2ffac9f43549894b2ac126ab790/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/049/f607828cfe474829a2da43323dbcbc99/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:29 [ayvens.es] INFO: Found listing with ID: 1985940
2026-03-26 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985940%27 HTTP/1.1" 200 None
2026-03-26 18:34:29 [ayvens.es] INFO: Scrape type for 1985940: 1
2026-03-26 18:34:29 [ayvens.es] INFO: Extracting data for car ID: 1985940
2026-03-26 18:34:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d95d0bc-b307-5109-ae9d-fc2e5984a2ac with identifier: 1985940
2026-03-26 18:34:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d95d0bc-b307-5109-ae9d-fc2e5984a2ac with scrape type 1
2026-03-26 18:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9d95d0bc-b307-5109-ae9d-fc2e5984a2ac
2026-03-26 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F801%252Fe2d0dfc388444bd594150bb4f875b59c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/801/e2d0dfc388444bd594150bb4f875b59c/images/large/1.jpg not downloaded yet
2026-03-26 18:34:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/574/9a9804e4b6604e02a35b0220f9252d08/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:29 [ayvens.es] INFO: Found listing with ID: 1985941
2026-03-26 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985941%27 HTTP/1.1" 200 None
2026-03-26 18:34:29 [ayvens.es] INFO: Scrape type for 1985941: 1
2026-03-26 18:34:29 [ayvens.es] INFO: Extracting data for car ID: 1985941
2026-03-26 18:34:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0629ae7b-4d12-5fa6-bdba-9f23580273ad with identifier: 1985941
2026-03-26 18:34:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0629ae7b-4d12-5fa6-bdba-9f23580273ad with scrape type 1
2026-03-26 18:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0629ae7b-4d12-5fa6-bdba-9f23580273ad
2026-03-26 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F529%252F30e6b70b59114844a3717510406c3c02%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/529/30e6b70b59114844a3717510406c3c02/images/large/1.jpg not downloaded yet
2026-03-26 18:34:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/233/202dca3a1a4a4f2d8c66e272f2078eca/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:29 [ayvens.es] INFO: Found listing with ID: 1985942
2026-03-26 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985942%27 HTTP/1.1" 200 None
2026-03-26 18:34:29 [ayvens.es] INFO: Scrape type for 1985942: 1
2026-03-26 18:34:29 [ayvens.es] INFO: Extracting data for car ID: 1985942
2026-03-26 18:34:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b7a407b-ca52-5c7d-a1aa-daeaa044399c with identifier: 1985942
2026-03-26 18:34:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b7a407b-ca52-5c7d-a1aa-daeaa044399c with scrape type 1
2026-03-26 18:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9b7a407b-ca52-5c7d-a1aa-daeaa044399c
2026-03-26 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F303%252F07bf020bf86f420bb35b265031588c19%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/303/07bf020bf86f420bb35b265031588c19/images/large/1.jpg not downloaded yet
2026-03-26 18:34:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28de8dd0>
2026-03-26 18:34:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c3f5d23-6d52-58a7-bab3-e889afaa45fd/9c3f5d23-6d52-58a7-bab3-e889afaa45fd_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F753%252F273f17fe13ac44f28954842d6194ae91%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/753/273f17fe13ac44f28954842d6194ae91/images/large/1.jpg saved to cache
2026-03-26 18:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9c3f5d23-6d52-58a7-bab3-e889afaa45fd
2026-03-26 18:34:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9c3f5d23-6d52-58a7-bab3-e889afaa45fd, skipping ID generation
2026-03-26 18:34:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c3f5d23-6d52-58a7-bab3-e889afaa45fd with scrape type 1
2026-03-26 18:34:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9c3f5d23-6d52-58a7-bab3-e889afaa45fd sending to next pipeline
2026-03-26 18:34:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9c3f5d23-6d52-58a7-bab3-e889afaa45fd, identifier: 1985930
2026-03-26 18:34:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a281fe390>
2026-03-26 18:34:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_128b6dfe-b465-5500-a1ea-25c049fbc4d8/128b6dfe-b465-5500-a1ea-25c049fbc4d8_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F643%252F542f15a6ce8648ff99a13fa78d822392%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/643/542f15a6ce8648ff99a13fa78d822392/images/large/1.jpg saved to cache
2026-03-26 18:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 128b6dfe-b465-5500-a1ea-25c049fbc4d8
2026-03-26 18:34:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 128b6dfe-b465-5500-a1ea-25c049fbc4d8, skipping ID generation
2026-03-26 18:34:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 128b6dfe-b465-5500-a1ea-25c049fbc4d8 with scrape type 1
2026-03-26 18:34:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 128b6dfe-b465-5500-a1ea-25c049fbc4d8 sending to next pipeline
2026-03-26 18:34:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 128b6dfe-b465-5500-a1ea-25c049fbc4d8, identifier: 1985932
2026-03-26 18:34:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c6f8d0>
2026-03-26 18:34:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94f48d3e-e3b7-5149-95d6-d6c04a3311a4/94f48d3e-e3b7-5149-95d6-d6c04a3311a4_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F812%252F920dbada881a455590154e5b852f9566%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/812/920dbada881a455590154e5b852f9566/images/large/1.jpg saved to cache
2026-03-26 18:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 94f48d3e-e3b7-5149-95d6-d6c04a3311a4
2026-03-26 18:34:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 94f48d3e-e3b7-5149-95d6-d6c04a3311a4, skipping ID generation
2026-03-26 18:34:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94f48d3e-e3b7-5149-95d6-d6c04a3311a4 with scrape type 1
2026-03-26 18:34:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 94f48d3e-e3b7-5149-95d6-d6c04a3311a4 sending to next pipeline
2026-03-26 18:34:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 94f48d3e-e3b7-5149-95d6-d6c04a3311a4, identifier: 1985933
2026-03-26 18:34:30 [ayvens.es] INFO: Found listing with ID: 1985943
2026-03-26 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985943%27 HTTP/1.1" 200 None
2026-03-26 18:34:30 [ayvens.es] INFO: Scrape type for 1985943: 1
2026-03-26 18:34:30 [ayvens.es] INFO: Extracting data for car ID: 1985943
2026-03-26 18:34:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03a287cd-d148-5778-a6e8-949192ba954b with identifier: 1985943
2026-03-26 18:34:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03a287cd-d148-5778-a6e8-949192ba954b with scrape type 1
2026-03-26 18:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 03a287cd-d148-5778-a6e8-949192ba954b
2026-03-26 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F908%252F5ad650114f34448abecc0589ec9fbc64%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/908/5ad650114f34448abecc0589ec9fbc64/images/large/1.jpg not downloaded yet
2026-03-26 18:34:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9c3f5d23-6d52-58a7-bab3-e889afaa45fd with identifier: 1985930
2026-03-26 18:34:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:34:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9c3f5d23-6d52-58a7-bab3-e889afaa45fd with identifier: 1985930
2026-03-26 18:34:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9c3f5d23-6d52-58a7-bab3-e889afaa45fd with identifier: 1985930 to the API
2026-03-26 18:34:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/753/273f17fe13ac44f28954842d6194ae91/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 153,
 'color': 'Gris platino',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '9c3f5d23-6d52-58a7-bab3-e889afaa45fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN ALLSPACE',
 'odometer': 223722,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c3f5d23-6d52-58a7-bab3-e889afaa45fd/9c3f5d23-6d52-58a7-bab3-e889afaa45fd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344296,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/753/273f17fe13ac44f28954842d6194ae91/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-02',
 'seats_number': 7,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN ALLSPACE Sport 2.0 TDI 110kW (150CV) 4Motion DSG',
 'transmission': 'manual',
 'trim': 'Sport 2.0 TDI 110kW (150CV) 4Motion DSG',
 'vin': None,
 'year': 2018}
2026-03-26 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985930%27 HTTP/1.1" 200 None
2026-03-26 18:34:30 [ayvens.es] INFO: Saving data for 1985930: {'created_time': 1774550070.521093, 'last_price_update_time': 1774550070.521104, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985930') HTTP/1.1" 204 0
2026-03-26 18:34:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 128b6dfe-b465-5500-a1ea-25c049fbc4d8 with identifier: 1985932
2026-03-26 18:34:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 128b6dfe-b465-5500-a1ea-25c049fbc4d8 with identifier: 1985932
2026-03-26 18:34:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 128b6dfe-b465-5500-a1ea-25c049fbc4d8 with identifier: 1985932 to the API
2026-03-26 18:34:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/643/542f15a6ce8648ff99a13fa78d822392/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '128b6dfe-b465-5500-a1ea-25c049fbc4d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ARONA',
 'odometer': 81770,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_128b6dfe-b465-5500-a1ea-25c049fbc4d8/128b6dfe-b465-5500-a1ea-25c049fbc4d8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 301454,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/643/542f15a6ce8648ff99a13fa78d822392/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ARONA 1.6 TDI 70kW (95CV) Style Go Eco',
 'transmission': 'manual',
 'trim': '1.6 TDI 70kW (95CV) Style Go Eco',
 'vin': None,
 'year': 2021}
2026-03-26 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985932%27 HTTP/1.1" 200 None
2026-03-26 18:34:30 [ayvens.es] INFO: Saving data for 1985932: {'created_time': 1774550070.90834, 'last_price_update_time': 1774550070.90835, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985932') HTTP/1.1" 204 0
2026-03-26 18:34:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 94f48d3e-e3b7-5149-95d6-d6c04a3311a4 with identifier: 1985933
2026-03-26 18:34:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 94f48d3e-e3b7-5149-95d6-d6c04a3311a4 with identifier: 1985933
2026-03-26 18:34:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 94f48d3e-e3b7-5149-95d6-d6c04a3311a4 with identifier: 1985933 to the API
2026-03-26 18:34:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/812/920dbada881a455590154e5b852f9566/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '94f48d3e-e3b7-5149-95d6-d6c04a3311a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'EXPERT',
 'odometer': 173115,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94f48d3e-e3b7-5149-95d6-d6c04a3311a4/94f48d3e-e3b7-5149-95d6-d6c04a3311a4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 317097,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/812/920dbada881a455590154e5b852f9566/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-31',
 'seats_number': 2,
 'seller_name': None,
 'title': 'PEUGEOT EXPERT Furgon Pro 2.0 BlueHDi 120 S&S Standard',
 'transmission': 'manual',
 'trim': 'Furgon Pro 2.0 BlueHDi 120 S&S Standard',
 'vin': None,
 'year': 2020}
2026-03-26 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985933%27 HTTP/1.1" 200 None
2026-03-26 18:34:31 [ayvens.es] INFO: Saving data for 1985933: {'created_time': 1774550071.358937, 'last_price_update_time': 1774550071.358948, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985933') HTTP/1.1" 204 0
2026-03-26 18:34:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28348110>
2026-03-26 18:34:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df1543a6-2d49-580c-a384-599e70c90b65/df1543a6-2d49-580c-a384-599e70c90b65_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F815%252F24e6d2ffac9f43549894b2ac126ab790%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/815/24e6d2ffac9f43549894b2ac126ab790/images/large/1.jpg saved to cache
2026-03-26 18:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item df1543a6-2d49-580c-a384-599e70c90b65
2026-03-26 18:34:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: df1543a6-2d49-580c-a384-599e70c90b65, skipping ID generation
2026-03-26 18:34:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df1543a6-2d49-580c-a384-599e70c90b65 with scrape type 1
2026-03-26 18:34:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item df1543a6-2d49-580c-a384-599e70c90b65 sending to next pipeline
2026-03-26 18:34:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: df1543a6-2d49-580c-a384-599e70c90b65, identifier: 1985934
2026-03-26 18:34:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a2ab07a90>
2026-03-26 18:34:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73526f6a-16aa-581f-9b2e-e927bed287e0/73526f6a-16aa-581f-9b2e-e927bed287e0_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F049%252Ff607828cfe474829a2da43323dbcbc99%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/049/f607828cfe474829a2da43323dbcbc99/images/large/1.jpg saved to cache
2026-03-26 18:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 73526f6a-16aa-581f-9b2e-e927bed287e0
2026-03-26 18:34:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 73526f6a-16aa-581f-9b2e-e927bed287e0, skipping ID generation
2026-03-26 18:34:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73526f6a-16aa-581f-9b2e-e927bed287e0 with scrape type 1
2026-03-26 18:34:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 73526f6a-16aa-581f-9b2e-e927bed287e0 sending to next pipeline
2026-03-26 18:34:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 73526f6a-16aa-581f-9b2e-e927bed287e0, identifier: 1985931
2026-03-26 18:34:31 [ayvens.es] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 400
2026-03-26 18:34:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: df1543a6-2d49-580c-a384-599e70c90b65 with identifier: 1985934
2026-03-26 18:34:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: df1543a6-2d49-580c-a384-599e70c90b65 with identifier: 1985934
2026-03-26 18:34:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: df1543a6-2d49-580c-a384-599e70c90b65 with identifier: 1985934 to the API
2026-03-26 18:34:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/815/24e6d2ffac9f43549894b2ac126ab790/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 101,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'df1543a6-2d49-580c-a384-599e70c90b65',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MEGANE',
 'odometer': 230321,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df1543a6-2d49-580c-a384-599e70c90b65/df1543a6-2d49-580c-a384-599e70c90b65_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 338679,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/815/24e6d2ffac9f43549894b2ac126ab790/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT MEGANE Business Blue dCi 81 kW (115CV)',
 'transmission': 'manual',
 'trim': 'Business Blue dCi 81 kW (115CV)',
 'vin': None,
 'year': 2019}
2026-03-26 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985934%27 HTTP/1.1" 200 None
2026-03-26 18:34:32 [ayvens.es] INFO: Saving data for 1985934: {'created_time': 1774550072.032921, 'last_price_update_time': 1774550072.032931, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985934') HTTP/1.1" 204 0
2026-03-26 18:34:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 73526f6a-16aa-581f-9b2e-e927bed287e0 with identifier: 1985931
2026-03-26 18:34:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:34:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 73526f6a-16aa-581f-9b2e-e927bed287e0 with identifier: 1985931
2026-03-26 18:34:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 73526f6a-16aa-581f-9b2e-e927bed287e0 with identifier: 1985931 to the API
2026-03-26 18:34:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/049/f607828cfe474829a2da43323dbcbc99/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Blanco candy',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '73526f6a-16aa-581f-9b2e-e927bed287e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'SCALA',
 'odometer': 97549,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73526f6a-16aa-581f-9b2e-e927bed287e0/73526f6a-16aa-581f-9b2e-e927bed287e0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 505323,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/049/f607828cfe474829a2da43323dbcbc99/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA SCALA SCALA 1.0 TSI 70 KW (95 CV) Emotion',
 'transmission': 'manual',
 'trim': 'SCALA 1.0 TSI 70 KW (95 CV) Emotion',
 'vin': None,
 'year': 2022}
2026-03-26 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985931%27 HTTP/1.1" 200 None
2026-03-26 18:34:32 [ayvens.es] INFO: Saving data for 1985931: {'created_time': 1774550072.328333, 'last_price_update_time': 1774550072.328342, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985931') HTTP/1.1" 204 0
2026-03-26 18:34:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28f6a150>
2026-03-26 18:34:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f94f7bb-2673-5c00-b7d7-995d6daf4e0c/3f94f7bb-2673-5c00-b7d7-995d6daf4e0c_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F574%252F9a9804e4b6604e02a35b0220f9252d08%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/574/9a9804e4b6604e02a35b0220f9252d08/images/large/1.jpg saved to cache
2026-03-26 18:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3f94f7bb-2673-5c00-b7d7-995d6daf4e0c
2026-03-26 18:34:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3f94f7bb-2673-5c00-b7d7-995d6daf4e0c, skipping ID generation
2026-03-26 18:34:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f94f7bb-2673-5c00-b7d7-995d6daf4e0c with scrape type 1
2026-03-26 18:34:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3f94f7bb-2673-5c00-b7d7-995d6daf4e0c sending to next pipeline
2026-03-26 18:34:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3f94f7bb-2673-5c00-b7d7-995d6daf4e0c, identifier: 1985935
2026-03-26 18:34:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c19690>
2026-03-26 18:34:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_900ade25-b85b-5235-9ca6-a354356aa3ae/900ade25-b85b-5235-9ca6-a354356aa3ae_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F233%252F202dca3a1a4a4f2d8c66e272f2078eca%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/233/202dca3a1a4a4f2d8c66e272f2078eca/images/large/1.jpg saved to cache
2026-03-26 18:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 900ade25-b85b-5235-9ca6-a354356aa3ae
2026-03-26 18:34:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 900ade25-b85b-5235-9ca6-a354356aa3ae, skipping ID generation
2026-03-26 18:34:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 900ade25-b85b-5235-9ca6-a354356aa3ae with scrape type 1
2026-03-26 18:34:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 900ade25-b85b-5235-9ca6-a354356aa3ae sending to next pipeline
2026-03-26 18:34:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 900ade25-b85b-5235-9ca6-a354356aa3ae, identifier: 1985936
2026-03-26 18:34:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3f94f7bb-2673-5c00-b7d7-995d6daf4e0c with identifier: 1985935
2026-03-26 18:34:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:34:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3f94f7bb-2673-5c00-b7d7-995d6daf4e0c with identifier: 1985935
2026-03-26 18:34:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3f94f7bb-2673-5c00-b7d7-995d6daf4e0c with identifier: 1985935 to the API
2026-03-26 18:34:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/574/9a9804e4b6604e02a35b0220f9252d08/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Gris delfmn metaliza',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '3f94f7bb-2673-5c00-b7d7-995d6daf4e0c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF',
 'odometer': 82692,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f94f7bb-2673-5c00-b7d7-995d6daf4e0c/3f94f7bb-2673-5c00-b7d7-995d6daf4e0c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 331795,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/574/9a9804e4b6604e02a35b0220f9252d08/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF Life 1.0 TSI 81kW (110CV)',
 'transmission': 'manual',
 'trim': 'Life 1.0 TSI 81kW (110CV)',
 'vin': None,
 'year': 2022}
2026-03-26 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985935%27 HTTP/1.1" 200 None
2026-03-26 18:34:33 [ayvens.es] INFO: Saving data for 1985935: {'created_time': 1774550073.010107, 'last_price_update_time': 1774550073.010117, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985935') HTTP/1.1" 204 0
2026-03-26 18:34:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 900ade25-b85b-5235-9ca6-a354356aa3ae with identifier: 1985936
2026-03-26 18:34:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:34:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 900ade25-b85b-5235-9ca6-a354356aa3ae with identifier: 1985936
2026-03-26 18:34:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 900ade25-b85b-5235-9ca6-a354356aa3ae with identifier: 1985936 to the API
2026-03-26 18:34:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/233/202dca3a1a4a4f2d8c66e272f2078eca/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'color': 'Plata r',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '900ade25-b85b-5235-9ca6-a354356aa3ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN',
 'odometer': 55708,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_900ade25-b85b-5235-9ca6-a354356aa3ae/900ade25-b85b-5235-9ca6-a354356aa3ae_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 327762,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/233/202dca3a1a4a4f2d8c66e272f2078eca/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN Life 2.0 TDI 110kW (150CV)',
 'transmission': 'manual',
 'trim': 'Life 2.0 TDI 110kW (150CV)',
 'vin': None,
 'year': 2021}
2026-03-26 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985936%27 HTTP/1.1" 200 None
2026-03-26 18:34:33 [ayvens.es] INFO: Saving data for 1985936: {'created_time': 1774550073.371554, 'last_price_update_time': 1774550073.371566, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985936') HTTP/1.1" 204 0
2026-03-26 18:34:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 18:34:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/716/d3480518ab97446d829f6121879c0ccf/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28ad84d0>
2026-03-26 18:34:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0f63492-7fe2-526e-bbdb-064221f4d7fa/e0f63492-7fe2-526e-bbdb-064221f4d7fa_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F716%252Fd3480518ab97446d829f6121879c0ccf%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/716/d3480518ab97446d829f6121879c0ccf/images/large/1.jpg saved to cache
2026-03-26 18:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e0f63492-7fe2-526e-bbdb-064221f4d7fa
2026-03-26 18:34:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e0f63492-7fe2-526e-bbdb-064221f4d7fa, skipping ID generation
2026-03-26 18:34:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0f63492-7fe2-526e-bbdb-064221f4d7fa with scrape type 1
2026-03-26 18:34:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e0f63492-7fe2-526e-bbdb-064221f4d7fa sending to next pipeline
2026-03-26 18:34:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e0f63492-7fe2-526e-bbdb-064221f4d7fa, identifier: 1985937
2026-03-26 18:34:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e0f63492-7fe2-526e-bbdb-064221f4d7fa with identifier: 1985937
2026-03-26 18:34:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e0f63492-7fe2-526e-bbdb-064221f4d7fa with identifier: 1985937
2026-03-26 18:34:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e0f63492-7fe2-526e-bbdb-064221f4d7fa with identifier: 1985937 to the API
2026-03-26 18:34:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/716/d3480518ab97446d829f6121879c0ccf/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 160,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e0f63492-7fe2-526e-bbdb-064221f4d7fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CADDY',
 'odometer': 141989,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0f63492-7fe2-526e-bbdb-064221f4d7fa/e0f63492-7fe2-526e-bbdb-064221f4d7fa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 273014,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/716/d3480518ab97446d829f6121879c0ccf/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-30',
 'seats_number': 2,
 'seller_name': None,
 'title': 'VOLKSWAGEN CADDY Profes Furgon 2.0 TDI 90kW BMT 4Motion',
 'transmission': 'manual',
 'trim': 'Profes Furgon 2.0 TDI 90kW BMT 4Motion',
 'vin': None,
 'year': 2020}
2026-03-26 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985937%27 HTTP/1.1" 200 None
2026-03-26 18:34:33 [ayvens.es] INFO: Saving data for 1985937: {'created_time': 1774550073.899921, 'last_price_update_time': 1774550073.899957, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985937') HTTP/1.1" 204 0
2026-03-26 18:34:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/801/e2d0dfc388444bd594150bb4f875b59c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/235/5e23f71f9b1b4cb688e4cc25500002fb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/381/5bb425fa7705443bacf0e1e6be67d826/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/529/30e6b70b59114844a3717510406c3c02/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/908/5ad650114f34448abecc0589ec9fbc64/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/303/07bf020bf86f420bb35b265031588c19/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28398d10>
2026-03-26 18:34:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d95d0bc-b307-5109-ae9d-fc2e5984a2ac/9d95d0bc-b307-5109-ae9d-fc2e5984a2ac_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F801%252Fe2d0dfc388444bd594150bb4f875b59c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/801/e2d0dfc388444bd594150bb4f875b59c/images/large/1.jpg saved to cache
2026-03-26 18:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9d95d0bc-b307-5109-ae9d-fc2e5984a2ac
2026-03-26 18:34:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9d95d0bc-b307-5109-ae9d-fc2e5984a2ac, skipping ID generation
2026-03-26 18:34:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d95d0bc-b307-5109-ae9d-fc2e5984a2ac with scrape type 1
2026-03-26 18:34:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9d95d0bc-b307-5109-ae9d-fc2e5984a2ac sending to next pipeline
2026-03-26 18:34:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9d95d0bc-b307-5109-ae9d-fc2e5984a2ac, identifier: 1985940
2026-03-26 18:34:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9d95d0bc-b307-5109-ae9d-fc2e5984a2ac with identifier: 1985940
2026-03-26 18:34:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9d95d0bc-b307-5109-ae9d-fc2e5984a2ac with identifier: 1985940
2026-03-26 18:34:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9d95d0bc-b307-5109-ae9d-fc2e5984a2ac with identifier: 1985940 to the API
2026-03-26 18:34:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/801/e2d0dfc388444bd594150bb4f875b59c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Plata pirita',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '9d95d0bc-b307-5109-ae9d-fc2e5984a2ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT',
 'odometer': 100239,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d95d0bc-b307-5109-ae9d-fc2e5984a2ac/9d95d0bc-b307-5109-ae9d-fc2e5984a2ac_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 317972,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/801/e2d0dfc388444bd594150bb4f875b59c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT Variant Business 2.0 TDI 110kW',
 'transmission': 'manual',
 'trim': 'Variant Business 2.0 TDI 110kW',
 'vin': None,
 'year': 2020}
2026-03-26 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985940%27 HTTP/1.1" 200 None
2026-03-26 18:34:34 [ayvens.es] INFO: Saving data for 1985940: {'created_time': 1774550074.483417, 'last_price_update_time': 1774550074.483428, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985940') HTTP/1.1" 204 0
2026-03-26 18:34:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28adbcd0>
2026-03-26 18:34:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b29dc4e2-0f55-5fdf-84c0-aaab7b85555d/b29dc4e2-0f55-5fdf-84c0-aaab7b85555d_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F235%252F5e23f71f9b1b4cb688e4cc25500002fb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/235/5e23f71f9b1b4cb688e4cc25500002fb/images/large/1.jpg saved to cache
2026-03-26 18:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b29dc4e2-0f55-5fdf-84c0-aaab7b85555d
2026-03-26 18:34:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b29dc4e2-0f55-5fdf-84c0-aaab7b85555d, skipping ID generation
2026-03-26 18:34:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b29dc4e2-0f55-5fdf-84c0-aaab7b85555d with scrape type 1
2026-03-26 18:34:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b29dc4e2-0f55-5fdf-84c0-aaab7b85555d sending to next pipeline
2026-03-26 18:34:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b29dc4e2-0f55-5fdf-84c0-aaab7b85555d, identifier: 1985939
2026-03-26 18:34:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b29dc4e2-0f55-5fdf-84c0-aaab7b85555d with identifier: 1985939
2026-03-26 18:34:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b29dc4e2-0f55-5fdf-84c0-aaab7b85555d with identifier: 1985939
2026-03-26 18:34:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b29dc4e2-0f55-5fdf-84c0-aaab7b85555d with identifier: 1985939 to the API
2026-03-26 18:34:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/235/5e23f71f9b1b4cb688e4cc25500002fb/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b29dc4e2-0f55-5fdf-84c0-aaab7b85555d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-ROC',
 'odometer': 80366,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b29dc4e2-0f55-5fdf-84c0-aaab7b85555d/b29dc4e2-0f55-5fdf-84c0-aaab7b85555d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354813,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/235/5e23f71f9b1b4cb688e4cc25500002fb/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-ROC Advance 1.6 TDI 85kW (115CV)',
 'transmission': 'manual',
 'trim': 'Advance 1.6 TDI 85kW (115CV)',
 'vin': None,
 'year': 2021}
2026-03-26 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985939%27 HTTP/1.1" 200 None
2026-03-26 18:34:34 [ayvens.es] INFO: Saving data for 1985939: {'created_time': 1774550074.958781, 'last_price_update_time': 1774550074.958794, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985939') HTTP/1.1" 204 0
2026-03-26 18:34:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28e5fc10>
2026-03-26 18:34:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fc0de46-af2b-5680-a07c-6d502dce14f5/1fc0de46-af2b-5680-a07c-6d502dce14f5_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F381%252F5bb425fa7705443bacf0e1e6be67d826%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/381/5bb425fa7705443bacf0e1e6be67d826/images/large/1.jpg saved to cache
2026-03-26 18:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1fc0de46-af2b-5680-a07c-6d502dce14f5
2026-03-26 18:34:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1fc0de46-af2b-5680-a07c-6d502dce14f5, skipping ID generation
2026-03-26 18:34:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fc0de46-af2b-5680-a07c-6d502dce14f5 with scrape type 1
2026-03-26 18:34:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1fc0de46-af2b-5680-a07c-6d502dce14f5 sending to next pipeline
2026-03-26 18:34:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1fc0de46-af2b-5680-a07c-6d502dce14f5, identifier: 1985938
2026-03-26 18:34:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28e5de10>
2026-03-26 18:34:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0629ae7b-4d12-5fa6-bdba-9f23580273ad/0629ae7b-4d12-5fa6-bdba-9f23580273ad_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F529%252F30e6b70b59114844a3717510406c3c02%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/529/30e6b70b59114844a3717510406c3c02/images/large/1.jpg saved to cache
2026-03-26 18:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0629ae7b-4d12-5fa6-bdba-9f23580273ad
2026-03-26 18:34:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0629ae7b-4d12-5fa6-bdba-9f23580273ad, skipping ID generation
2026-03-26 18:34:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0629ae7b-4d12-5fa6-bdba-9f23580273ad with scrape type 1
2026-03-26 18:34:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0629ae7b-4d12-5fa6-bdba-9f23580273ad sending to next pipeline
2026-03-26 18:34:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0629ae7b-4d12-5fa6-bdba-9f23580273ad, identifier: 1985941
2026-03-26 18:34:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a29057b90>
2026-03-26 18:34:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03a287cd-d148-5778-a6e8-949192ba954b/03a287cd-d148-5778-a6e8-949192ba954b_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F908%252F5ad650114f34448abecc0589ec9fbc64%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/908/5ad650114f34448abecc0589ec9fbc64/images/large/1.jpg saved to cache
2026-03-26 18:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 03a287cd-d148-5778-a6e8-949192ba954b
2026-03-26 18:34:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 03a287cd-d148-5778-a6e8-949192ba954b, skipping ID generation
2026-03-26 18:34:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03a287cd-d148-5778-a6e8-949192ba954b with scrape type 1
2026-03-26 18:34:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 03a287cd-d148-5778-a6e8-949192ba954b sending to next pipeline
2026-03-26 18:34:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 03a287cd-d148-5778-a6e8-949192ba954b, identifier: 1985943
2026-03-26 18:34:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28dd1fd0>
2026-03-26 18:34:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b7a407b-ca52-5c7d-a1aa-daeaa044399c/9b7a407b-ca52-5c7d-a1aa-daeaa044399c_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F303%252F07bf020bf86f420bb35b265031588c19%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/303/07bf020bf86f420bb35b265031588c19/images/large/1.jpg saved to cache
2026-03-26 18:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9b7a407b-ca52-5c7d-a1aa-daeaa044399c
2026-03-26 18:34:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9b7a407b-ca52-5c7d-a1aa-daeaa044399c, skipping ID generation
2026-03-26 18:34:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b7a407b-ca52-5c7d-a1aa-daeaa044399c with scrape type 1
2026-03-26 18:34:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9b7a407b-ca52-5c7d-a1aa-daeaa044399c sending to next pipeline
2026-03-26 18:34:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9b7a407b-ca52-5c7d-a1aa-daeaa044399c, identifier: 1985942
2026-03-26 18:34:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1fc0de46-af2b-5680-a07c-6d502dce14f5 with identifier: 1985938
2026-03-26 18:34:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1fc0de46-af2b-5680-a07c-6d502dce14f5 with identifier: 1985938
2026-03-26 18:34:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1fc0de46-af2b-5680-a07c-6d502dce14f5 with identifier: 1985938 to the API
2026-03-26 18:34:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/381/5bb425fa7705443bacf0e1e6be67d826/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Gris indy',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '1fc0de46-af2b-5680-a07c-6d502dce14f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TOURAN',
 'odometer': 232689,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fc0de46-af2b-5680-a07c-6d502dce14f5/1fc0de46-af2b-5680-a07c-6d502dce14f5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328045,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/381/5bb425fa7705443bacf0e1e6be67d826/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-25',
 'seats_number': 7,
 'seller_name': None,
 'title': 'VOLKSWAGEN TOURAN Business & Navi 1.6 TDI 85kW (115CV)',
 'transmission': 'manual',
 'trim': 'Business & Navi 1.6 TDI 85kW (115CV)',
 'vin': None,
 'year': 2019}
2026-03-26 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985938%27 HTTP/1.1" 200 None
2026-03-26 18:34:35 [ayvens.es] INFO: Saving data for 1985938: {'created_time': 1774550075.825924, 'last_price_update_time': 1774550075.825934, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985938') HTTP/1.1" 204 0
2026-03-26 18:34:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0629ae7b-4d12-5fa6-bdba-9f23580273ad with identifier: 1985941
2026-03-26 18:34:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0629ae7b-4d12-5fa6-bdba-9f23580273ad with identifier: 1985941
2026-03-26 18:34:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0629ae7b-4d12-5fa6-bdba-9f23580273ad with identifier: 1985941 to the API
2026-03-26 18:34:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/529/30e6b70b59114844a3717510406c3c02/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'color': 'Negro metalizado',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '0629ae7b-4d12-5fa6-bdba-9f23580273ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'S60',
 'odometer': 80019,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0629ae7b-4d12-5fa6-bdba-9f23580273ad/0629ae7b-4d12-5fa6-bdba-9f23580273ad_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 315274,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/529/30e6b70b59114844a3717510406c3c02/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO S60 B4(G) FWD Momentum Pro aut',
 'transmission': 'manual',
 'trim': 'B4(G) FWD Momentum Pro aut',
 'vin': None,
 'year': 2021}
2026-03-26 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985941%27 HTTP/1.1" 200 None
2026-03-26 18:34:36 [ayvens.es] INFO: Saving data for 1985941: {'created_time': 1774550076.152386, 'last_price_update_time': 1774550076.152441, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985941') HTTP/1.1" 204 0
2026-03-26 18:34:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 03a287cd-d148-5778-a6e8-949192ba954b with identifier: 1985943
2026-03-26 18:34:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:34:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 03a287cd-d148-5778-a6e8-949192ba954b with identifier: 1985943
2026-03-26 18:34:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 03a287cd-d148-5778-a6e8-949192ba954b with identifier: 1985943 to the API
2026-03-26 18:34:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/908/5ad650114f34448abecc0589ec9fbc64/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'color': 'Plata r',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '03a287cd-d148-5778-a6e8-949192ba954b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN',
 'odometer': 87654,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03a287cd-d148-5778-a6e8-949192ba954b/03a287cd-d148-5778-a6e8-949192ba954b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 506340,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/908/5ad650114f34448abecc0589ec9fbc64/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN R-Line 2.0 TDI 110kW (150CV) DSG',
 'transmission': 'manual',
 'trim': 'R-Line 2.0 TDI 110kW (150CV) DSG',
 'vin': None,
 'year': 2021}
2026-03-26 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985943%27 HTTP/1.1" 200 None
2026-03-26 18:34:36 [ayvens.es] INFO: Saving data for 1985943: {'created_time': 1774550076.554881, 'last_price_update_time': 1774550076.554893, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985943') HTTP/1.1" 204 0
2026-03-26 18:34:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9b7a407b-ca52-5c7d-a1aa-daeaa044399c with identifier: 1985942
2026-03-26 18:34:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:34:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9b7a407b-ca52-5c7d-a1aa-daeaa044399c with identifier: 1985942
2026-03-26 18:34:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9b7a407b-ca52-5c7d-a1aa-daeaa044399c with identifier: 1985942 to the API
2026-03-26 18:34:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/303/07bf020bf86f420bb35b265031588c19/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'color': 'Rojo',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '9b7a407b-ca52-5c7d-a1aa-daeaa044399c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'PROACE CITY VERSO',
 'odometer': 87258,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b7a407b-ca52-5c7d-a1aa-daeaa044399c/9b7a407b-ca52-5c7d-a1aa-daeaa044399c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 498718,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/303/07bf020bf86f420bb35b265031588c19/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA PROACE CITY VERSO 1.5D 96kW (130CV) Combi GX Plus L1',
 'transmission': 'manual',
 'trim': '1.5D 96kW (130CV) Combi GX Plus L1',
 'vin': None,
 'year': 2023}
2026-03-26 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985942%27 HTTP/1.1" 200 None
2026-03-26 18:34:36 [ayvens.es] INFO: Saving data for 1985942: {'created_time': 1774550076.907332, 'last_price_update_time': 1774550076.907344, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985942') HTTP/1.1" 204 0
2026-03-26 18:34:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-26 18:34:37 [ayvens.es] INFO: Found listing with ID: 1985944
2026-03-26 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985944%27 HTTP/1.1" 200 None
2026-03-26 18:34:37 [ayvens.es] INFO: Scrape type for 1985944: 1
2026-03-26 18:34:37 [ayvens.es] INFO: Extracting data for car ID: 1985944
2026-03-26 18:34:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da5d105b-fc41-5d33-a476-55af0a1ae503 with identifier: 1985944
2026-03-26 18:34:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da5d105b-fc41-5d33-a476-55af0a1ae503 with scrape type 1
2026-03-26 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item da5d105b-fc41-5d33-a476-55af0a1ae503
2026-03-26 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F688%252F1b8f91efc76e472abe26d5f037838183%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/688/1b8f91efc76e472abe26d5f037838183/images/large/1.jpg not downloaded yet
2026-03-26 18:34:37 [ayvens.es] INFO: Found listing with ID: 1985945
2026-03-26 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985945%27 HTTP/1.1" 200 None
2026-03-26 18:34:37 [ayvens.es] INFO: Scrape type for 1985945: 1
2026-03-26 18:34:37 [ayvens.es] INFO: Extracting data for car ID: 1985945
2026-03-26 18:34:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efa4a992-7df2-51d3-a473-aa0df1df8e0b with identifier: 1985945
2026-03-26 18:34:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efa4a992-7df2-51d3-a473-aa0df1df8e0b with scrape type 1
2026-03-26 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item efa4a992-7df2-51d3-a473-aa0df1df8e0b
2026-03-26 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F057%252F9af0df5d7bb143eda9fd6d383038c2db%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/057/9af0df5d7bb143eda9fd6d383038c2db/images/large/1.jpg not downloaded yet
2026-03-26 18:34:37 [ayvens.es] INFO: Found listing with ID: 1985946
2026-03-26 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985946%27 HTTP/1.1" 200 None
2026-03-26 18:34:37 [ayvens.es] INFO: Scrape type for 1985946: 1
2026-03-26 18:34:37 [ayvens.es] INFO: Extracting data for car ID: 1985946
2026-03-26 18:34:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ba17eae-5fde-57ea-9e80-962dd8cda078 with identifier: 1985946
2026-03-26 18:34:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ba17eae-5fde-57ea-9e80-962dd8cda078 with scrape type 1
2026-03-26 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9ba17eae-5fde-57ea-9e80-962dd8cda078
2026-03-26 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F459%252F1b88df71f19540c68db0f66b4dbb280c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/459/1b88df71f19540c68db0f66b4dbb280c/images/large/1.jpg not downloaded yet
2026-03-26 18:34:37 [ayvens.es] INFO: Found listing with ID: 1985947
2026-03-26 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985947%27 HTTP/1.1" 200 None
2026-03-26 18:34:37 [ayvens.es] INFO: Scrape type for 1985947: 1
2026-03-26 18:34:37 [ayvens.es] INFO: Extracting data for car ID: 1985947
2026-03-26 18:34:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bc86e80-3c9c-522c-a6b1-829a4275668e with identifier: 1985947
2026-03-26 18:34:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bc86e80-3c9c-522c-a6b1-829a4275668e with scrape type 1
2026-03-26 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4bc86e80-3c9c-522c-a6b1-829a4275668e
2026-03-26 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F493%252F5f8b3c062dd1462a83fbdb6fdf09c560%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/493/5f8b3c062dd1462a83fbdb6fdf09c560/images/large/1.jpg not downloaded yet
2026-03-26 18:34:37 [ayvens.es] INFO: Found listing with ID: 1985948
2026-03-26 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985948%27 HTTP/1.1" 200 None
2026-03-26 18:34:37 [ayvens.es] INFO: Scrape type for 1985948: 1
2026-03-26 18:34:37 [ayvens.es] INFO: Extracting data for car ID: 1985948
2026-03-26 18:34:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe158112-6914-5ec1-aa68-f56d03fe534d with identifier: 1985948
2026-03-26 18:34:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe158112-6914-5ec1-aa68-f56d03fe534d with scrape type 1
2026-03-26 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item fe158112-6914-5ec1-aa68-f56d03fe534d
2026-03-26 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F135%252F34ebd8045fed4c228e58a575c8d195c2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/135/34ebd8045fed4c228e58a575c8d195c2/images/large/1.jpg not downloaded yet
2026-03-26 18:34:37 [ayvens.es] INFO: Found listing with ID: 1985949
2026-03-26 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985949%27 HTTP/1.1" 200 None
2026-03-26 18:34:37 [ayvens.es] INFO: Scrape type for 1985949: 1
2026-03-26 18:34:37 [ayvens.es] INFO: Extracting data for car ID: 1985949
2026-03-26 18:34:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ebef030-ec61-57f4-8cd3-ce8655266e2a with identifier: 1985949
2026-03-26 18:34:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ebef030-ec61-57f4-8cd3-ce8655266e2a with scrape type 1
2026-03-26 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4ebef030-ec61-57f4-8cd3-ce8655266e2a
2026-03-26 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F978%252F7d66186d35cd421caeefefb1c2cd5d42%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/978/7d66186d35cd421caeefefb1c2cd5d42/images/large/1.jpg not downloaded yet
2026-03-26 18:34:37 [ayvens.es] INFO: Found listing with ID: 1985950
2026-03-26 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985950%27 HTTP/1.1" 200 None
2026-03-26 18:34:37 [ayvens.es] INFO: Scrape type for 1985950: 1
2026-03-26 18:34:37 [ayvens.es] INFO: Extracting data for car ID: 1985950
2026-03-26 18:34:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eca0a30e-5d44-5ac2-9c79-972c37093cf3 with identifier: 1985950
2026-03-26 18:34:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eca0a30e-5d44-5ac2-9c79-972c37093cf3 with scrape type 1
2026-03-26 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item eca0a30e-5d44-5ac2-9c79-972c37093cf3
2026-03-26 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F871%252F3d262416ba6e49308e163bd28168d065%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/871/3d262416ba6e49308e163bd28168d065/images/large/1.jpg not downloaded yet
2026-03-26 18:34:37 [ayvens.es] INFO: Found listing with ID: 1985951
2026-03-26 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985951%27 HTTP/1.1" 200 None
2026-03-26 18:34:37 [ayvens.es] INFO: Scrape type for 1985951: 1
2026-03-26 18:34:37 [ayvens.es] INFO: Extracting data for car ID: 1985951
2026-03-26 18:34:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 090fbaef-f2f4-5f0d-8aae-d39b202730f2 with identifier: 1985951
2026-03-26 18:34:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 090fbaef-f2f4-5f0d-8aae-d39b202730f2 with scrape type 1
2026-03-26 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 090fbaef-f2f4-5f0d-8aae-d39b202730f2
2026-03-26 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F499%252F71c71daed3af49af825aeca63a2f0086%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/499/71c71daed3af49af825aeca63a2f0086/images/large/1.jpg not downloaded yet
2026-03-26 18:34:37 [ayvens.es] INFO: Found listing with ID: 1985952
2026-03-26 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985952%27 HTTP/1.1" 200 None
2026-03-26 18:34:37 [ayvens.es] INFO: Scrape type for 1985952: 1
2026-03-26 18:34:37 [ayvens.es] INFO: Extracting data for car ID: 1985952
2026-03-26 18:34:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c273638-3546-569c-94dc-4fe5d0e5818f with identifier: 1985952
2026-03-26 18:34:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c273638-3546-569c-94dc-4fe5d0e5818f with scrape type 1
2026-03-26 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7c273638-3546-569c-94dc-4fe5d0e5818f
2026-03-26 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F110%252Fac58baa7f0e445e1bb3025ba0e11327d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/110/ac58baa7f0e445e1bb3025ba0e11327d/images/large/1.jpg not downloaded yet
2026-03-26 18:34:37 [ayvens.es] INFO: Found listing with ID: 1985953
2026-03-26 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985953%27 HTTP/1.1" 200 None
2026-03-26 18:34:37 [ayvens.es] INFO: Scrape type for 1985953: 1
2026-03-26 18:34:37 [ayvens.es] INFO: Extracting data for car ID: 1985953
2026-03-26 18:34:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82d3ae70-0a86-5522-b14b-41961a80e839 with identifier: 1985953
2026-03-26 18:34:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82d3ae70-0a86-5522-b14b-41961a80e839 with scrape type 1
2026-03-26 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 82d3ae70-0a86-5522-b14b-41961a80e839
2026-03-26 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F819%252F6d4d5da5ca0d429fa852fec1e8ed8f48%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/819/6d4d5da5ca0d429fa852fec1e8ed8f48/images/large/1.jpg not downloaded yet
2026-03-26 18:34:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/057/9af0df5d7bb143eda9fd6d383038c2db/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/688/1b8f91efc76e472abe26d5f037838183/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/459/1b88df71f19540c68db0f66b4dbb280c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:37 [ayvens.es] INFO: Found listing with ID: 1985954
2026-03-26 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985954%27 HTTP/1.1" 200 None
2026-03-26 18:34:37 [ayvens.es] INFO: Scrape type for 1985954: 1
2026-03-26 18:34:37 [ayvens.es] INFO: Extracting data for car ID: 1985954
2026-03-26 18:34:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0acfd30-c697-55a8-8378-20c8960460dc with identifier: 1985954
2026-03-26 18:34:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0acfd30-c697-55a8-8378-20c8960460dc with scrape type 1
2026-03-26 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e0acfd30-c697-55a8-8378-20c8960460dc
2026-03-26 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F398%252F08bfacd1615149eea4c0eafb56468b82%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/398/08bfacd1615149eea4c0eafb56468b82/images/large/1.jpg not downloaded yet
2026-03-26 18:34:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/493/5f8b3c062dd1462a83fbdb6fdf09c560/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:37 [ayvens.es] INFO: Found listing with ID: 1985955
2026-03-26 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985955%27 HTTP/1.1" 200 None
2026-03-26 18:34:37 [ayvens.es] INFO: Scrape type for 1985955: 1
2026-03-26 18:34:37 [ayvens.es] INFO: Extracting data for car ID: 1985955
2026-03-26 18:34:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fbe3053f-53e4-5e21-a158-50fe19ea0162 with identifier: 1985955
2026-03-26 18:34:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbe3053f-53e4-5e21-a158-50fe19ea0162 with scrape type 1
2026-03-26 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item fbe3053f-53e4-5e21-a158-50fe19ea0162
2026-03-26 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F721%252F6b4b3d786bf3457b882cc4e5362e12d9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/721/6b4b3d786bf3457b882cc4e5362e12d9/images/large/1.jpg not downloaded yet
2026-03-26 18:34:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/135/34ebd8045fed4c228e58a575c8d195c2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:37 [ayvens.es] INFO: Found listing with ID: 1985956
2026-03-26 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985956%27 HTTP/1.1" 200 None
2026-03-26 18:34:37 [ayvens.es] INFO: Scrape type for 1985956: 1
2026-03-26 18:34:37 [ayvens.es] INFO: Extracting data for car ID: 1985956
2026-03-26 18:34:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1253682e-269d-5d9d-b362-12b0be968fd1 with identifier: 1985956
2026-03-26 18:34:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1253682e-269d-5d9d-b362-12b0be968fd1 with scrape type 1
2026-03-26 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1253682e-269d-5d9d-b362-12b0be968fd1
2026-03-26 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F759%252Fb9198c054d604624b968c7ac2265bcf3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/759/b9198c054d604624b968c7ac2265bcf3/images/large/1.jpg not downloaded yet
2026-03-26 18:34:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/978/7d66186d35cd421caeefefb1c2cd5d42/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:37 [ayvens.es] INFO: Found listing with ID: 1985957
2026-03-26 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985957%27 HTTP/1.1" 200 None
2026-03-26 18:34:37 [ayvens.es] INFO: Scrape type for 1985957: 1
2026-03-26 18:34:37 [ayvens.es] INFO: Extracting data for car ID: 1985957
2026-03-26 18:34:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61a97a4e-fcd6-574f-9d77-4da164874010 with identifier: 1985957
2026-03-26 18:34:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61a97a4e-fcd6-574f-9d77-4da164874010 with scrape type 1
2026-03-26 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 61a97a4e-fcd6-574f-9d77-4da164874010
2026-03-26 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F803%252F89c0a3d7d1cf46039eb2b4ce8df7f4fd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/803/89c0a3d7d1cf46039eb2b4ce8df7f4fd/images/large/1.jpg not downloaded yet
2026-03-26 18:34:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28d30b10>
2026-03-26 18:34:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efa4a992-7df2-51d3-a473-aa0df1df8e0b/efa4a992-7df2-51d3-a473-aa0df1df8e0b_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F057%252F9af0df5d7bb143eda9fd6d383038c2db%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/057/9af0df5d7bb143eda9fd6d383038c2db/images/large/1.jpg saved to cache
2026-03-26 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item efa4a992-7df2-51d3-a473-aa0df1df8e0b
2026-03-26 18:34:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: efa4a992-7df2-51d3-a473-aa0df1df8e0b, skipping ID generation
2026-03-26 18:34:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efa4a992-7df2-51d3-a473-aa0df1df8e0b with scrape type 1
2026-03-26 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item efa4a992-7df2-51d3-a473-aa0df1df8e0b sending to next pipeline
2026-03-26 18:34:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: efa4a992-7df2-51d3-a473-aa0df1df8e0b, identifier: 1985945
2026-03-26 18:34:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a2abb7e50>
2026-03-26 18:34:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da5d105b-fc41-5d33-a476-55af0a1ae503/da5d105b-fc41-5d33-a476-55af0a1ae503_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F688%252F1b8f91efc76e472abe26d5f037838183%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/688/1b8f91efc76e472abe26d5f037838183/images/large/1.jpg saved to cache
2026-03-26 18:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item da5d105b-fc41-5d33-a476-55af0a1ae503
2026-03-26 18:34:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: da5d105b-fc41-5d33-a476-55af0a1ae503, skipping ID generation
2026-03-26 18:34:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da5d105b-fc41-5d33-a476-55af0a1ae503 with scrape type 1
2026-03-26 18:34:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item da5d105b-fc41-5d33-a476-55af0a1ae503 sending to next pipeline
2026-03-26 18:34:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: da5d105b-fc41-5d33-a476-55af0a1ae503, identifier: 1985944
2026-03-26 18:34:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a282fb050>
2026-03-26 18:34:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ba17eae-5fde-57ea-9e80-962dd8cda078/9ba17eae-5fde-57ea-9e80-962dd8cda078_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F459%252F1b88df71f19540c68db0f66b4dbb280c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/459/1b88df71f19540c68db0f66b4dbb280c/images/large/1.jpg saved to cache
2026-03-26 18:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9ba17eae-5fde-57ea-9e80-962dd8cda078
2026-03-26 18:34:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9ba17eae-5fde-57ea-9e80-962dd8cda078, skipping ID generation
2026-03-26 18:34:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ba17eae-5fde-57ea-9e80-962dd8cda078 with scrape type 1
2026-03-26 18:34:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9ba17eae-5fde-57ea-9e80-962dd8cda078 sending to next pipeline
2026-03-26 18:34:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9ba17eae-5fde-57ea-9e80-962dd8cda078, identifier: 1985946
2026-03-26 18:34:38 [ayvens.es] INFO: Found listing with ID: 1985958
2026-03-26 18:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985958%27 HTTP/1.1" 200 None
2026-03-26 18:34:38 [ayvens.es] INFO: Scrape type for 1985958: 1
2026-03-26 18:34:38 [ayvens.es] INFO: Extracting data for car ID: 1985958
2026-03-26 18:34:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0514be0-9b26-5cea-a0ad-ee5acded6d97 with identifier: 1985958
2026-03-26 18:34:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0514be0-9b26-5cea-a0ad-ee5acded6d97 with scrape type 1
2026-03-26 18:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e0514be0-9b26-5cea-a0ad-ee5acded6d97
2026-03-26 18:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F420%252F8c780dda18b24aa59dd5d8cf9a6adcc6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/420/8c780dda18b24aa59dd5d8cf9a6adcc6/images/large/1.jpg not downloaded yet
2026-03-26 18:34:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: efa4a992-7df2-51d3-a473-aa0df1df8e0b with identifier: 1985945
2026-03-26 18:34:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:34:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: efa4a992-7df2-51d3-a473-aa0df1df8e0b with identifier: 1985945
2026-03-26 18:34:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: efa4a992-7df2-51d3-a473-aa0df1df8e0b with identifier: 1985945 to the API
2026-03-26 18:34:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/057/9af0df5d7bb143eda9fd6d383038c2db/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'Plata pirita',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'efa4a992-7df2-51d3-a473-aa0df1df8e0b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'ARTEON',
 'odometer': 59951,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efa4a992-7df2-51d3-a473-aa0df1df8e0b/efa4a992-7df2-51d3-a473-aa0df1df8e0b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 509478,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/057/9af0df5d7bb143eda9fd6d383038c2db/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN ARTEON Elegance 2.0 TDI 110kW (150CV) DSG',
 'transmission': 'manual',
 'trim': 'Elegance 2.0 TDI 110kW (150CV) DSG',
 'vin': None,
 'year': 2020}
2026-03-26 18:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985945%27 HTTP/1.1" 200 None
2026-03-26 18:34:38 [ayvens.es] INFO: Saving data for 1985945: {'created_time': 1774550078.728421, 'last_price_update_time': 1774550078.728432, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985945') HTTP/1.1" 204 0
2026-03-26 18:34:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: da5d105b-fc41-5d33-a476-55af0a1ae503 with identifier: 1985944
2026-03-26 18:34:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: da5d105b-fc41-5d33-a476-55af0a1ae503 with identifier: 1985944
2026-03-26 18:34:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: da5d105b-fc41-5d33-a476-55af0a1ae503 with identifier: 1985944 to the API
2026-03-26 18:34:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/688/1b8f91efc76e472abe26d5f037838183/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 94,
 'color': 'Gris plata metalizad',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'da5d105b-fc41-5d33-a476-55af0a1ae503',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'RAPID',
 'odometer': 119496,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da5d105b-fc41-5d33-a476-55af0a1ae503/da5d105b-fc41-5d33-a476-55af0a1ae503_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 381174,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/688/1b8f91efc76e472abe26d5f037838183/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA RAPID 1.4 TDI CR 66KW (90cv) Like Spaceback',
 'transmission': 'manual',
 'trim': '1.4 TDI CR 66KW (90cv) Like Spaceback',
 'vin': None,
 'year': 2018}
2026-03-26 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985944%27 HTTP/1.1" 200 None
2026-03-26 18:34:39 [ayvens.es] INFO: Saving data for 1985944: {'created_time': 1774550079.118842, 'last_price_update_time': 1774550079.118853, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985944') HTTP/1.1" 204 0
2026-03-26 18:34:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9ba17eae-5fde-57ea-9e80-962dd8cda078 with identifier: 1985946
2026-03-26 18:34:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:34:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9ba17eae-5fde-57ea-9e80-962dd8cda078 with identifier: 1985946
2026-03-26 18:34:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9ba17eae-5fde-57ea-9e80-962dd8cda078 with identifier: 1985946 to the API
2026-03-26 18:34:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/459/1b88df71f19540c68db0f66b4dbb280c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 151,
 'color': 'Denim blue m',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '9ba17eae-5fde-57ea-9e80-962dd8cda078',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC90',
 'odometer': 176970,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ba17eae-5fde-57ea-9e80-962dd8cda078/9ba17eae-5fde-57ea-9e80-962dd8cda078_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 337927,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/459/1b88df71f19540c68db0f66b4dbb280c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-21',
 'seats_number': 7,
 'seller_name': None,
 'title': 'VOLVO XC90 2.0 B5 D AWD Momentum Pro Auto',
 'transmission': 'manual',
 'trim': '2.0 B5 D AWD Momentum Pro Auto',
 'vin': None,
 'year': 2020}
2026-03-26 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985946%27 HTTP/1.1" 200 None
2026-03-26 18:34:39 [ayvens.es] INFO: Saving data for 1985946: {'created_time': 1774550079.545493, 'last_price_update_time': 1774550079.545504, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985946') HTTP/1.1" 204 0
2026-03-26 18:34:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a29033a10>
2026-03-26 18:34:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bc86e80-3c9c-522c-a6b1-829a4275668e/4bc86e80-3c9c-522c-a6b1-829a4275668e_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F493%252F5f8b3c062dd1462a83fbdb6fdf09c560%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/493/5f8b3c062dd1462a83fbdb6fdf09c560/images/large/1.jpg saved to cache
2026-03-26 18:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4bc86e80-3c9c-522c-a6b1-829a4275668e
2026-03-26 18:34:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4bc86e80-3c9c-522c-a6b1-829a4275668e, skipping ID generation
2026-03-26 18:34:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bc86e80-3c9c-522c-a6b1-829a4275668e with scrape type 1
2026-03-26 18:34:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4bc86e80-3c9c-522c-a6b1-829a4275668e sending to next pipeline
2026-03-26 18:34:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4bc86e80-3c9c-522c-a6b1-829a4275668e, identifier: 1985947
2026-03-26 18:34:39 [ayvens.es] INFO: Found listing with ID: 1985959
2026-03-26 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985959%27 HTTP/1.1" 200 None
2026-03-26 18:34:39 [ayvens.es] INFO: Scrape type for 1985959: 1
2026-03-26 18:34:39 [ayvens.es] INFO: Extracting data for car ID: 1985959
2026-03-26 18:34:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a070411-bc31-5a61-baca-0ca9c24e9e3d with identifier: 1985959
2026-03-26 18:34:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a070411-bc31-5a61-baca-0ca9c24e9e3d with scrape type 1
2026-03-26 18:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0a070411-bc31-5a61-baca-0ca9c24e9e3d
2026-03-26 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F434%252F6564c4868df04124bc26c32fb2fe137f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/434/6564c4868df04124bc26c32fb2fe137f/images/large/1.jpg not downloaded yet
2026-03-26 18:34:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4bc86e80-3c9c-522c-a6b1-829a4275668e with identifier: 1985947
2026-03-26 18:34:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4bc86e80-3c9c-522c-a6b1-829a4275668e with identifier: 1985947
2026-03-26 18:34:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 4bc86e80-3c9c-522c-a6b1-829a4275668e with identifier: 1985947 to the API
2026-03-26 18:34:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/493/5f8b3c062dd1462a83fbdb6fdf09c560/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'color': 'Rojo',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '4bc86e80-3c9c-522c-a6b1-829a4275668e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'PROACE CITY VERSO',
 'odometer': 107387,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bc86e80-3c9c-522c-a6b1-829a4275668e/4bc86e80-3c9c-522c-a6b1-829a4275668e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 521781,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/493/5f8b3c062dd1462a83fbdb6fdf09c560/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA PROACE CITY VERSO 1.5D 96kW (130CV) Combi GX Plus L1',
 'transmission': 'manual',
 'trim': '1.5D 96kW (130CV) Combi GX Plus L1',
 'vin': None,
 'year': 2023}
2026-03-26 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985947%27 HTTP/1.1" 200 None
2026-03-26 18:34:40 [ayvens.es] INFO: Saving data for 1985947: {'created_time': 1774550080.085069, 'last_price_update_time': 1774550080.08508, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985947') HTTP/1.1" 204 0
2026-03-26 18:34:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a283c8110>
2026-03-26 18:34:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe158112-6914-5ec1-aa68-f56d03fe534d/fe158112-6914-5ec1-aa68-f56d03fe534d_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F135%252F34ebd8045fed4c228e58a575c8d195c2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/135/34ebd8045fed4c228e58a575c8d195c2/images/large/1.jpg saved to cache
2026-03-26 18:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fe158112-6914-5ec1-aa68-f56d03fe534d
2026-03-26 18:34:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fe158112-6914-5ec1-aa68-f56d03fe534d, skipping ID generation
2026-03-26 18:34:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe158112-6914-5ec1-aa68-f56d03fe534d with scrape type 1
2026-03-26 18:34:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fe158112-6914-5ec1-aa68-f56d03fe534d sending to next pipeline
2026-03-26 18:34:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: fe158112-6914-5ec1-aa68-f56d03fe534d, identifier: 1985948
2026-03-26 18:34:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a282f8a50>
2026-03-26 18:34:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ebef030-ec61-57f4-8cd3-ce8655266e2a/4ebef030-ec61-57f4-8cd3-ce8655266e2a_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F978%252F7d66186d35cd421caeefefb1c2cd5d42%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/978/7d66186d35cd421caeefefb1c2cd5d42/images/large/1.jpg saved to cache
2026-03-26 18:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4ebef030-ec61-57f4-8cd3-ce8655266e2a
2026-03-26 18:34:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4ebef030-ec61-57f4-8cd3-ce8655266e2a, skipping ID generation
2026-03-26 18:34:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ebef030-ec61-57f4-8cd3-ce8655266e2a with scrape type 1
2026-03-26 18:34:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4ebef030-ec61-57f4-8cd3-ce8655266e2a sending to next pipeline
2026-03-26 18:34:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4ebef030-ec61-57f4-8cd3-ce8655266e2a, identifier: 1985949
2026-03-26 18:34:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: fe158112-6914-5ec1-aa68-f56d03fe534d with identifier: 1985948
2026-03-26 18:34:40 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:34:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: fe158112-6914-5ec1-aa68-f56d03fe534d with identifier: 1985948
2026-03-26 18:34:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: fe158112-6914-5ec1-aa68-f56d03fe534d with identifier: 1985948 to the API
2026-03-26 18:34:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/135/34ebd8045fed4c228e58a575c8d195c2/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 146,
 'color': 'Mineral blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'fe158112-6914-5ec1-aa68-f56d03fe534d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 154523,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe158112-6914-5ec1-aa68-f56d03fe534d/fe158112-6914-5ec1-aa68-f56d03fe534d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 308412,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/135/34ebd8045fed4c228e58a575c8d195c2/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-01',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS (O) Profesional Blue dCi 59 kW (80CV)',
 'transmission': 'manual',
 'trim': '(O) Profesional Blue dCi 59 kW (80CV)',
 'vin': None,
 'year': 2021}
2026-03-26 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985948%27 HTTP/1.1" 200 None
2026-03-26 18:34:40 [ayvens.es] INFO: Saving data for 1985948: {'created_time': 1774550080.838017, 'last_price_update_time': 1774550080.838031, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985948') HTTP/1.1" 204 0
2026-03-26 18:34:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4ebef030-ec61-57f4-8cd3-ce8655266e2a with identifier: 1985949
2026-03-26 18:34:40 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:34:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4ebef030-ec61-57f4-8cd3-ce8655266e2a with identifier: 1985949
2026-03-26 18:34:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 4ebef030-ec61-57f4-8cd3-ce8655266e2a with identifier: 1985949 to the API
2026-03-26 18:34:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/978/7d66186d35cd421caeefefb1c2cd5d42/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'Blanco puro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '4ebef030-ec61-57f4-8cd3-ce8655266e2a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-CROSS',
 'odometer': 34424,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ebef030-ec61-57f4-8cd3-ce8655266e2a/4ebef030-ec61-57f4-8cd3-ce8655266e2a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 361462,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/978/7d66186d35cd421caeefefb1c2cd5d42/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-CROSS Advance 1.0 TSI 70kW (95CV)',
 'transmission': 'manual',
 'trim': 'Advance 1.0 TSI 70kW (95CV)',
 'vin': None,
 'year': 2021}
2026-03-26 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985949%27 HTTP/1.1" 200 None
2026-03-26 18:34:41 [ayvens.es] INFO: Saving data for 1985949: {'created_time': 1774550081.325766, 'last_price_update_time': 1774550081.325779, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985949') HTTP/1.1" 204 0
2026-03-26 18:34:41 [ayvens.es] INFO: Found listing with ID: 1985960
2026-03-26 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985960%27 HTTP/1.1" 200 None
2026-03-26 18:34:41 [ayvens.es] INFO: Scrape type for 1985960: 1
2026-03-26 18:34:41 [ayvens.es] INFO: Extracting data for car ID: 1985960
2026-03-26 18:34:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9fceba8-e991-5224-82d8-92d4752b27a8 with identifier: 1985960
2026-03-26 18:34:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9fceba8-e991-5224-82d8-92d4752b27a8 with scrape type 1
2026-03-26 18:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a9fceba8-e991-5224-82d8-92d4752b27a8
2026-03-26 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F943%252Fe2a85ea503624a8099c337a0c38ec3b4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/943/e2a85ea503624a8099c337a0c38ec3b4/images/large/1.jpg not downloaded yet
2026-03-26 18:34:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/110/ac58baa7f0e445e1bb3025ba0e11327d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/398/08bfacd1615149eea4c0eafb56468b82/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/721/6b4b3d786bf3457b882cc4e5362e12d9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:41 [ayvens.es] INFO: Found listing with ID: 1985961
2026-03-26 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985961%27 HTTP/1.1" 200 None
2026-03-26 18:34:41 [ayvens.es] INFO: Scrape type for 1985961: 1
2026-03-26 18:34:41 [ayvens.es] INFO: Extracting data for car ID: 1985961
2026-03-26 18:34:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a73bd65-e205-57ac-9789-151091b04d26 with identifier: 1985961
2026-03-26 18:34:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a73bd65-e205-57ac-9789-151091b04d26 with scrape type 1
2026-03-26 18:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8a73bd65-e205-57ac-9789-151091b04d26
2026-03-26 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F290%252F4b9ce131ffe149ec92d4bea801bfb64f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/290/4b9ce131ffe149ec92d4bea801bfb64f/images/large/1.jpg not downloaded yet
2026-03-26 18:34:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/819/6d4d5da5ca0d429fa852fec1e8ed8f48/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/759/b9198c054d604624b968c7ac2265bcf3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/803/89c0a3d7d1cf46039eb2b4ce8df7f4fd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:41 [ayvens.es] INFO: Found listing with ID: 1985962
2026-03-26 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985962%27 HTTP/1.1" 200 None
2026-03-26 18:34:41 [ayvens.es] INFO: Scrape type for 1985962: 1
2026-03-26 18:34:41 [ayvens.es] INFO: Extracting data for car ID: 1985962
2026-03-26 18:34:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4402d649-c304-5c29-810c-b2ffa8f27990 with identifier: 1985962
2026-03-26 18:34:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4402d649-c304-5c29-810c-b2ffa8f27990 with scrape type 1
2026-03-26 18:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4402d649-c304-5c29-810c-b2ffa8f27990
2026-03-26 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F069%252F21a1dc394daa48a9a57c143d4e780dd0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/069/21a1dc394daa48a9a57c143d4e780dd0/images/large/1.jpg not downloaded yet
2026-03-26 18:34:41 [ayvens.es] INFO: Found listing with ID: 1985963
2026-03-26 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985963%27 HTTP/1.1" 200 None
2026-03-26 18:34:41 [ayvens.es] INFO: Scrape type for 1985963: 1
2026-03-26 18:34:41 [ayvens.es] INFO: Extracting data for car ID: 1985963
2026-03-26 18:34:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0cc2183-9488-5b4d-a5d5-0495b9f52261 with identifier: 1985963
2026-03-26 18:34:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0cc2183-9488-5b4d-a5d5-0495b9f52261 with scrape type 1
2026-03-26 18:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d0cc2183-9488-5b4d-a5d5-0495b9f52261
2026-03-26 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F026%252F74b8ea58c78445b8ae203cc136a68ff4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/026/74b8ea58c78445b8ae203cc136a68ff4/images/large/1.jpg not downloaded yet
2026-03-26 18:34:41 [ayvens.es] INFO: Found listing with ID: 1985964
2026-03-26 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985964%27 HTTP/1.1" 200 None
2026-03-26 18:34:41 [ayvens.es] INFO: Scrape type for 1985964: 1
2026-03-26 18:34:41 [ayvens.es] INFO: Extracting data for car ID: 1985964
2026-03-26 18:34:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76b4e2c2-71a0-536b-b5e4-df568482dad8 with identifier: 1985964
2026-03-26 18:34:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76b4e2c2-71a0-536b-b5e4-df568482dad8 with scrape type 1
2026-03-26 18:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 76b4e2c2-71a0-536b-b5e4-df568482dad8
2026-03-26 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F808%252F6d6438fd96a04cc58854d52a6a3e15a4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/808/6d6438fd96a04cc58854d52a6a3e15a4/images/large/1.jpg not downloaded yet
2026-03-26 18:34:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a29081910>
2026-03-26 18:34:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c273638-3546-569c-94dc-4fe5d0e5818f/7c273638-3546-569c-94dc-4fe5d0e5818f_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F110%252Fac58baa7f0e445e1bb3025ba0e11327d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/110/ac58baa7f0e445e1bb3025ba0e11327d/images/large/1.jpg saved to cache
2026-03-26 18:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7c273638-3546-569c-94dc-4fe5d0e5818f
2026-03-26 18:34:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7c273638-3546-569c-94dc-4fe5d0e5818f, skipping ID generation
2026-03-26 18:34:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c273638-3546-569c-94dc-4fe5d0e5818f with scrape type 1
2026-03-26 18:34:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7c273638-3546-569c-94dc-4fe5d0e5818f sending to next pipeline
2026-03-26 18:34:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7c273638-3546-569c-94dc-4fe5d0e5818f, identifier: 1985952
2026-03-26 18:34:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c76a50>
2026-03-26 18:34:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0acfd30-c697-55a8-8378-20c8960460dc/e0acfd30-c697-55a8-8378-20c8960460dc_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F398%252F08bfacd1615149eea4c0eafb56468b82%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/398/08bfacd1615149eea4c0eafb56468b82/images/large/1.jpg saved to cache
2026-03-26 18:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e0acfd30-c697-55a8-8378-20c8960460dc
2026-03-26 18:34:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e0acfd30-c697-55a8-8378-20c8960460dc, skipping ID generation
2026-03-26 18:34:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0acfd30-c697-55a8-8378-20c8960460dc with scrape type 1
2026-03-26 18:34:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e0acfd30-c697-55a8-8378-20c8960460dc sending to next pipeline
2026-03-26 18:34:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e0acfd30-c697-55a8-8378-20c8960460dc, identifier: 1985954
2026-03-26 18:34:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a2830c290>
2026-03-26 18:34:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbe3053f-53e4-5e21-a158-50fe19ea0162/fbe3053f-53e4-5e21-a158-50fe19ea0162_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F721%252F6b4b3d786bf3457b882cc4e5362e12d9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/721/6b4b3d786bf3457b882cc4e5362e12d9/images/large/1.jpg saved to cache
2026-03-26 18:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fbe3053f-53e4-5e21-a158-50fe19ea0162
2026-03-26 18:34:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fbe3053f-53e4-5e21-a158-50fe19ea0162, skipping ID generation
2026-03-26 18:34:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbe3053f-53e4-5e21-a158-50fe19ea0162 with scrape type 1
2026-03-26 18:34:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fbe3053f-53e4-5e21-a158-50fe19ea0162 sending to next pipeline
2026-03-26 18:34:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: fbe3053f-53e4-5e21-a158-50fe19ea0162, identifier: 1985955
2026-03-26 18:34:42 [ayvens.es] INFO: Found listing with ID: 1985965
2026-03-26 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985965%27 HTTP/1.1" 200 None
2026-03-26 18:34:42 [ayvens.es] INFO: Scrape type for 1985965: 1
2026-03-26 18:34:42 [ayvens.es] INFO: Extracting data for car ID: 1985965
2026-03-26 18:34:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62c50d59-bba8-5342-885c-037d79db5c39 with identifier: 1985965
2026-03-26 18:34:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62c50d59-bba8-5342-885c-037d79db5c39 with scrape type 1
2026-03-26 18:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 62c50d59-bba8-5342-885c-037d79db5c39
2026-03-26 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F387%252F864fd241aa68417caa99914d50dad67a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/387/864fd241aa68417caa99914d50dad67a/images/large/1.jpg not downloaded yet
2026-03-26 18:34:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7c273638-3546-569c-94dc-4fe5d0e5818f with identifier: 1985952
2026-03-26 18:34:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7c273638-3546-569c-94dc-4fe5d0e5818f with identifier: 1985952
2026-03-26 18:34:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7c273638-3546-569c-94dc-4fe5d0e5818f with identifier: 1985952 to the API
2026-03-26 18:34:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/110/ac58baa7f0e445e1bb3025ba0e11327d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'Blanco candy',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '7c273638-3546-569c-94dc-4fe5d0e5818f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KAMIQ',
 'odometer': 50763,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c273638-3546-569c-94dc-4fe5d0e5818f/7c273638-3546-569c-94dc-4fe5d0e5818f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344218,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/110/ac58baa7f0e445e1bb3025ba0e11327d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA KAMIQ 1.0 TSI 81kW (110CV) DSG Ambition',
 'transmission': 'manual',
 'trim': '1.0 TSI 81kW (110CV) DSG Ambition',
 'vin': None,
 'year': 2021}
2026-03-26 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985952%27 HTTP/1.1" 200 None
2026-03-26 18:34:42 [ayvens.es] INFO: Saving data for 1985952: {'created_time': 1774550082.659334, 'last_price_update_time': 1774550082.659346, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985952') HTTP/1.1" 204 0
2026-03-26 18:34:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e0acfd30-c697-55a8-8378-20c8960460dc with identifier: 1985954
2026-03-26 18:34:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e0acfd30-c697-55a8-8378-20c8960460dc with identifier: 1985954
2026-03-26 18:34:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e0acfd30-c697-55a8-8378-20c8960460dc with identifier: 1985954 to the API
2026-03-26 18:34:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/398/08bfacd1615149eea4c0eafb56468b82/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'Gris plata metalizad',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e0acfd30-c697-55a8-8378-20c8960460dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 107374,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0acfd30-c697-55a8-8378-20c8960460dc/e0acfd30-c697-55a8-8378-20c8960460dc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 345762,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/398/08bfacd1615149eea4c0eafb56468b82/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON ST 2.0 TDI 110kW DSG-7 S&S Xcellence',
 'transmission': 'manual',
 'trim': 'ST 2.0 TDI 110kW DSG-7 S&S Xcellence',
 'vin': None,
 'year': 2020}
2026-03-26 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985954%27 HTTP/1.1" 200 None
2026-03-26 18:34:43 [ayvens.es] INFO: Saving data for 1985954: {'created_time': 1774550083.0537, 'last_price_update_time': 1774550083.053711, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985954') HTTP/1.1" 204 0
2026-03-26 18:34:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: fbe3053f-53e4-5e21-a158-50fe19ea0162 with identifier: 1985955
2026-03-26 18:34:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: fbe3053f-53e4-5e21-a158-50fe19ea0162 with identifier: 1985955
2026-03-26 18:34:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: fbe3053f-53e4-5e21-a158-50fe19ea0162 with identifier: 1985955 to the API
2026-03-26 18:34:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/721/6b4b3d786bf3457b882cc4e5362e12d9/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'fbe3053f-53e4-5e21-a158-50fe19ea0162',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ARONA',
 'odometer': 39685,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbe3053f-53e4-5e21-a158-50fe19ea0162/fbe3053f-53e4-5e21-a158-50fe19ea0162_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 334919,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/721/6b4b3d786bf3457b882cc4e5362e12d9/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ARONA 1.0 TSI 81kW (110CV) Style Go Eco',
 'transmission': 'manual',
 'trim': '1.0 TSI 81kW (110CV) Style Go Eco',
 'vin': None,
 'year': 2020}
2026-03-26 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985955%27 HTTP/1.1" 200 None
2026-03-26 18:34:43 [ayvens.es] INFO: Saving data for 1985955: {'created_time': 1774550083.376873, 'last_price_update_time': 1774550083.376884, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985955') HTTP/1.1" 204 0
2026-03-26 18:34:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/871/3d262416ba6e49308e163bd28168d065/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:43 [ayvens.es] INFO: Found listing with ID: 1985966
2026-03-26 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985966%27 HTTP/1.1" 200 None
2026-03-26 18:34:43 [ayvens.es] INFO: Scrape type for 1985966: 1
2026-03-26 18:34:43 [ayvens.es] INFO: Extracting data for car ID: 1985966
2026-03-26 18:34:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 477f3e37-ff75-5318-abdd-0850833645a9 with identifier: 1985966
2026-03-26 18:34:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 477f3e37-ff75-5318-abdd-0850833645a9 with scrape type 1
2026-03-26 18:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 477f3e37-ff75-5318-abdd-0850833645a9
2026-03-26 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F809%252F1e009f4ce9594ed48aa92babfad175e8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/809/1e009f4ce9594ed48aa92babfad175e8/images/large/1.jpg not downloaded yet
2026-03-26 18:34:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28d1c9d0>
2026-03-26 18:34:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82d3ae70-0a86-5522-b14b-41961a80e839/82d3ae70-0a86-5522-b14b-41961a80e839_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F819%252F6d4d5da5ca0d429fa852fec1e8ed8f48%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/819/6d4d5da5ca0d429fa852fec1e8ed8f48/images/large/1.jpg saved to cache
2026-03-26 18:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 82d3ae70-0a86-5522-b14b-41961a80e839
2026-03-26 18:34:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 82d3ae70-0a86-5522-b14b-41961a80e839, skipping ID generation
2026-03-26 18:34:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82d3ae70-0a86-5522-b14b-41961a80e839 with scrape type 1
2026-03-26 18:34:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 82d3ae70-0a86-5522-b14b-41961a80e839 sending to next pipeline
2026-03-26 18:34:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 82d3ae70-0a86-5522-b14b-41961a80e839, identifier: 1985953
2026-03-26 18:34:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a29082610>
2026-03-26 18:34:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1253682e-269d-5d9d-b362-12b0be968fd1/1253682e-269d-5d9d-b362-12b0be968fd1_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F759%252Fb9198c054d604624b968c7ac2265bcf3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/759/b9198c054d604624b968c7ac2265bcf3/images/large/1.jpg saved to cache
2026-03-26 18:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1253682e-269d-5d9d-b362-12b0be968fd1
2026-03-26 18:34:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1253682e-269d-5d9d-b362-12b0be968fd1, skipping ID generation
2026-03-26 18:34:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1253682e-269d-5d9d-b362-12b0be968fd1 with scrape type 1
2026-03-26 18:34:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1253682e-269d-5d9d-b362-12b0be968fd1 sending to next pipeline
2026-03-26 18:34:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1253682e-269d-5d9d-b362-12b0be968fd1, identifier: 1985956
2026-03-26 18:34:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28346e10>
2026-03-26 18:34:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61a97a4e-fcd6-574f-9d77-4da164874010/61a97a4e-fcd6-574f-9d77-4da164874010_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F803%252F89c0a3d7d1cf46039eb2b4ce8df7f4fd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/803/89c0a3d7d1cf46039eb2b4ce8df7f4fd/images/large/1.jpg saved to cache
2026-03-26 18:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 61a97a4e-fcd6-574f-9d77-4da164874010
2026-03-26 18:34:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 61a97a4e-fcd6-574f-9d77-4da164874010, skipping ID generation
2026-03-26 18:34:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61a97a4e-fcd6-574f-9d77-4da164874010 with scrape type 1
2026-03-26 18:34:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 61a97a4e-fcd6-574f-9d77-4da164874010 sending to next pipeline
2026-03-26 18:34:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 61a97a4e-fcd6-574f-9d77-4da164874010, identifier: 1985957
2026-03-26 18:34:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 82d3ae70-0a86-5522-b14b-41961a80e839 with identifier: 1985953
2026-03-26 18:34:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 82d3ae70-0a86-5522-b14b-41961a80e839 with identifier: 1985953
2026-03-26 18:34:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 82d3ae70-0a86-5522-b14b-41961a80e839 with identifier: 1985953 to the API
2026-03-26 18:34:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/819/6d4d5da5ca0d429fa852fec1e8ed8f48/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '82d3ae70-0a86-5522-b14b-41961a80e839',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 134563,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82d3ae70-0a86-5522-b14b-41961a80e839/82d3ae70-0a86-5522-b14b-41961a80e839_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 518048,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/819/6d4d5da5ca0d429fa852fec1e8ed8f48/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON 1.6 TDI 85kW (115CV) S&S Style Visio Ed',
 'transmission': 'manual',
 'trim': '1.6 TDI 85kW (115CV) S&S Style Visio Ed',
 'vin': None,
 'year': 2020}
2026-03-26 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985953%27 HTTP/1.1" 200 None
2026-03-26 18:34:44 [ayvens.es] INFO: Saving data for 1985953: {'created_time': 1774550084.181839, 'last_price_update_time': 1774550084.18185, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985953') HTTP/1.1" 204 0
2026-03-26 18:34:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1253682e-269d-5d9d-b362-12b0be968fd1 with identifier: 1985956
2026-03-26 18:34:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1253682e-269d-5d9d-b362-12b0be968fd1 with identifier: 1985956
2026-03-26 18:34:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1253682e-269d-5d9d-b362-12b0be968fd1 with identifier: 1985956 to the API
2026-03-26 18:34:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/759/b9198c054d604624b968c7ac2265bcf3/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 101,
 'color': 'Blanco glaciar',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '1253682e-269d-5d9d-b362-12b0be968fd1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MEGANE',
 'odometer': 153040,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1253682e-269d-5d9d-b362-12b0be968fd1/1253682e-269d-5d9d-b362-12b0be968fd1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330581,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/759/b9198c054d604624b968c7ac2265bcf3/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT MEGANE (O) Business Blue dCi 81 kW (115CV)',
 'transmission': 'manual',
 'trim': '(O) Business Blue dCi 81 kW (115CV)',
 'vin': None,
 'year': 2020}
2026-03-26 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985956%27 HTTP/1.1" 200 None
2026-03-26 18:34:44 [ayvens.es] INFO: Saving data for 1985956: {'created_time': 1774550084.512215, 'last_price_update_time': 1774550084.512225, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985956') HTTP/1.1" 204 0
2026-03-26 18:34:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 61a97a4e-fcd6-574f-9d77-4da164874010 with identifier: 1985957
2026-03-26 18:34:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 61a97a4e-fcd6-574f-9d77-4da164874010 with identifier: 1985957
2026-03-26 18:34:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 61a97a4e-fcd6-574f-9d77-4da164874010 with identifier: 1985957 to the API
2026-03-26 18:34:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/803/89c0a3d7d1cf46039eb2b4ce8df7f4fd/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'color': 'Blanco banquise',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '61a97a4e-fcd6-574f-9d77-4da164874010',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'RIFTER',
 'odometer': 134888,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61a97a4e-fcd6-574f-9d77-4da164874010/61a97a4e-fcd6-574f-9d77-4da164874010_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 316438,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/803/89c0a3d7d1cf46039eb2b4ce8df7f4fd/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT RIFTER Active Standard BlueHDi 73kW',
 'transmission': 'manual',
 'trim': 'Active Standard BlueHDi 73kW',
 'vin': None,
 'year': 2021}
2026-03-26 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985957%27 HTTP/1.1" 200 None
2026-03-26 18:34:44 [ayvens.es] INFO: Saving data for 1985957: {'created_time': 1774550084.817649, 'last_price_update_time': 1774550084.817663, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985957') HTTP/1.1" 204 0
2026-03-26 18:34:44 [ayvens.es] INFO: Found listing with ID: 1985967
2026-03-26 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985967%27 HTTP/1.1" 200 None
2026-03-26 18:34:44 [ayvens.es] INFO: Scrape type for 1985967: 1
2026-03-26 18:34:44 [ayvens.es] INFO: Extracting data for car ID: 1985967
2026-03-26 18:34:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: caa78e8b-36a9-583b-8aec-5b1e61213ee1 with identifier: 1985967
2026-03-26 18:34:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item caa78e8b-36a9-583b-8aec-5b1e61213ee1 with scrape type 1
2026-03-26 18:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item caa78e8b-36a9-583b-8aec-5b1e61213ee1
2026-03-26 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F592%252Fe90c854828ba4ac991c91364aa2a4a83%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/592/e90c854828ba4ac991c91364aa2a4a83/images/large/1.jpg not downloaded yet
2026-03-26 18:34:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/420/8c780dda18b24aa59dd5d8cf9a6adcc6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/290/4b9ce131ffe149ec92d4bea801bfb64f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/943/e2a85ea503624a8099c337a0c38ec3b4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:44 [ayvens.es] INFO: Found listing with ID: 1985968
2026-03-26 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985968%27 HTTP/1.1" 200 None
2026-03-26 18:34:44 [ayvens.es] INFO: Scrape type for 1985968: 1
2026-03-26 18:34:44 [ayvens.es] INFO: Extracting data for car ID: 1985968
2026-03-26 18:34:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65aa538b-02c8-5330-aadc-9325e3c45854 with identifier: 1985968
2026-03-26 18:34:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65aa538b-02c8-5330-aadc-9325e3c45854 with scrape type 1
2026-03-26 18:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 65aa538b-02c8-5330-aadc-9325e3c45854
2026-03-26 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F288%252Fffc8225fc26e4ee0a740b27b272378ca%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/288/ffc8225fc26e4ee0a740b27b272378ca/images/large/1.jpg not downloaded yet
2026-03-26 18:34:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c6fc50>
2026-03-26 18:34:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eca0a30e-5d44-5ac2-9c79-972c37093cf3/eca0a30e-5d44-5ac2-9c79-972c37093cf3_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F871%252F3d262416ba6e49308e163bd28168d065%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/871/3d262416ba6e49308e163bd28168d065/images/large/1.jpg saved to cache
2026-03-26 18:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eca0a30e-5d44-5ac2-9c79-972c37093cf3
2026-03-26 18:34:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eca0a30e-5d44-5ac2-9c79-972c37093cf3, skipping ID generation
2026-03-26 18:34:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eca0a30e-5d44-5ac2-9c79-972c37093cf3 with scrape type 1
2026-03-26 18:34:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eca0a30e-5d44-5ac2-9c79-972c37093cf3 sending to next pipeline
2026-03-26 18:34:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: eca0a30e-5d44-5ac2-9c79-972c37093cf3, identifier: 1985950
2026-03-26 18:34:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: eca0a30e-5d44-5ac2-9c79-972c37093cf3 with identifier: 1985950
2026-03-26 18:34:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: eca0a30e-5d44-5ac2-9c79-972c37093cf3 with identifier: 1985950
2026-03-26 18:34:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: eca0a30e-5d44-5ac2-9c79-972c37093cf3 with identifier: 1985950 to the API
2026-03-26 18:34:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/871/3d262416ba6e49308e163bd28168d065/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'eca0a30e-5d44-5ac2-9c79-972c37093cf3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'TRAFIC',
 'odometer': 124064,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eca0a30e-5d44-5ac2-9c79-972c37093cf3/eca0a30e-5d44-5ac2-9c79-972c37093cf3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 320833,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/871/3d262416ba6e49308e163bd28168d065/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-20',
 'seats_number': 9,
 'seller_name': None,
 'title': 'RENAULT TRAFIC Combi 9 Energy Blue dCi 88 kW (120 CV)',
 'transmission': 'manual',
 'trim': 'Combi 9 Energy Blue dCi 88 kW (120 CV)',
 'vin': None,
 'year': 2021}
2026-03-26 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985950%27 HTTP/1.1" 200 None
2026-03-26 18:34:45 [ayvens.es] INFO: Saving data for 1985950: {'created_time': 1774550085.393689, 'last_price_update_time': 1774550085.393698, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985950') HTTP/1.1" 204 0
2026-03-26 18:34:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/434/6564c4868df04124bc26c32fb2fe137f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/026/74b8ea58c78445b8ae203cc136a68ff4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:45 [ayvens.es] INFO: Found listing with ID: 1985969
2026-03-26 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985969%27 HTTP/1.1" 200 None
2026-03-26 18:34:45 [ayvens.es] INFO: Scrape type for 1985969: 1
2026-03-26 18:34:45 [ayvens.es] INFO: Extracting data for car ID: 1985969
2026-03-26 18:34:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee6b271d-fc2d-5ee1-8855-f910dee21907 with identifier: 1985969
2026-03-26 18:34:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee6b271d-fc2d-5ee1-8855-f910dee21907 with scrape type 1
2026-03-26 18:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ee6b271d-fc2d-5ee1-8855-f910dee21907
2026-03-26 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F505%252Fb69c1b5324f74da59206b394477ba240%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/505/b69c1b5324f74da59206b394477ba240/images/large/1.jpg not downloaded yet
2026-03-26 18:34:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28dea9d0>
2026-03-26 18:34:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0514be0-9b26-5cea-a0ad-ee5acded6d97/e0514be0-9b26-5cea-a0ad-ee5acded6d97_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F420%252F8c780dda18b24aa59dd5d8cf9a6adcc6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/420/8c780dda18b24aa59dd5d8cf9a6adcc6/images/large/1.jpg saved to cache
2026-03-26 18:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e0514be0-9b26-5cea-a0ad-ee5acded6d97
2026-03-26 18:34:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e0514be0-9b26-5cea-a0ad-ee5acded6d97, skipping ID generation
2026-03-26 18:34:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0514be0-9b26-5cea-a0ad-ee5acded6d97 with scrape type 1
2026-03-26 18:34:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e0514be0-9b26-5cea-a0ad-ee5acded6d97 sending to next pipeline
2026-03-26 18:34:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e0514be0-9b26-5cea-a0ad-ee5acded6d97, identifier: 1985958
2026-03-26 18:34:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28386050>
2026-03-26 18:34:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a73bd65-e205-57ac-9789-151091b04d26/8a73bd65-e205-57ac-9789-151091b04d26_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F290%252F4b9ce131ffe149ec92d4bea801bfb64f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/290/4b9ce131ffe149ec92d4bea801bfb64f/images/large/1.jpg saved to cache
2026-03-26 18:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8a73bd65-e205-57ac-9789-151091b04d26
2026-03-26 18:34:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8a73bd65-e205-57ac-9789-151091b04d26, skipping ID generation
2026-03-26 18:34:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a73bd65-e205-57ac-9789-151091b04d26 with scrape type 1
2026-03-26 18:34:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8a73bd65-e205-57ac-9789-151091b04d26 sending to next pipeline
2026-03-26 18:34:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8a73bd65-e205-57ac-9789-151091b04d26, identifier: 1985961
2026-03-26 18:34:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28ac5090>
2026-03-26 18:34:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9fceba8-e991-5224-82d8-92d4752b27a8/a9fceba8-e991-5224-82d8-92d4752b27a8_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F943%252Fe2a85ea503624a8099c337a0c38ec3b4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/943/e2a85ea503624a8099c337a0c38ec3b4/images/large/1.jpg saved to cache
2026-03-26 18:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a9fceba8-e991-5224-82d8-92d4752b27a8
2026-03-26 18:34:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a9fceba8-e991-5224-82d8-92d4752b27a8, skipping ID generation
2026-03-26 18:34:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9fceba8-e991-5224-82d8-92d4752b27a8 with scrape type 1
2026-03-26 18:34:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a9fceba8-e991-5224-82d8-92d4752b27a8 sending to next pipeline
2026-03-26 18:34:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a9fceba8-e991-5224-82d8-92d4752b27a8, identifier: 1985960
2026-03-26 18:34:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/069/21a1dc394daa48a9a57c143d4e780dd0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:45 [ayvens.es] INFO: Found listing with ID: 1985970
2026-03-26 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985970%27 HTTP/1.1" 200 None
2026-03-26 18:34:45 [ayvens.es] INFO: Scrape type for 1985970: 1
2026-03-26 18:34:45 [ayvens.es] INFO: Extracting data for car ID: 1985970
2026-03-26 18:34:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c427576d-c75e-56d6-a85c-141d89e2ddb1 with identifier: 1985970
2026-03-26 18:34:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c427576d-c75e-56d6-a85c-141d89e2ddb1 with scrape type 1
2026-03-26 18:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c427576d-c75e-56d6-a85c-141d89e2ddb1
2026-03-26 18:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F177%252F66a280b21f4142b19edb9c2691a4dcc5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/177/66a280b21f4142b19edb9c2691a4dcc5/images/large/1.jpg not downloaded yet
2026-03-26 18:34:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e0514be0-9b26-5cea-a0ad-ee5acded6d97 with identifier: 1985958
2026-03-26 18:34:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e0514be0-9b26-5cea-a0ad-ee5acded6d97 with identifier: 1985958
2026-03-26 18:34:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e0514be0-9b26-5cea-a0ad-ee5acded6d97 with identifier: 1985958 to the API
2026-03-26 18:34:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/420/8c780dda18b24aa59dd5d8cf9a6adcc6/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 179,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.4L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e0514be0-9b26-5cea-a0ad-ee5acded6d97',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'HILUX',
 'odometer': 92651,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0514be0-9b26-5cea-a0ad-ee5acded6d97/e0514be0-9b26-5cea-a0ad-ee5acded6d97_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 498932,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/420/8c780dda18b24aa59dd5d8cf9a6adcc6/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA HILUX 2.4 D-4D Cabina Doble GX',
 'transmission': 'manual',
 'trim': '2.4 D-4D Cabina Doble GX',
 'vin': None,
 'year': 2021}
2026-03-26 18:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985958%27 HTTP/1.1" 200 None
2026-03-26 18:34:46 [ayvens.es] INFO: Saving data for 1985958: {'created_time': 1774550086.33072, 'last_price_update_time': 1774550086.330729, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985958') HTTP/1.1" 204 0
2026-03-26 18:34:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8a73bd65-e205-57ac-9789-151091b04d26 with identifier: 1985961
2026-03-26 18:34:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:34:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8a73bd65-e205-57ac-9789-151091b04d26 with identifier: 1985961
2026-03-26 18:34:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8a73bd65-e205-57ac-9789-151091b04d26 with identifier: 1985961 to the API
2026-03-26 18:34:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/290/4b9ce131ffe149ec92d4bea801bfb64f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Rojo deseo',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '8a73bd65-e205-57ac-9789-151091b04d26',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CAPTUR',
 'odometer': 191202,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a73bd65-e205-57ac-9789-151091b04d26/8a73bd65-e205-57ac-9789-151091b04d26_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 383399,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/290/4b9ce131ffe149ec92d4bea801bfb64f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CAPTUR Intens TCe 140CV GPF Micro Hibrido',
 'transmission': 'manual',
 'trim': 'Intens TCe 140CV GPF Micro Hibrido',
 'vin': None,
 'year': 2021}
2026-03-26 18:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985961%27 HTTP/1.1" 200 None
2026-03-26 18:34:46 [ayvens.es] INFO: Saving data for 1985961: {'created_time': 1774550086.77435, 'last_price_update_time': 1774550086.774365, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985961') HTTP/1.1" 204 0
2026-03-26 18:34:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a9fceba8-e991-5224-82d8-92d4752b27a8 with identifier: 1985960
2026-03-26 18:34:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a9fceba8-e991-5224-82d8-92d4752b27a8 with identifier: 1985960
2026-03-26 18:34:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a9fceba8-e991-5224-82d8-92d4752b27a8 with identifier: 1985960 to the API
2026-03-26 18:34:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/943/e2a85ea503624a8099c337a0c38ec3b4/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'a9fceba8-e991-5224-82d8-92d4752b27a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ARONA',
 'odometer': 47696,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9fceba8-e991-5224-82d8-92d4752b27a8/a9fceba8-e991-5224-82d8-92d4752b27a8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 326358,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/943/e2a85ea503624a8099c337a0c38ec3b4/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ARONA 1.0 TSI 85kW (115CV) Style Edition Eco',
 'transmission': 'manual',
 'trim': '1.0 TSI 85kW (115CV) Style Edition Eco',
 'vin': None,
 'year': 2019}
2026-03-26 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985960%27 HTTP/1.1" 200 None
2026-03-26 18:34:47 [ayvens.es] INFO: Saving data for 1985960: {'created_time': 1774550087.10013, 'last_price_update_time': 1774550087.100141, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985960') HTTP/1.1" 204 0
2026-03-26 18:34:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/499/71c71daed3af49af825aeca63a2f0086/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/808/6d6438fd96a04cc58854d52a6a3e15a4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:47 [ayvens.es] INFO: Found listing with ID: 1985971
2026-03-26 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985971%27 HTTP/1.1" 200 None
2026-03-26 18:34:47 [ayvens.es] INFO: Scrape type for 1985971: 1
2026-03-26 18:34:47 [ayvens.es] INFO: Extracting data for car ID: 1985971
2026-03-26 18:34:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7218d759-2242-5ace-81ba-07ca69ea8bc7 with identifier: 1985971
2026-03-26 18:34:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7218d759-2242-5ace-81ba-07ca69ea8bc7 with scrape type 1
2026-03-26 18:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7218d759-2242-5ace-81ba-07ca69ea8bc7
2026-03-26 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F865%252F74235631a383444eaefb439f69c9e67c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/865/74235631a383444eaefb439f69c9e67c/images/large/1.jpg not downloaded yet
2026-03-26 18:34:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c19910>
2026-03-26 18:34:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a070411-bc31-5a61-baca-0ca9c24e9e3d/0a070411-bc31-5a61-baca-0ca9c24e9e3d_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F434%252F6564c4868df04124bc26c32fb2fe137f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/434/6564c4868df04124bc26c32fb2fe137f/images/large/1.jpg saved to cache
2026-03-26 18:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0a070411-bc31-5a61-baca-0ca9c24e9e3d
2026-03-26 18:34:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0a070411-bc31-5a61-baca-0ca9c24e9e3d, skipping ID generation
2026-03-26 18:34:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a070411-bc31-5a61-baca-0ca9c24e9e3d with scrape type 1
2026-03-26 18:34:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0a070411-bc31-5a61-baca-0ca9c24e9e3d sending to next pipeline
2026-03-26 18:34:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0a070411-bc31-5a61-baca-0ca9c24e9e3d, identifier: 1985959
2026-03-26 18:34:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c2d8d0>
2026-03-26 18:34:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0cc2183-9488-5b4d-a5d5-0495b9f52261/d0cc2183-9488-5b4d-a5d5-0495b9f52261_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F026%252F74b8ea58c78445b8ae203cc136a68ff4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/026/74b8ea58c78445b8ae203cc136a68ff4/images/large/1.jpg saved to cache
2026-03-26 18:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d0cc2183-9488-5b4d-a5d5-0495b9f52261
2026-03-26 18:34:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d0cc2183-9488-5b4d-a5d5-0495b9f52261, skipping ID generation
2026-03-26 18:34:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0cc2183-9488-5b4d-a5d5-0495b9f52261 with scrape type 1
2026-03-26 18:34:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d0cc2183-9488-5b4d-a5d5-0495b9f52261 sending to next pipeline
2026-03-26 18:34:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d0cc2183-9488-5b4d-a5d5-0495b9f52261, identifier: 1985963
2026-03-26 18:34:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0a070411-bc31-5a61-baca-0ca9c24e9e3d with identifier: 1985959
2026-03-26 18:34:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0a070411-bc31-5a61-baca-0ca9c24e9e3d with identifier: 1985959
2026-03-26 18:34:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0a070411-bc31-5a61-baca-0ca9c24e9e3d with identifier: 1985959 to the API
2026-03-26 18:34:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/434/6564c4868df04124bc26c32fb2fe137f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '0a070411-bc31-5a61-baca-0ca9c24e9e3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 47614,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a070411-bc31-5a61-baca-0ca9c24e9e3d/0a070411-bc31-5a61-baca-0ca9c24e9e3d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 487773,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/434/6564c4868df04124bc26c32fb2fe137f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO Equilibre Blue dCi 74kW (100CV)',
 'transmission': 'manual',
 'trim': 'Equilibre Blue dCi 74kW (100CV)',
 'vin': None,
 'year': 2022}
2026-03-26 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985959%27 HTTP/1.1" 200 None
2026-03-26 18:34:47 [ayvens.es] INFO: Saving data for 1985959: {'created_time': 1774550087.820322, 'last_price_update_time': 1774550087.820333, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985959') HTTP/1.1" 204 0
2026-03-26 18:34:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d0cc2183-9488-5b4d-a5d5-0495b9f52261 with identifier: 1985963
2026-03-26 18:34:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d0cc2183-9488-5b4d-a5d5-0495b9f52261 with identifier: 1985963
2026-03-26 18:34:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d0cc2183-9488-5b4d-a5d5-0495b9f52261 with identifier: 1985963 to the API
2026-03-26 18:34:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/026/74b8ea58c78445b8ae203cc136a68ff4/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 101,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd0cc2183-9488-5b4d-a5d5-0495b9f52261',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MEGANE',
 'odometer': 138387,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0cc2183-9488-5b4d-a5d5-0495b9f52261/d0cc2183-9488-5b4d-a5d5-0495b9f52261_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 312926,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/026/74b8ea58c78445b8ae203cc136a68ff4/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT MEGANE Business Blue dCi 81 kW (115CV)',
 'transmission': 'manual',
 'trim': 'Business Blue dCi 81 kW (115CV)',
 'vin': None,
 'year': 2020}
2026-03-26 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985963%27 HTTP/1.1" 200 None
2026-03-26 18:34:48 [ayvens.es] INFO: Saving data for 1985963: {'created_time': 1774550088.154705, 'last_price_update_time': 1774550088.154715, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985963') HTTP/1.1" 204 0
2026-03-26 18:34:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c1b950>
2026-03-26 18:34:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4402d649-c304-5c29-810c-b2ffa8f27990/4402d649-c304-5c29-810c-b2ffa8f27990_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F069%252F21a1dc394daa48a9a57c143d4e780dd0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/069/21a1dc394daa48a9a57c143d4e780dd0/images/large/1.jpg saved to cache
2026-03-26 18:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4402d649-c304-5c29-810c-b2ffa8f27990
2026-03-26 18:34:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4402d649-c304-5c29-810c-b2ffa8f27990, skipping ID generation
2026-03-26 18:34:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4402d649-c304-5c29-810c-b2ffa8f27990 with scrape type 1
2026-03-26 18:34:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4402d649-c304-5c29-810c-b2ffa8f27990 sending to next pipeline
2026-03-26 18:34:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4402d649-c304-5c29-810c-b2ffa8f27990, identifier: 1985962
2026-03-26 18:34:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/387/864fd241aa68417caa99914d50dad67a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:48 [ayvens.es] INFO: Found listing with ID: 1985972
2026-03-26 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985972%27 HTTP/1.1" 200 None
2026-03-26 18:34:48 [ayvens.es] INFO: Scrape type for 1985972: 1
2026-03-26 18:34:48 [ayvens.es] INFO: Extracting data for car ID: 1985972
2026-03-26 18:34:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57bb5350-9daf-5c07-8af9-b09b80878c11 with identifier: 1985972
2026-03-26 18:34:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57bb5350-9daf-5c07-8af9-b09b80878c11 with scrape type 1
2026-03-26 18:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 57bb5350-9daf-5c07-8af9-b09b80878c11
2026-03-26 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F129%252F6eb8711e7d2b40e7a94b2a451a648268%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/129/6eb8711e7d2b40e7a94b2a451a648268/images/large/1.jpg not downloaded yet
2026-03-26 18:34:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4402d649-c304-5c29-810c-b2ffa8f27990 with identifier: 1985962
2026-03-26 18:34:48 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:34:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4402d649-c304-5c29-810c-b2ffa8f27990 with identifier: 1985962
2026-03-26 18:34:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 4402d649-c304-5c29-810c-b2ffa8f27990 with identifier: 1985962 to the API
2026-03-26 18:34:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/069/21a1dc394daa48a9a57c143d4e780dd0/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'Azul atl',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '4402d649-c304-5c29-810c-b2ffa8f27990',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TOURAN',
 'odometer': 88577,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4402d649-c304-5c29-810c-b2ffa8f27990/4402d649-c304-5c29-810c-b2ffa8f27990_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 604589,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/069/21a1dc394daa48a9a57c143d4e780dd0/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-06',
 'seats_number': 7,
 'seller_name': None,
 'title': 'VOLKSWAGEN TOURAN Advance 2.0 TDI 90kW (122CV)',
 'transmission': 'manual',
 'trim': 'Advance 2.0 TDI 90kW (122CV)',
 'vin': None,
 'year': 2021}
2026-03-26 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985962%27 HTTP/1.1" 200 None
2026-03-26 18:34:48 [ayvens.es] INFO: Saving data for 1985962: {'created_time': 1774550088.899512, 'last_price_update_time': 1774550088.899522, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985962') HTTP/1.1" 204 0
2026-03-26 18:34:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c1a790>
2026-03-26 18:34:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_090fbaef-f2f4-5f0d-8aae-d39b202730f2/090fbaef-f2f4-5f0d-8aae-d39b202730f2_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F499%252F71c71daed3af49af825aeca63a2f0086%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/499/71c71daed3af49af825aeca63a2f0086/images/large/1.jpg saved to cache
2026-03-26 18:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 090fbaef-f2f4-5f0d-8aae-d39b202730f2
2026-03-26 18:34:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 090fbaef-f2f4-5f0d-8aae-d39b202730f2, skipping ID generation
2026-03-26 18:34:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 090fbaef-f2f4-5f0d-8aae-d39b202730f2 with scrape type 1
2026-03-26 18:34:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 090fbaef-f2f4-5f0d-8aae-d39b202730f2 sending to next pipeline
2026-03-26 18:34:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 090fbaef-f2f4-5f0d-8aae-d39b202730f2, identifier: 1985951
2026-03-26 18:34:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a29057890>
2026-03-26 18:34:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76b4e2c2-71a0-536b-b5e4-df568482dad8/76b4e2c2-71a0-536b-b5e4-df568482dad8_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F808%252F6d6438fd96a04cc58854d52a6a3e15a4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/808/6d6438fd96a04cc58854d52a6a3e15a4/images/large/1.jpg saved to cache
2026-03-26 18:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 76b4e2c2-71a0-536b-b5e4-df568482dad8
2026-03-26 18:34:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 76b4e2c2-71a0-536b-b5e4-df568482dad8, skipping ID generation
2026-03-26 18:34:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76b4e2c2-71a0-536b-b5e4-df568482dad8 with scrape type 1
2026-03-26 18:34:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 76b4e2c2-71a0-536b-b5e4-df568482dad8 sending to next pipeline
2026-03-26 18:34:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 76b4e2c2-71a0-536b-b5e4-df568482dad8, identifier: 1985964
2026-03-26 18:34:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/592/e90c854828ba4ac991c91364aa2a4a83/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:49 [ayvens.es] INFO: Found listing with ID: 1985973
2026-03-26 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985973%27 HTTP/1.1" 200 None
2026-03-26 18:34:49 [ayvens.es] INFO: Scrape type for 1985973: 1
2026-03-26 18:34:49 [ayvens.es] INFO: Extracting data for car ID: 1985973
2026-03-26 18:34:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4aea56c3-bff3-51eb-b2ec-cef629d986d9 with identifier: 1985973
2026-03-26 18:34:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4aea56c3-bff3-51eb-b2ec-cef629d986d9 with scrape type 1
2026-03-26 18:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4aea56c3-bff3-51eb-b2ec-cef629d986d9
2026-03-26 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F170%252F021b113b0cf74c9384ecf06d383a49c2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/170/021b113b0cf74c9384ecf06d383a49c2/images/large/1.jpg not downloaded yet
2026-03-26 18:34:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 090fbaef-f2f4-5f0d-8aae-d39b202730f2 with identifier: 1985951
2026-03-26 18:34:49 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:34:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 090fbaef-f2f4-5f0d-8aae-d39b202730f2 with identifier: 1985951
2026-03-26 18:34:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 090fbaef-f2f4-5f0d-8aae-d39b202730f2 with identifier: 1985951 to the API
2026-03-26 18:34:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/499/71c71daed3af49af825aeca63a2f0086/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Negro profundo',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '090fbaef-f2f4-5f0d-8aae-d39b202730f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN',
 'odometer': 137262,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_090fbaef-f2f4-5f0d-8aae-d39b202730f2/090fbaef-f2f4-5f0d-8aae-d39b202730f2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 652211,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/499/71c71daed3af49af825aeca63a2f0086/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN Life 2.0 TDI 110kW (150CV) DSG',
 'transmission': 'manual',
 'trim': 'Life 2.0 TDI 110kW (150CV) DSG',
 'vin': None,
 'year': 2021}
2026-03-26 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985951%27 HTTP/1.1" 200 None
2026-03-26 18:34:49 [ayvens.es] INFO: Saving data for 1985951: {'created_time': 1774550089.917772, 'last_price_update_time': 1774550089.917781, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985951') HTTP/1.1" 204 0
2026-03-26 18:34:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 76b4e2c2-71a0-536b-b5e4-df568482dad8 with identifier: 1985964
2026-03-26 18:34:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 76b4e2c2-71a0-536b-b5e4-df568482dad8 with identifier: 1985964
2026-03-26 18:34:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 76b4e2c2-71a0-536b-b5e4-df568482dad8 with identifier: 1985964 to the API
2026-03-26 18:34:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/808/6d6438fd96a04cc58854d52a6a3e15a4/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'color': 'Blanco puro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '76b4e2c2-71a0-536b-b5e4-df568482dad8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-ROC',
 'odometer': 67439,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76b4e2c2-71a0-536b-b5e4-df568482dad8/76b4e2c2-71a0-536b-b5e4-df568482dad8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 520639,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/808/6d6438fd96a04cc58854d52a6a3e15a4/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-ROC (O) Advance R-Line 1.0 TSI 81kW (110CV)',
 'transmission': 'manual',
 'trim': '(O) Advance R-Line 1.0 TSI 81kW (110CV)',
 'vin': None,
 'year': 2022}
2026-03-26 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985964%27 HTTP/1.1" 200 None
2026-03-26 18:34:50 [ayvens.es] INFO: Saving data for 1985964: {'created_time': 1774550090.265492, 'last_price_update_time': 1774550090.265502, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985964') HTTP/1.1" 204 0
2026-03-26 18:34:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/809/1e009f4ce9594ed48aa92babfad175e8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c20810>
2026-03-26 18:34:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62c50d59-bba8-5342-885c-037d79db5c39/62c50d59-bba8-5342-885c-037d79db5c39_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F387%252F864fd241aa68417caa99914d50dad67a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/387/864fd241aa68417caa99914d50dad67a/images/large/1.jpg saved to cache
2026-03-26 18:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 62c50d59-bba8-5342-885c-037d79db5c39
2026-03-26 18:34:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 62c50d59-bba8-5342-885c-037d79db5c39, skipping ID generation
2026-03-26 18:34:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62c50d59-bba8-5342-885c-037d79db5c39 with scrape type 1
2026-03-26 18:34:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 62c50d59-bba8-5342-885c-037d79db5c39 sending to next pipeline
2026-03-26 18:34:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 62c50d59-bba8-5342-885c-037d79db5c39, identifier: 1985965
2026-03-26 18:34:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/288/ffc8225fc26e4ee0a740b27b272378ca/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:50 [ayvens.es] INFO: Found listing with ID: 1985974
2026-03-26 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985974%27 HTTP/1.1" 200 None
2026-03-26 18:34:50 [ayvens.es] INFO: Scrape type for 1985974: 1
2026-03-26 18:34:50 [ayvens.es] INFO: Extracting data for car ID: 1985974
2026-03-26 18:34:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00958baa-e58b-5b0e-986b-82613047e519 with identifier: 1985974
2026-03-26 18:34:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00958baa-e58b-5b0e-986b-82613047e519 with scrape type 1
2026-03-26 18:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 00958baa-e58b-5b0e-986b-82613047e519
2026-03-26 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F144%252Ffc07a22afc2e4267bc00bca2cc7f89ea%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/144/fc07a22afc2e4267bc00bca2cc7f89ea/images/large/1.jpg not downloaded yet
2026-03-26 18:34:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 62c50d59-bba8-5342-885c-037d79db5c39 with identifier: 1985965
2026-03-26 18:34:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 62c50d59-bba8-5342-885c-037d79db5c39 with identifier: 1985965
2026-03-26 18:34:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 62c50d59-bba8-5342-885c-037d79db5c39 with identifier: 1985965 to the API
2026-03-26 18:34:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/387/864fd241aa68417caa99914d50dad67a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'Blanco glaciar',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '62c50d59-bba8-5342-885c-037d79db5c39',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 64642,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62c50d59-bba8-5342-885c-037d79db5c39/62c50d59-bba8-5342-885c-037d79db5c39_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328340,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/387/864fd241aa68417caa99914d50dad67a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO (O) Intens Blue dCi 74kW (100CV)',
 'transmission': 'manual',
 'trim': '(O) Intens Blue dCi 74kW (100CV)',
 'vin': None,
 'year': 2022}
2026-03-26 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985965%27 HTTP/1.1" 200 None
2026-03-26 18:34:50 [ayvens.es] INFO: Saving data for 1985965: {'created_time': 1774550090.80052, 'last_price_update_time': 1774550090.80053, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985965') HTTP/1.1" 204 0
2026-03-26 18:34:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28ec2450>
2026-03-26 18:34:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_caa78e8b-36a9-583b-8aec-5b1e61213ee1/caa78e8b-36a9-583b-8aec-5b1e61213ee1_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F592%252Fe90c854828ba4ac991c91364aa2a4a83%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/592/e90c854828ba4ac991c91364aa2a4a83/images/large/1.jpg saved to cache
2026-03-26 18:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item caa78e8b-36a9-583b-8aec-5b1e61213ee1
2026-03-26 18:34:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: caa78e8b-36a9-583b-8aec-5b1e61213ee1, skipping ID generation
2026-03-26 18:34:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item caa78e8b-36a9-583b-8aec-5b1e61213ee1 with scrape type 1
2026-03-26 18:34:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item caa78e8b-36a9-583b-8aec-5b1e61213ee1 sending to next pipeline
2026-03-26 18:34:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: caa78e8b-36a9-583b-8aec-5b1e61213ee1, identifier: 1985967
2026-03-26 18:34:51 [ayvens.es] INFO: Found listing with ID: 1985975
2026-03-26 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985975%27 HTTP/1.1" 200 None
2026-03-26 18:34:51 [ayvens.es] INFO: Scrape type for 1985975: 1
2026-03-26 18:34:51 [ayvens.es] INFO: Extracting data for car ID: 1985975
2026-03-26 18:34:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5636adce-2449-531a-b464-5aded1c14884 with identifier: 1985975
2026-03-26 18:34:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5636adce-2449-531a-b464-5aded1c14884 with scrape type 1
2026-03-26 18:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5636adce-2449-531a-b464-5aded1c14884
2026-03-26 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F560%252Fe7ebe07003c64128a19c6bf58182458a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/560/e7ebe07003c64128a19c6bf58182458a/images/large/1.jpg not downloaded yet
2026-03-26 18:34:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: caa78e8b-36a9-583b-8aec-5b1e61213ee1 with identifier: 1985967
2026-03-26 18:34:51 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:34:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: caa78e8b-36a9-583b-8aec-5b1e61213ee1 with identifier: 1985967
2026-03-26 18:34:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: caa78e8b-36a9-583b-8aec-5b1e61213ee1 with identifier: 1985967 to the API
2026-03-26 18:34:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/592/e90c854828ba4ac991c91364aa2a4a83/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 153,
 'color': 'Blanco nevada',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'caa78e8b-36a9-583b-8aec-5b1e61213ee1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ATECA',
 'odometer': 191818,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_caa78e8b-36a9-583b-8aec-5b1e61213ee1/caa78e8b-36a9-583b-8aec-5b1e61213ee1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329233,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/592/e90c854828ba4ac991c91364aa2a4a83/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ATECA 1.5 TSI 110kW (150CV) DSG S&S FR Go',
 'transmission': 'manual',
 'trim': '1.5 TSI 110kW (150CV) DSG S&S FR Go',
 'vin': None,
 'year': 2022}
2026-03-26 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985967%27 HTTP/1.1" 200 None
2026-03-26 18:34:51 [ayvens.es] INFO: Saving data for 1985967: {'created_time': 1774550091.353408, 'last_price_update_time': 1774550091.353417, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985967') HTTP/1.1" 204 0
2026-03-26 18:34:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28f80c50>
2026-03-26 18:34:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_477f3e37-ff75-5318-abdd-0850833645a9/477f3e37-ff75-5318-abdd-0850833645a9_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F809%252F1e009f4ce9594ed48aa92babfad175e8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/809/1e009f4ce9594ed48aa92babfad175e8/images/large/1.jpg saved to cache
2026-03-26 18:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 477f3e37-ff75-5318-abdd-0850833645a9
2026-03-26 18:34:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 477f3e37-ff75-5318-abdd-0850833645a9, skipping ID generation
2026-03-26 18:34:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 477f3e37-ff75-5318-abdd-0850833645a9 with scrape type 1
2026-03-26 18:34:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 477f3e37-ff75-5318-abdd-0850833645a9 sending to next pipeline
2026-03-26 18:34:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 477f3e37-ff75-5318-abdd-0850833645a9, identifier: 1985966
2026-03-26 18:34:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/177/66a280b21f4142b19edb9c2691a4dcc5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 477f3e37-ff75-5318-abdd-0850833645a9 with identifier: 1985966
2026-03-26 18:34:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 477f3e37-ff75-5318-abdd-0850833645a9 with identifier: 1985966
2026-03-26 18:34:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 477f3e37-ff75-5318-abdd-0850833645a9 with identifier: 1985966 to the API
2026-03-26 18:34:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/809/1e009f4ce9594ed48aa92babfad175e8/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.7L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '477f3e37-ff75-5318-abdd-0850833645a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'TALISMAN',
 'odometer': 199348,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_477f3e37-ff75-5318-abdd-0850833645a9/477f3e37-ff75-5318-abdd-0850833645a9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 578885,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/809/1e009f4ce9594ed48aa92babfad175e8/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT TALISMAN Limited Blue dCi 88 kW (120CV)',
 'transmission': 'manual',
 'trim': 'Limited Blue dCi 88 kW (120CV)',
 'vin': None,
 'year': 2019}
2026-03-26 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985966%27 HTTP/1.1" 200 None
2026-03-26 18:34:51 [ayvens.es] INFO: Saving data for 1985966: {'created_time': 1774550091.787058, 'last_price_update_time': 1774550091.787068, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985966') HTTP/1.1" 204 0
2026-03-26 18:34:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28e54a10>
2026-03-26 18:34:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65aa538b-02c8-5330-aadc-9325e3c45854/65aa538b-02c8-5330-aadc-9325e3c45854_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F288%252Fffc8225fc26e4ee0a740b27b272378ca%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/288/ffc8225fc26e4ee0a740b27b272378ca/images/large/1.jpg saved to cache
2026-03-26 18:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 65aa538b-02c8-5330-aadc-9325e3c45854
2026-03-26 18:34:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 65aa538b-02c8-5330-aadc-9325e3c45854, skipping ID generation
2026-03-26 18:34:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65aa538b-02c8-5330-aadc-9325e3c45854 with scrape type 1
2026-03-26 18:34:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 65aa538b-02c8-5330-aadc-9325e3c45854 sending to next pipeline
2026-03-26 18:34:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 65aa538b-02c8-5330-aadc-9325e3c45854, identifier: 1985968
2026-03-26 18:34:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/505/b69c1b5324f74da59206b394477ba240/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:52 [ayvens.es] INFO: Found listing with ID: 1985976
2026-03-26 18:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985976%27 HTTP/1.1" 200 None
2026-03-26 18:34:52 [ayvens.es] INFO: Scrape type for 1985976: 1
2026-03-26 18:34:52 [ayvens.es] INFO: Extracting data for car ID: 1985976
2026-03-26 18:34:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37d53609-84ea-5b3c-aa21-349fe82e7b79 with identifier: 1985976
2026-03-26 18:34:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37d53609-84ea-5b3c-aa21-349fe82e7b79 with scrape type 1
2026-03-26 18:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 37d53609-84ea-5b3c-aa21-349fe82e7b79
2026-03-26 18:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F793%252F458fe48491454519ae3e3a3192e26b34%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/793/458fe48491454519ae3e3a3192e26b34/images/large/1.jpg not downloaded yet
2026-03-26 18:34:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 65aa538b-02c8-5330-aadc-9325e3c45854 with identifier: 1985968
2026-03-26 18:34:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 65aa538b-02c8-5330-aadc-9325e3c45854 with identifier: 1985968
2026-03-26 18:34:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 65aa538b-02c8-5330-aadc-9325e3c45854 with identifier: 1985968 to the API
2026-03-26 18:34:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/288/ffc8225fc26e4ee0a740b27b272378ca/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 170,
 'color': 'Serie',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '65aa538b-02c8-5330-aadc-9325e3c45854',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TRANSPORTER',
 'odometer': 149116,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65aa538b-02c8-5330-aadc-9325e3c45854/65aa538b-02c8-5330-aadc-9325e3c45854_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270821,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/288/ffc8225fc26e4ee0a740b27b272378ca/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-11',
 'seats_number': 3,
 'seller_name': None,
 'title': 'VOLKSWAGEN TRANSPORTER (E) Furgon Corto TN 2.0 TDI 110kW BMT 4M',
 'transmission': 'manual',
 'trim': '(E) Furgon Corto TN 2.0 TDI 110kW BMT 4M',
 'vin': None,
 'year': 2020}
2026-03-26 18:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985968%27 HTTP/1.1" 200 None
2026-03-26 18:34:52 [ayvens.es] INFO: Saving data for 1985968: {'created_time': 1774550092.319081, 'last_price_update_time': 1774550092.319091, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985968') HTTP/1.1" 204 0
2026-03-26 18:34:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/865/74235631a383444eaefb439f69c9e67c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:52 [ayvens.es] INFO: Found listing with ID: 1985977
2026-03-26 18:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985977%27 HTTP/1.1" 200 None
2026-03-26 18:34:52 [ayvens.es] INFO: Scrape type for 1985977: 1
2026-03-26 18:34:52 [ayvens.es] INFO: Extracting data for car ID: 1985977
2026-03-26 18:34:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84af8fdd-1912-55f7-bbc3-167a4b283a7c with identifier: 1985977
2026-03-26 18:34:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84af8fdd-1912-55f7-bbc3-167a4b283a7c with scrape type 1
2026-03-26 18:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 84af8fdd-1912-55f7-bbc3-167a4b283a7c
2026-03-26 18:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F987%252F37f4abd22fa2454e9e74b344709f06c6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/987/37f4abd22fa2454e9e74b344709f06c6/images/large/1.jpg not downloaded yet
2026-03-26 18:34:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/129/6eb8711e7d2b40e7a94b2a451a648268/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28e57e90>
2026-03-26 18:34:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c427576d-c75e-56d6-a85c-141d89e2ddb1/c427576d-c75e-56d6-a85c-141d89e2ddb1_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F177%252F66a280b21f4142b19edb9c2691a4dcc5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/177/66a280b21f4142b19edb9c2691a4dcc5/images/large/1.jpg saved to cache
2026-03-26 18:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c427576d-c75e-56d6-a85c-141d89e2ddb1
2026-03-26 18:34:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c427576d-c75e-56d6-a85c-141d89e2ddb1, skipping ID generation
2026-03-26 18:34:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c427576d-c75e-56d6-a85c-141d89e2ddb1 with scrape type 1
2026-03-26 18:34:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c427576d-c75e-56d6-a85c-141d89e2ddb1 sending to next pipeline
2026-03-26 18:34:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c427576d-c75e-56d6-a85c-141d89e2ddb1, identifier: 1985970
2026-03-26 18:34:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28d80b10>
2026-03-26 18:34:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee6b271d-fc2d-5ee1-8855-f910dee21907/ee6b271d-fc2d-5ee1-8855-f910dee21907_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F505%252Fb69c1b5324f74da59206b394477ba240%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/505/b69c1b5324f74da59206b394477ba240/images/large/1.jpg saved to cache
2026-03-26 18:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ee6b271d-fc2d-5ee1-8855-f910dee21907
2026-03-26 18:34:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ee6b271d-fc2d-5ee1-8855-f910dee21907, skipping ID generation
2026-03-26 18:34:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee6b271d-fc2d-5ee1-8855-f910dee21907 with scrape type 1
2026-03-26 18:34:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ee6b271d-fc2d-5ee1-8855-f910dee21907 sending to next pipeline
2026-03-26 18:34:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ee6b271d-fc2d-5ee1-8855-f910dee21907, identifier: 1985969
2026-03-26 18:34:52 [ayvens.es] INFO: Found listing with ID: 1985978
2026-03-26 18:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985978%27 HTTP/1.1" 200 None
2026-03-26 18:34:52 [ayvens.es] INFO: Scrape type for 1985978: 1
2026-03-26 18:34:52 [ayvens.es] INFO: Extracting data for car ID: 1985978
2026-03-26 18:34:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2be1eb77-4400-585c-9476-b7fab0969c45 with identifier: 1985978
2026-03-26 18:34:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2be1eb77-4400-585c-9476-b7fab0969c45 with scrape type 1
2026-03-26 18:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2be1eb77-4400-585c-9476-b7fab0969c45
2026-03-26 18:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F522%252F513f61a0c38d48009c760e145704a50f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/522/513f61a0c38d48009c760e145704a50f/images/large/1.jpg not downloaded yet
2026-03-26 18:34:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c427576d-c75e-56d6-a85c-141d89e2ddb1 with identifier: 1985970
2026-03-26 18:34:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c427576d-c75e-56d6-a85c-141d89e2ddb1 with identifier: 1985970
2026-03-26 18:34:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c427576d-c75e-56d6-a85c-141d89e2ddb1 with identifier: 1985970 to the API
2026-03-26 18:34:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/177/66a280b21f4142b19edb9c2691a4dcc5/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 184,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c427576d-c75e-56d6-a85c-141d89e2ddb1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CRAFTER',
 'odometer': 185357,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c427576d-c75e-56d6-a85c-141d89e2ddb1/c427576d-c75e-56d6-a85c-141d89e2ddb1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 358507,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/177/66a280b21f4142b19edb9c2691a4dcc5/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-08',
 'seats_number': 3,
 'seller_name': None,
 'title': 'VOLKSWAGEN CRAFTER 35 Chasis CS BL 2.0 TDI 103kW (140CV)',
 'transmission': 'manual',
 'trim': '35 Chasis CS BL 2.0 TDI 103kW (140CV)',
 'vin': None,
 'year': 2018}
2026-03-26 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985970%27 HTTP/1.1" 200 None
2026-03-26 18:34:53 [ayvens.es] INFO: Saving data for 1985970: {'created_time': 1774550093.115398, 'last_price_update_time': 1774550093.115407, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985970') HTTP/1.1" 204 0
2026-03-26 18:34:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ee6b271d-fc2d-5ee1-8855-f910dee21907 with identifier: 1985969
2026-03-26 18:34:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ee6b271d-fc2d-5ee1-8855-f910dee21907 with identifier: 1985969
2026-03-26 18:34:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ee6b271d-fc2d-5ee1-8855-f910dee21907 with identifier: 1985969 to the API
2026-03-26 18:34:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/505/b69c1b5324f74da59206b394477ba240/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 101,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ee6b271d-fc2d-5ee1-8855-f910dee21907',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MEGANE',
 'odometer': 182742,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee6b271d-fc2d-5ee1-8855-f910dee21907/ee6b271d-fc2d-5ee1-8855-f910dee21907_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 529336,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/505/b69c1b5324f74da59206b394477ba240/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT MEGANE Business Blue dCi 81 kW (115CV)',
 'transmission': 'manual',
 'trim': 'Business Blue dCi 81 kW (115CV)',
 'vin': None,
 'year': 2019}
2026-03-26 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985969%27 HTTP/1.1" 200 None
2026-03-26 18:34:53 [ayvens.es] INFO: Saving data for 1985969: {'created_time': 1774550093.412556, 'last_price_update_time': 1774550093.412566, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985969') HTTP/1.1" 204 0
2026-03-26 18:34:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/170/021b113b0cf74c9384ecf06d383a49c2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/144/fc07a22afc2e4267bc00bca2cc7f89ea/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:53 [ayvens.es] INFO: Found listing with ID: 1985979
2026-03-26 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985979%27 HTTP/1.1" 200 None
2026-03-26 18:34:53 [ayvens.es] INFO: Scrape type for 1985979: 1
2026-03-26 18:34:53 [ayvens.es] INFO: Extracting data for car ID: 1985979
2026-03-26 18:34:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 923fdc6d-374a-5c58-9d6a-0ea1fa0e9fa6 with identifier: 1985979
2026-03-26 18:34:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 923fdc6d-374a-5c58-9d6a-0ea1fa0e9fa6 with scrape type 1
2026-03-26 18:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 923fdc6d-374a-5c58-9d6a-0ea1fa0e9fa6
2026-03-26 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F172%252F3ad6e10afed54ce0ad9a76884f03cbe9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/172/3ad6e10afed54ce0ad9a76884f03cbe9/images/large/1.jpg not downloaded yet
2026-03-26 18:34:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c2e910>
2026-03-26 18:34:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7218d759-2242-5ace-81ba-07ca69ea8bc7/7218d759-2242-5ace-81ba-07ca69ea8bc7_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F865%252F74235631a383444eaefb439f69c9e67c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/865/74235631a383444eaefb439f69c9e67c/images/large/1.jpg saved to cache
2026-03-26 18:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7218d759-2242-5ace-81ba-07ca69ea8bc7
2026-03-26 18:34:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7218d759-2242-5ace-81ba-07ca69ea8bc7, skipping ID generation
2026-03-26 18:34:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7218d759-2242-5ace-81ba-07ca69ea8bc7 with scrape type 1
2026-03-26 18:34:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7218d759-2242-5ace-81ba-07ca69ea8bc7 sending to next pipeline
2026-03-26 18:34:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7218d759-2242-5ace-81ba-07ca69ea8bc7, identifier: 1985971
2026-03-26 18:34:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28d83790>
2026-03-26 18:34:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57bb5350-9daf-5c07-8af9-b09b80878c11/57bb5350-9daf-5c07-8af9-b09b80878c11_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F129%252F6eb8711e7d2b40e7a94b2a451a648268%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/129/6eb8711e7d2b40e7a94b2a451a648268/images/large/1.jpg saved to cache
2026-03-26 18:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 57bb5350-9daf-5c07-8af9-b09b80878c11
2026-03-26 18:34:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 57bb5350-9daf-5c07-8af9-b09b80878c11, skipping ID generation
2026-03-26 18:34:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57bb5350-9daf-5c07-8af9-b09b80878c11 with scrape type 1
2026-03-26 18:34:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 57bb5350-9daf-5c07-8af9-b09b80878c11 sending to next pipeline
2026-03-26 18:34:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 57bb5350-9daf-5c07-8af9-b09b80878c11, identifier: 1985972
2026-03-26 18:34:53 [ayvens.es] INFO: Found listing with ID: 1985980
2026-03-26 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985980%27 HTTP/1.1" 200 None
2026-03-26 18:34:53 [ayvens.es] INFO: Scrape type for 1985980: 1
2026-03-26 18:34:53 [ayvens.es] INFO: Extracting data for car ID: 1985980
2026-03-26 18:34:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77c56427-74e0-594a-94cf-9905e7323d28 with identifier: 1985980
2026-03-26 18:34:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77c56427-74e0-594a-94cf-9905e7323d28 with scrape type 1
2026-03-26 18:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 77c56427-74e0-594a-94cf-9905e7323d28
2026-03-26 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F911%252Fc2d7491bffea4ec98cc1c3c29ce5f095%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/911/c2d7491bffea4ec98cc1c3c29ce5f095/images/large/1.jpg not downloaded yet
2026-03-26 18:34:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7218d759-2242-5ace-81ba-07ca69ea8bc7 with identifier: 1985971
2026-03-26 18:34:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7218d759-2242-5ace-81ba-07ca69ea8bc7 with identifier: 1985971
2026-03-26 18:34:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7218d759-2242-5ace-81ba-07ca69ea8bc7 with identifier: 1985971 to the API
2026-03-26 18:34:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/865/74235631a383444eaefb439f69c9e67c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '7218d759-2242-5ace-81ba-07ca69ea8bc7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ARONA',
 'odometer': 44445,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7218d759-2242-5ace-81ba-07ca69ea8bc7/7218d759-2242-5ace-81ba-07ca69ea8bc7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 345367,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/865/74235631a383444eaefb439f69c9e67c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ARONA 1.0 TSI 81kW (110CV) Style Go2',
 'transmission': 'manual',
 'trim': '1.0 TSI 81kW (110CV) Style Go2',
 'vin': None,
 'year': 2021}
2026-03-26 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985971%27 HTTP/1.1" 200 None
2026-03-26 18:34:54 [ayvens.es] INFO: Saving data for 1985971: {'created_time': 1774550094.076973, 'last_price_update_time': 1774550094.076985, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985971') HTTP/1.1" 204 0
2026-03-26 18:34:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 57bb5350-9daf-5c07-8af9-b09b80878c11 with identifier: 1985972
2026-03-26 18:34:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 57bb5350-9daf-5c07-8af9-b09b80878c11 with identifier: 1985972
2026-03-26 18:34:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 57bb5350-9daf-5c07-8af9-b09b80878c11 with identifier: 1985972 to the API
2026-03-26 18:34:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/129/6eb8711e7d2b40e7a94b2a451a648268/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.6L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '57bb5350-9daf-5c07-8af9-b09b80878c11',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'PARTNER',
 'odometer': 175233,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57bb5350-9daf-5c07-8af9-b09b80878c11/57bb5350-9daf-5c07-8af9-b09b80878c11_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324869,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/129/6eb8711e7d2b40e7a94b2a451a648268/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-30',
 'seats_number': 2,
 'seller_name': None,
 'title': 'PEUGEOT PARTNER Pro Standard 600kg BlueHDi 73kW',
 'transmission': 'manual',
 'trim': 'Pro Standard 600kg BlueHDi 73kW',
 'vin': None,
 'year': 2019}
2026-03-26 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985972%27 HTTP/1.1" 200 None
2026-03-26 18:34:54 [ayvens.es] INFO: Saving data for 1985972: {'created_time': 1774550094.355029, 'last_price_update_time': 1774550094.355043, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985972') HTTP/1.1" 204 0
2026-03-26 18:34:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/560/e7ebe07003c64128a19c6bf58182458a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:54 [ayvens.es] INFO: Found listing with ID: 1985981
2026-03-26 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985981%27 HTTP/1.1" 200 None
2026-03-26 18:34:54 [ayvens.es] INFO: Scrape type for 1985981: 1
2026-03-26 18:34:54 [ayvens.es] INFO: Extracting data for car ID: 1985981
2026-03-26 18:34:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9a79e8c-942e-5c44-8889-fa1db6fd3d9f with identifier: 1985981
2026-03-26 18:34:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9a79e8c-942e-5c44-8889-fa1db6fd3d9f with scrape type 1
2026-03-26 18:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b9a79e8c-942e-5c44-8889-fa1db6fd3d9f
2026-03-26 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F638%252F159d76ba064d4a5fa442518d46fd447f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/638/159d76ba064d4a5fa442518d46fd447f/images/large/1.jpg not downloaded yet
2026-03-26 18:34:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c76cd0>
2026-03-26 18:34:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4aea56c3-bff3-51eb-b2ec-cef629d986d9/4aea56c3-bff3-51eb-b2ec-cef629d986d9_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F170%252F021b113b0cf74c9384ecf06d383a49c2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/170/021b113b0cf74c9384ecf06d383a49c2/images/large/1.jpg saved to cache
2026-03-26 18:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4aea56c3-bff3-51eb-b2ec-cef629d986d9
2026-03-26 18:34:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4aea56c3-bff3-51eb-b2ec-cef629d986d9, skipping ID generation
2026-03-26 18:34:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4aea56c3-bff3-51eb-b2ec-cef629d986d9 with scrape type 1
2026-03-26 18:34:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4aea56c3-bff3-51eb-b2ec-cef629d986d9 sending to next pipeline
2026-03-26 18:34:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4aea56c3-bff3-51eb-b2ec-cef629d986d9, identifier: 1985973
2026-03-26 18:34:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c223d0>
2026-03-26 18:34:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00958baa-e58b-5b0e-986b-82613047e519/00958baa-e58b-5b0e-986b-82613047e519_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F144%252Ffc07a22afc2e4267bc00bca2cc7f89ea%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/144/fc07a22afc2e4267bc00bca2cc7f89ea/images/large/1.jpg saved to cache
2026-03-26 18:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 00958baa-e58b-5b0e-986b-82613047e519
2026-03-26 18:34:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 00958baa-e58b-5b0e-986b-82613047e519, skipping ID generation
2026-03-26 18:34:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00958baa-e58b-5b0e-986b-82613047e519 with scrape type 1
2026-03-26 18:34:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 00958baa-e58b-5b0e-986b-82613047e519 sending to next pipeline
2026-03-26 18:34:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 00958baa-e58b-5b0e-986b-82613047e519, identifier: 1985974
2026-03-26 18:34:54 [ayvens.es] INFO: Found listing with ID: 1985982
2026-03-26 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985982%27 HTTP/1.1" 200 None
2026-03-26 18:34:54 [ayvens.es] INFO: Scrape type for 1985982: 1
2026-03-26 18:34:54 [ayvens.es] INFO: Extracting data for car ID: 1985982
2026-03-26 18:34:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee40a6ab-a360-5784-b8ba-edd0917391a0 with identifier: 1985982
2026-03-26 18:34:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee40a6ab-a360-5784-b8ba-edd0917391a0 with scrape type 1
2026-03-26 18:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ee40a6ab-a360-5784-b8ba-edd0917391a0
2026-03-26 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F975%252Febdca7e508af4141b8b08f0c0b9446ef%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/975/ebdca7e508af4141b8b08f0c0b9446ef/images/large/1.jpg not downloaded yet
2026-03-26 18:34:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4aea56c3-bff3-51eb-b2ec-cef629d986d9 with identifier: 1985973
2026-03-26 18:34:54 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:34:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4aea56c3-bff3-51eb-b2ec-cef629d986d9 with identifier: 1985973
2026-03-26 18:34:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 4aea56c3-bff3-51eb-b2ec-cef629d986d9 with identifier: 1985973 to the API
2026-03-26 18:34:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/170/021b113b0cf74c9384ecf06d383a49c2/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'Gris indy',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '4aea56c3-bff3-51eb-b2ec-cef629d986d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-ROC',
 'odometer': 176021,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4aea56c3-bff3-51eb-b2ec-cef629d986d9/4aea56c3-bff3-51eb-b2ec-cef629d986d9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 366706,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/170/021b113b0cf74c9384ecf06d383a49c2/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-ROC Life 2.0 TDI 85kW (115CV)',
 'transmission': 'manual',
 'trim': 'Life 2.0 TDI 85kW (115CV)',
 'vin': None,
 'year': 2022}
2026-03-26 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985973%27 HTTP/1.1" 200 None
2026-03-26 18:34:55 [ayvens.es] INFO: Saving data for 1985973: {'created_time': 1774550095.061398, 'last_price_update_time': 1774550095.061408, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985973') HTTP/1.1" 204 0
2026-03-26 18:34:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 00958baa-e58b-5b0e-986b-82613047e519 with identifier: 1985974
2026-03-26 18:34:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 00958baa-e58b-5b0e-986b-82613047e519 with identifier: 1985974
2026-03-26 18:34:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 00958baa-e58b-5b0e-986b-82613047e519 with identifier: 1985974 to the API
2026-03-26 18:34:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/144/fc07a22afc2e4267bc00bca2cc7f89ea/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '00958baa-e58b-5b0e-986b-82613047e519',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ARONA',
 'odometer': 130076,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00958baa-e58b-5b0e-986b-82613047e519/00958baa-e58b-5b0e-986b-82613047e519_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325253,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/144/fc07a22afc2e4267bc00bca2cc7f89ea/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ARONA 1.6 TDI 70kW (95CV) Style Edition Eco',
 'transmission': 'manual',
 'trim': '1.6 TDI 70kW (95CV) Style Edition Eco',
 'vin': None,
 'year': 2020}
2026-03-26 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985974%27 HTTP/1.1" 200 None
2026-03-26 18:34:55 [ayvens.es] INFO: Saving data for 1985974: {'created_time': 1774550095.448437, 'last_price_update_time': 1774550095.44845, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985974') HTTP/1.1" 204 0
2026-03-26 18:34:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/793/458fe48491454519ae3e3a3192e26b34/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/987/37f4abd22fa2454e9e74b344709f06c6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:55 [ayvens.es] INFO: Found listing with ID: 1985983
2026-03-26 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985983%27 HTTP/1.1" 200 None
2026-03-26 18:34:55 [ayvens.es] INFO: Scrape type for 1985983: 1
2026-03-26 18:34:55 [ayvens.es] INFO: Extracting data for car ID: 1985983
2026-03-26 18:34:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6335a1a4-7875-57ab-b397-e49667252e57 with identifier: 1985983
2026-03-26 18:34:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6335a1a4-7875-57ab-b397-e49667252e57 with scrape type 1
2026-03-26 18:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6335a1a4-7875-57ab-b397-e49667252e57
2026-03-26 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F998%252F2e041b2419e142d68f92106066f5f022%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/998/2e041b2419e142d68f92106066f5f022/images/large/1.jpg not downloaded yet
2026-03-26 18:34:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a2ab037d0>
2026-03-26 18:34:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5636adce-2449-531a-b464-5aded1c14884/5636adce-2449-531a-b464-5aded1c14884_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F560%252Fe7ebe07003c64128a19c6bf58182458a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/560/e7ebe07003c64128a19c6bf58182458a/images/large/1.jpg saved to cache
2026-03-26 18:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5636adce-2449-531a-b464-5aded1c14884
2026-03-26 18:34:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5636adce-2449-531a-b464-5aded1c14884, skipping ID generation
2026-03-26 18:34:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5636adce-2449-531a-b464-5aded1c14884 with scrape type 1
2026-03-26 18:34:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5636adce-2449-531a-b464-5aded1c14884 sending to next pipeline
2026-03-26 18:34:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5636adce-2449-531a-b464-5aded1c14884, identifier: 1985975
2026-03-26 18:34:55 [ayvens.es] INFO: Found listing with ID: 1985984
2026-03-26 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985984%27 HTTP/1.1" 200 None
2026-03-26 18:34:55 [ayvens.es] INFO: Scrape type for 1985984: 1
2026-03-26 18:34:55 [ayvens.es] INFO: Extracting data for car ID: 1985984
2026-03-26 18:34:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3578e2cf-047b-5be8-8093-6c35b21882dc with identifier: 1985984
2026-03-26 18:34:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3578e2cf-047b-5be8-8093-6c35b21882dc with scrape type 1
2026-03-26 18:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3578e2cf-047b-5be8-8093-6c35b21882dc
2026-03-26 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F489%252Ff151b2cb09764a28a53e8d36b4450583%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/489/f151b2cb09764a28a53e8d36b4450583/images/large/1.jpg not downloaded yet
2026-03-26 18:34:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5636adce-2449-531a-b464-5aded1c14884 with identifier: 1985975
2026-03-26 18:34:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5636adce-2449-531a-b464-5aded1c14884 with identifier: 1985975
2026-03-26 18:34:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5636adce-2449-531a-b464-5aded1c14884 with identifier: 1985975 to the API
2026-03-26 18:34:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/560/e7ebe07003c64128a19c6bf58182458a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 153,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '5636adce-2449-531a-b464-5aded1c14884',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KODIAQ',
 'odometer': 118468,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5636adce-2449-531a-b464-5aded1c14884/5636adce-2449-531a-b464-5aded1c14884_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 363509,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/560/e7ebe07003c64128a19c6bf58182458a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA KODIAQ 2.0 TDI 110KW (150cv) DSG 4x4 Ambition',
 'transmission': 'manual',
 'trim': '2.0 TDI 110KW (150cv) DSG 4x4 Ambition',
 'vin': None,
 'year': 2022}
2026-03-26 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985975%27 HTTP/1.1" 200 None
2026-03-26 18:34:55 [ayvens.es] INFO: Saving data for 1985975: {'created_time': 1774550095.94411, 'last_price_update_time': 1774550095.944122, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985975') HTTP/1.1" 204 0
2026-03-26 18:34:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/172/3ad6e10afed54ce0ad9a76884f03cbe9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/522/513f61a0c38d48009c760e145704a50f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:55 [ayvens.es] INFO: Found listing with ID: 1985985
2026-03-26 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985985%27 HTTP/1.1" 200 None
2026-03-26 18:34:55 [ayvens.es] INFO: Scrape type for 1985985: 1
2026-03-26 18:34:55 [ayvens.es] INFO: Extracting data for car ID: 1985985
2026-03-26 18:34:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89d37f89-9a1b-566f-842e-e976c8cb9f3b with identifier: 1985985
2026-03-26 18:34:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89d37f89-9a1b-566f-842e-e976c8cb9f3b with scrape type 1
2026-03-26 18:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 89d37f89-9a1b-566f-842e-e976c8cb9f3b
2026-03-26 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F896%252F581291471a8a480d997e0c2035d8f5b0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/896/581291471a8a480d997e0c2035d8f5b0/images/large/1.jpg not downloaded yet
2026-03-26 18:34:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c2a210>
2026-03-26 18:34:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37d53609-84ea-5b3c-aa21-349fe82e7b79/37d53609-84ea-5b3c-aa21-349fe82e7b79_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F793%252F458fe48491454519ae3e3a3192e26b34%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/793/458fe48491454519ae3e3a3192e26b34/images/large/1.jpg saved to cache
2026-03-26 18:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 37d53609-84ea-5b3c-aa21-349fe82e7b79
2026-03-26 18:34:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 37d53609-84ea-5b3c-aa21-349fe82e7b79, skipping ID generation
2026-03-26 18:34:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37d53609-84ea-5b3c-aa21-349fe82e7b79 with scrape type 1
2026-03-26 18:34:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 37d53609-84ea-5b3c-aa21-349fe82e7b79 sending to next pipeline
2026-03-26 18:34:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 37d53609-84ea-5b3c-aa21-349fe82e7b79, identifier: 1985976
2026-03-26 18:34:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28adaa90>
2026-03-26 18:34:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84af8fdd-1912-55f7-bbc3-167a4b283a7c/84af8fdd-1912-55f7-bbc3-167a4b283a7c_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F987%252F37f4abd22fa2454e9e74b344709f06c6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/987/37f4abd22fa2454e9e74b344709f06c6/images/large/1.jpg saved to cache
2026-03-26 18:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 84af8fdd-1912-55f7-bbc3-167a4b283a7c
2026-03-26 18:34:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 84af8fdd-1912-55f7-bbc3-167a4b283a7c, skipping ID generation
2026-03-26 18:34:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84af8fdd-1912-55f7-bbc3-167a4b283a7c with scrape type 1
2026-03-26 18:34:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 84af8fdd-1912-55f7-bbc3-167a4b283a7c sending to next pipeline
2026-03-26 18:34:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 84af8fdd-1912-55f7-bbc3-167a4b283a7c, identifier: 1985977
2026-03-26 18:34:56 [ayvens.es] INFO: Found listing with ID: 1985986
2026-03-26 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985986%27 HTTP/1.1" 200 None
2026-03-26 18:34:56 [ayvens.es] INFO: Scrape type for 1985986: 1
2026-03-26 18:34:56 [ayvens.es] INFO: Extracting data for car ID: 1985986
2026-03-26 18:34:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 781d62a4-fa86-5976-9904-6844fa85b89b with identifier: 1985986
2026-03-26 18:34:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 781d62a4-fa86-5976-9904-6844fa85b89b with scrape type 1
2026-03-26 18:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 781d62a4-fa86-5976-9904-6844fa85b89b
2026-03-26 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F034%252F8814a7f7d9f9451ba10ee2ee98bd1398%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/034/8814a7f7d9f9451ba10ee2ee98bd1398/images/large/1.jpg not downloaded yet
2026-03-26 18:34:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 37d53609-84ea-5b3c-aa21-349fe82e7b79 with identifier: 1985976
2026-03-26 18:34:56 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:34:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 37d53609-84ea-5b3c-aa21-349fe82e7b79 with identifier: 1985976
2026-03-26 18:34:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 37d53609-84ea-5b3c-aa21-349fe82e7b79 with identifier: 1985976 to the API
2026-03-26 18:34:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/793/458fe48491454519ae3e3a3192e26b34/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Pintura suave s',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '37d53609-84ea-5b3c-aa21-349fe82e7b79',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ATECA',
 'odometer': 145381,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37d53609-84ea-5b3c-aa21-349fe82e7b79/37d53609-84ea-5b3c-aa21-349fe82e7b79_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 542622,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/793/458fe48491454519ae3e3a3192e26b34/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ATECA 2.0 TDI 110kW (150CV) DSG S&S Style Go',
 'transmission': 'manual',
 'trim': '2.0 TDI 110kW (150CV) DSG S&S Style Go',
 'vin': None,
 'year': 2022}
2026-03-26 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985976%27 HTTP/1.1" 200 None
2026-03-26 18:34:56 [ayvens.es] INFO: Saving data for 1985976: {'created_time': 1774550096.669916, 'last_price_update_time': 1774550096.669926, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985976') HTTP/1.1" 204 0
2026-03-26 18:34:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 84af8fdd-1912-55f7-bbc3-167a4b283a7c with identifier: 1985977
2026-03-26 18:34:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 84af8fdd-1912-55f7-bbc3-167a4b283a7c with identifier: 1985977
2026-03-26 18:34:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 84af8fdd-1912-55f7-bbc3-167a4b283a7c with identifier: 1985977 to the API
2026-03-26 18:34:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/987/37f4abd22fa2454e9e74b344709f06c6/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '84af8fdd-1912-55f7-bbc3-167a4b283a7c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ATECA',
 'odometer': 134123,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84af8fdd-1912-55f7-bbc3-167a4b283a7c/84af8fdd-1912-55f7-bbc3-167a4b283a7c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 368304,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/987/37f4abd22fa2454e9e74b344709f06c6/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ATECA 1.5 TSI 110kW DSG S&S Style Edition Nav',
 'transmission': 'manual',
 'trim': '1.5 TSI 110kW DSG S&S Style Edition Nav',
 'vin': None,
 'year': 2019}
2026-03-26 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985977%27 HTTP/1.1" 200 None
2026-03-26 18:34:56 [ayvens.es] INFO: Saving data for 1985977: {'created_time': 1774550096.946769, 'last_price_update_time': 1774550096.946779, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985977') HTTP/1.1" 204 0
2026-03-26 18:34:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/638/159d76ba064d4a5fa442518d46fd447f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:56 [ayvens.es] INFO: Found listing with ID: 1985987
2026-03-26 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985987%27 HTTP/1.1" 200 None
2026-03-26 18:34:56 [ayvens.es] INFO: Scrape type for 1985987: 1
2026-03-26 18:34:56 [ayvens.es] INFO: Extracting data for car ID: 1985987
2026-03-26 18:34:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26521e49-3281-53d1-a231-14766905c5f1 with identifier: 1985987
2026-03-26 18:34:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26521e49-3281-53d1-a231-14766905c5f1 with scrape type 1
2026-03-26 18:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 26521e49-3281-53d1-a231-14766905c5f1
2026-03-26 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F707%252Feb8a1167e174416f83fc5bfecdf07e99%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/707/eb8a1167e174416f83fc5bfecdf07e99/images/large/1.jpg not downloaded yet
2026-03-26 18:34:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a2a818590>
2026-03-26 18:34:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_923fdc6d-374a-5c58-9d6a-0ea1fa0e9fa6/923fdc6d-374a-5c58-9d6a-0ea1fa0e9fa6_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F172%252F3ad6e10afed54ce0ad9a76884f03cbe9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/172/3ad6e10afed54ce0ad9a76884f03cbe9/images/large/1.jpg saved to cache
2026-03-26 18:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 923fdc6d-374a-5c58-9d6a-0ea1fa0e9fa6
2026-03-26 18:34:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 923fdc6d-374a-5c58-9d6a-0ea1fa0e9fa6, skipping ID generation
2026-03-26 18:34:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 923fdc6d-374a-5c58-9d6a-0ea1fa0e9fa6 with scrape type 1
2026-03-26 18:34:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 923fdc6d-374a-5c58-9d6a-0ea1fa0e9fa6 sending to next pipeline
2026-03-26 18:34:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 923fdc6d-374a-5c58-9d6a-0ea1fa0e9fa6, identifier: 1985979
2026-03-26 18:34:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28d44510>
2026-03-26 18:34:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2be1eb77-4400-585c-9476-b7fab0969c45/2be1eb77-4400-585c-9476-b7fab0969c45_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F522%252F513f61a0c38d48009c760e145704a50f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/522/513f61a0c38d48009c760e145704a50f/images/large/1.jpg saved to cache
2026-03-26 18:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2be1eb77-4400-585c-9476-b7fab0969c45
2026-03-26 18:34:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2be1eb77-4400-585c-9476-b7fab0969c45, skipping ID generation
2026-03-26 18:34:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2be1eb77-4400-585c-9476-b7fab0969c45 with scrape type 1
2026-03-26 18:34:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2be1eb77-4400-585c-9476-b7fab0969c45 sending to next pipeline
2026-03-26 18:34:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2be1eb77-4400-585c-9476-b7fab0969c45, identifier: 1985978
2026-03-26 18:34:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/911/c2d7491bffea4ec98cc1c3c29ce5f095/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:57 [ayvens.es] INFO: Found listing with ID: 1985988
2026-03-26 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985988%27 HTTP/1.1" 200 None
2026-03-26 18:34:57 [ayvens.es] INFO: Scrape type for 1985988: 1
2026-03-26 18:34:57 [ayvens.es] INFO: Extracting data for car ID: 1985988
2026-03-26 18:34:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e21a458-03ff-50ca-8724-7967b98d1798 with identifier: 1985988
2026-03-26 18:34:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e21a458-03ff-50ca-8724-7967b98d1798 with scrape type 1
2026-03-26 18:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4e21a458-03ff-50ca-8724-7967b98d1798
2026-03-26 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F398%252Fcbdbd43a3efc4a1993916f7a24fe599b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/398/cbdbd43a3efc4a1993916f7a24fe599b/images/large/1.jpg not downloaded yet
2026-03-26 18:34:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 923fdc6d-374a-5c58-9d6a-0ea1fa0e9fa6 with identifier: 1985979
2026-03-26 18:34:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 923fdc6d-374a-5c58-9d6a-0ea1fa0e9fa6 with identifier: 1985979
2026-03-26 18:34:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 923fdc6d-374a-5c58-9d6a-0ea1fa0e9fa6 with identifier: 1985979 to the API
2026-03-26 18:34:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/172/3ad6e10afed54ce0ad9a76884f03cbe9/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 184,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '923fdc6d-374a-5c58-9d6a-0ea1fa0e9fa6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CRAFTER',
 'odometer': 160530,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_923fdc6d-374a-5c58-9d6a-0ea1fa0e9fa6/923fdc6d-374a-5c58-9d6a-0ea1fa0e9fa6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325795,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/172/3ad6e10afed54ce0ad9a76884f03cbe9/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-08',
 'seats_number': 3,
 'seller_name': None,
 'title': 'VOLKSWAGEN CRAFTER 35 Chasis CS BL 2.0 TDI 103kW (140CV)',
 'transmission': 'manual',
 'trim': '35 Chasis CS BL 2.0 TDI 103kW (140CV)',
 'vin': None,
 'year': 2018}
2026-03-26 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985979%27 HTTP/1.1" 200 None
2026-03-26 18:34:57 [ayvens.es] INFO: Saving data for 1985979: {'created_time': 1774550097.643331, 'last_price_update_time': 1774550097.643341, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985979') HTTP/1.1" 204 0
2026-03-26 18:34:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2be1eb77-4400-585c-9476-b7fab0969c45 with identifier: 1985978
2026-03-26 18:34:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2be1eb77-4400-585c-9476-b7fab0969c45 with identifier: 1985978
2026-03-26 18:34:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 2be1eb77-4400-585c-9476-b7fab0969c45 with identifier: 1985978 to the API
2026-03-26 18:34:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/522/513f61a0c38d48009c760e145704a50f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '2be1eb77-4400-585c-9476-b7fab0969c45',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'OCTAVIA',
 'odometer': 134004,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2be1eb77-4400-585c-9476-b7fab0969c45/2be1eb77-4400-585c-9476-b7fab0969c45_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342674,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/522/513f61a0c38d48009c760e145704a50f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA OCTAVIA 2.0 TDI 85kW (115 CV) Manual Ambition',
 'transmission': 'manual',
 'trim': '2.0 TDI 85kW (115 CV) Manual Ambition',
 'vin': None,
 'year': 2022}
2026-03-26 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985978%27 HTTP/1.1" 200 None
2026-03-26 18:34:57 [ayvens.es] INFO: Saving data for 1985978: {'created_time': 1774550097.956475, 'last_price_update_time': 1774550097.956485, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985978') HTTP/1.1" 204 0
2026-03-26 18:34:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/998/2e041b2419e142d68f92106066f5f022/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/975/ebdca7e508af4141b8b08f0c0b9446ef/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:57 [ayvens.es] INFO: Found listing with ID: 1985989
2026-03-26 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985989%27 HTTP/1.1" 200 None
2026-03-26 18:34:58 [ayvens.es] INFO: Scrape type for 1985989: 1
2026-03-26 18:34:58 [ayvens.es] INFO: Extracting data for car ID: 1985989
2026-03-26 18:34:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f3bc382-e9b0-5c66-9c8a-39c44573ff0e with identifier: 1985989
2026-03-26 18:34:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f3bc382-e9b0-5c66-9c8a-39c44573ff0e with scrape type 1
2026-03-26 18:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3f3bc382-e9b0-5c66-9c8a-39c44573ff0e
2026-03-26 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F802%252F33c456815fdb45f4a60c668280470b06%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/802/33c456815fdb45f4a60c668280470b06/images/large/1.jpg not downloaded yet
2026-03-26 18:34:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a290b4410>
2026-03-26 18:34:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9a79e8c-942e-5c44-8889-fa1db6fd3d9f/b9a79e8c-942e-5c44-8889-fa1db6fd3d9f_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F638%252F159d76ba064d4a5fa442518d46fd447f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/638/159d76ba064d4a5fa442518d46fd447f/images/large/1.jpg saved to cache
2026-03-26 18:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b9a79e8c-942e-5c44-8889-fa1db6fd3d9f
2026-03-26 18:34:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b9a79e8c-942e-5c44-8889-fa1db6fd3d9f, skipping ID generation
2026-03-26 18:34:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9a79e8c-942e-5c44-8889-fa1db6fd3d9f with scrape type 1
2026-03-26 18:34:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b9a79e8c-942e-5c44-8889-fa1db6fd3d9f sending to next pipeline
2026-03-26 18:34:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b9a79e8c-942e-5c44-8889-fa1db6fd3d9f, identifier: 1985981
2026-03-26 18:34:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a283dee10>
2026-03-26 18:34:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77c56427-74e0-594a-94cf-9905e7323d28/77c56427-74e0-594a-94cf-9905e7323d28_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F911%252Fc2d7491bffea4ec98cc1c3c29ce5f095%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/911/c2d7491bffea4ec98cc1c3c29ce5f095/images/large/1.jpg saved to cache
2026-03-26 18:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 77c56427-74e0-594a-94cf-9905e7323d28
2026-03-26 18:34:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 77c56427-74e0-594a-94cf-9905e7323d28, skipping ID generation
2026-03-26 18:34:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77c56427-74e0-594a-94cf-9905e7323d28 with scrape type 1
2026-03-26 18:34:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 77c56427-74e0-594a-94cf-9905e7323d28 sending to next pipeline
2026-03-26 18:34:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 77c56427-74e0-594a-94cf-9905e7323d28, identifier: 1985980
2026-03-26 18:34:58 [ayvens.es] INFO: Found listing with ID: 1985990
2026-03-26 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985990%27 HTTP/1.1" 200 None
2026-03-26 18:34:58 [ayvens.es] INFO: Scrape type for 1985990: 1
2026-03-26 18:34:58 [ayvens.es] INFO: Extracting data for car ID: 1985990
2026-03-26 18:34:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6304ac0d-8502-5f46-8421-fc2cd18aee84 with identifier: 1985990
2026-03-26 18:34:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6304ac0d-8502-5f46-8421-fc2cd18aee84 with scrape type 1
2026-03-26 18:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6304ac0d-8502-5f46-8421-fc2cd18aee84
2026-03-26 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F803%252Fb3e47d5d4905442597c26a8013884837%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/803/b3e47d5d4905442597c26a8013884837/images/large/1.jpg not downloaded yet
2026-03-26 18:34:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b9a79e8c-942e-5c44-8889-fa1db6fd3d9f with identifier: 1985981
2026-03-26 18:34:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b9a79e8c-942e-5c44-8889-fa1db6fd3d9f with identifier: 1985981
2026-03-26 18:34:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b9a79e8c-942e-5c44-8889-fa1db6fd3d9f with identifier: 1985981 to the API
2026-03-26 18:34:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/638/159d76ba064d4a5fa442518d46fd447f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 101,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b9a79e8c-942e-5c44-8889-fa1db6fd3d9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MEGANE',
 'odometer': 128644,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9a79e8c-942e-5c44-8889-fa1db6fd3d9f/b9a79e8c-942e-5c44-8889-fa1db6fd3d9f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 341087,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/638/159d76ba064d4a5fa442518d46fd447f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT MEGANE Business Blue dCi 81 kW (115CV)',
 'transmission': 'manual',
 'trim': 'Business Blue dCi 81 kW (115CV)',
 'vin': None,
 'year': 2020}
2026-03-26 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985981%27 HTTP/1.1" 200 None
2026-03-26 18:34:58 [ayvens.es] INFO: Saving data for 1985981: {'created_time': 1774550098.709898, 'last_price_update_time': 1774550098.709908, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985981') HTTP/1.1" 204 0
2026-03-26 18:34:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 77c56427-74e0-594a-94cf-9905e7323d28 with identifier: 1985980
2026-03-26 18:34:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 77c56427-74e0-594a-94cf-9905e7323d28 with identifier: 1985980
2026-03-26 18:34:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 77c56427-74e0-594a-94cf-9905e7323d28 with identifier: 1985980 to the API
2026-03-26 18:34:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/911/c2d7491bffea4ec98cc1c3c29ce5f095/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '77c56427-74e0-594a-94cf-9905e7323d28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KAMIQ',
 'odometer': 50104,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77c56427-74e0-594a-94cf-9905e7323d28/77c56427-74e0-594a-94cf-9905e7323d28_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 509877,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/911/c2d7491bffea4ec98cc1c3c29ce5f095/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA KAMIQ 1.0 TSI 81kW (110CV) Emotion',
 'transmission': 'manual',
 'trim': '1.0 TSI 81kW (110CV) Emotion',
 'vin': None,
 'year': 2022}
2026-03-26 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985980%27 HTTP/1.1" 200 None
2026-03-26 18:34:59 [ayvens.es] INFO: Saving data for 1985980: {'created_time': 1774550099.021145, 'last_price_update_time': 1774550099.021155, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985980') HTTP/1.1" 204 0
2026-03-26 18:34:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/896/581291471a8a480d997e0c2035d8f5b0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/489/f151b2cb09764a28a53e8d36b4450583/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:34:59 [ayvens.es] INFO: Found listing with ID: 1985991
2026-03-26 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985991%27 HTTP/1.1" 200 None
2026-03-26 18:34:59 [ayvens.es] INFO: Scrape type for 1985991: 1
2026-03-26 18:34:59 [ayvens.es] INFO: Extracting data for car ID: 1985991
2026-03-26 18:34:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12aa9e70-1af9-5c3a-8dae-ee919f9464d7 with identifier: 1985991
2026-03-26 18:34:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12aa9e70-1af9-5c3a-8dae-ee919f9464d7 with scrape type 1
2026-03-26 18:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 12aa9e70-1af9-5c3a-8dae-ee919f9464d7
2026-03-26 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F511%252F9fa839ff396c48f792ff0837255cdce6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/511/9fa839ff396c48f792ff0837255cdce6/images/large/1.jpg not downloaded yet
2026-03-26 18:34:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a283dc350>
2026-03-26 18:34:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6335a1a4-7875-57ab-b397-e49667252e57/6335a1a4-7875-57ab-b397-e49667252e57_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F998%252F2e041b2419e142d68f92106066f5f022%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/998/2e041b2419e142d68f92106066f5f022/images/large/1.jpg saved to cache
2026-03-26 18:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6335a1a4-7875-57ab-b397-e49667252e57
2026-03-26 18:34:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6335a1a4-7875-57ab-b397-e49667252e57, skipping ID generation
2026-03-26 18:34:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6335a1a4-7875-57ab-b397-e49667252e57 with scrape type 1
2026-03-26 18:34:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6335a1a4-7875-57ab-b397-e49667252e57 sending to next pipeline
2026-03-26 18:34:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6335a1a4-7875-57ab-b397-e49667252e57, identifier: 1985983
2026-03-26 18:34:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:34:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c76b90>
2026-03-26 18:34:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:34:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:34:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:34:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee40a6ab-a360-5784-b8ba-edd0917391a0/ee40a6ab-a360-5784-b8ba-edd0917391a0_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F975%252Febdca7e508af4141b8b08f0c0b9446ef%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/975/ebdca7e508af4141b8b08f0c0b9446ef/images/large/1.jpg saved to cache
2026-03-26 18:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ee40a6ab-a360-5784-b8ba-edd0917391a0
2026-03-26 18:34:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ee40a6ab-a360-5784-b8ba-edd0917391a0, skipping ID generation
2026-03-26 18:34:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee40a6ab-a360-5784-b8ba-edd0917391a0 with scrape type 1
2026-03-26 18:34:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ee40a6ab-a360-5784-b8ba-edd0917391a0 sending to next pipeline
2026-03-26 18:34:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ee40a6ab-a360-5784-b8ba-edd0917391a0, identifier: 1985982
2026-03-26 18:34:59 [ayvens.es] INFO: Found listing with ID: 1985992
2026-03-26 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985992%27 HTTP/1.1" 200 None
2026-03-26 18:34:59 [ayvens.es] INFO: Scrape type for 1985992: 1
2026-03-26 18:34:59 [ayvens.es] INFO: Extracting data for car ID: 1985992
2026-03-26 18:34:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13f81fd4-4b29-5b2a-8664-49474631b685 with identifier: 1985992
2026-03-26 18:34:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13f81fd4-4b29-5b2a-8664-49474631b685 with scrape type 1
2026-03-26 18:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 13f81fd4-4b29-5b2a-8664-49474631b685
2026-03-26 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F619%252F934d44a195654f5bbb23831f99992b97%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/619/934d44a195654f5bbb23831f99992b97/images/large/1.jpg not downloaded yet
2026-03-26 18:34:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6335a1a4-7875-57ab-b397-e49667252e57 with identifier: 1985983
2026-03-26 18:34:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6335a1a4-7875-57ab-b397-e49667252e57 with identifier: 1985983
2026-03-26 18:34:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 6335a1a4-7875-57ab-b397-e49667252e57 with identifier: 1985983 to the API
2026-03-26 18:34:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/998/2e041b2419e142d68f92106066f5f022/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'color': 'Blanco candy s',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '6335a1a4-7875-57ab-b397-e49667252e57',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CADDY',
 'odometer': 202251,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6335a1a4-7875-57ab-b397-e49667252e57/6335a1a4-7875-57ab-b397-e49667252e57_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 338956,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/998/2e041b2419e142d68f92106066f5f022/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN CADDY Profesional Kombi 2.0 TDI 55kW BMT',
 'transmission': 'manual',
 'trim': 'Profesional Kombi 2.0 TDI 55kW BMT',
 'vin': None,
 'year': 2019}
2026-03-26 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985983%27 HTTP/1.1" 200 None
2026-03-26 18:34:59 [ayvens.es] INFO: Saving data for 1985983: {'created_time': 1774550099.708384, 'last_price_update_time': 1774550099.708395, 'auction_closing_time': 1774612800.0}
2026-03-26 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985983') HTTP/1.1" 204 0
2026-03-26 18:34:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ee40a6ab-a360-5784-b8ba-edd0917391a0 with identifier: 1985982
2026-03-26 18:34:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ee40a6ab-a360-5784-b8ba-edd0917391a0 with identifier: 1985982
2026-03-26 18:34:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ee40a6ab-a360-5784-b8ba-edd0917391a0 with identifier: 1985982 to the API
2026-03-26 18:34:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:34:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:34:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/975/ebdca7e508af4141b8b08f0c0b9446ef/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 185,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.4L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ee40a6ab-a360-5784-b8ba-edd0917391a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'HILUX',
 'odometer': 38548,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee40a6ab-a360-5784-b8ba-edd0917391a0/ee40a6ab-a360-5784-b8ba-edd0917391a0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 339920,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/975/ebdca7e508af4141b8b08f0c0b9446ef/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA HILUX 2.4 D-4D Cabina Doble GX **REVISAR PERITACION**',
 'transmission': 'manual',
 'trim': '2.4 D-4D Cabina Doble GX **REVISAR PERITACION**',
 'vin': None,
 'year': 2018}
2026-03-26 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985982%27 HTTP/1.1" 200 None
2026-03-26 18:34:59 [ayvens.es] INFO: Saving data for 1985982: {'created_time': 1774550099.990468, 'last_price_update_time': 1774550099.990478, 'auction_closing_time': 1774612800.0}
2026-03-26 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985982') HTTP/1.1" 204 0
2026-03-26 18:35:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/707/eb8a1167e174416f83fc5bfecdf07e99/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:35:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/034/8814a7f7d9f9451ba10ee2ee98bd1398/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:35:00 [ayvens.es] INFO: Found listing with ID: 1985993
2026-03-26 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985993%27 HTTP/1.1" 200 None
2026-03-26 18:35:00 [ayvens.es] INFO: Scrape type for 1985993: 1
2026-03-26 18:35:00 [ayvens.es] INFO: Extracting data for car ID: 1985993
2026-03-26 18:35:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3c095f8-2527-5f5e-baa6-34e0232371d5 with identifier: 1985993
2026-03-26 18:35:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3c095f8-2527-5f5e-baa6-34e0232371d5 with scrape type 1
2026-03-26 18:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a3c095f8-2527-5f5e-baa6-34e0232371d5
2026-03-26 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F711%252F107358a5b1ae40dca7200f8942a331be%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/711/107358a5b1ae40dca7200f8942a331be/images/large/1.jpg not downloaded yet
2026-03-26 18:35:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:35:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28312410>
2026-03-26 18:35:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:35:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:35:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:35:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89d37f89-9a1b-566f-842e-e976c8cb9f3b/89d37f89-9a1b-566f-842e-e976c8cb9f3b_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F896%252F581291471a8a480d997e0c2035d8f5b0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/896/581291471a8a480d997e0c2035d8f5b0/images/large/1.jpg saved to cache
2026-03-26 18:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 89d37f89-9a1b-566f-842e-e976c8cb9f3b
2026-03-26 18:35:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 89d37f89-9a1b-566f-842e-e976c8cb9f3b, skipping ID generation
2026-03-26 18:35:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89d37f89-9a1b-566f-842e-e976c8cb9f3b with scrape type 1
2026-03-26 18:35:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 89d37f89-9a1b-566f-842e-e976c8cb9f3b sending to next pipeline
2026-03-26 18:35:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 89d37f89-9a1b-566f-842e-e976c8cb9f3b, identifier: 1985985
2026-03-26 18:35:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:35:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28adb790>
2026-03-26 18:35:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:35:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:35:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:35:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3578e2cf-047b-5be8-8093-6c35b21882dc/3578e2cf-047b-5be8-8093-6c35b21882dc_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F489%252Ff151b2cb09764a28a53e8d36b4450583%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/489/f151b2cb09764a28a53e8d36b4450583/images/large/1.jpg saved to cache
2026-03-26 18:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3578e2cf-047b-5be8-8093-6c35b21882dc
2026-03-26 18:35:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3578e2cf-047b-5be8-8093-6c35b21882dc, skipping ID generation
2026-03-26 18:35:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3578e2cf-047b-5be8-8093-6c35b21882dc with scrape type 1
2026-03-26 18:35:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3578e2cf-047b-5be8-8093-6c35b21882dc sending to next pipeline
2026-03-26 18:35:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3578e2cf-047b-5be8-8093-6c35b21882dc, identifier: 1985984
2026-03-26 18:35:00 [ayvens.es] INFO: Found listing with ID: 1985994
2026-03-26 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985994%27 HTTP/1.1" 200 None
2026-03-26 18:35:00 [ayvens.es] INFO: Scrape type for 1985994: 1
2026-03-26 18:35:00 [ayvens.es] INFO: Extracting data for car ID: 1985994
2026-03-26 18:35:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e2e99d0-e7c6-558d-b0c9-7c3a0bb2d4fd with identifier: 1985994
2026-03-26 18:35:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e2e99d0-e7c6-558d-b0c9-7c3a0bb2d4fd with scrape type 1
2026-03-26 18:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3e2e99d0-e7c6-558d-b0c9-7c3a0bb2d4fd
2026-03-26 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F907%252Fde1883773a264dd2ae379fc044b17b2c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/907/de1883773a264dd2ae379fc044b17b2c/images/large/1.jpg not downloaded yet
2026-03-26 18:35:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 89d37f89-9a1b-566f-842e-e976c8cb9f3b with identifier: 1985985
2026-03-26 18:35:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 89d37f89-9a1b-566f-842e-e976c8cb9f3b with identifier: 1985985
2026-03-26 18:35:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 89d37f89-9a1b-566f-842e-e976c8cb9f3b with identifier: 1985985 to the API
2026-03-26 18:35:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:35:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:35:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/896/581291471a8a480d997e0c2035d8f5b0/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.6L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '89d37f89-9a1b-566f-842e-e976c8cb9f3b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'PARTNER',
 'odometer': 149190,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89d37f89-9a1b-566f-842e-e976c8cb9f3b/89d37f89-9a1b-566f-842e-e976c8cb9f3b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325332,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/896/581291471a8a480d997e0c2035d8f5b0/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-07',
 'seats_number': 2,
 'seller_name': None,
 'title': 'PEUGEOT PARTNER Furgon Confort L1 1.6 BlueHDi 55KW (75)',
 'transmission': 'manual',
 'trim': 'Furgon Confort L1 1.6 BlueHDi 55KW (75)',
 'vin': None,
 'year': 2018}
2026-03-26 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985985%27 HTTP/1.1" 200 None
2026-03-26 18:35:00 [ayvens.es] INFO: Saving data for 1985985: {'created_time': 1774550100.735487, 'last_price_update_time': 1774550100.735497, 'auction_closing_time': 1774612800.0}
2026-03-26 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985985') HTTP/1.1" 204 0
2026-03-26 18:35:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3578e2cf-047b-5be8-8093-6c35b21882dc with identifier: 1985984
2026-03-26 18:35:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3578e2cf-047b-5be8-8093-6c35b21882dc with identifier: 1985984
2026-03-26 18:35:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3578e2cf-047b-5be8-8093-6c35b21882dc with identifier: 1985984 to the API
2026-03-26 18:35:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:35:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:35:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/489/f151b2cb09764a28a53e8d36b4450583/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'color': 'Plata',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '3578e2cf-047b-5be8-8093-6c35b21882dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CADDY',
 'odometer': 88406,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3578e2cf-047b-5be8-8093-6c35b21882dc/3578e2cf-047b-5be8-8093-6c35b21882dc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344477,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/489/f151b2cb09764a28a53e8d36b4450583/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN CADDY Edition 1.0 TSI 75kW (102CV) BMT',
 'transmission': 'manual',
 'trim': 'Edition 1.0 TSI 75kW (102CV) BMT',
 'vin': None,
 'year': 2019}
2026-03-26 18:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985984%27 HTTP/1.1" 200 None
2026-03-26 18:35:01 [ayvens.es] INFO: Saving data for 1985984: {'created_time': 1774550101.159585, 'last_price_update_time': 1774550101.159594, 'auction_closing_time': 1774612800.0}
2026-03-26 18:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985984') HTTP/1.1" 204 0
2026-03-26 18:35:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:35:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28ec37d0>
2026-03-26 18:35:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:35:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:35:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:35:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26521e49-3281-53d1-a231-14766905c5f1/26521e49-3281-53d1-a231-14766905c5f1_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F707%252Feb8a1167e174416f83fc5bfecdf07e99%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/707/eb8a1167e174416f83fc5bfecdf07e99/images/large/1.jpg saved to cache
2026-03-26 18:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 26521e49-3281-53d1-a231-14766905c5f1
2026-03-26 18:35:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 26521e49-3281-53d1-a231-14766905c5f1, skipping ID generation
2026-03-26 18:35:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26521e49-3281-53d1-a231-14766905c5f1 with scrape type 1
2026-03-26 18:35:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 26521e49-3281-53d1-a231-14766905c5f1 sending to next pipeline
2026-03-26 18:35:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 26521e49-3281-53d1-a231-14766905c5f1, identifier: 1985987
2026-03-26 18:35:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:35:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28e55ad0>
2026-03-26 18:35:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:35:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:35:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:35:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_781d62a4-fa86-5976-9904-6844fa85b89b/781d62a4-fa86-5976-9904-6844fa85b89b_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F034%252F8814a7f7d9f9451ba10ee2ee98bd1398%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/034/8814a7f7d9f9451ba10ee2ee98bd1398/images/large/1.jpg saved to cache
2026-03-26 18:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 781d62a4-fa86-5976-9904-6844fa85b89b
2026-03-26 18:35:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 781d62a4-fa86-5976-9904-6844fa85b89b, skipping ID generation
2026-03-26 18:35:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 781d62a4-fa86-5976-9904-6844fa85b89b with scrape type 1
2026-03-26 18:35:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 781d62a4-fa86-5976-9904-6844fa85b89b sending to next pipeline
2026-03-26 18:35:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 781d62a4-fa86-5976-9904-6844fa85b89b, identifier: 1985986
2026-03-26 18:35:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/802/33c456815fdb45f4a60c668280470b06/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:35:01 [ayvens.es] INFO: Found listing with ID: 1985995
2026-03-26 18:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985995%27 HTTP/1.1" 200 None
2026-03-26 18:35:01 [ayvens.es] INFO: Scrape type for 1985995: 1
2026-03-26 18:35:01 [ayvens.es] INFO: Extracting data for car ID: 1985995
2026-03-26 18:35:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1017ee0b-a992-5018-a328-9926375a70b3 with identifier: 1985995
2026-03-26 18:35:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1017ee0b-a992-5018-a328-9926375a70b3 with scrape type 1
2026-03-26 18:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1017ee0b-a992-5018-a328-9926375a70b3
2026-03-26 18:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F482%252F4c94fecd597c45199efdc63f0043415c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/482/4c94fecd597c45199efdc63f0043415c/images/large/1.jpg not downloaded yet
2026-03-26 18:35:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 26521e49-3281-53d1-a231-14766905c5f1 with identifier: 1985987
2026-03-26 18:35:01 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:35:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 26521e49-3281-53d1-a231-14766905c5f1 with identifier: 1985987
2026-03-26 18:35:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 26521e49-3281-53d1-a231-14766905c5f1 with identifier: 1985987 to the API
2026-03-26 18:35:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:35:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:35:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/707/eb8a1167e174416f83fc5bfecdf07e99/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'color': 'Candy blanco s',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '26521e49-3281-53d1-a231-14766905c5f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CADDY',
 'odometer': 221768,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26521e49-3281-53d1-a231-14766905c5f1/26521e49-3281-53d1-a231-14766905c5f1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342743,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/707/eb8a1167e174416f83fc5bfecdf07e99/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-22',
 'seats_number': 2,
 'seller_name': None,
 'title': 'VOLKSWAGEN CADDY (E) Business 2.0 TDI 90kW (122CV) BMT 4M',
 'transmission': 'manual',
 'trim': '(E) Business 2.0 TDI 90kW (122CV) BMT 4M',
 'vin': None,
 'year': 2019}
2026-03-26 18:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985987%27 HTTP/1.1" 200 None
2026-03-26 18:35:01 [ayvens.es] INFO: Saving data for 1985987: {'created_time': 1774550101.849218, 'last_price_update_time': 1774550101.849234, 'auction_closing_time': 1774612800.0}
2026-03-26 18:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985987') HTTP/1.1" 204 0
2026-03-26 18:35:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 781d62a4-fa86-5976-9904-6844fa85b89b with identifier: 1985986
2026-03-26 18:35:01 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:35:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 781d62a4-fa86-5976-9904-6844fa85b89b with identifier: 1985986
2026-03-26 18:35:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 781d62a4-fa86-5976-9904-6844fa85b89b with identifier: 1985986 to the API
2026-03-26 18:35:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:35:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:35:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/034/8814a7f7d9f9451ba10ee2ee98bd1398/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '781d62a4-fa86-5976-9904-6844fa85b89b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'PARTNER',
 'odometer': 104048,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_781d62a4-fa86-5976-9904-6844fa85b89b/781d62a4-fa86-5976-9904-6844fa85b89b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 313366,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/034/8814a7f7d9f9451ba10ee2ee98bd1398/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-01',
 'seats_number': 2,
 'seller_name': None,
 'title': 'PEUGEOT PARTNER Premium Standard 600kg BlueHDi 73kW',
 'transmission': 'manual',
 'trim': 'Premium Standard 600kg BlueHDi 73kW',
 'vin': None,
 'year': 2021}
2026-03-26 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985986%27 HTTP/1.1" 200 None
2026-03-26 18:35:02 [ayvens.es] INFO: Saving data for 1985986: {'created_time': 1774550102.154091, 'last_price_update_time': 1774550102.154101, 'auction_closing_time': 1774612800.0}
2026-03-26 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985986') HTTP/1.1" 204 0
2026-03-26 18:35:02 [ayvens.es] INFO: Found listing with ID: 1985996
2026-03-26 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985996%27 HTTP/1.1" 200 None
2026-03-26 18:35:02 [ayvens.es] INFO: Scrape type for 1985996: 1
2026-03-26 18:35:02 [ayvens.es] INFO: Extracting data for car ID: 1985996
2026-03-26 18:35:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01a4ece3-ff83-5a3a-8c0a-95f1396650c2 with identifier: 1985996
2026-03-26 18:35:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01a4ece3-ff83-5a3a-8c0a-95f1396650c2 with scrape type 1
2026-03-26 18:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 01a4ece3-ff83-5a3a-8c0a-95f1396650c2
2026-03-26 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F767%252F242ed89f6e1741ea84603e949aa7ec78%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/767/242ed89f6e1741ea84603e949aa7ec78/images/large/1.jpg not downloaded yet
2026-03-26 18:35:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/398/cbdbd43a3efc4a1993916f7a24fe599b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:35:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:35:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c2bc90>
2026-03-26 18:35:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:35:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:35:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:35:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f3bc382-e9b0-5c66-9c8a-39c44573ff0e/3f3bc382-e9b0-5c66-9c8a-39c44573ff0e_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F802%252F33c456815fdb45f4a60c668280470b06%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/802/33c456815fdb45f4a60c668280470b06/images/large/1.jpg saved to cache
2026-03-26 18:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3f3bc382-e9b0-5c66-9c8a-39c44573ff0e
2026-03-26 18:35:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3f3bc382-e9b0-5c66-9c8a-39c44573ff0e, skipping ID generation
2026-03-26 18:35:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f3bc382-e9b0-5c66-9c8a-39c44573ff0e with scrape type 1
2026-03-26 18:35:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3f3bc382-e9b0-5c66-9c8a-39c44573ff0e sending to next pipeline
2026-03-26 18:35:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3f3bc382-e9b0-5c66-9c8a-39c44573ff0e, identifier: 1985989
2026-03-26 18:35:02 [ayvens.es] INFO: Found listing with ID: 1985997
2026-03-26 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985997%27 HTTP/1.1" 200 None
2026-03-26 18:35:02 [ayvens.es] INFO: Scrape type for 1985997: 1
2026-03-26 18:35:02 [ayvens.es] INFO: Extracting data for car ID: 1985997
2026-03-26 18:35:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ec34319-bbec-58b4-83dd-822a1185ac71 with identifier: 1985997
2026-03-26 18:35:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ec34319-bbec-58b4-83dd-822a1185ac71 with scrape type 1
2026-03-26 18:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5ec34319-bbec-58b4-83dd-822a1185ac71
2026-03-26 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F691%252Ff3527580c4b8491fbe0f9f1d34d08333%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/691/f3527580c4b8491fbe0f9f1d34d08333/images/large/1.jpg not downloaded yet
2026-03-26 18:35:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3f3bc382-e9b0-5c66-9c8a-39c44573ff0e with identifier: 1985989
2026-03-26 18:35:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3f3bc382-e9b0-5c66-9c8a-39c44573ff0e with identifier: 1985989
2026-03-26 18:35:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3f3bc382-e9b0-5c66-9c8a-39c44573ff0e with identifier: 1985989 to the API
2026-03-26 18:35:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:35:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:35:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/802/33c456815fdb45f4a60c668280470b06/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'color': 'Blanco puro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '3f3bc382-e9b0-5c66-9c8a-39c44573ff0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF',
 'odometer': 100233,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f3bc382-e9b0-5c66-9c8a-39c44573ff0e/3f3bc382-e9b0-5c66-9c8a-39c44573ff0e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 338867,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/802/33c456815fdb45f4a60c668280470b06/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF Life 2.0 TDI 85kW (115CV) DSG',
 'transmission': 'manual',
 'trim': 'Life 2.0 TDI 85kW (115CV) DSG',
 'vin': None,
 'year': 2021}
2026-03-26 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985989%27 HTTP/1.1" 200 None
2026-03-26 18:35:02 [ayvens.es] INFO: Saving data for 1985989: {'created_time': 1774550102.697201, 'last_price_update_time': 1774550102.69721, 'auction_closing_time': 1774612800.0}
2026-03-26 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985989') HTTP/1.1" 204 0
2026-03-26 18:35:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/803/b3e47d5d4905442597c26a8013884837/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:35:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/619/934d44a195654f5bbb23831f99992b97/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:35:02 [ayvens.es] INFO: Found listing with ID: 1985998
2026-03-26 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985998%27 HTTP/1.1" 200 None
2026-03-26 18:35:02 [ayvens.es] INFO: Scrape type for 1985998: 1
2026-03-26 18:35:02 [ayvens.es] INFO: Extracting data for car ID: 1985998
2026-03-26 18:35:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2fa80951-bf9e-5966-af8b-930189dcd60c with identifier: 1985998
2026-03-26 18:35:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2fa80951-bf9e-5966-af8b-930189dcd60c with scrape type 1
2026-03-26 18:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2fa80951-bf9e-5966-af8b-930189dcd60c
2026-03-26 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F751%252Fdfa50ebe325f4cef8eb97fbf01b4a46d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/751/dfa50ebe325f4cef8eb97fbf01b4a46d/images/large/1.jpg not downloaded yet
2026-03-26 18:35:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/511/9fa839ff396c48f792ff0837255cdce6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:35:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/711/107358a5b1ae40dca7200f8942a331be/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:35:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:35:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28d83790>
2026-03-26 18:35:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:35:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:35:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:35:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e21a458-03ff-50ca-8724-7967b98d1798/4e21a458-03ff-50ca-8724-7967b98d1798_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F398%252Fcbdbd43a3efc4a1993916f7a24fe599b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/398/cbdbd43a3efc4a1993916f7a24fe599b/images/large/1.jpg saved to cache
2026-03-26 18:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4e21a458-03ff-50ca-8724-7967b98d1798
2026-03-26 18:35:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4e21a458-03ff-50ca-8724-7967b98d1798, skipping ID generation
2026-03-26 18:35:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e21a458-03ff-50ca-8724-7967b98d1798 with scrape type 1
2026-03-26 18:35:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4e21a458-03ff-50ca-8724-7967b98d1798 sending to next pipeline
2026-03-26 18:35:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4e21a458-03ff-50ca-8724-7967b98d1798, identifier: 1985988
2026-03-26 18:35:02 [ayvens.es] INFO: Found listing with ID: 1985999
2026-03-26 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985999%27 HTTP/1.1" 200 None
2026-03-26 18:35:02 [ayvens.es] INFO: Scrape type for 1985999: 1
2026-03-26 18:35:02 [ayvens.es] INFO: Extracting data for car ID: 1985999
2026-03-26 18:35:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e7f6d42-ac12-57e4-94d1-47f4eef66598 with identifier: 1985999
2026-03-26 18:35:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e7f6d42-ac12-57e4-94d1-47f4eef66598 with scrape type 1
2026-03-26 18:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1e7f6d42-ac12-57e4-94d1-47f4eef66598
2026-03-26 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F558%252F0ca366d994f846a18fe4197166641344%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/558/0ca366d994f846a18fe4197166641344/images/large/1.jpg not downloaded yet
2026-03-26 18:35:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4e21a458-03ff-50ca-8724-7967b98d1798 with identifier: 1985988
2026-03-26 18:35:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4e21a458-03ff-50ca-8724-7967b98d1798 with identifier: 1985988
2026-03-26 18:35:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 4e21a458-03ff-50ca-8724-7967b98d1798 with identifier: 1985988 to the API
2026-03-26 18:35:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:35:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:35:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/398/cbdbd43a3efc4a1993916f7a24fe599b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'Blanco puro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '4e21a458-03ff-50ca-8724-7967b98d1798',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-ROC',
 'odometer': 126950,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e21a458-03ff-50ca-8724-7967b98d1798/4e21a458-03ff-50ca-8724-7967b98d1798_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 556958,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/398/cbdbd43a3efc4a1993916f7a24fe599b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-ROC Advance 2.0 TDI 110kW (150CV)',
 'transmission': 'manual',
 'trim': 'Advance 2.0 TDI 110kW (150CV)',
 'vin': None,
 'year': 2021}
2026-03-26 18:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985988%27 HTTP/1.1" 200 None
2026-03-26 18:35:03 [ayvens.es] INFO: Saving data for 1985988: {'created_time': 1774550103.248468, 'last_price_update_time': 1774550103.248477, 'auction_closing_time': 1774612800.0}
2026-03-26 18:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985988') HTTP/1.1" 204 0
2026-03-26 18:35:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/907/de1883773a264dd2ae379fc044b17b2c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:35:03 [ayvens.es] INFO: Found listing with ID: 1986000
2026-03-26 18:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986000%27 HTTP/1.1" 200 None
2026-03-26 18:35:03 [ayvens.es] INFO: Scrape type for 1986000: 1
2026-03-26 18:35:03 [ayvens.es] INFO: Extracting data for car ID: 1986000
2026-03-26 18:35:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4feaf296-8629-5274-931b-afe144cc432b with identifier: 1986000
2026-03-26 18:35:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4feaf296-8629-5274-931b-afe144cc432b with scrape type 1
2026-03-26 18:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4feaf296-8629-5274-931b-afe144cc432b
2026-03-26 18:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F334%252F569b766e3b6e46dab0a0680da65a6903%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/334/569b766e3b6e46dab0a0680da65a6903/images/large/1.jpg not downloaded yet
2026-03-26 18:35:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:35:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c28190>
2026-03-26 18:35:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:35:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:35:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:35:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6304ac0d-8502-5f46-8421-fc2cd18aee84/6304ac0d-8502-5f46-8421-fc2cd18aee84_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F803%252Fb3e47d5d4905442597c26a8013884837%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/803/b3e47d5d4905442597c26a8013884837/images/large/1.jpg saved to cache
2026-03-26 18:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6304ac0d-8502-5f46-8421-fc2cd18aee84
2026-03-26 18:35:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6304ac0d-8502-5f46-8421-fc2cd18aee84, skipping ID generation
2026-03-26 18:35:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6304ac0d-8502-5f46-8421-fc2cd18aee84 with scrape type 1
2026-03-26 18:35:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6304ac0d-8502-5f46-8421-fc2cd18aee84 sending to next pipeline
2026-03-26 18:35:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6304ac0d-8502-5f46-8421-fc2cd18aee84, identifier: 1985990
2026-03-26 18:35:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:35:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28f6b6d0>
2026-03-26 18:35:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:35:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:35:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:35:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13f81fd4-4b29-5b2a-8664-49474631b685/13f81fd4-4b29-5b2a-8664-49474631b685_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F619%252F934d44a195654f5bbb23831f99992b97%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/619/934d44a195654f5bbb23831f99992b97/images/large/1.jpg saved to cache
2026-03-26 18:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 13f81fd4-4b29-5b2a-8664-49474631b685
2026-03-26 18:35:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 13f81fd4-4b29-5b2a-8664-49474631b685, skipping ID generation
2026-03-26 18:35:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13f81fd4-4b29-5b2a-8664-49474631b685 with scrape type 1
2026-03-26 18:35:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 13f81fd4-4b29-5b2a-8664-49474631b685 sending to next pipeline
2026-03-26 18:35:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 13f81fd4-4b29-5b2a-8664-49474631b685, identifier: 1985992
2026-03-26 18:35:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:35:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28fe8890>
2026-03-26 18:35:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:35:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:35:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:35:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12aa9e70-1af9-5c3a-8dae-ee919f9464d7/12aa9e70-1af9-5c3a-8dae-ee919f9464d7_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F511%252F9fa839ff396c48f792ff0837255cdce6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/511/9fa839ff396c48f792ff0837255cdce6/images/large/1.jpg saved to cache
2026-03-26 18:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 12aa9e70-1af9-5c3a-8dae-ee919f9464d7
2026-03-26 18:35:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 12aa9e70-1af9-5c3a-8dae-ee919f9464d7, skipping ID generation
2026-03-26 18:35:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12aa9e70-1af9-5c3a-8dae-ee919f9464d7 with scrape type 1
2026-03-26 18:35:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 12aa9e70-1af9-5c3a-8dae-ee919f9464d7 sending to next pipeline
2026-03-26 18:35:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 12aa9e70-1af9-5c3a-8dae-ee919f9464d7, identifier: 1985991
2026-03-26 18:35:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:35:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a283d3a50>
2026-03-26 18:35:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:35:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:35:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:35:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3c095f8-2527-5f5e-baa6-34e0232371d5/a3c095f8-2527-5f5e-baa6-34e0232371d5_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F711%252F107358a5b1ae40dca7200f8942a331be%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/711/107358a5b1ae40dca7200f8942a331be/images/large/1.jpg saved to cache
2026-03-26 18:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a3c095f8-2527-5f5e-baa6-34e0232371d5
2026-03-26 18:35:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a3c095f8-2527-5f5e-baa6-34e0232371d5, skipping ID generation
2026-03-26 18:35:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3c095f8-2527-5f5e-baa6-34e0232371d5 with scrape type 1
2026-03-26 18:35:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a3c095f8-2527-5f5e-baa6-34e0232371d5 sending to next pipeline
2026-03-26 18:35:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a3c095f8-2527-5f5e-baa6-34e0232371d5, identifier: 1985993
2026-03-26 18:35:04 [ayvens.es] INFO: Found listing with ID: 1986001
2026-03-26 18:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986001%27 HTTP/1.1" 200 None
2026-03-26 18:35:04 [ayvens.es] INFO: Scrape type for 1986001: 1
2026-03-26 18:35:04 [ayvens.es] INFO: Extracting data for car ID: 1986001
2026-03-26 18:35:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83746df7-f017-5bd5-8cba-981e0f55f2a5 with identifier: 1986001
2026-03-26 18:35:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83746df7-f017-5bd5-8cba-981e0f55f2a5 with scrape type 1
2026-03-26 18:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 83746df7-f017-5bd5-8cba-981e0f55f2a5
2026-03-26 18:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F302%252Ff5f81d6b8b43475b8c5a1a394c8fea02%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/302/f5f81d6b8b43475b8c5a1a394c8fea02/images/large/1.jpg not downloaded yet
2026-03-26 18:35:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6304ac0d-8502-5f46-8421-fc2cd18aee84 with identifier: 1985990
2026-03-26 18:35:04 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:35:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6304ac0d-8502-5f46-8421-fc2cd18aee84 with identifier: 1985990
2026-03-26 18:35:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 6304ac0d-8502-5f46-8421-fc2cd18aee84 with identifier: 1985990 to the API
2026-03-26 18:35:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:35:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:35:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/803/b3e47d5d4905442597c26a8013884837/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'Gris intenso metaliz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '6304ac0d-8502-5f46-8421-fc2cd18aee84',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TAIGO',
 'odometer': 39599,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6304ac0d-8502-5f46-8421-fc2cd18aee84/6304ac0d-8502-5f46-8421-fc2cd18aee84_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 499720,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/803/b3e47d5d4905442597c26a8013884837/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN TAIGO Life 1.0 TSI 81kW (110CV) DSG',
 'transmission': 'manual',
 'trim': 'Life 1.0 TSI 81kW (110CV) DSG',
 'vin': None,
 'year': 2022}
2026-03-26 18:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985990%27 HTTP/1.1" 200 None
2026-03-26 18:35:04 [ayvens.es] INFO: Saving data for 1985990: {'created_time': 1774550104.360554, 'last_price_update_time': 1774550104.360563, 'auction_closing_time': 1774612800.0}
2026-03-26 18:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985990') HTTP/1.1" 204 0
2026-03-26 18:35:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 13f81fd4-4b29-5b2a-8664-49474631b685 with identifier: 1985992
2026-03-26 18:35:04 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:35:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 13f81fd4-4b29-5b2a-8664-49474631b685 with identifier: 1985992
2026-03-26 18:35:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 13f81fd4-4b29-5b2a-8664-49474631b685 with identifier: 1985992 to the API
2026-03-26 18:35:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:35:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:35:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/619/934d44a195654f5bbb23831f99992b97/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 188,
 'color': 'Blanco glaciar',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '13f81fd4-4b29-5b2a-8664-49474631b685',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'TRAFIC',
 'odometer': 43193,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13f81fd4-4b29-5b2a-8664-49474631b685/13f81fd4-4b29-5b2a-8664-49474631b685_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 337692,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/619/934d44a195654f5bbb23831f99992b97/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-06-21',
 'seats_number': 9,
 'seller_name': None,
 'title': 'RENAULT TRAFIC (O) Authentic Energy Blue dCi 81 kW (110CV)',
 'transmission': 'manual',
 'trim': '(O) Authentic Energy Blue dCi 81 kW (110CV)',
 'vin': None,
 'year': 2024}
2026-03-26 18:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985992%27 HTTP/1.1" 200 None
2026-03-26 18:35:04 [ayvens.es] INFO: Saving data for 1985992: {'created_time': 1774550104.651512, 'last_price_update_time': 1774550104.651523, 'auction_closing_time': 1774612800.0}
2026-03-26 18:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985992') HTTP/1.1" 204 0
2026-03-26 18:35:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 12aa9e70-1af9-5c3a-8dae-ee919f9464d7 with identifier: 1985991
2026-03-26 18:35:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 12aa9e70-1af9-5c3a-8dae-ee919f9464d7 with identifier: 1985991
2026-03-26 18:35:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 12aa9e70-1af9-5c3a-8dae-ee919f9464d7 with identifier: 1985991 to the API
2026-03-26 18:35:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:35:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:35:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/511/9fa839ff396c48f792ff0837255cdce6/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'Blanco puro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '12aa9e70-1af9-5c3a-8dae-ee919f9464d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF',
 'odometer': 152107,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12aa9e70-1af9-5c3a-8dae-ee919f9464d7/12aa9e70-1af9-5c3a-8dae-ee919f9464d7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 539226,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/511/9fa839ff396c48f792ff0837255cdce6/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF Last Edition 1.6 TDI 85kW (115CV)',
 'transmission': 'manual',
 'trim': 'Last Edition 1.6 TDI 85kW (115CV)',
 'vin': None,
 'year': 2020}
2026-03-26 18:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985991%27 HTTP/1.1" 200 None
2026-03-26 18:35:04 [ayvens.es] INFO: Saving data for 1985991: {'created_time': 1774550104.949249, 'last_price_update_time': 1774550104.949259, 'auction_closing_time': 1774612800.0}
2026-03-26 18:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985991') HTTP/1.1" 204 0
2026-03-26 18:35:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a3c095f8-2527-5f5e-baa6-34e0232371d5 with identifier: 1985993
2026-03-26 18:35:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a3c095f8-2527-5f5e-baa6-34e0232371d5 with identifier: 1985993
2026-03-26 18:35:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a3c095f8-2527-5f5e-baa6-34e0232371d5 with identifier: 1985993 to the API
2026-03-26 18:35:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:35:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:35:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/711/107358a5b1ae40dca7200f8942a331be/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'color': 'Candy blanco s',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a3c095f8-2527-5f5e-baa6-34e0232371d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CADDY',
 'odometer': 89028,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3c095f8-2527-5f5e-baa6-34e0232371d5/a3c095f8-2527-5f5e-baa6-34e0232371d5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 341378,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/711/107358a5b1ae40dca7200f8942a331be/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-22',
 'seats_number': 2,
 'seller_name': None,
 'title': 'VOLKSWAGEN CADDY (E) Business 2.0 TDI 90kW (122CV) BMT 4M',
 'transmission': 'manual',
 'trim': '(E) Business 2.0 TDI 90kW (122CV) BMT 4M',
 'vin': None,
 'year': 2019}
2026-03-26 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985993%27 HTTP/1.1" 200 None
2026-03-26 18:35:05 [ayvens.es] INFO: Saving data for 1985993: {'created_time': 1774550105.239194, 'last_price_update_time': 1774550105.239208, 'auction_closing_time': 1774612800.0}
2026-03-26 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985993') HTTP/1.1" 204 0
2026-03-26 18:35:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/482/4c94fecd597c45199efdc63f0043415c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:35:05 [ayvens.es] INFO: Found listing with ID: 1986002
2026-03-26 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986002%27 HTTP/1.1" 200 None
2026-03-26 18:35:05 [ayvens.es] INFO: Scrape type for 1986002: 1
2026-03-26 18:35:05 [ayvens.es] INFO: Extracting data for car ID: 1986002
2026-03-26 18:35:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca96feed-a9b2-5da4-898f-921fbbcf8558 with identifier: 1986002
2026-03-26 18:35:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca96feed-a9b2-5da4-898f-921fbbcf8558 with scrape type 1
2026-03-26 18:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ca96feed-a9b2-5da4-898f-921fbbcf8558
2026-03-26 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F667%252F8a0ab9328f32444e8c352d3bad0810ae%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/667/8a0ab9328f32444e8c352d3bad0810ae/images/large/1.jpg not downloaded yet
2026-03-26 18:35:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/691/f3527580c4b8491fbe0f9f1d34d08333/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:35:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:35:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a29034190>
2026-03-26 18:35:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:35:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:35:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:35:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e2e99d0-e7c6-558d-b0c9-7c3a0bb2d4fd/3e2e99d0-e7c6-558d-b0c9-7c3a0bb2d4fd_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F907%252Fde1883773a264dd2ae379fc044b17b2c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/907/de1883773a264dd2ae379fc044b17b2c/images/large/1.jpg saved to cache
2026-03-26 18:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3e2e99d0-e7c6-558d-b0c9-7c3a0bb2d4fd
2026-03-26 18:35:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3e2e99d0-e7c6-558d-b0c9-7c3a0bb2d4fd, skipping ID generation
2026-03-26 18:35:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e2e99d0-e7c6-558d-b0c9-7c3a0bb2d4fd with scrape type 1
2026-03-26 18:35:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3e2e99d0-e7c6-558d-b0c9-7c3a0bb2d4fd sending to next pipeline
2026-03-26 18:35:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3e2e99d0-e7c6-558d-b0c9-7c3a0bb2d4fd, identifier: 1985994
2026-03-26 18:35:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/767/242ed89f6e1741ea84603e949aa7ec78/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:35:05 [ayvens.es] INFO: Found listing with ID: 1986003
2026-03-26 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986003%27 HTTP/1.1" 200 None
2026-03-26 18:35:05 [ayvens.es] INFO: Scrape type for 1986003: 1
2026-03-26 18:35:05 [ayvens.es] INFO: Extracting data for car ID: 1986003
2026-03-26 18:35:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb0d2231-b790-554e-84b9-b2d7d0ca8738 with identifier: 1986003
2026-03-26 18:35:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb0d2231-b790-554e-84b9-b2d7d0ca8738 with scrape type 1
2026-03-26 18:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item eb0d2231-b790-554e-84b9-b2d7d0ca8738
2026-03-26 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F646%252F04bcd45c52c64e169fcf888bf6fc4f18%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/646/04bcd45c52c64e169fcf888bf6fc4f18/images/large/1.jpg not downloaded yet
2026-03-26 18:35:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3e2e99d0-e7c6-558d-b0c9-7c3a0bb2d4fd with identifier: 1985994
2026-03-26 18:35:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3e2e99d0-e7c6-558d-b0c9-7c3a0bb2d4fd with identifier: 1985994
2026-03-26 18:35:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3e2e99d0-e7c6-558d-b0c9-7c3a0bb2d4fd with identifier: 1985994 to the API
2026-03-26 18:35:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:35:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:35:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/907/de1883773a264dd2ae379fc044b17b2c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '3e2e99d0-e7c6-558d-b0c9-7c3a0bb2d4fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ATECA',
 'odometer': 226429,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e2e99d0-e7c6-558d-b0c9-7c3a0bb2d4fd/3e2e99d0-e7c6-558d-b0c9-7c3a0bb2d4fd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325865,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/907/de1883773a264dd2ae379fc044b17b2c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ATECA 2.0 TDI 85kW (115CV) S&S Style Go M',
 'transmission': 'manual',
 'trim': '2.0 TDI 85kW (115CV) S&S Style Go M',
 'vin': None,
 'year': 2021}
2026-03-26 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985994%27 HTTP/1.1" 200 None
2026-03-26 18:35:05 [ayvens.es] INFO: Saving data for 1985994: {'created_time': 1774550105.783473, 'last_price_update_time': 1774550105.783486, 'auction_closing_time': 1774612800.0}
2026-03-26 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985994') HTTP/1.1" 204 0
2026-03-26 18:35:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/751/dfa50ebe325f4cef8eb97fbf01b4a46d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:35:05 [ayvens.es] INFO: Found listing with ID: 1986004
2026-03-26 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986004%27 HTTP/1.1" 200 None
2026-03-26 18:35:05 [ayvens.es] INFO: Scrape type for 1986004: 1
2026-03-26 18:35:05 [ayvens.es] INFO: Extracting data for car ID: 1986004
2026-03-26 18:35:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69230fc6-af24-58d7-9d61-0d90c7533d5c with identifier: 1986004
2026-03-26 18:35:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69230fc6-af24-58d7-9d61-0d90c7533d5c with scrape type 1
2026-03-26 18:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 69230fc6-af24-58d7-9d61-0d90c7533d5c
2026-03-26 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F018%252Ffa3a960dfc654d2380ee29a7fa7e6043%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/018/fa3a960dfc654d2380ee29a7fa7e6043/images/large/1.jpg not downloaded yet
2026-03-26 18:35:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/558/0ca366d994f846a18fe4197166641344/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:35:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:35:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c26250>
2026-03-26 18:35:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:35:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:35:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:35:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1017ee0b-a992-5018-a328-9926375a70b3/1017ee0b-a992-5018-a328-9926375a70b3_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F482%252F4c94fecd597c45199efdc63f0043415c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/482/4c94fecd597c45199efdc63f0043415c/images/large/1.jpg saved to cache
2026-03-26 18:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1017ee0b-a992-5018-a328-9926375a70b3
2026-03-26 18:35:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1017ee0b-a992-5018-a328-9926375a70b3, skipping ID generation
2026-03-26 18:35:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1017ee0b-a992-5018-a328-9926375a70b3 with scrape type 1
2026-03-26 18:35:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1017ee0b-a992-5018-a328-9926375a70b3 sending to next pipeline
2026-03-26 18:35:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1017ee0b-a992-5018-a328-9926375a70b3, identifier: 1985995
2026-03-26 18:35:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:35:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28acea10>
2026-03-26 18:35:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:35:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:35:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:35:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ec34319-bbec-58b4-83dd-822a1185ac71/5ec34319-bbec-58b4-83dd-822a1185ac71_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F691%252Ff3527580c4b8491fbe0f9f1d34d08333%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/691/f3527580c4b8491fbe0f9f1d34d08333/images/large/1.jpg saved to cache
2026-03-26 18:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5ec34319-bbec-58b4-83dd-822a1185ac71
2026-03-26 18:35:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5ec34319-bbec-58b4-83dd-822a1185ac71, skipping ID generation
2026-03-26 18:35:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ec34319-bbec-58b4-83dd-822a1185ac71 with scrape type 1
2026-03-26 18:35:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5ec34319-bbec-58b4-83dd-822a1185ac71 sending to next pipeline
2026-03-26 18:35:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5ec34319-bbec-58b4-83dd-822a1185ac71, identifier: 1985997
2026-03-26 18:35:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:35:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a283850d0>
2026-03-26 18:35:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:35:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:35:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:35:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01a4ece3-ff83-5a3a-8c0a-95f1396650c2/01a4ece3-ff83-5a3a-8c0a-95f1396650c2_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F767%252F242ed89f6e1741ea84603e949aa7ec78%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/767/242ed89f6e1741ea84603e949aa7ec78/images/large/1.jpg saved to cache
2026-03-26 18:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 01a4ece3-ff83-5a3a-8c0a-95f1396650c2
2026-03-26 18:35:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 01a4ece3-ff83-5a3a-8c0a-95f1396650c2, skipping ID generation
2026-03-26 18:35:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01a4ece3-ff83-5a3a-8c0a-95f1396650c2 with scrape type 1
2026-03-26 18:35:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 01a4ece3-ff83-5a3a-8c0a-95f1396650c2 sending to next pipeline
2026-03-26 18:35:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 01a4ece3-ff83-5a3a-8c0a-95f1396650c2, identifier: 1985996
2026-03-26 18:35:06 [scrapy.extensions.logstats] INFO: Crawled 8 pages (at 2 pages/min), scraped 451 items (at 100 items/min)
2026-03-26 18:35:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 177MiB
2026-03-26 18:35:06 [ayvens.es] INFO: Found listing with ID: 1986005
2026-03-26 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986005%27 HTTP/1.1" 200 None
2026-03-26 18:35:06 [ayvens.es] INFO: Scrape type for 1986005: 1
2026-03-26 18:35:06 [ayvens.es] INFO: Extracting data for car ID: 1986005
2026-03-26 18:35:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 247d8c0a-8ddb-5ae6-b0ef-e170220c5412 with identifier: 1986005
2026-03-26 18:35:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 247d8c0a-8ddb-5ae6-b0ef-e170220c5412 with scrape type 1
2026-03-26 18:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 247d8c0a-8ddb-5ae6-b0ef-e170220c5412
2026-03-26 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F584%252Fe50fcefbac9d400d8125de763f3f5488%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/584/e50fcefbac9d400d8125de763f3f5488/images/large/1.jpg not downloaded yet
2026-03-26 18:35:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1017ee0b-a992-5018-a328-9926375a70b3 with identifier: 1985995
2026-03-26 18:35:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1017ee0b-a992-5018-a328-9926375a70b3 with identifier: 1985995
2026-03-26 18:35:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1017ee0b-a992-5018-a328-9926375a70b3 with identifier: 1985995 to the API
2026-03-26 18:35:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:35:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:35:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/482/4c94fecd597c45199efdc63f0043415c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '1017ee0b-a992-5018-a328-9926375a70b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 76114,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1017ee0b-a992-5018-a328-9926375a70b3/1017ee0b-a992-5018-a328-9926375a70b3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 496646,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/482/4c94fecd597c45199efdc63f0043415c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 (O) 2.0 D3',
 'transmission': 'manual',
 'trim': '(O) 2.0 D3',
 'vin': None,
 'year': 2020}
2026-03-26 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985995%27 HTTP/1.1" 200 None
2026-03-26 18:35:06 [ayvens.es] INFO: Saving data for 1985995: {'created_time': 1774550106.595745, 'last_price_update_time': 1774550106.595755, 'auction_closing_time': 1774612800.0}
2026-03-26 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985995') HTTP/1.1" 204 0
2026-03-26 18:35:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5ec34319-bbec-58b4-83dd-822a1185ac71 with identifier: 1985997
2026-03-26 18:35:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5ec34319-bbec-58b4-83dd-822a1185ac71 with identifier: 1985997
2026-03-26 18:35:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5ec34319-bbec-58b4-83dd-822a1185ac71 with identifier: 1985997 to the API
2026-03-26 18:35:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:35:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:35:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/691/f3527580c4b8491fbe0f9f1d34d08333/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '5ec34319-bbec-58b4-83dd-822a1185ac71',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO',
 'odometer': 34280,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ec34319-bbec-58b4-83dd-822a1185ac71/5ec34319-bbec-58b4-83dd-822a1185ac71_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 345173,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/691/f3527580c4b8491fbe0f9f1d34d08333/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT KANGOO Profesional M1-AF En. dCi 55kW (75CV) E6',
 'transmission': 'manual',
 'trim': 'Profesional M1-AF En. dCi 55kW (75CV) E6',
 'vin': None,
 'year': 2017}
2026-03-26 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985997%27 HTTP/1.1" 200 None
2026-03-26 18:35:06 [ayvens.es] INFO: Saving data for 1985997: {'created_time': 1774550106.959917, 'last_price_update_time': 1774550106.959929, 'auction_closing_time': 1774612800.0}
2026-03-26 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985997') HTTP/1.1" 204 0
2026-03-26 18:35:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 01a4ece3-ff83-5a3a-8c0a-95f1396650c2 with identifier: 1985996
2026-03-26 18:35:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 01a4ece3-ff83-5a3a-8c0a-95f1396650c2 with identifier: 1985996
2026-03-26 18:35:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 01a4ece3-ff83-5a3a-8c0a-95f1396650c2 with identifier: 1985996 to the API
2026-03-26 18:35:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:35:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:35:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/767/242ed89f6e1741ea84603e949aa7ec78/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '01a4ece3-ff83-5a3a-8c0a-95f1396650c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 64869,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01a4ece3-ff83-5a3a-8c0a-95f1396650c2/01a4ece3-ff83-5a3a-8c0a-95f1396650c2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 495367,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/767/242ed89f6e1741ea84603e949aa7ec78/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-14',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS (E) Profesional Maxi 2p 2014 dCi 90 Gen5',
 'transmission': 'manual',
 'trim': '(E) Profesional Maxi 2p 2014 dCi 90 Gen5',
 'vin': None,
 'year': 2016}
2026-03-26 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985996%27 HTTP/1.1" 200 None
2026-03-26 18:35:07 [ayvens.es] INFO: Saving data for 1985996: {'created_time': 1774550107.230222, 'last_price_update_time': 1774550107.230233, 'auction_closing_time': 1774612800.0}
2026-03-26 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985996') HTTP/1.1" 204 0
2026-03-26 18:35:07 [ayvens.es] INFO: Found listing with ID: 1986006
2026-03-26 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986006%27 HTTP/1.1" 200 None
2026-03-26 18:35:07 [ayvens.es] INFO: Scrape type for 1986006: 1
2026-03-26 18:35:07 [ayvens.es] INFO: Extracting data for car ID: 1986006
2026-03-26 18:35:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 916d34c5-301c-5fdf-988e-607779018868 with identifier: 1986006
2026-03-26 18:35:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 916d34c5-301c-5fdf-988e-607779018868 with scrape type 1
2026-03-26 18:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 916d34c5-301c-5fdf-988e-607779018868
2026-03-26 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F080%252Fafab813ac13b4cd686b58d3d61668aff%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/080/afab813ac13b4cd686b58d3d61668aff/images/large/1.jpg not downloaded yet
2026-03-26 18:35:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:35:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c83510>
2026-03-26 18:35:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:35:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:35:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:35:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fa80951-bf9e-5966-af8b-930189dcd60c/2fa80951-bf9e-5966-af8b-930189dcd60c_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F751%252Fdfa50ebe325f4cef8eb97fbf01b4a46d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/751/dfa50ebe325f4cef8eb97fbf01b4a46d/images/large/1.jpg saved to cache
2026-03-26 18:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2fa80951-bf9e-5966-af8b-930189dcd60c
2026-03-26 18:35:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2fa80951-bf9e-5966-af8b-930189dcd60c, skipping ID generation
2026-03-26 18:35:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2fa80951-bf9e-5966-af8b-930189dcd60c with scrape type 1
2026-03-26 18:35:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2fa80951-bf9e-5966-af8b-930189dcd60c sending to next pipeline
2026-03-26 18:35:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2fa80951-bf9e-5966-af8b-930189dcd60c, identifier: 1985998
2026-03-26 18:35:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:35:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a2b1124d0>
2026-03-26 18:35:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:35:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:35:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:35:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e7f6d42-ac12-57e4-94d1-47f4eef66598/1e7f6d42-ac12-57e4-94d1-47f4eef66598_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F558%252F0ca366d994f846a18fe4197166641344%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/558/0ca366d994f846a18fe4197166641344/images/large/1.jpg saved to cache
2026-03-26 18:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1e7f6d42-ac12-57e4-94d1-47f4eef66598
2026-03-26 18:35:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1e7f6d42-ac12-57e4-94d1-47f4eef66598, skipping ID generation
2026-03-26 18:35:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e7f6d42-ac12-57e4-94d1-47f4eef66598 with scrape type 1
2026-03-26 18:35:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1e7f6d42-ac12-57e4-94d1-47f4eef66598 sending to next pipeline
2026-03-26 18:35:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1e7f6d42-ac12-57e4-94d1-47f4eef66598, identifier: 1985999
2026-03-26 18:35:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/334/569b766e3b6e46dab0a0680da65a6903/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:35:07 [ayvens.es] INFO: Found listing with ID: 1986007
2026-03-26 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986007%27 HTTP/1.1" 200 None
2026-03-26 18:35:07 [ayvens.es] INFO: Scrape type for 1986007: 1
2026-03-26 18:35:07 [ayvens.es] INFO: Extracting data for car ID: 1986007
2026-03-26 18:35:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef5d584d-074d-594d-9be9-32af1cffcb34 with identifier: 1986007
2026-03-26 18:35:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef5d584d-074d-594d-9be9-32af1cffcb34 with scrape type 1
2026-03-26 18:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ef5d584d-074d-594d-9be9-32af1cffcb34
2026-03-26 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F857%252Fd65ccff382c64c859f4952a5deac62db%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/857/d65ccff382c64c859f4952a5deac62db/images/large/1.jpg not downloaded yet
2026-03-26 18:35:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2fa80951-bf9e-5966-af8b-930189dcd60c with identifier: 1985998
2026-03-26 18:35:07 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:35:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2fa80951-bf9e-5966-af8b-930189dcd60c with identifier: 1985998
2026-03-26 18:35:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 2fa80951-bf9e-5966-af8b-930189dcd60c with identifier: 1985998 to the API
2026-03-26 18:35:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:35:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:35:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/751/dfa50ebe325f4cef8eb97fbf01b4a46d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 227,
 'color': 'Classic blanco s',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '2.4L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '2fa80951-bf9e-5966-af8b-930189dcd60c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'HILUX',
 'odometer': 134872,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fa80951-bf9e-5966-af8b-930189dcd60c/2fa80951-bf9e-5966-af8b-930189dcd60c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 317800,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/751/dfa50ebe325f4cef8eb97fbf01b4a46d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-22',
 'seats_number': 2,
 'seller_name': None,
 'title': 'TOYOTA HILUX 2.4 D-4D Cabina Sencilla GX',
 'transmission': 'manual',
 'trim': '2.4 D-4D Cabina Sencilla GX',
 'vin': None,
 'year': 2021}
2026-03-26 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985998%27 HTTP/1.1" 200 None
2026-03-26 18:35:07 [ayvens.es] INFO: Saving data for 1985998: {'created_time': 1774550107.973884, 'last_price_update_time': 1774550107.973894, 'auction_closing_time': 1774612800.0}
2026-03-26 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985998') HTTP/1.1" 204 0
2026-03-26 18:35:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1e7f6d42-ac12-57e4-94d1-47f4eef66598 with identifier: 1985999
2026-03-26 18:35:07 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:35:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1e7f6d42-ac12-57e4-94d1-47f4eef66598 with identifier: 1985999
2026-03-26 18:35:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1e7f6d42-ac12-57e4-94d1-47f4eef66598 with identifier: 1985999 to the API
2026-03-26 18:35:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:35:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:35:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/558/0ca366d994f846a18fe4197166641344/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'Gris plata',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '1e7f6d42-ac12-57e4-94d1-47f4eef66598',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT',
 'odometer': 90948,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e7f6d42-ac12-57e4-94d1-47f4eef66598/1e7f6d42-ac12-57e4-94d1-47f4eef66598_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 377066,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/558/0ca366d994f846a18fe4197166641344/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT Executive 2.0 TDI 110kW (150CV) DSG',
 'transmission': 'manual',
 'trim': 'Executive 2.0 TDI 110kW (150CV) DSG',
 'vin': None,
 'year': 2021}
2026-03-26 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271985999%27 HTTP/1.1" 200 None
2026-03-26 18:35:08 [ayvens.es] INFO: Saving data for 1985999: {'created_time': 1774550108.25843, 'last_price_update_time': 1774550108.258441, 'auction_closing_time': 1774612800.0}
2026-03-26 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1985999') HTTP/1.1" 204 0
2026-03-26 18:35:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/667/8a0ab9328f32444e8c352d3bad0810ae/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:35:08 [ayvens.es] INFO: Found listing with ID: 1986008
2026-03-26 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986008%27 HTTP/1.1" 200 None
2026-03-26 18:35:08 [ayvens.es] INFO: Scrape type for 1986008: 1
2026-03-26 18:35:08 [ayvens.es] INFO: Extracting data for car ID: 1986008
2026-03-26 18:35:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 865ca659-f084-578e-a65a-cc21fc786178 with identifier: 1986008
2026-03-26 18:35:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 865ca659-f084-578e-a65a-cc21fc786178 with scrape type 1
2026-03-26 18:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 865ca659-f084-578e-a65a-cc21fc786178
2026-03-26 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F619%252F19c111b536eb4747b3291874fe1e6db5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/619/19c111b536eb4747b3291874fe1e6db5/images/large/1.jpg not downloaded yet
2026-03-26 18:35:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/302/f5f81d6b8b43475b8c5a1a394c8fea02/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:35:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:35:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28ce3ad0>
2026-03-26 18:35:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:35:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:35:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:35:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4feaf296-8629-5274-931b-afe144cc432b/4feaf296-8629-5274-931b-afe144cc432b_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F334%252F569b766e3b6e46dab0a0680da65a6903%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/334/569b766e3b6e46dab0a0680da65a6903/images/large/1.jpg saved to cache
2026-03-26 18:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4feaf296-8629-5274-931b-afe144cc432b
2026-03-26 18:35:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4feaf296-8629-5274-931b-afe144cc432b, skipping ID generation
2026-03-26 18:35:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4feaf296-8629-5274-931b-afe144cc432b with scrape type 1
2026-03-26 18:35:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4feaf296-8629-5274-931b-afe144cc432b sending to next pipeline
2026-03-26 18:35:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4feaf296-8629-5274-931b-afe144cc432b, identifier: 1986000
2026-03-26 18:35:08 [ayvens.es] INFO: Found listing with ID: 1986009
2026-03-26 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986009%27 HTTP/1.1" 200 None
2026-03-26 18:35:08 [ayvens.es] INFO: Scrape type for 1986009: 1
2026-03-26 18:35:08 [ayvens.es] INFO: Extracting data for car ID: 1986009
2026-03-26 18:35:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf4a0179-eb29-5fa4-9b48-6be09a23b1e8 with identifier: 1986009
2026-03-26 18:35:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf4a0179-eb29-5fa4-9b48-6be09a23b1e8 with scrape type 1
2026-03-26 18:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item bf4a0179-eb29-5fa4-9b48-6be09a23b1e8
2026-03-26 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F746%252F786aeee2027447038a9241e5c8a3bbba%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/746/786aeee2027447038a9241e5c8a3bbba/images/large/1.jpg not downloaded yet
2026-03-26 18:35:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4feaf296-8629-5274-931b-afe144cc432b with identifier: 1986000
2026-03-26 18:35:08 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:35:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4feaf296-8629-5274-931b-afe144cc432b with identifier: 1986000
2026-03-26 18:35:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 4feaf296-8629-5274-931b-afe144cc432b with identifier: 1986000 to the API
2026-03-26 18:35:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:35:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:35:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/334/569b766e3b6e46dab0a0680da65a6903/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'color': 'Blanco classic',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '4feaf296-8629-5274-931b-afe144cc432b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'YARIS',
 'odometer': 121884,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4feaf296-8629-5274-931b-afe144cc432b/4feaf296-8629-5274-931b-afe144cc432b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 521951,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/334/569b766e3b6e46dab0a0680da65a6903/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA YARIS 1.5 125 S-Edition',
 'transmission': 'manual',
 'trim': '1.5 125 S-Edition',
 'vin': None,
 'year': 2022}
2026-03-26 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986000%27 HTTP/1.1" 200 None
2026-03-26 18:35:08 [ayvens.es] INFO: Saving data for 1986000: {'created_time': 1774550108.870228, 'last_price_update_time': 1774550108.870238, 'auction_closing_time': 1774612800.0}
2026-03-26 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986000') HTTP/1.1" 204 0
2026-03-26 18:35:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/646/04bcd45c52c64e169fcf888bf6fc4f18/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:35:08 [ayvens.es] INFO: Found listing with ID: 1986010
2026-03-26 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986010%27 HTTP/1.1" 200 None
2026-03-26 18:35:08 [ayvens.es] INFO: Scrape type for 1986010: 1
2026-03-26 18:35:08 [ayvens.es] INFO: Extracting data for car ID: 1986010
2026-03-26 18:35:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 498b659f-5233-54b5-9aab-0c00c61da854 with identifier: 1986010
2026-03-26 18:35:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 498b659f-5233-54b5-9aab-0c00c61da854 with scrape type 1
2026-03-26 18:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 498b659f-5233-54b5-9aab-0c00c61da854
2026-03-26 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F774%252F44c9e9619b51483abcdb5b412f70e4f3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/774/44c9e9619b51483abcdb5b412f70e4f3/images/large/1.jpg not downloaded yet
2026-03-26 18:35:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:35:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28398bd0>
2026-03-26 18:35:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:35:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:35:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:35:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca96feed-a9b2-5da4-898f-921fbbcf8558/ca96feed-a9b2-5da4-898f-921fbbcf8558_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F667%252F8a0ab9328f32444e8c352d3bad0810ae%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/667/8a0ab9328f32444e8c352d3bad0810ae/images/large/1.jpg saved to cache
2026-03-26 18:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ca96feed-a9b2-5da4-898f-921fbbcf8558
2026-03-26 18:35:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ca96feed-a9b2-5da4-898f-921fbbcf8558, skipping ID generation
2026-03-26 18:35:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca96feed-a9b2-5da4-898f-921fbbcf8558 with scrape type 1
2026-03-26 18:35:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ca96feed-a9b2-5da4-898f-921fbbcf8558 sending to next pipeline
2026-03-26 18:35:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ca96feed-a9b2-5da4-898f-921fbbcf8558, identifier: 1986002
2026-03-26 18:35:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:35:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a29317850>
2026-03-26 18:35:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:35:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:35:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:35:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83746df7-f017-5bd5-8cba-981e0f55f2a5/83746df7-f017-5bd5-8cba-981e0f55f2a5_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F302%252Ff5f81d6b8b43475b8c5a1a394c8fea02%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/302/f5f81d6b8b43475b8c5a1a394c8fea02/images/large/1.jpg saved to cache
2026-03-26 18:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 83746df7-f017-5bd5-8cba-981e0f55f2a5
2026-03-26 18:35:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 83746df7-f017-5bd5-8cba-981e0f55f2a5, skipping ID generation
2026-03-26 18:35:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83746df7-f017-5bd5-8cba-981e0f55f2a5 with scrape type 1
2026-03-26 18:35:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 83746df7-f017-5bd5-8cba-981e0f55f2a5 sending to next pipeline
2026-03-26 18:35:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 83746df7-f017-5bd5-8cba-981e0f55f2a5, identifier: 1986001
2026-03-26 18:35:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/018/fa3a960dfc654d2380ee29a7fa7e6043/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:35:09 [ayvens.es] INFO: Found listing with ID: 1986011
2026-03-26 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986011%27 HTTP/1.1" 200 None
2026-03-26 18:35:09 [ayvens.es] INFO: Scrape type for 1986011: 1
2026-03-26 18:35:09 [ayvens.es] INFO: Extracting data for car ID: 1986011
2026-03-26 18:35:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c328de20-9fec-5b0d-9fc7-2953b2ab95f3 with identifier: 1986011
2026-03-26 18:35:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c328de20-9fec-5b0d-9fc7-2953b2ab95f3 with scrape type 1
2026-03-26 18:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c328de20-9fec-5b0d-9fc7-2953b2ab95f3
2026-03-26 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F696%252F91b3eaea6b1449e2814d8eca058fde15%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/696/91b3eaea6b1449e2814d8eca058fde15/images/large/1.jpg not downloaded yet
2026-03-26 18:35:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ca96feed-a9b2-5da4-898f-921fbbcf8558 with identifier: 1986002
2026-03-26 18:35:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ca96feed-a9b2-5da4-898f-921fbbcf8558 with identifier: 1986002
2026-03-26 18:35:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ca96feed-a9b2-5da4-898f-921fbbcf8558 with identifier: 1986002 to the API
2026-03-26 18:35:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:35:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:35:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/667/8a0ab9328f32444e8c352d3bad0810ae/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'Azul atl',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ca96feed-a9b2-5da4-898f-921fbbcf8558',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF',
 'odometer': 126971,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca96feed-a9b2-5da4-898f-921fbbcf8558/ca96feed-a9b2-5da4-898f-921fbbcf8558_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 355923,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/667/8a0ab9328f32444e8c352d3bad0810ae/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF 2.0 TDI 85kW (115CV)',
 'transmission': 'manual',
 'trim': '2.0 TDI 85kW (115CV)',
 'vin': None,
 'year': 2022}
2026-03-26 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986002%27 HTTP/1.1" 200 None
2026-03-26 18:35:09 [ayvens.es] INFO: Saving data for 1986002: {'created_time': 1774550109.514666, 'last_price_update_time': 1774550109.514676, 'auction_closing_time': 1774612800.0}
2026-03-26 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986002') HTTP/1.1" 204 0
2026-03-26 18:35:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 83746df7-f017-5bd5-8cba-981e0f55f2a5 with identifier: 1986001
2026-03-26 18:35:09 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:35:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 83746df7-f017-5bd5-8cba-981e0f55f2a5 with identifier: 1986001
2026-03-26 18:35:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 83746df7-f017-5bd5-8cba-981e0f55f2a5 with identifier: 1986001 to the API
2026-03-26 18:35:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:35:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:35:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/302/f5f81d6b8b43475b8c5a1a394c8fea02/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 166,
 'color': 'Negro onyx',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '83746df7-f017-5bd5-8cba-981e0f55f2a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 73442,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83746df7-f017-5bd5-8cba-981e0f55f2a5/83746df7-f017-5bd5-8cba-981e0f55f2a5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 443835,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/302/f5f81d6b8b43475b8c5a1a394c8fea02/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 (O) 2.0 D4 AWD Business Plus Auto',
 'transmission': 'manual',
 'trim': '(O) 2.0 D4 AWD Business Plus Auto',
 'vin': None,
 'year': 2020}
2026-03-26 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986001%27 HTTP/1.1" 200 None
2026-03-26 18:35:09 [ayvens.es] INFO: Saving data for 1986001: {'created_time': 1774550109.825598, 'last_price_update_time': 1774550109.82561, 'auction_closing_time': 1774612800.0}
2026-03-26 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986001') HTTP/1.1" 204 0
2026-03-26 18:35:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/080/afab813ac13b4cd686b58d3d61668aff/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:35:09 [ayvens.es] INFO: Found listing with ID: 1986012
2026-03-26 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986012%27 HTTP/1.1" 200 None
2026-03-26 18:35:09 [ayvens.es] INFO: Scrape type for 1986012: 1
2026-03-26 18:35:09 [ayvens.es] INFO: Extracting data for car ID: 1986012
2026-03-26 18:35:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 131d1b34-f4ea-5930-bb5e-dab78dd6ab66 with identifier: 1986012
2026-03-26 18:35:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 131d1b34-f4ea-5930-bb5e-dab78dd6ab66 with scrape type 1
2026-03-26 18:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 131d1b34-f4ea-5930-bb5e-dab78dd6ab66
2026-03-26 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F506%252F523b70627ff342a3ace3f9cfe0f4e65f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/506/523b70627ff342a3ace3f9cfe0f4e65f/images/large/1.jpg not downloaded yet
2026-03-26 18:35:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:35:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28231d90>
2026-03-26 18:35:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:35:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:35:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:35:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb0d2231-b790-554e-84b9-b2d7d0ca8738/eb0d2231-b790-554e-84b9-b2d7d0ca8738_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F646%252F04bcd45c52c64e169fcf888bf6fc4f18%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/646/04bcd45c52c64e169fcf888bf6fc4f18/images/large/1.jpg saved to cache
2026-03-26 18:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eb0d2231-b790-554e-84b9-b2d7d0ca8738
2026-03-26 18:35:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eb0d2231-b790-554e-84b9-b2d7d0ca8738, skipping ID generation
2026-03-26 18:35:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb0d2231-b790-554e-84b9-b2d7d0ca8738 with scrape type 1
2026-03-26 18:35:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eb0d2231-b790-554e-84b9-b2d7d0ca8738 sending to next pipeline
2026-03-26 18:35:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: eb0d2231-b790-554e-84b9-b2d7d0ca8738, identifier: 1986003
2026-03-26 18:35:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:35:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28ca5810>
2026-03-26 18:35:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:35:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:35:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:35:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69230fc6-af24-58d7-9d61-0d90c7533d5c/69230fc6-af24-58d7-9d61-0d90c7533d5c_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F018%252Ffa3a960dfc654d2380ee29a7fa7e6043%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/018/fa3a960dfc654d2380ee29a7fa7e6043/images/large/1.jpg saved to cache
2026-03-26 18:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 69230fc6-af24-58d7-9d61-0d90c7533d5c
2026-03-26 18:35:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 69230fc6-af24-58d7-9d61-0d90c7533d5c, skipping ID generation
2026-03-26 18:35:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69230fc6-af24-58d7-9d61-0d90c7533d5c with scrape type 1
2026-03-26 18:35:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 69230fc6-af24-58d7-9d61-0d90c7533d5c sending to next pipeline
2026-03-26 18:35:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 69230fc6-af24-58d7-9d61-0d90c7533d5c, identifier: 1986004
2026-03-26 18:35:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/584/e50fcefbac9d400d8125de763f3f5488/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:35:10 [ayvens.es] INFO: Found listing with ID: 1986013
2026-03-26 18:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986013%27 HTTP/1.1" 200 None
2026-03-26 18:35:10 [ayvens.es] INFO: Scrape type for 1986013: 1
2026-03-26 18:35:10 [ayvens.es] INFO: Extracting data for car ID: 1986013
2026-03-26 18:35:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8227e132-e51f-5aea-8dac-8f10981863bf with identifier: 1986013
2026-03-26 18:35:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8227e132-e51f-5aea-8dac-8f10981863bf with scrape type 1
2026-03-26 18:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8227e132-e51f-5aea-8dac-8f10981863bf
2026-03-26 18:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F307%252Fada1a651925f4649960727064e00ad4d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/307/ada1a651925f4649960727064e00ad4d/images/large/1.jpg not downloaded yet
2026-03-26 18:35:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: eb0d2231-b790-554e-84b9-b2d7d0ca8738 with identifier: 1986003
2026-03-26 18:35:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:35:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: eb0d2231-b790-554e-84b9-b2d7d0ca8738 with identifier: 1986003
2026-03-26 18:35:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: eb0d2231-b790-554e-84b9-b2d7d0ca8738 with identifier: 1986003 to the API
2026-03-26 18:35:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:35:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:35:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/646/04bcd45c52c64e169fcf888bf6fc4f18/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'color': 'Plata tungsteno',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'eb0d2231-b790-554e-84b9-b2d7d0ca8738',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN',
 'odometer': 152582,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb0d2231-b790-554e-84b9-b2d7d0ca8738/eb0d2231-b790-554e-84b9-b2d7d0ca8738_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 337733,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/646/04bcd45c52c64e169fcf888bf6fc4f18/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN Sport 1.5 TSI 110kW (150CV) DSG',
 'transmission': 'manual',
 'trim': 'Sport 1.5 TSI 110kW (150CV) DSG',
 'vin': None,
 'year': 2019}
2026-03-26 18:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986003%27 HTTP/1.1" 200 None
2026-03-26 18:35:10 [ayvens.es] INFO: Saving data for 1986003: {'created_time': 1774550110.614756, 'last_price_update_time': 1774550110.61477, 'auction_closing_time': 1774612800.0}
2026-03-26 18:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986003') HTTP/1.1" 204 0
2026-03-26 18:35:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 69230fc6-af24-58d7-9d61-0d90c7533d5c with identifier: 1986004
2026-03-26 18:35:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 69230fc6-af24-58d7-9d61-0d90c7533d5c with identifier: 1986004
2026-03-26 18:35:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 69230fc6-af24-58d7-9d61-0d90c7533d5c with identifier: 1986004 to the API
2026-03-26 18:35:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:35:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:35:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/018/fa3a960dfc654d2380ee29a7fa7e6043/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'Blanco nevada',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '69230fc6-af24-58d7-9d61-0d90c7533d5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'IBIZA',
 'odometer': 83216,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69230fc6-af24-58d7-9d61-0d90c7533d5c/69230fc6-af24-58d7-9d61-0d90c7533d5c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 498913,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/018/fa3a960dfc654d2380ee29a7fa7e6043/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT IBIZA 1.0 EcoTSI 70kW (95CV) Style Plus',
 'transmission': 'manual',
 'trim': '1.0 EcoTSI 70kW (95CV) Style Plus',
 'vin': None,
 'year': 2019}
2026-03-26 18:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986004%27 HTTP/1.1" 200 None
2026-03-26 18:35:10 [ayvens.es] INFO: Saving data for 1986004: {'created_time': 1774550110.90797, 'last_price_update_time': 1774550110.90798, 'auction_closing_time': 1774612800.0}
2026-03-26 18:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986004') HTTP/1.1" 204 0
2026-03-26 18:35:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/619/19c111b536eb4747b3291874fe1e6db5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:35:10 [ayvens.es] INFO: Found listing with ID: 1986014
2026-03-26 18:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986014%27 HTTP/1.1" 200 None
2026-03-26 18:35:10 [ayvens.es] INFO: Scrape type for 1986014: 1
2026-03-26 18:35:10 [ayvens.es] INFO: Extracting data for car ID: 1986014
2026-03-26 18:35:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c252e51-4d11-53f8-b391-be4717442b30 with identifier: 1986014
2026-03-26 18:35:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c252e51-4d11-53f8-b391-be4717442b30 with scrape type 1
2026-03-26 18:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4c252e51-4d11-53f8-b391-be4717442b30
2026-03-26 18:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F856%252F934681e9fff34f91b1c187ca67f2b07c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/856/934681e9fff34f91b1c187ca67f2b07c/images/large/1.jpg not downloaded yet
2026-03-26 18:35:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:35:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28d3e390>
2026-03-26 18:35:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:35:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:35:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:35:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_916d34c5-301c-5fdf-988e-607779018868/916d34c5-301c-5fdf-988e-607779018868_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F080%252Fafab813ac13b4cd686b58d3d61668aff%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/080/afab813ac13b4cd686b58d3d61668aff/images/large/1.jpg saved to cache
2026-03-26 18:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 916d34c5-301c-5fdf-988e-607779018868
2026-03-26 18:35:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 916d34c5-301c-5fdf-988e-607779018868, skipping ID generation
2026-03-26 18:35:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 916d34c5-301c-5fdf-988e-607779018868 with scrape type 1
2026-03-26 18:35:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 916d34c5-301c-5fdf-988e-607779018868 sending to next pipeline
2026-03-26 18:35:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 916d34c5-301c-5fdf-988e-607779018868, identifier: 1986006
2026-03-26 18:35:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:35:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a29037d10>
2026-03-26 18:35:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:35:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:35:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:35:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_247d8c0a-8ddb-5ae6-b0ef-e170220c5412/247d8c0a-8ddb-5ae6-b0ef-e170220c5412_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F584%252Fe50fcefbac9d400d8125de763f3f5488%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/584/e50fcefbac9d400d8125de763f3f5488/images/large/1.jpg saved to cache
2026-03-26 18:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 247d8c0a-8ddb-5ae6-b0ef-e170220c5412
2026-03-26 18:35:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 247d8c0a-8ddb-5ae6-b0ef-e170220c5412, skipping ID generation
2026-03-26 18:35:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 247d8c0a-8ddb-5ae6-b0ef-e170220c5412 with scrape type 1
2026-03-26 18:35:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 247d8c0a-8ddb-5ae6-b0ef-e170220c5412 sending to next pipeline
2026-03-26 18:35:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 247d8c0a-8ddb-5ae6-b0ef-e170220c5412, identifier: 1986005
2026-03-26 18:35:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/857/d65ccff382c64c859f4952a5deac62db/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:35:11 [ayvens.es] INFO: Found listing with ID: 1986015
2026-03-26 18:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986015%27 HTTP/1.1" 200 None
2026-03-26 18:35:11 [ayvens.es] INFO: Scrape type for 1986015: 1
2026-03-26 18:35:11 [ayvens.es] INFO: Extracting data for car ID: 1986015
2026-03-26 18:35:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0677fc3-f8bd-5e3a-af77-9c2023cfb108 with identifier: 1986015
2026-03-26 18:35:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0677fc3-f8bd-5e3a-af77-9c2023cfb108 with scrape type 1
2026-03-26 18:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e0677fc3-f8bd-5e3a-af77-9c2023cfb108
2026-03-26 18:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F341%252F8fdb6786a31b4b4d936fad2844c21718%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/341/8fdb6786a31b4b4d936fad2844c21718/images/large/1.jpg not downloaded yet
2026-03-26 18:35:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 916d34c5-301c-5fdf-988e-607779018868 with identifier: 1986006
2026-03-26 18:35:11 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:35:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 916d34c5-301c-5fdf-988e-607779018868 with identifier: 1986006
2026-03-26 18:35:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 916d34c5-301c-5fdf-988e-607779018868 with identifier: 1986006 to the API
2026-03-26 18:35:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:35:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:35:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/080/afab813ac13b4cd686b58d3d61668aff/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 236,
 'color': 'Verde',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.3L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '916d34c5-301c-5fdf-988e-607779018868',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MASTER',
 'odometer': 136849,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_916d34c5-301c-5fdf-988e-607779018868/916d34c5-301c-5fdf-988e-607779018868_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324558,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/080/afab813ac13b4cd686b58d3d61668aff/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-16',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT MASTER Furgon T L2H2 3500 Bl dCi 100kW (135CV)',
 'transmission': 'manual',
 'trim': 'Furgon T L2H2 3500 Bl dCi 100kW (135CV)',
 'vin': None,
 'year': 2021}
2026-03-26 18:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986006%27 HTTP/1.1" 200 None
2026-03-26 18:35:11 [ayvens.es] INFO: Saving data for 1986006: {'created_time': 1774550111.597589, 'last_price_update_time': 1774550111.597599, 'auction_closing_time': 1774612800.0}
2026-03-26 18:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986006') HTTP/1.1" 204 0
2026-03-26 18:35:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 247d8c0a-8ddb-5ae6-b0ef-e170220c5412 with identifier: 1986005
2026-03-26 18:35:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 247d8c0a-8ddb-5ae6-b0ef-e170220c5412 with identifier: 1986005
2026-03-26 18:35:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 247d8c0a-8ddb-5ae6-b0ef-e170220c5412 with identifier: 1986005 to the API
2026-03-26 18:35:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:35:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:35:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/584/e50fcefbac9d400d8125de763f3f5488/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'color': 'Blanco suave',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '247d8c0a-8ddb-5ae6-b0ef-e170220c5412',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 89216,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_247d8c0a-8ddb-5ae6-b0ef-e170220c5412/247d8c0a-8ddb-5ae6-b0ef-e170220c5412_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 468312,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/584/e50fcefbac9d400d8125de763f3f5488/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON 2.0 TDI 85kW S&S Style Go',
 'transmission': 'manual',
 'trim': '2.0 TDI 85kW S&S Style Go',
 'vin': None,
 'year': 2021}
2026-03-26 18:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986005%27 HTTP/1.1" 200 None
2026-03-26 18:35:11 [ayvens.es] INFO: Saving data for 1986005: {'created_time': 1774550111.876189, 'last_price_update_time': 1774550111.8762, 'auction_closing_time': 1774612800.0}
2026-03-26 18:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986005') HTTP/1.1" 204 0
2026-03-26 18:35:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/746/786aeee2027447038a9241e5c8a3bbba/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:35:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/774/44c9e9619b51483abcdb5b412f70e4f3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:35:11 [ayvens.es] INFO: Found listing with ID: 1986016
2026-03-26 18:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986016%27 HTTP/1.1" 200 None
2026-03-26 18:35:11 [ayvens.es] INFO: Scrape type for 1986016: 1
2026-03-26 18:35:11 [ayvens.es] INFO: Extracting data for car ID: 1986016
2026-03-26 18:35:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e489edc9-70be-534f-aba4-6e2f2b111668 with identifier: 1986016
2026-03-26 18:35:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e489edc9-70be-534f-aba4-6e2f2b111668 with scrape type 1
2026-03-26 18:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e489edc9-70be-534f-aba4-6e2f2b111668
2026-03-26 18:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F080%252F3fae17e336d54c61af9e5d6e55abba54%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/080/3fae17e336d54c61af9e5d6e55abba54/images/large/1.jpg not downloaded yet
2026-03-26 18:35:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:35:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c57f90>
2026-03-26 18:35:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:35:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:35:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:35:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_865ca659-f084-578e-a65a-cc21fc786178/865ca659-f084-578e-a65a-cc21fc786178_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F619%252F19c111b536eb4747b3291874fe1e6db5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/619/19c111b536eb4747b3291874fe1e6db5/images/large/1.jpg saved to cache
2026-03-26 18:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 865ca659-f084-578e-a65a-cc21fc786178
2026-03-26 18:35:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 865ca659-f084-578e-a65a-cc21fc786178, skipping ID generation
2026-03-26 18:35:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 865ca659-f084-578e-a65a-cc21fc786178 with scrape type 1
2026-03-26 18:35:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 865ca659-f084-578e-a65a-cc21fc786178 sending to next pipeline
2026-03-26 18:35:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 865ca659-f084-578e-a65a-cc21fc786178, identifier: 1986008
2026-03-26 18:35:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:35:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c57050>
2026-03-26 18:35:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:35:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:35:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:35:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef5d584d-074d-594d-9be9-32af1cffcb34/ef5d584d-074d-594d-9be9-32af1cffcb34_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F857%252Fd65ccff382c64c859f4952a5deac62db%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/857/d65ccff382c64c859f4952a5deac62db/images/large/1.jpg saved to cache
2026-03-26 18:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ef5d584d-074d-594d-9be9-32af1cffcb34
2026-03-26 18:35:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ef5d584d-074d-594d-9be9-32af1cffcb34, skipping ID generation
2026-03-26 18:35:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef5d584d-074d-594d-9be9-32af1cffcb34 with scrape type 1
2026-03-26 18:35:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ef5d584d-074d-594d-9be9-32af1cffcb34 sending to next pipeline
2026-03-26 18:35:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ef5d584d-074d-594d-9be9-32af1cffcb34, identifier: 1986007
2026-03-26 18:35:12 [ayvens.es] INFO: Found listing with ID: 1986017
2026-03-26 18:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986017%27 HTTP/1.1" 200 None
2026-03-26 18:35:12 [ayvens.es] INFO: Scrape type for 1986017: 1
2026-03-26 18:35:12 [ayvens.es] INFO: Extracting data for car ID: 1986017
2026-03-26 18:35:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21f47461-22d0-5177-bee2-9b650d61626b with identifier: 1986017
2026-03-26 18:35:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21f47461-22d0-5177-bee2-9b650d61626b with scrape type 1
2026-03-26 18:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 21f47461-22d0-5177-bee2-9b650d61626b
2026-03-26 18:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F196%252F76d91c4801634d3dbba51c93fa143611%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/196/76d91c4801634d3dbba51c93fa143611/images/large/1.jpg not downloaded yet
2026-03-26 18:35:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 865ca659-f084-578e-a65a-cc21fc786178 with identifier: 1986008
2026-03-26 18:35:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 865ca659-f084-578e-a65a-cc21fc786178 with identifier: 1986008
2026-03-26 18:35:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 865ca659-f084-578e-a65a-cc21fc786178 with identifier: 1986008 to the API
2026-03-26 18:35:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:35:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:35:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/619/19c111b536eb4747b3291874fe1e6db5/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 175,
 'color': 'Blanco banquise',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '865ca659-f084-578e-a65a-cc21fc786178',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'EXPERT',
 'odometer': 171256,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_865ca659-f084-578e-a65a-cc21fc786178/865ca659-f084-578e-a65a-cc21fc786178_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 314826,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/619/19c111b536eb4747b3291874fe1e6db5/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-30',
 'seats_number': 2,
 'seller_name': None,
 'title': 'PEUGEOT EXPERT Furgon Premium 1.5 BlueHDi 100 Standard',
 'transmission': 'manual',
 'trim': 'Furgon Premium 1.5 BlueHDi 100 Standard',
 'vin': None,
 'year': 2021}
2026-03-26 18:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986008%27 HTTP/1.1" 200 None
2026-03-26 18:35:12 [ayvens.es] INFO: Saving data for 1986008: {'created_time': 1774550112.51037, 'last_price_update_time': 1774550112.51038, 'auction_closing_time': 1774612800.0}
2026-03-26 18:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986008') HTTP/1.1" 204 0
2026-03-26 18:35:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ef5d584d-074d-594d-9be9-32af1cffcb34 with identifier: 1986007
2026-03-26 18:35:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ef5d584d-074d-594d-9be9-32af1cffcb34 with identifier: 1986007
2026-03-26 18:35:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ef5d584d-074d-594d-9be9-32af1cffcb34 with identifier: 1986007 to the API
2026-03-26 18:35:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:35:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:35:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/857/d65ccff382c64c859f4952a5deac62db/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.6L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ef5d584d-074d-594d-9be9-32af1cffcb34',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'PARTNER',
 'odometer': 148620,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef5d584d-074d-594d-9be9-32af1cffcb34/ef5d584d-074d-594d-9be9-32af1cffcb34_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 482210,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/857/d65ccff382c64c859f4952a5deac62db/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-13',
 'seats_number': 2,
 'seller_name': None,
 'title': 'PEUGEOT PARTNER Furgon Confort L1 1.6 BlueHDi 55KW (75)',
 'transmission': 'manual',
 'trim': 'Furgon Confort L1 1.6 BlueHDi 55KW (75)',
 'vin': None,
 'year': 2017}
2026-03-26 18:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986007%27 HTTP/1.1" 200 None
2026-03-26 18:35:12 [ayvens.es] INFO: Saving data for 1986007: {'created_time': 1774550112.863526, 'last_price_update_time': 1774550112.863538, 'auction_closing_time': 1774612800.0}
2026-03-26 18:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986007') HTTP/1.1" 204 0
2026-03-26 18:35:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/696/91b3eaea6b1449e2814d8eca058fde15/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:35:12 [ayvens.es] INFO: Found listing with ID: 1986018
2026-03-26 18:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986018%27 HTTP/1.1" 200 None
2026-03-26 18:35:12 [ayvens.es] INFO: Scrape type for 1986018: 1
2026-03-26 18:35:12 [ayvens.es] INFO: Extracting data for car ID: 1986018
2026-03-26 18:35:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 719702a5-355a-52f8-a0d9-282c76ffa55b with identifier: 1986018
2026-03-26 18:35:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 719702a5-355a-52f8-a0d9-282c76ffa55b with scrape type 1
2026-03-26 18:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 719702a5-355a-52f8-a0d9-282c76ffa55b
2026-03-26 18:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F933%252F7abf2290a6414ae886f00aed96ed99e5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/933/7abf2290a6414ae886f00aed96ed99e5/images/large/1.jpg not downloaded yet
2026-03-26 18:35:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:35:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28af65d0>
2026-03-26 18:35:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:35:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:35:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:35:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf4a0179-eb29-5fa4-9b48-6be09a23b1e8/bf4a0179-eb29-5fa4-9b48-6be09a23b1e8_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F746%252F786aeee2027447038a9241e5c8a3bbba%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/746/786aeee2027447038a9241e5c8a3bbba/images/large/1.jpg saved to cache
2026-03-26 18:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bf4a0179-eb29-5fa4-9b48-6be09a23b1e8
2026-03-26 18:35:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bf4a0179-eb29-5fa4-9b48-6be09a23b1e8, skipping ID generation
2026-03-26 18:35:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf4a0179-eb29-5fa4-9b48-6be09a23b1e8 with scrape type 1
2026-03-26 18:35:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bf4a0179-eb29-5fa4-9b48-6be09a23b1e8 sending to next pipeline
2026-03-26 18:35:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: bf4a0179-eb29-5fa4-9b48-6be09a23b1e8, identifier: 1986009
2026-03-26 18:35:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:35:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a292f5910>
2026-03-26 18:35:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:35:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:35:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:35:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_498b659f-5233-54b5-9aab-0c00c61da854/498b659f-5233-54b5-9aab-0c00c61da854_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F774%252F44c9e9619b51483abcdb5b412f70e4f3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/774/44c9e9619b51483abcdb5b412f70e4f3/images/large/1.jpg saved to cache
2026-03-26 18:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 498b659f-5233-54b5-9aab-0c00c61da854
2026-03-26 18:35:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 498b659f-5233-54b5-9aab-0c00c61da854, skipping ID generation
2026-03-26 18:35:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 498b659f-5233-54b5-9aab-0c00c61da854 with scrape type 1
2026-03-26 18:35:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 498b659f-5233-54b5-9aab-0c00c61da854 sending to next pipeline
2026-03-26 18:35:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 498b659f-5233-54b5-9aab-0c00c61da854, identifier: 1986010
2026-03-26 18:35:13 [ayvens.es] INFO: Found listing with ID: 1986019
2026-03-26 18:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986019%27 HTTP/1.1" 200 None
2026-03-26 18:35:13 [ayvens.es] INFO: Scrape type for 1986019: 1
2026-03-26 18:35:13 [ayvens.es] INFO: Extracting data for car ID: 1986019
2026-03-26 18:35:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35a70f4f-ab23-5857-b133-d5aa3c2565b3 with identifier: 1986019
2026-03-26 18:35:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35a70f4f-ab23-5857-b133-d5aa3c2565b3 with scrape type 1
2026-03-26 18:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 35a70f4f-ab23-5857-b133-d5aa3c2565b3
2026-03-26 18:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F257%252Fe24f4f6bb2af441484554328494ce03f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/257/e24f4f6bb2af441484554328494ce03f/images/large/1.jpg not downloaded yet
2026-03-26 18:35:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: bf4a0179-eb29-5fa4-9b48-6be09a23b1e8 with identifier: 1986009
2026-03-26 18:35:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: bf4a0179-eb29-5fa4-9b48-6be09a23b1e8 with identifier: 1986009
2026-03-26 18:35:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: bf4a0179-eb29-5fa4-9b48-6be09a23b1e8 with identifier: 1986009 to the API
2026-03-26 18:35:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:35:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:35:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/746/786aeee2027447038a9241e5c8a3bbba/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'color': 'Candy blanco s',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'bf4a0179-eb29-5fa4-9b48-6be09a23b1e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CADDY',
 'odometer': 146873,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf4a0179-eb29-5fa4-9b48-6be09a23b1e8/bf4a0179-eb29-5fa4-9b48-6be09a23b1e8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 304550,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/746/786aeee2027447038a9241e5c8a3bbba/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-22',
 'seats_number': 2,
 'seller_name': None,
 'title': 'VOLKSWAGEN CADDY (E) Business 2.0 TDI 90kW (122CV) BMT 4M',
 'transmission': 'manual',
 'trim': '(E) Business 2.0 TDI 90kW (122CV) BMT 4M',
 'vin': None,
 'year': 2019}
2026-03-26 18:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986009%27 HTTP/1.1" 200 None
2026-03-26 18:35:13 [ayvens.es] INFO: Saving data for 1986009: {'created_time': 1774550113.626209, 'last_price_update_time': 1774550113.626219, 'auction_closing_time': 1774612800.0}
2026-03-26 18:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986009') HTTP/1.1" 204 0
2026-03-26 18:35:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 498b659f-5233-54b5-9aab-0c00c61da854 with identifier: 1986010
2026-03-26 18:35:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 498b659f-5233-54b5-9aab-0c00c61da854 with identifier: 1986010
2026-03-26 18:35:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 498b659f-5233-54b5-9aab-0c00c61da854 with identifier: 1986010 to the API
2026-03-26 18:35:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:35:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:35:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/774/44c9e9619b51483abcdb5b412f70e4f3/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '498b659f-5233-54b5-9aab-0c00c61da854',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'TRAFIC',
 'odometer': 213674,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_498b659f-5233-54b5-9aab-0c00c61da854/498b659f-5233-54b5-9aab-0c00c61da854_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 349262,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/774/44c9e9619b51483abcdb5b412f70e4f3/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-10',
 'seats_number': 6,
 'seller_name': None,
 'title': 'RENAULT TRAFIC Mixto N1 5/6 Energy Blue dCi 88 kW',
 'transmission': 'manual',
 'trim': 'Mixto N1 5/6 Energy Blue dCi 88 kW',
 'vin': None,
 'year': 2019}
2026-03-26 18:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986010%27 HTTP/1.1" 200 None
2026-03-26 18:35:13 [ayvens.es] INFO: Saving data for 1986010: {'created_time': 1774550113.916989, 'last_price_update_time': 1774550113.917002, 'auction_closing_time': 1774612800.0}
2026-03-26 18:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986010') HTTP/1.1" 204 0
2026-03-26 18:35:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/506/523b70627ff342a3ace3f9cfe0f4e65f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:35:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:35:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c20110>
2026-03-26 18:35:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:35:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:35:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:35:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c328de20-9fec-5b0d-9fc7-2953b2ab95f3/c328de20-9fec-5b0d-9fc7-2953b2ab95f3_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F696%252F91b3eaea6b1449e2814d8eca058fde15%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/696/91b3eaea6b1449e2814d8eca058fde15/images/large/1.jpg saved to cache
2026-03-26 18:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c328de20-9fec-5b0d-9fc7-2953b2ab95f3
2026-03-26 18:35:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c328de20-9fec-5b0d-9fc7-2953b2ab95f3, skipping ID generation
2026-03-26 18:35:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c328de20-9fec-5b0d-9fc7-2953b2ab95f3 with scrape type 1
2026-03-26 18:35:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c328de20-9fec-5b0d-9fc7-2953b2ab95f3 sending to next pipeline
2026-03-26 18:35:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c328de20-9fec-5b0d-9fc7-2953b2ab95f3, identifier: 1986011
2026-03-26 18:35:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/307/ada1a651925f4649960727064e00ad4d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:35:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/856/934681e9fff34f91b1c187ca67f2b07c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:35:14 [ayvens.es] INFO: Found listing with ID: 1986020
2026-03-26 18:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986020%27 HTTP/1.1" 200 None
2026-03-26 18:35:14 [ayvens.es] INFO: Scrape type for 1986020: 1
2026-03-26 18:35:14 [ayvens.es] INFO: Extracting data for car ID: 1986020
2026-03-26 18:35:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88ad7d6b-88b5-5d1d-b64a-b7509438001d with identifier: 1986020
2026-03-26 18:35:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88ad7d6b-88b5-5d1d-b64a-b7509438001d with scrape type 1
2026-03-26 18:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 88ad7d6b-88b5-5d1d-b64a-b7509438001d
2026-03-26 18:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F915%252F0b23e4db311b45b592ee10582e646755%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/915/0b23e4db311b45b592ee10582e646755/images/large/1.jpg not downloaded yet
2026-03-26 18:35:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c328de20-9fec-5b0d-9fc7-2953b2ab95f3 with identifier: 1986011
2026-03-26 18:35:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c328de20-9fec-5b0d-9fc7-2953b2ab95f3 with identifier: 1986011
2026-03-26 18:35:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c328de20-9fec-5b0d-9fc7-2953b2ab95f3 with identifier: 1986011 to the API
2026-03-26 18:35:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:35:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:35:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/696/91b3eaea6b1449e2814d8eca058fde15/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 248,
 'color': 'Blanco candy',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c328de20-9fec-5b0d-9fc7-2953b2ab95f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CRAFTER',
 'odometer': 71187,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c328de20-9fec-5b0d-9fc7-2953b2ab95f3/c328de20-9fec-5b0d-9fc7-2953b2ab95f3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 310465,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/696/91b3eaea6b1449e2814d8eca058fde15/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-27',
 'seats_number': 3,
 'seller_name': None,
 'title': 'VOLKSWAGEN CRAFTER 35 Furgon BM TN L3H2 2.0TDI 103kW(140CV)',
 'transmission': 'manual',
 'trim': '35 Furgon BM TN L3H2 2.0TDI 103kW(140CV)',
 'vin': None,
 'year': 2021}
2026-03-26 18:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986011%27 HTTP/1.1" 200 None
2026-03-26 18:35:14 [ayvens.es] INFO: Saving data for 1986011: {'created_time': 1774550114.453542, 'last_price_update_time': 1774550114.453552, 'auction_closing_time': 1774612800.0}
2026-03-26 18:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986011') HTTP/1.1" 204 0
2026-03-26 18:35:14 [ayvens.es] INFO: Found listing with ID: 1986021
2026-03-26 18:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986021%27 HTTP/1.1" 200 None
2026-03-26 18:35:14 [ayvens.es] INFO: Scrape type for 1986021: 1
2026-03-26 18:35:14 [ayvens.es] INFO: Extracting data for car ID: 1986021
2026-03-26 18:35:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56196a07-4d34-5fcf-b15c-8dfa964603f5 with identifier: 1986021
2026-03-26 18:35:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56196a07-4d34-5fcf-b15c-8dfa964603f5 with scrape type 1
2026-03-26 18:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 56196a07-4d34-5fcf-b15c-8dfa964603f5
2026-03-26 18:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F035%252F64ec8f741e854417b78d9cf3f614c177%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/035/64ec8f741e854417b78d9cf3f614c177/images/large/1.jpg not downloaded yet
2026-03-26 18:35:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:35:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28d1fdd0>
2026-03-26 18:35:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:35:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:35:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:35:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_131d1b34-f4ea-5930-bb5e-dab78dd6ab66/131d1b34-f4ea-5930-bb5e-dab78dd6ab66_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F506%252F523b70627ff342a3ace3f9cfe0f4e65f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/506/523b70627ff342a3ace3f9cfe0f4e65f/images/large/1.jpg saved to cache
2026-03-26 18:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 131d1b34-f4ea-5930-bb5e-dab78dd6ab66
2026-03-26 18:35:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 131d1b34-f4ea-5930-bb5e-dab78dd6ab66, skipping ID generation
2026-03-26 18:35:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 131d1b34-f4ea-5930-bb5e-dab78dd6ab66 with scrape type 1
2026-03-26 18:35:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 131d1b34-f4ea-5930-bb5e-dab78dd6ab66 sending to next pipeline
2026-03-26 18:35:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 131d1b34-f4ea-5930-bb5e-dab78dd6ab66, identifier: 1986012
2026-03-26 18:35:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:35:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a290704d0>
2026-03-26 18:35:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:35:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:35:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:35:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8227e132-e51f-5aea-8dac-8f10981863bf/8227e132-e51f-5aea-8dac-8f10981863bf_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F307%252Fada1a651925f4649960727064e00ad4d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/307/ada1a651925f4649960727064e00ad4d/images/large/1.jpg saved to cache
2026-03-26 18:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8227e132-e51f-5aea-8dac-8f10981863bf
2026-03-26 18:35:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8227e132-e51f-5aea-8dac-8f10981863bf, skipping ID generation
2026-03-26 18:35:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8227e132-e51f-5aea-8dac-8f10981863bf with scrape type 1
2026-03-26 18:35:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8227e132-e51f-5aea-8dac-8f10981863bf sending to next pipeline
2026-03-26 18:35:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8227e132-e51f-5aea-8dac-8f10981863bf, identifier: 1986013
2026-03-26 18:35:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:35:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28ca5250>
2026-03-26 18:35:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:35:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:35:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:35:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c252e51-4d11-53f8-b391-be4717442b30/4c252e51-4d11-53f8-b391-be4717442b30_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F856%252F934681e9fff34f91b1c187ca67f2b07c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/856/934681e9fff34f91b1c187ca67f2b07c/images/large/1.jpg saved to cache
2026-03-26 18:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4c252e51-4d11-53f8-b391-be4717442b30
2026-03-26 18:35:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4c252e51-4d11-53f8-b391-be4717442b30, skipping ID generation
2026-03-26 18:35:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c252e51-4d11-53f8-b391-be4717442b30 with scrape type 1
2026-03-26 18:35:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4c252e51-4d11-53f8-b391-be4717442b30 sending to next pipeline
2026-03-26 18:35:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4c252e51-4d11-53f8-b391-be4717442b30, identifier: 1986014
2026-03-26 18:35:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/341/8fdb6786a31b4b4d936fad2844c21718/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:35:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/080/3fae17e336d54c61af9e5d6e55abba54/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:35:15 [ayvens.es] INFO: Found listing with ID: 1986022
2026-03-26 18:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986022%27 HTTP/1.1" 200 None
2026-03-26 18:35:15 [ayvens.es] INFO: Scrape type for 1986022: 1
2026-03-26 18:35:15 [ayvens.es] INFO: Extracting data for car ID: 1986022
2026-03-26 18:35:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a28ffd9e-bb2b-5cf6-8202-b731887dd39f with identifier: 1986022
2026-03-26 18:35:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a28ffd9e-bb2b-5cf6-8202-b731887dd39f with scrape type 1
2026-03-26 18:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a28ffd9e-bb2b-5cf6-8202-b731887dd39f
2026-03-26 18:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F376%252F6d11073a0fab4fde8f97422bd1686116%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/376/6d11073a0fab4fde8f97422bd1686116/images/large/1.jpg not downloaded yet
2026-03-26 18:35:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 131d1b34-f4ea-5930-bb5e-dab78dd6ab66 with identifier: 1986012
2026-03-26 18:35:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 131d1b34-f4ea-5930-bb5e-dab78dd6ab66 with identifier: 1986012
2026-03-26 18:35:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 131d1b34-f4ea-5930-bb5e-dab78dd6ab66 with identifier: 1986012 to the API
2026-03-26 18:35:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:35:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:35:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/506/523b70627ff342a3ace3f9cfe0f4e65f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '131d1b34-f4ea-5930-bb5e-dab78dd6ab66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO',
 'odometer': 87521,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_131d1b34-f4ea-5930-bb5e-dab78dd6ab66/131d1b34-f4ea-5930-bb5e-dab78dd6ab66_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 540917,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/506/523b70627ff342a3ace3f9cfe0f4e65f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT KANGOO (O) Profes. M1-AF Blue dCi 70 kW(95 CV) -SS)',
 'transmission': 'manual',
 'trim': '(O) Profes. M1-AF Blue dCi 70 kW(95 CV) -SS)',
 'vin': None,
 'year': 2021}
2026-03-26 18:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986012%27 HTTP/1.1" 200 None
2026-03-26 18:35:15 [ayvens.es] INFO: Saving data for 1986012: {'created_time': 1774550115.46259, 'last_price_update_time': 1774550115.4626, 'auction_closing_time': 1774612800.0}
2026-03-26 18:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986012') HTTP/1.1" 204 0
2026-03-26 18:35:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8227e132-e51f-5aea-8dac-8f10981863bf with identifier: 1986013
2026-03-26 18:35:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8227e132-e51f-5aea-8dac-8f10981863bf with identifier: 1986013
2026-03-26 18:35:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8227e132-e51f-5aea-8dac-8f10981863bf with identifier: 1986013 to the API
2026-03-26 18:35:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:35:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:35:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/307/ada1a651925f4649960727064e00ad4d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 248,
 'color': 'Blanco candy',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '8227e132-e51f-5aea-8dac-8f10981863bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CRAFTER',
 'odometer': 286869,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8227e132-e51f-5aea-8dac-8f10981863bf/8227e132-e51f-5aea-8dac-8f10981863bf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332726,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/307/ada1a651925f4649960727064e00ad4d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-03',
 'seats_number': 3,
 'seller_name': None,
 'title': 'VOLKSWAGEN CRAFTER 35 Furgon BM TN L3H2 2.0TDI 103kW(140CV)',
 'transmission': 'manual',
 'trim': '35 Furgon BM TN L3H2 2.0TDI 103kW(140CV)',
 'vin': None,
 'year': 2022}
2026-03-26 18:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986013%27 HTTP/1.1" 200 None
2026-03-26 18:35:15 [ayvens.es] INFO: Saving data for 1986013: {'created_time': 1774550115.813937, 'last_price_update_time': 1774550115.813949, 'auction_closing_time': 1774612800.0}
2026-03-26 18:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986013') HTTP/1.1" 204 0
2026-03-26 18:35:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4c252e51-4d11-53f8-b391-be4717442b30 with identifier: 1986014
2026-03-26 18:35:15 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:35:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4c252e51-4d11-53f8-b391-be4717442b30 with identifier: 1986014
2026-03-26 18:35:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 4c252e51-4d11-53f8-b391-be4717442b30 with identifier: 1986014 to the API
2026-03-26 18:35:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:35:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:35:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/856/934681e9fff34f91b1c187ca67f2b07c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 170,
 'color': 'Blanco casablanca',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.6L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '4c252e51-4d11-53f8-b391-be4717442b30',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'TRAFIC',
 'odometer': 105619,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c252e51-4d11-53f8-b391-be4717442b30/4c252e51-4d11-53f8-b391-be4717442b30_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 362661,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/856/934681e9fff34f91b1c187ca67f2b07c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-09',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT TRAFIC Furgon 29 L1H1 dCi 88kW (120CV)',
 'transmission': 'manual',
 'trim': 'Furgon 29 L1H1 dCi 88kW (120CV)',
 'vin': None,
 'year': 2019}
2026-03-26 18:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986014%27 HTTP/1.1" 200 None
2026-03-26 18:35:16 [ayvens.es] INFO: Saving data for 1986014: {'created_time': 1774550116.176566, 'last_price_update_time': 1774550116.176576, 'auction_closing_time': 1774612800.0}
2026-03-26 18:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986014') HTTP/1.1" 204 0
2026-03-26 18:35:16 [ayvens.es] INFO: Found listing with ID: 1986023
2026-03-26 18:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986023%27 HTTP/1.1" 200 None
2026-03-26 18:35:16 [ayvens.es] INFO: Scrape type for 1986023: 1
2026-03-26 18:35:16 [ayvens.es] INFO: Extracting data for car ID: 1986023
2026-03-26 18:35:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1628382-338d-58f0-a760-348f8b83b0ca with identifier: 1986023
2026-03-26 18:35:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1628382-338d-58f0-a760-348f8b83b0ca with scrape type 1
2026-03-26 18:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c1628382-338d-58f0-a760-348f8b83b0ca
2026-03-26 18:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F635%252F1f941fb2e3ba4e1c876a5182cd74d868%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/635/1f941fb2e3ba4e1c876a5182cd74d868/images/large/1.jpg not downloaded yet
2026-03-26 18:35:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:35:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28f80b90>
2026-03-26 18:35:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:35:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:35:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:35:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0677fc3-f8bd-5e3a-af77-9c2023cfb108/e0677fc3-f8bd-5e3a-af77-9c2023cfb108_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F341%252F8fdb6786a31b4b4d936fad2844c21718%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/341/8fdb6786a31b4b4d936fad2844c21718/images/large/1.jpg saved to cache
2026-03-26 18:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e0677fc3-f8bd-5e3a-af77-9c2023cfb108
2026-03-26 18:35:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e0677fc3-f8bd-5e3a-af77-9c2023cfb108, skipping ID generation
2026-03-26 18:35:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0677fc3-f8bd-5e3a-af77-9c2023cfb108 with scrape type 1
2026-03-26 18:35:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e0677fc3-f8bd-5e3a-af77-9c2023cfb108 sending to next pipeline
2026-03-26 18:35:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e0677fc3-f8bd-5e3a-af77-9c2023cfb108, identifier: 1986015
2026-03-26 18:35:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:35:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28acead0>
2026-03-26 18:35:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:35:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:35:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:35:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e489edc9-70be-534f-aba4-6e2f2b111668/e489edc9-70be-534f-aba4-6e2f2b111668_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F080%252F3fae17e336d54c61af9e5d6e55abba54%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/080/3fae17e336d54c61af9e5d6e55abba54/images/large/1.jpg saved to cache
2026-03-26 18:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e489edc9-70be-534f-aba4-6e2f2b111668
2026-03-26 18:35:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e489edc9-70be-534f-aba4-6e2f2b111668, skipping ID generation
2026-03-26 18:35:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e489edc9-70be-534f-aba4-6e2f2b111668 with scrape type 1
2026-03-26 18:35:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e489edc9-70be-534f-aba4-6e2f2b111668 sending to next pipeline
2026-03-26 18:35:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e489edc9-70be-534f-aba4-6e2f2b111668, identifier: 1986016
2026-03-26 18:35:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/933/7abf2290a6414ae886f00aed96ed99e5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:35:16 [ayvens.es] INFO: Found listing with ID: 1986024
2026-03-26 18:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986024%27 HTTP/1.1" 200 None
2026-03-26 18:35:16 [ayvens.es] INFO: Scrape type for 1986024: 1
2026-03-26 18:35:16 [ayvens.es] INFO: Extracting data for car ID: 1986024
2026-03-26 18:35:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a74d0317-f8f2-57f9-957b-b3ce77155a4b with identifier: 1986024
2026-03-26 18:35:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a74d0317-f8f2-57f9-957b-b3ce77155a4b with scrape type 1
2026-03-26 18:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a74d0317-f8f2-57f9-957b-b3ce77155a4b
2026-03-26 18:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F050%252Fc7fe91599830438ca24868912029ccda%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/050/c7fe91599830438ca24868912029ccda/images/large/1.jpg not downloaded yet
2026-03-26 18:35:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e0677fc3-f8bd-5e3a-af77-9c2023cfb108 with identifier: 1986015
2026-03-26 18:35:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:35:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e0677fc3-f8bd-5e3a-af77-9c2023cfb108 with identifier: 1986015
2026-03-26 18:35:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e0677fc3-f8bd-5e3a-af77-9c2023cfb108 with identifier: 1986015 to the API
2026-03-26 18:35:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:35:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:35:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/341/8fdb6786a31b4b4d936fad2844c21718/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Amarillo correos',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e0677fc3-f8bd-5e3a-af77-9c2023cfb108',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 64991,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0677fc3-f8bd-5e3a-af77-9c2023cfb108/e0677fc3-f8bd-5e3a-af77-9c2023cfb108_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 345168,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/341/8fdb6786a31b4b4d936fad2844c21718/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-19',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS (O) Profesional Maxi 2p dCi 66 kW (90 CV',
 'transmission': 'manual',
 'trim': '(O) Profesional Maxi 2p dCi 66 kW (90 CV',
 'vin': None,
 'year': 2019}
2026-03-26 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986015%27 HTTP/1.1" 200 None
2026-03-26 18:35:17 [ayvens.es] INFO: Saving data for 1986015: {'created_time': 1774550117.02329, 'last_price_update_time': 1774550117.0233, 'auction_closing_time': 1774612800.0}
2026-03-26 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986015') HTTP/1.1" 204 0
2026-03-26 18:35:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e489edc9-70be-534f-aba4-6e2f2b111668 with identifier: 1986016
2026-03-26 18:35:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e489edc9-70be-534f-aba4-6e2f2b111668 with identifier: 1986016
2026-03-26 18:35:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e489edc9-70be-534f-aba4-6e2f2b111668 with identifier: 1986016 to the API
2026-03-26 18:35:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:35:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:35:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/080/3fae17e336d54c61af9e5d6e55abba54/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 167,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e489edc9-70be-534f-aba4-6e2f2b111668',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TRANSPORTER',
 'odometer': 52664,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e489edc9-70be-534f-aba4-6e2f2b111668/e489edc9-70be-534f-aba4-6e2f2b111668_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 339397,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/080/3fae17e336d54c61af9e5d6e55abba54/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-22',
 'seats_number': 3,
 'seller_name': None,
 'title': 'VOLKSWAGEN TRANSPORTER Furgon Corto TN 2.0 TDI 81kW (110CV)',
 'transmission': 'manual',
 'trim': 'Furgon Corto TN 2.0 TDI 81kW (110CV)',
 'vin': None,
 'year': 2020}
2026-03-26 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986016%27 HTTP/1.1" 200 None
2026-03-26 18:35:17 [ayvens.es] INFO: Saving data for 1986016: {'created_time': 1774550117.506637, 'last_price_update_time': 1774550117.506648, 'auction_closing_time': 1774612800.0}
2026-03-26 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986016') HTTP/1.1" 204 0
2026-03-26 18:35:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/196/76d91c4801634d3dbba51c93fa143611/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:35:17 [ayvens.es] INFO: Found listing with ID: 1986025
2026-03-26 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986025%27 HTTP/1.1" 200 None
2026-03-26 18:35:17 [ayvens.es] INFO: Scrape type for 1986025: 1
2026-03-26 18:35:17 [ayvens.es] INFO: Extracting data for car ID: 1986025
2026-03-26 18:35:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1674e3e3-2296-5ccc-b1b4-61ed161feb0f with identifier: 1986025
2026-03-26 18:35:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1674e3e3-2296-5ccc-b1b4-61ed161feb0f with scrape type 1
2026-03-26 18:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1674e3e3-2296-5ccc-b1b4-61ed161feb0f
2026-03-26 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F887%252Fb4039c6949964a10ad9849e2fa24de85%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/887/b4039c6949964a10ad9849e2fa24de85/images/large/1.jpg not downloaded yet
2026-03-26 18:35:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:35:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28230f90>
2026-03-26 18:35:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:35:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:35:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:35:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_719702a5-355a-52f8-a0d9-282c76ffa55b/719702a5-355a-52f8-a0d9-282c76ffa55b_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F933%252F7abf2290a6414ae886f00aed96ed99e5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/933/7abf2290a6414ae886f00aed96ed99e5/images/large/1.jpg saved to cache
2026-03-26 18:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 719702a5-355a-52f8-a0d9-282c76ffa55b
2026-03-26 18:35:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 719702a5-355a-52f8-a0d9-282c76ffa55b, skipping ID generation
2026-03-26 18:35:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 719702a5-355a-52f8-a0d9-282c76ffa55b with scrape type 1
2026-03-26 18:35:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 719702a5-355a-52f8-a0d9-282c76ffa55b sending to next pipeline
2026-03-26 18:35:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 719702a5-355a-52f8-a0d9-282c76ffa55b, identifier: 1986018
2026-03-26 18:35:17 [ayvens.es] INFO: Found listing with ID: 1986026
2026-03-26 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986026%27 HTTP/1.1" 200 None
2026-03-26 18:35:17 [ayvens.es] INFO: Scrape type for 1986026: 1
2026-03-26 18:35:17 [ayvens.es] INFO: Extracting data for car ID: 1986026
2026-03-26 18:35:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1a319ad-6f80-5055-b982-9eaf85b8e7ec with identifier: 1986026
2026-03-26 18:35:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1a319ad-6f80-5055-b982-9eaf85b8e7ec with scrape type 1
2026-03-26 18:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b1a319ad-6f80-5055-b982-9eaf85b8e7ec
2026-03-26 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F967%252Fd61a7ce815484ef8bd70a64a860da8a8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/967/d61a7ce815484ef8bd70a64a860da8a8/images/large/1.jpg not downloaded yet
2026-03-26 18:35:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 719702a5-355a-52f8-a0d9-282c76ffa55b with identifier: 1986018
2026-03-26 18:35:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 719702a5-355a-52f8-a0d9-282c76ffa55b with identifier: 1986018
2026-03-26 18:35:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 719702a5-355a-52f8-a0d9-282c76ffa55b with identifier: 1986018 to the API
2026-03-26 18:35:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:35:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:35:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/933/7abf2290a6414ae886f00aed96ed99e5/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 174,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '719702a5-355a-52f8-a0d9-282c76ffa55b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'PROACE',
 'odometer': 152857,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_719702a5-355a-52f8-a0d9-282c76ffa55b/719702a5-355a-52f8-a0d9-282c76ffa55b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 425186,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/933/7abf2290a6414ae886f00aed96ed99e5/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-19',
 'seats_number': 3,
 'seller_name': None,
 'title': 'TOYOTA PROACE 2.0D 120CV BUSINESS 1PL 2PT L1',
 'transmission': 'manual',
 'trim': '2.0D 120CV BUSINESS 1PL 2PT L1',
 'vin': None,
 'year': 2019}
2026-03-26 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986018%27 HTTP/1.1" 200 None
2026-03-26 18:35:18 [ayvens.es] INFO: Saving data for 1986018: {'created_time': 1774550118.215075, 'last_price_update_time': 1774550118.215085, 'auction_closing_time': 1774612800.0}
2026-03-26 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986018') HTTP/1.1" 204 0
2026-03-26 18:35:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/257/e24f4f6bb2af441484554328494ce03f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:35:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/915/0b23e4db311b45b592ee10582e646755/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:35:18 [ayvens.es] INFO: Found listing with ID: 1986027
2026-03-26 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986027%27 HTTP/1.1" 200 None
2026-03-26 18:35:18 [ayvens.es] INFO: Scrape type for 1986027: 1
2026-03-26 18:35:18 [ayvens.es] INFO: Extracting data for car ID: 1986027
2026-03-26 18:35:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14bf452b-fb11-5ad8-bdee-fa746259e679 with identifier: 1986027
2026-03-26 18:35:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14bf452b-fb11-5ad8-bdee-fa746259e679 with scrape type 1
2026-03-26 18:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 14bf452b-fb11-5ad8-bdee-fa746259e679
2026-03-26 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F394%252F2412d8d60d624485b33ee1fe8ac44719%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/394/2412d8d60d624485b33ee1fe8ac44719/images/large/1.jpg not downloaded yet
2026-03-26 18:35:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/035/64ec8f741e854417b78d9cf3f614c177/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:35:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:35:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28e7a790>
2026-03-26 18:35:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:35:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:35:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:35:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21f47461-22d0-5177-bee2-9b650d61626b/21f47461-22d0-5177-bee2-9b650d61626b_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F196%252F76d91c4801634d3dbba51c93fa143611%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/196/76d91c4801634d3dbba51c93fa143611/images/large/1.jpg saved to cache
2026-03-26 18:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 21f47461-22d0-5177-bee2-9b650d61626b
2026-03-26 18:35:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 21f47461-22d0-5177-bee2-9b650d61626b, skipping ID generation
2026-03-26 18:35:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21f47461-22d0-5177-bee2-9b650d61626b with scrape type 1
2026-03-26 18:35:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 21f47461-22d0-5177-bee2-9b650d61626b sending to next pipeline
2026-03-26 18:35:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 21f47461-22d0-5177-bee2-9b650d61626b, identifier: 1986017
2026-03-26 18:35:18 [ayvens.es] INFO: Found listing with ID: 1986028
2026-03-26 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986028%27 HTTP/1.1" 200 None
2026-03-26 18:35:18 [ayvens.es] INFO: Scrape type for 1986028: 1
2026-03-26 18:35:18 [ayvens.es] INFO: Extracting data for car ID: 1986028
2026-03-26 18:35:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc7e6059-d5f0-5681-b94a-08ac9c7a4a51 with identifier: 1986028
2026-03-26 18:35:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc7e6059-d5f0-5681-b94a-08ac9c7a4a51 with scrape type 1
2026-03-26 18:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item dc7e6059-d5f0-5681-b94a-08ac9c7a4a51
2026-03-26 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F044%252F1b240e563ee048a8ad0601e90bcf1313%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/044/1b240e563ee048a8ad0601e90bcf1313/images/large/1.jpg not downloaded yet
2026-03-26 18:35:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 21f47461-22d0-5177-bee2-9b650d61626b with identifier: 1986017
2026-03-26 18:35:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 21f47461-22d0-5177-bee2-9b650d61626b with identifier: 1986017
2026-03-26 18:35:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 21f47461-22d0-5177-bee2-9b650d61626b with identifier: 1986017 to the API
2026-03-26 18:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:35:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:35:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/196/76d91c4801634d3dbba51c93fa143611/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'Pintura blanco glaci',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '21f47461-22d0-5177-bee2-9b650d61626b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'EXPRESS',
 'odometer': 83697,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21f47461-22d0-5177-bee2-9b650d61626b/21f47461-22d0-5177-bee2-9b650d61626b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 539815,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/196/76d91c4801634d3dbba51c93fa143611/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-15',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT EXPRESS Confort 1.5 Blue dCi 55 kW (75 cv)',
 'transmission': 'manual',
 'trim': 'Confort 1.5 Blue dCi 55 kW (75 cv)',
 'vin': None,
 'year': 2022}
2026-03-26 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986017%27 HTTP/1.1" 200 None
2026-03-26 18:35:18 [ayvens.es] INFO: Saving data for 1986017: {'created_time': 1774550118.775917, 'last_price_update_time': 1774550118.775928, 'auction_closing_time': 1774612800.0}
2026-03-26 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986017') HTTP/1.1" 204 0
2026-03-26 18:35:18 [ayvens.es] INFO: Found listing with ID: 1986029
2026-03-26 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986029%27 HTTP/1.1" 200 None
2026-03-26 18:35:18 [ayvens.es] INFO: Scrape type for 1986029: 1
2026-03-26 18:35:18 [ayvens.es] INFO: Extracting data for car ID: 1986029
2026-03-26 18:35:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8900fe2c-744f-5eb3-b564-5dccd9a1b757 with identifier: 1986029
2026-03-26 18:35:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8900fe2c-744f-5eb3-b564-5dccd9a1b757 with scrape type 1
2026-03-26 18:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8900fe2c-744f-5eb3-b564-5dccd9a1b757
2026-03-26 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F021%252Fe26aa48cf6284e6c8e490ff3f840e1f9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-26 18:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/021/e26aa48cf6284e6c8e490ff3f840e1f9/images/large/1.jpg not downloaded yet
2026-03-26 18:35:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/376/6d11073a0fab4fde8f97422bd1686116/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:35:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:35:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a2a7f7990>
2026-03-26 18:35:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:35:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:35:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35a70f4f-ab23-5857-b133-d5aa3c2565b3/35a70f4f-ab23-5857-b133-d5aa3c2565b3_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F257%252Fe24f4f6bb2af441484554328494ce03f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/257/e24f4f6bb2af441484554328494ce03f/images/large/1.jpg saved to cache
2026-03-26 18:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 35a70f4f-ab23-5857-b133-d5aa3c2565b3
2026-03-26 18:35:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 35a70f4f-ab23-5857-b133-d5aa3c2565b3, skipping ID generation
2026-03-26 18:35:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35a70f4f-ab23-5857-b133-d5aa3c2565b3 with scrape type 1
2026-03-26 18:35:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 35a70f4f-ab23-5857-b133-d5aa3c2565b3 sending to next pipeline
2026-03-26 18:35:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 35a70f4f-ab23-5857-b133-d5aa3c2565b3, identifier: 1986019
2026-03-26 18:35:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:35:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a29071cd0>
2026-03-26 18:35:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:35:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88ad7d6b-88b5-5d1d-b64a-b7509438001d/88ad7d6b-88b5-5d1d-b64a-b7509438001d_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F915%252F0b23e4db311b45b592ee10582e646755%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/915/0b23e4db311b45b592ee10582e646755/images/large/1.jpg saved to cache
2026-03-26 18:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 88ad7d6b-88b5-5d1d-b64a-b7509438001d
2026-03-26 18:35:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 88ad7d6b-88b5-5d1d-b64a-b7509438001d, skipping ID generation
2026-03-26 18:35:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88ad7d6b-88b5-5d1d-b64a-b7509438001d with scrape type 1
2026-03-26 18:35:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 88ad7d6b-88b5-5d1d-b64a-b7509438001d sending to next pipeline
2026-03-26 18:35:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 88ad7d6b-88b5-5d1d-b64a-b7509438001d, identifier: 1986020
2026-03-26 18:35:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:35:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28cae790>
2026-03-26 18:35:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:35:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56196a07-4d34-5fcf-b15c-8dfa964603f5/56196a07-4d34-5fcf-b15c-8dfa964603f5_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F035%252F64ec8f741e854417b78d9cf3f614c177%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/035/64ec8f741e854417b78d9cf3f614c177/images/large/1.jpg saved to cache
2026-03-26 18:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 56196a07-4d34-5fcf-b15c-8dfa964603f5
2026-03-26 18:35:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 56196a07-4d34-5fcf-b15c-8dfa964603f5, skipping ID generation
2026-03-26 18:35:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56196a07-4d34-5fcf-b15c-8dfa964603f5 with scrape type 1
2026-03-26 18:35:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 56196a07-4d34-5fcf-b15c-8dfa964603f5 sending to next pipeline
2026-03-26 18:35:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 56196a07-4d34-5fcf-b15c-8dfa964603f5, identifier: 1986021
2026-03-26 18:35:19 [ayvens.es] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 500
2026-03-26 18:35:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 35a70f4f-ab23-5857-b133-d5aa3c2565b3 with identifier: 1986019
2026-03-26 18:35:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:35:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 35a70f4f-ab23-5857-b133-d5aa3c2565b3 with identifier: 1986019
2026-03-26 18:35:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 35a70f4f-ab23-5857-b133-d5aa3c2565b3 with identifier: 1986019 to the API
2026-03-26 18:35:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:35:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:35:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/257/e24f4f6bb2af441484554328494ce03f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 95,
 'color': 'Blanco con imagen',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '35a70f4f-ab23-5857-b133-d5aa3c2565b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 155266,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35a70f4f-ab23-5857-b133-d5aa3c2565b3/35a70f4f-ab23-5857-b133-d5aa3c2565b3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 533805,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/257/e24f4f6bb2af441484554328494ce03f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO (E) Business dCi 75 eco2',
 'transmission': 'manual',
 'trim': '(E) Business dCi 75 eco2',
 'vin': None,
 'year': 2014}
2026-03-26 18:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986019%27 HTTP/1.1" 200 None
2026-03-26 18:35:19 [ayvens.es] INFO: Saving data for 1986019: {'created_time': 1774550119.868241, 'last_price_update_time': 1774550119.868252, 'auction_closing_time': 1774612800.0}
2026-03-26 18:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986019') HTTP/1.1" 204 0
2026-03-26 18:35:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 88ad7d6b-88b5-5d1d-b64a-b7509438001d with identifier: 1986020
2026-03-26 18:35:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:35:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 88ad7d6b-88b5-5d1d-b64a-b7509438001d with identifier: 1986020
2026-03-26 18:35:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 88ad7d6b-88b5-5d1d-b64a-b7509438001d with identifier: 1986020 to the API
2026-03-26 18:35:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:35:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:35:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/915/0b23e4db311b45b592ee10582e646755/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'color': 'Negro profundo e',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '88ad7d6b-88b5-5d1d-b64a-b7509438001d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF',
 'odometer': 167649,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88ad7d6b-88b5-5d1d-b64a-b7509438001d/88ad7d6b-88b5-5d1d-b64a-b7509438001d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 498984,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/915/0b23e4db311b45b592ee10582e646755/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF Advance 1.6 TDI 85kW (115CV) Variant',
 'transmission': 'manual',
 'trim': 'Advance 1.6 TDI 85kW (115CV) Variant',
 'vin': None,
 'year': 2019}
2026-03-26 18:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986020%27 HTTP/1.1" 200 None
2026-03-26 18:35:20 [ayvens.es] INFO: Saving data for 1986020: {'created_time': 1774550120.846683, 'last_price_update_time': 1774550120.846695, 'auction_closing_time': 1774612800.0}
2026-03-26 18:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986020') HTTP/1.1" 204 0
2026-03-26 18:35:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 56196a07-4d34-5fcf-b15c-8dfa964603f5 with identifier: 1986021
2026-03-26 18:35:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 56196a07-4d34-5fcf-b15c-8dfa964603f5 with identifier: 1986021
2026-03-26 18:35:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 56196a07-4d34-5fcf-b15c-8dfa964603f5 with identifier: 1986021 to the API
2026-03-26 18:35:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:35:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:35:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/035/64ec8f741e854417b78d9cf3f614c177/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 179,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.4L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '56196a07-4d34-5fcf-b15c-8dfa964603f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'HILUX',
 'odometer': 81545,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56196a07-4d34-5fcf-b15c-8dfa964603f5/56196a07-4d34-5fcf-b15c-8dfa964603f5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 431840,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/035/64ec8f741e854417b78d9cf3f614c177/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA HILUX 2.4 D-4D Cabina Doble GX',
 'transmission': 'manual',
 'trim': '2.4 D-4D Cabina Doble GX',
 'vin': None,
 'year': 2021}
2026-03-26 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986021%27 HTTP/1.1" 200 None
2026-03-26 18:35:21 [ayvens.es] INFO: Saving data for 1986021: {'created_time': 1774550121.189529, 'last_price_update_time': 1774550121.189541, 'auction_closing_time': 1774612800.0}
2026-03-26 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986021') HTTP/1.1" 204 0
2026-03-26 18:35:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/635/1f941fb2e3ba4e1c876a5182cd74d868/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:35:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 18:35:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:35:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28ce30d0>
2026-03-26 18:35:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:35:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:35:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:35:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a28ffd9e-bb2b-5cf6-8202-b731887dd39f/a28ffd9e-bb2b-5cf6-8202-b731887dd39f_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F376%252F6d11073a0fab4fde8f97422bd1686116%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/376/6d11073a0fab4fde8f97422bd1686116/images/large/1.jpg saved to cache
2026-03-26 18:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a28ffd9e-bb2b-5cf6-8202-b731887dd39f
2026-03-26 18:35:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a28ffd9e-bb2b-5cf6-8202-b731887dd39f, skipping ID generation
2026-03-26 18:35:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a28ffd9e-bb2b-5cf6-8202-b731887dd39f with scrape type 1
2026-03-26 18:35:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a28ffd9e-bb2b-5cf6-8202-b731887dd39f sending to next pipeline
2026-03-26 18:35:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a28ffd9e-bb2b-5cf6-8202-b731887dd39f, identifier: 1986022
2026-03-26 18:35:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/887/b4039c6949964a10ad9849e2fa24de85/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:35:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a28ffd9e-bb2b-5cf6-8202-b731887dd39f with identifier: 1986022
2026-03-26 18:35:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:35:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a28ffd9e-bb2b-5cf6-8202-b731887dd39f with identifier: 1986022
2026-03-26 18:35:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a28ffd9e-bb2b-5cf6-8202-b731887dd39f with identifier: 1986022 to the API
2026-03-26 18:35:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:35:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:35:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/376/6d11073a0fab4fde8f97422bd1686116/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Mineral blanco opaca',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a28ffd9e-bb2b-5cf6-8202-b731887dd39f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO',
 'odometer': 119575,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a28ffd9e-bb2b-5cf6-8202-b731887dd39f/a28ffd9e-bb2b-5cf6-8202-b731887dd39f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 642393,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/376/6d11073a0fab4fde8f97422bd1686116/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT KANGOO Profesional N1 Energy dCi 55kW (75CV)',
 'transmission': 'manual',
 'trim': 'Profesional N1 Energy dCi 55kW (75CV)',
 'vin': None,
 'year': 2019}
2026-03-26 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986022%27 HTTP/1.1" 200 None
2026-03-26 18:35:21 [ayvens.es] INFO: Saving data for 1986022: {'created_time': 1774550121.780315, 'last_price_update_time': 1774550121.780325, 'auction_closing_time': 1774612800.0}
2026-03-26 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986022') HTTP/1.1" 204 0
2026-03-26 18:35:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/050/c7fe91599830438ca24868912029ccda/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:35:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/394/2412d8d60d624485b33ee1fe8ac44719/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:35:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:35:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28c5f210>
2026-03-26 18:35:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:35:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:35:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:35:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1628382-338d-58f0-a760-348f8b83b0ca/c1628382-338d-58f0-a760-348f8b83b0ca_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F635%252F1f941fb2e3ba4e1c876a5182cd74d868%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/635/1f941fb2e3ba4e1c876a5182cd74d868/images/large/1.jpg saved to cache
2026-03-26 18:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c1628382-338d-58f0-a760-348f8b83b0ca
2026-03-26 18:35:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c1628382-338d-58f0-a760-348f8b83b0ca, skipping ID generation
2026-03-26 18:35:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1628382-338d-58f0-a760-348f8b83b0ca with scrape type 1
2026-03-26 18:35:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c1628382-338d-58f0-a760-348f8b83b0ca sending to next pipeline
2026-03-26 18:35:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c1628382-338d-58f0-a760-348f8b83b0ca, identifier: 1986023
2026-03-26 18:35:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:35:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a290a6310>
2026-03-26 18:35:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:35:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:35:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:35:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1674e3e3-2296-5ccc-b1b4-61ed161feb0f/1674e3e3-2296-5ccc-b1b4-61ed161feb0f_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F887%252Fb4039c6949964a10ad9849e2fa24de85%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/887/b4039c6949964a10ad9849e2fa24de85/images/large/1.jpg saved to cache
2026-03-26 18:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1674e3e3-2296-5ccc-b1b4-61ed161feb0f
2026-03-26 18:35:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1674e3e3-2296-5ccc-b1b4-61ed161feb0f, skipping ID generation
2026-03-26 18:35:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1674e3e3-2296-5ccc-b1b4-61ed161feb0f with scrape type 1
2026-03-26 18:35:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1674e3e3-2296-5ccc-b1b4-61ed161feb0f sending to next pipeline
2026-03-26 18:35:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1674e3e3-2296-5ccc-b1b4-61ed161feb0f, identifier: 1986025
2026-03-26 18:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/044/1b240e563ee048a8ad0601e90bcf1313/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:35:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c1628382-338d-58f0-a760-348f8b83b0ca with identifier: 1986023
2026-03-26 18:35:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c1628382-338d-58f0-a760-348f8b83b0ca with identifier: 1986023
2026-03-26 18:35:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c1628382-338d-58f0-a760-348f8b83b0ca with identifier: 1986023 to the API
2026-03-26 18:35:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:35:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:35:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/635/1f941fb2e3ba4e1c876a5182cd74d868/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Amarillo correos',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c1628382-338d-58f0-a760-348f8b83b0ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 44450,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1628382-338d-58f0-a760-348f8b83b0ca/c1628382-338d-58f0-a760-348f8b83b0ca_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 597976,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/635/1f941fb2e3ba4e1c876a5182cd74d868/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-01',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS (O) Profesional Maxi 2p dCi 66 kW (90 CV',
 'transmission': 'manual',
 'trim': '(O) Profesional Maxi 2p dCi 66 kW (90 CV',
 'vin': None,
 'year': 2019}
2026-03-26 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986023%27 HTTP/1.1" 200 None
2026-03-26 18:35:22 [ayvens.es] INFO: Saving data for 1986023: {'created_time': 1774550122.402603, 'last_price_update_time': 1774550122.402612, 'auction_closing_time': 1774612800.0}
2026-03-26 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986023') HTTP/1.1" 204 0
2026-03-26 18:35:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1674e3e3-2296-5ccc-b1b4-61ed161feb0f with identifier: 1986025
2026-03-26 18:35:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1674e3e3-2296-5ccc-b1b4-61ed161feb0f with identifier: 1986025
2026-03-26 18:35:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1674e3e3-2296-5ccc-b1b4-61ed161feb0f with identifier: 1986025 to the API
2026-03-26 18:35:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:35:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:35:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/887/b4039c6949964a10ad9849e2fa24de85/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Azul',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '1674e3e3-2296-5ccc-b1b4-61ed161feb0f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ARONA',
 'odometer': 128223,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1674e3e3-2296-5ccc-b1b4-61ed161feb0f/1674e3e3-2296-5ccc-b1b4-61ed161feb0f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 372885,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/887/b4039c6949964a10ad9849e2fa24de85/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ARONA 1.6 TDI 70kW (95CV) Style Ecomotive',
 'transmission': 'manual',
 'trim': '1.6 TDI 70kW (95CV) Style Ecomotive',
 'vin': None,
 'year': 2019}
2026-03-26 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986025%27 HTTP/1.1" 200 None
2026-03-26 18:35:22 [ayvens.es] INFO: Saving data for 1986025: {'created_time': 1774550122.728281, 'last_price_update_time': 1774550122.728291, 'auction_closing_time': 1774612800.0}
2026-03-26 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986025') HTTP/1.1" 204 0
2026-03-26 18:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/967/d61a7ce815484ef8bd70a64a860da8a8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/021/e26aa48cf6284e6c8e490ff3f840e1f9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-26 18:35:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:35:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a283d3a50>
2026-03-26 18:35:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:35:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:35:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:35:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a74d0317-f8f2-57f9-957b-b3ce77155a4b/a74d0317-f8f2-57f9-957b-b3ce77155a4b_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F050%252Fc7fe91599830438ca24868912029ccda%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/050/c7fe91599830438ca24868912029ccda/images/large/1.jpg saved to cache
2026-03-26 18:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a74d0317-f8f2-57f9-957b-b3ce77155a4b
2026-03-26 18:35:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a74d0317-f8f2-57f9-957b-b3ce77155a4b, skipping ID generation
2026-03-26 18:35:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a74d0317-f8f2-57f9-957b-b3ce77155a4b with scrape type 1
2026-03-26 18:35:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a74d0317-f8f2-57f9-957b-b3ce77155a4b sending to next pipeline
2026-03-26 18:35:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a74d0317-f8f2-57f9-957b-b3ce77155a4b, identifier: 1986024
2026-03-26 18:35:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:35:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28ac4b90>
2026-03-26 18:35:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:35:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:35:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:35:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14bf452b-fb11-5ad8-bdee-fa746259e679/14bf452b-fb11-5ad8-bdee-fa746259e679_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F394%252F2412d8d60d624485b33ee1fe8ac44719%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/394/2412d8d60d624485b33ee1fe8ac44719/images/large/1.jpg saved to cache
2026-03-26 18:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 14bf452b-fb11-5ad8-bdee-fa746259e679
2026-03-26 18:35:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 14bf452b-fb11-5ad8-bdee-fa746259e679, skipping ID generation
2026-03-26 18:35:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14bf452b-fb11-5ad8-bdee-fa746259e679 with scrape type 1
2026-03-26 18:35:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 14bf452b-fb11-5ad8-bdee-fa746259e679 sending to next pipeline
2026-03-26 18:35:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 14bf452b-fb11-5ad8-bdee-fa746259e679, identifier: 1986027
2026-03-26 18:35:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:35:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28312fd0>
2026-03-26 18:35:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:35:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:35:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:35:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc7e6059-d5f0-5681-b94a-08ac9c7a4a51/dc7e6059-d5f0-5681-b94a-08ac9c7a4a51_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F044%252F1b240e563ee048a8ad0601e90bcf1313%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/044/1b240e563ee048a8ad0601e90bcf1313/images/large/1.jpg saved to cache
2026-03-26 18:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dc7e6059-d5f0-5681-b94a-08ac9c7a4a51
2026-03-26 18:35:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dc7e6059-d5f0-5681-b94a-08ac9c7a4a51, skipping ID generation
2026-03-26 18:35:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc7e6059-d5f0-5681-b94a-08ac9c7a4a51 with scrape type 1
2026-03-26 18:35:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dc7e6059-d5f0-5681-b94a-08ac9c7a4a51 sending to next pipeline
2026-03-26 18:35:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: dc7e6059-d5f0-5681-b94a-08ac9c7a4a51, identifier: 1986028
2026-03-26 18:35:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a74d0317-f8f2-57f9-957b-b3ce77155a4b with identifier: 1986024
2026-03-26 18:35:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:35:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a74d0317-f8f2-57f9-957b-b3ce77155a4b with identifier: 1986024
2026-03-26 18:35:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a74d0317-f8f2-57f9-957b-b3ce77155a4b with identifier: 1986024 to the API
2026-03-26 18:35:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:35:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:35:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/050/c7fe91599830438ca24868912029ccda/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'color': 'Blanco mineral',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a74d0317-f8f2-57f9-957b-b3ce77155a4b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO',
 'odometer': 144798,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a74d0317-f8f2-57f9-957b-b3ce77155a4b/a74d0317-f8f2-57f9-957b-b3ce77155a4b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 482526,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/050/c7fe91599830438ca24868912029ccda/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT KANGOO Life Edition One 1.5 Blue dCi 70kW(95CV)',
 'transmission': 'manual',
 'trim': 'Life Edition One 1.5 Blue dCi 70kW(95CV)',
 'vin': None,
 'year': 2022}
2026-03-26 18:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986024%27 HTTP/1.1" 200 None
2026-03-26 18:35:23 [ayvens.es] INFO: Saving data for 1986024: {'created_time': 1774550123.672562, 'last_price_update_time': 1774550123.672574, 'auction_closing_time': 1774612800.0}
2026-03-26 18:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986024') HTTP/1.1" 204 0
2026-03-26 18:35:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 14bf452b-fb11-5ad8-bdee-fa746259e679 with identifier: 1986027
2026-03-26 18:35:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 14bf452b-fb11-5ad8-bdee-fa746259e679 with identifier: 1986027
2026-03-26 18:35:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 14bf452b-fb11-5ad8-bdee-fa746259e679 with identifier: 1986027 to the API
2026-03-26 18:35:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:35:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:35:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/394/2412d8d60d624485b33ee1fe8ac44719/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '14bf452b-fb11-5ad8-bdee-fa746259e679',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MEGANE',
 'odometer': 209676,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14bf452b-fb11-5ad8-bdee-fa746259e679/14bf452b-fb11-5ad8-bdee-fa746259e679_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 370354,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/394/2412d8d60d624485b33ee1fe8ac44719/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT MEGANE (O) Intens Blue dCi 85 kW (115CV)',
 'transmission': 'manual',
 'trim': '(O) Intens Blue dCi 85 kW (115CV)',
 'vin': None,
 'year': 2021}
2026-03-26 18:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986027%27 HTTP/1.1" 200 None
2026-03-26 18:35:24 [ayvens.es] INFO: Saving data for 1986027: {'created_time': 1774550124.007705, 'last_price_update_time': 1774550124.007716, 'auction_closing_time': 1774612800.0}
2026-03-26 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986027') HTTP/1.1" 204 0
2026-03-26 18:35:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: dc7e6059-d5f0-5681-b94a-08ac9c7a4a51 with identifier: 1986028
2026-03-26 18:35:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: dc7e6059-d5f0-5681-b94a-08ac9c7a4a51 with identifier: 1986028
2026-03-26 18:35:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: dc7e6059-d5f0-5681-b94a-08ac9c7a4a51 with identifier: 1986028 to the API
2026-03-26 18:35:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:35:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:35:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/044/1b240e563ee048a8ad0601e90bcf1313/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 153,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'dc7e6059-d5f0-5681-b94a-08ac9c7a4a51',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KODIAQ',
 'odometer': 181492,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc7e6059-d5f0-5681-b94a-08ac9c7a4a51/dc7e6059-d5f0-5681-b94a-08ac9c7a4a51_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 320384,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/044/1b240e563ee048a8ad0601e90bcf1313/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA KODIAQ 2.0 TDI 110KW (150cv) DSG 4x4 Ambition',
 'transmission': 'manual',
 'trim': '2.0 TDI 110KW (150cv) DSG 4x4 Ambition',
 'vin': None,
 'year': 2021}
2026-03-26 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986028%27 HTTP/1.1" 200 None
2026-03-26 18:35:24 [ayvens.es] INFO: Saving data for 1986028: {'created_time': 1774550124.325422, 'last_price_update_time': 1774550124.325431, 'auction_closing_time': 1774612800.0}
2026-03-26 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986028') HTTP/1.1" 204 0
2026-03-26 18:35:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:35:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28ac4710>
2026-03-26 18:35:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:35:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:35:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:35:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1a319ad-6f80-5055-b982-9eaf85b8e7ec/b1a319ad-6f80-5055-b982-9eaf85b8e7ec_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F967%252Fd61a7ce815484ef8bd70a64a860da8a8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/967/d61a7ce815484ef8bd70a64a860da8a8/images/large/1.jpg saved to cache
2026-03-26 18:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b1a319ad-6f80-5055-b982-9eaf85b8e7ec
2026-03-26 18:35:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b1a319ad-6f80-5055-b982-9eaf85b8e7ec, skipping ID generation
2026-03-26 18:35:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1a319ad-6f80-5055-b982-9eaf85b8e7ec with scrape type 1
2026-03-26 18:35:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b1a319ad-6f80-5055-b982-9eaf85b8e7ec sending to next pipeline
2026-03-26 18:35:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b1a319ad-6f80-5055-b982-9eaf85b8e7ec, identifier: 1986026
2026-03-26 18:35:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 18:35:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2a28ecfb50>
2026-03-26 18:35:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 18:35:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 18:35:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 18:35:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8900fe2c-744f-5eb3-b564-5dccd9a1b757/8900fe2c-744f-5eb3-b564-5dccd9a1b757_image_0.jpg HTTP/1.1" 201 0
2026-03-26 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F021%252Fe26aa48cf6284e6c8e490ff3f840e1f9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-26 18:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/021/e26aa48cf6284e6c8e490ff3f840e1f9/images/large/1.jpg saved to cache
2026-03-26 18:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8900fe2c-744f-5eb3-b564-5dccd9a1b757
2026-03-26 18:35:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8900fe2c-744f-5eb3-b564-5dccd9a1b757, skipping ID generation
2026-03-26 18:35:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8900fe2c-744f-5eb3-b564-5dccd9a1b757 with scrape type 1
2026-03-26 18:35:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8900fe2c-744f-5eb3-b564-5dccd9a1b757 sending to next pipeline
2026-03-26 18:35:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8900fe2c-744f-5eb3-b564-5dccd9a1b757, identifier: 1986029
2026-03-26 18:35:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b1a319ad-6f80-5055-b982-9eaf85b8e7ec with identifier: 1986026
2026-03-26 18:35:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:35:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b1a319ad-6f80-5055-b982-9eaf85b8e7ec with identifier: 1986026
2026-03-26 18:35:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b1a319ad-6f80-5055-b982-9eaf85b8e7ec with identifier: 1986026 to the API
2026-03-26 18:35:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:35:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:35:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/967/d61a7ce815484ef8bd70a64a860da8a8/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'color': 'Blanco canddy',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b1a319ad-6f80-5055-b982-9eaf85b8e7ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CADDY',
 'odometer': 87510,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1a319ad-6f80-5055-b982-9eaf85b8e7ec/b1a319ad-6f80-5055-b982-9eaf85b8e7ec_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 600486,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/967/d61a7ce815484ef8bd70a64a860da8a8/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN CADDY Kombi 2.0 TDI 75kW (102CV)',
 'transmission': 'manual',
 'trim': 'Kombi 2.0 TDI 75kW (102CV)',
 'vin': None,
 'year': 2023}
2026-03-26 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986026%27 HTTP/1.1" 200 None
2026-03-26 18:35:24 [ayvens.es] INFO: Saving data for 1986026: {'created_time': 1774550124.976098, 'last_price_update_time': 1774550124.976108, 'auction_closing_time': 1774612800.0}
2026-03-26 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986026') HTTP/1.1" 204 0
2026-03-26 18:35:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8900fe2c-744f-5eb3-b564-5dccd9a1b757 with identifier: 1986029
2026-03-26 18:35:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-26 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-26 18:35:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8900fe2c-744f-5eb3-b564-5dccd9a1b757 with identifier: 1986029
2026-03-26 18:35:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8900fe2c-744f-5eb3-b564-5dccd9a1b757 with identifier: 1986029 to the API
2026-03-26 18:35:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-26 18:35:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-26 18:35:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/021/e26aa48cf6284e6c8e490ff3f840e1f9/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Pintura correos',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-27T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '8900fe2c-744f-5eb3-b564-5dccd9a1b757',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41072',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 96184,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8900fe2c-744f-5eb3-b564-5dccd9a1b757/8900fe2c-744f-5eb3-b564-5dccd9a1b757_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340361,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/021/e26aa48cf6284e6c8e490ff3f840e1f9/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-24',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS Maxi 2p Blue dCi 70 kW (95CV)',
 'transmission': 'manual',
 'trim': 'Maxi 2p Blue dCi 70 kW (95CV)',
 'vin': None,
 'year': 2020}
2026-03-26 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271986029%27 HTTP/1.1" 200 None
2026-03-26 18:35:25 [ayvens.es] INFO: Saving data for 1986029: {'created_time': 1774550125.343486, 'last_price_update_time': 1774550125.343496, 'auction_closing_time': 1774612800.0}
2026-03-26 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1986029') HTTP/1.1" 204 0
2026-03-26 18:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-26 18:35:56 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-26 18:35:56 [ayvens.es] INFO: ayvens.es Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 1, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0, <ScrapeType.BATCH_SKIPPED: 5>: 0}
2026-03-26 18:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 18:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20last_price_update_time%20lt%201774118156 HTTP/1.1" 200 None
2026-03-26 18:35:56 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (486 items) in: file:///var/lib/scrapyd/items/sourcing_v2/ayvens.es/task_38_2026-03-26T18_30_00.jl
2026-03-26 18:35:56 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 232546,
 'downloader/request_count': 489,
 'downloader/request_method_count/GET': 483,
 'downloader/request_method_count/POST': 6,
 'downloader/response_bytes': 196357848,
 'downloader/response_count': 489,
 'downloader/response_status_count/200': 489,
 'elapsed_time_seconds': 350.204826,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 26, 18, 35, 56, 300446, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 486,
 'log_count/DEBUG': 8731,
 'log_count/INFO': 9965,
 'memusage/max': 185888768,
 'memusage/startup': 147877888,
 'photo_download_count': 482,
 'playwright/context_count': 1,
 'playwright/context_count/max_concurrent': 1,
 'playwright/context_count/persistent/False': 1,
 'playwright/context_count/remote/False': 1,
 'playwright/page_count': 1,
 'playwright/page_count/max_concurrent': 1,
 'playwright/request_count': 131,
 'playwright/request_count/aborted': 15,
 'playwright/request_count/method/GET': 127,
 'playwright/request_count/method/POST': 4,
 'playwright/request_count/navigation': 2,
 'playwright/request_count/resource_type/document': 2,
 'playwright/request_count/resource_type/fetch': 1,
 'playwright/request_count/resource_type/font': 16,
 'playwright/request_count/resource_type/image': 26,
 'playwright/request_count/resource_type/script': 80,
 'playwright/request_count/resource_type/stylesheet': 1,
 'playwright/request_count/resource_type/xhr': 5,
 'playwright/response_count': 115,
 'playwright/response_count/method/GET': 112,
 'playwright/response_count/method/POST': 3,
 'playwright/response_count/resource_type/document': 2,
 'playwright/response_count/resource_type/fetch': 1,
 'playwright/response_count/resource_type/font': 16,
 'playwright/response_count/resource_type/image': 11,
 'playwright/response_count/resource_type/script': 80,
 'playwright/response_count/resource_type/stylesheet': 1,
 'playwright/response_count/resource_type/xhr': 4,
 'request_depth_max': 6,
 'response_received_count': 7,
 'scheduler/dequeued': 489,
 'scheduler/dequeued/memory': 489,
 'scheduler/enqueued': 489,
 'scheduler/enqueued/memory': 489,
 'scrape_type/new': 486,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 6,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 8.913756396776686,
 'scrapy-zyte-api/mean_response_seconds': 8.930529796906436,
 'scrapy-zyte-api/processed': 6,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 6,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 6,
 'scrapy-zyte-api/request_args/httpRequestBody': 6,
 'scrapy-zyte-api/request_args/httpRequestMethod': 6,
 'scrapy-zyte-api/request_args/httpResponseBody': 6,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 6,
 'scrapy-zyte-api/request_args/url': 6,
 'scrapy-zyte-api/status_codes/200': 6,
 'scrapy-zyte-api/success': 6,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'start_time': datetime.datetime(2026, 3, 26, 18, 30, 6, 95620, tzinfo=datetime.timezone.utc)}
2026-03-26 18:35:56 [scrapy.core.engine] INFO: Spider closed (finished)