2026-03-30 13:30:02 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-30 13:30:02 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-30 13:30:02 [ayvens.es] INFO: Starting spider ayvens.es
2026-03-30 13:30:02 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-30 13:30:02 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-30 13:30:02 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-30 13:30:02 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-30 13:30:02 [scrapy.extensions.telnet] INFO: Telnet Password: 224af7a1899244b6
2026-03-30 13:30:03 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-30 13:30:03 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/ayvens.es/task_38_2026-03-30T13_30_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-30 13:30:03 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 13:30:03 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 13:30:03 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-30 13:30:03 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-30 13:30:03 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-30 13:30:03 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-30 13:30:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 13:30:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2117
2026-03-30 13:30:03 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-30 13:30:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-30 13:30:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:03 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: en
2026-03-30 13:30:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27en%27%20and%20RowKey%20eq%20%27en%27 HTTP/1.1" 200 None
2026-03-30 13:30:03 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-30 13:30:03 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-30 13:30:03 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-30 13:30:03 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-30 13:30:03 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-30 13:30:03 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-30 13:30:03 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-30 13:30:03 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-30 13:30:03 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-30 13:30:03 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-30 13:30:03 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-30 13:30:03 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-30 13:30:03 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-30 13:30:03 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-30 13:30:03 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-30 13:30:03 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-30 13:30:03 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-30 13:30:03 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-30 13:30:03 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-30 13:30:03 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-30 13:30:03 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-30 13:30:03 [scrapy.core.engine] INFO: Spider opened
2026-03-30 13:30:03 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-30 13:30:03 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-30 13:30:03 [scrapy.extensions.memusage] INFO: Peak memory usage is 143MiB
2026-03-30 13:30:03 [scrapy-playwright] INFO: Starting download handler
2026-03-30 13:30:03 [scrapy-playwright] INFO: Starting download handler
2026-03-30 13:30:08 [scrapy-playwright] INFO: Launching browser firefox
2026-03-30 13:30:09 [scrapy-playwright] INFO: Browser firefox launched
2026-03-30 13:30:09 [scrapy-playwright] DEBUG: Browser context started: 'default' (persistent=False, remote=False)
2026-03-30 13:30:10 [scrapy-playwright] DEBUG: [Context=default] New page created, page count is 1 (1 for all contexts)
2026-03-30 13:30:10 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/lots> (resource type: document)
2026-03-30 13:30:10 [scrapy-playwright] DEBUG: [Context=default] Response: <407 https://carmarket.ayvens.com/en-gb/lots>
2026-03-30 13:30:10 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/lots> (resource type: document)
2026-03-30 13:30:11 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/lots>
2026-03-30 13:30:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Medium.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-30 13:30:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Regular.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-30 13:30:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Semibold.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-30 13:30:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Bold.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-30 13:30:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Medium.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-30 13:30:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Regular.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-30 13:30:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-SemiBold.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-30 13:30:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/styles-ETA5EMQJ.css> (resource type: stylesheet, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-30 13:30:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-30 13:30:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-30 13:30:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-30 13:30:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-R5GGQAWE.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-30 13:30:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-YI6GGZZZ.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-30 13:30:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-NAGGRITV.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-30 13:30:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-BBQ7R2BV.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-30 13:30:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HPL7GXW6.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-30 13:30:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ADG3G2OJ.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-30 13:30:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7JYRLYWD.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-30 13:30:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2S63FZXS.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-30 13:30:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-K7GQAXGO.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-30 13:30:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-PMQRMPGY.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-30 13:30:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/polyfills-FFHMD2TL.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-30 13:30:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/main-NKPAFEH2.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-30 13:30:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-30 13:30:12 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg>
2026-03-30 13:30:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-30 13:30:12 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg>
2026-03-30 13:30:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/line.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-30 13:30:12 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/line.svg>
2026-03-30 13:30:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-30 13:30:12 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg>
2026-03-30 13:30:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/loader.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-30 13:30:12 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/loader.svg>
2026-03-30 13:30:12 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Medium.woff2>
2026-03-30 13:30:12 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Regular.woff2>
2026-03-30 13:30:12 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Bold.woff2>
2026-03-30 13:30:12 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Medium.woff2>
2026-03-30 13:30:12 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Semibold.woff2>
2026-03-30 13:30:12 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/styles-ETA5EMQJ.css>
2026-03-30 13:30:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-30 13:30:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-30 13:30:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/SourceSans3-Bold-OH3V3LEB.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-30 13:30:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/SourceSans3-Regular-VMJBJIXS.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-30 13:30:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-30 13:30:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/SourceSans3-SemiBold-NPKTOIJ5.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-30 13:30:12 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2>
2026-03-30 13:30:12 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Regular.woff2>
2026-03-30 13:30:12 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-SemiBold.woff2>
2026-03-30 13:30:12 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2>
2026-03-30 13:30:12 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2>
2026-03-30 13:30:12 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-R5GGQAWE.js>
2026-03-30 13:30:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-QV3UPEBS.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-R5GGQAWE.js)
2026-03-30 13:30:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AQBI4CYB.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-R5GGQAWE.js)
2026-03-30 13:30:12 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-YI6GGZZZ.js>
2026-03-30 13:30:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EIXBRKXP.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-R5GGQAWE.js)
2026-03-30 13:30:12 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-NAGGRITV.js>
2026-03-30 13:30:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-5567JMUS.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-R5GGQAWE.js)
2026-03-30 13:30:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-4CLCTAJ7.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-YI6GGZZZ.js)
2026-03-30 13:30:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-CQOH37XC.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-NAGGRITV.js)
2026-03-30 13:30:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HQZHDCQG.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-NAGGRITV.js)
2026-03-30 13:30:12 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-BBQ7R2BV.js>
2026-03-30 13:30:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-QZ2M64VL.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-BBQ7R2BV.js)
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HPL7GXW6.js>
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ADG3G2OJ.js>
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7JYRLYWD.js>
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EVZDJ3YH.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2BYH6G4C.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2S63FZXS.js>
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AHM2LY2L.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VGUEXTON.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-SUQC6PCL.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7DYAUIPQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-6BXXUPPN.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-PMQRMPGY.js>
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-K7GQAXGO.js>
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/polyfills-FFHMD2TL.js>
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-SALCXTDR.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-K7GQAXGO.js)
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/main-NKPAFEH2.js>
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2>
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-OF6JT4KC.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-Y6LYHJ33.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ELPOVYM7.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VBU7AOHF.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-SPE4D2IX.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-N2FZW7V7.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/SourceSans3-Bold-OH3V3LEB.woff2>
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VPLHK2CL.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2>
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AVZZH6AV.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-KLKMSQPH.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2FANG3NP.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ABBXN5WQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-NPJHDJ36.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-MLMYZRAG.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-5D4JF6DX.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7IEPAGTW.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ZYL3EWWF.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-WWYAPULQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XXARMH2T.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AYT4KML6.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-CX65R3QQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XGLUMAK5.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EHSUL3RU.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7UDVUMWJ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-WRLSZEDX.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XCHSKDZH.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/SourceSans3-Regular-VMJBJIXS.woff2>
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2>
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/SourceSans3-SemiBold-NPKTOIJ5.woff2>
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-QV3UPEBS.js>
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AQBI4CYB.js>
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-4CLCTAJ7.js>
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EIXBRKXP.js>
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-CQOH37XC.js>
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-5567JMUS.js>
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HQZHDCQG.js>
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-QZ2M64VL.js>
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EVZDJ3YH.js>
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2BYH6G4C.js>
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AHM2LY2L.js>
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-SUQC6PCL.js>
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VGUEXTON.js>
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-6BXXUPPN.js>
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7DYAUIPQ.js>
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-SALCXTDR.js>
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-Y6LYHJ33.js>
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-OF6JT4KC.js>
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VBU7AOHF.js>
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ELPOVYM7.js>
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-SPE4D2IX.js>
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AVZZH6AV.js>
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-N2FZW7V7.js>
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-KLKMSQPH.js>
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VPLHK2CL.js>
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2FANG3NP.js>
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ABBXN5WQ.js>
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-NPJHDJ36.js>
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-MLMYZRAG.js>
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-5D4JF6DX.js>
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7IEPAGTW.js>
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ZYL3EWWF.js>
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-WWYAPULQ.js>
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XXARMH2T.js>
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XGLUMAK5.js>
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-CX65R3QQ.js>
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AYT4KML6.js>
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EHSUL3RU.js>
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-WRLSZEDX.js>
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7UDVUMWJ.js>
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XCHSKDZH.js>
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://js.monitor.azure.com/scripts/b/ai.config.1.cfg.json> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-U3DCL5KE.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-30 13:30:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7HVTDVUE.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-30 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens-white-bg_192x192.png> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-30 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens-white-bg_192x192.png>
2026-03-30 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-30 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens.svg>
2026-03-30 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-U3DCL5KE.js>
2026-03-30 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7HVTDVUE.js>
2026-03-30 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VPZ5PCFV.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-7HVTDVUE.js)
2026-03-30 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VPZ5PCFV.js>
2026-03-30 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-R57BLUBZ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-VPZ5PCFV.js)
2026-03-30 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://js.monitor.azure.com/scripts/b/ai.config.1.cfg.json>
2026-03-30 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-R57BLUBZ.js>
2026-03-30 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XI7MA6UU.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-30 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-253AOQV4.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-30 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-Y26P6NOT.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-VPZ5PCFV.js)
2026-03-30 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XI7MA6UU.js>
2026-03-30 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-253AOQV4.js>
2026-03-30 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-Y26P6NOT.js>
2026-03-30 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-E2QM5VHP.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-XI7MA6UU.js)
2026-03-30 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-QVU7EFJH.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-XI7MA6UU.js)
2026-03-30 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-CJQ6ZMFR.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-XI7MA6UU.js)
2026-03-30 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-PU5AH4GE.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-30 13:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-6AWK7DQQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-30 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-JMKQRIJX.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-30 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-OXIZJZO4.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-30 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-H7VMIGZK.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-30 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-QVU7EFJH.js>
2026-03-30 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-JMKQRIJX.js>
2026-03-30 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-CJQ6ZMFR.js>
2026-03-30 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-6AWK7DQQ.js>
2026-03-30 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-PU5AH4GE.js>
2026-03-30 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-OXIZJZO4.js>
2026-03-30 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-E2QM5VHP.js>
2026-03-30 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-H7VMIGZK.js>
2026-03-30 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/loader.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-30 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/loader.svg>
2026-03-30 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-30 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg>
2026-03-30 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/line.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-30 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/line.svg>
2026-03-30 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-30 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg>
2026-03-30 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-30 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg>
2026-03-30 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-30 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-BQLC5RJD.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-30 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HGLYMGTS.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-PU5AH4GE.js)
2026-03-30 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VNA57F7Z.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-253AOQV4.js)
2026-03-30 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EXKYPD3J.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-253AOQV4.js)
2026-03-30 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-BQLC5RJD.js>
2026-03-30 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-30 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/down.svg>
2026-03-30 13:30:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://carmarket.ayvens.com/en-gb/lots> (referer: None) ['playwright']
2026-03-30 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HGLYMGTS.js>
2026-03-30 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AZBPSD4I.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HGLYMGTS.js)
2026-03-30 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2NCM5KDW.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HGLYMGTS.js)
2026-03-30 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VNA57F7Z.js>
2026-03-30 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EXKYPD3J.js>
2026-03-30 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/bell.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-30 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/bell.svg>
2026-03-30 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/next-breadcrumb.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-30 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/next-breadcrumb.svg>
2026-03-30 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-30 13:30:15 [ayvens.es] INFO: Cookies from Playwright: [{'name': 'ai_user', 'value': 'BRGsgyYoTtIPVcMAgx1erH|2026-03-30T13:30:13.837Z', 'domain': 'carmarket.ayvens.com', 'path': '/', 'expires': 1806413413, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}, {'name': 'user_culture', 'value': 'en-gb', 'domain': 'carmarket.ayvens.com', 'path': '/', 'expires': -1, 'httpOnly': False, 'secure': False, 'sameSite': 'None'}, {'name': 'ai_session', 'value': 'jQgFaPXny/fJ4QIsJKvJLW|1774877415318|1774877415318', 'domain': 'carmarket.ayvens.com', 'path': '/', 'expires': 1774879215, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}]
2026-03-30 13:30:15 [ayvens.es] INFO: Scrapy-formatted cookies: [{'name': 'ai_user', 'value': 'BRGsgyYoTtIPVcMAgx1erH|2026-03-30T13:30:13.837Z', 'domain': 'carmarket.ayvens.com', 'path': '/'}, {'name': 'user_culture', 'value': 'en-gb', 'domain': 'carmarket.ayvens.com', 'path': '/'}, {'name': 'ai_session', 'value': 'jQgFaPXny/fJ4QIsJKvJLW|1774877415318|1774877415318', 'domain': 'carmarket.ayvens.com', 'path': '/'}]
2026-03-30 13:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /SpiderData(PartitionKey='Ayvens',RowKey='cookies') HTTP/1.1" 204 0
2026-03-30 13:30:15 [ayvens.es] INFO: Intercepting token...
2026-03-30 13:30:15 [ayvens.es] INFO: Scrolling element to trigger lazy load...
2026-03-30 13:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-30 13:30:15 [ayvens.es] INFO: GraphQL headers: {'host': 'api-carmarket.ayvens.com', 'user-agent': 'Mozilla/5.0 (X11; Linux x86_64; rv:125.0) Gecko/20100101 Firefox/125.0', 'accept': 'application/json, text/plain, */*', 'accept-language': 'en-US,en;q=0.5', 'accept-encoding': 'gzip, deflate, br', 'content-type': 'application/json', 'content-length': '839', 'referer': 'https://carmarket.ayvens.com/', 'x-ald-subscription-key': '3b2cc62fd26c4e29a762db3de181266b', 'x-tenant': 'ald', 'x-country': 'gb', 'origin': 'https://carmarket.ayvens.com', 'sec-fetch-dest': 'empty', 'sec-fetch-mode': 'cors', 'sec-fetch-site': 'same-site', 'proxy-authorization': 'Basic Y3VzdG9tZXItaW5maW5pdF9zb3VyY2luZ192Ml9XQjdOUi1jYy1HQjozY35+YWdLUmM2MlZaQUw=', 'connection': 'keep-alive'}
2026-03-30 13:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VUZVFPNF.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-30 13:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://api-carmarket.ayvens.com/graphql/saleevents> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-30 13:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/logo-ayvens.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-30 13:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-fr.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-30 13:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-es.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-30 13:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-be.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-30 13:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-de.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-30 13:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-it.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-30 13:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/loader.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-30 13:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2NCM5KDW.js>
2026-03-30 13:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AZBPSD4I.js>
2026-03-30 13:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-30 13:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VUZVFPNF.js>
2026-03-30 13:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/logo-ayvens.svg>
2026-03-30 13:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-FX6676C7.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-VUZVFPNF.js)
2026-03-30 13:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-30 13:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/loader.svg>
2026-03-30 13:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://dc.services.visualstudio.com/v2/track>
2026-03-30 13:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-BK6NFD4R.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-30 13:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/chevron-down.svg>
2026-03-30 13:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-fr.svg>
2026-03-30 13:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/be.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-30 13:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://dc.services.visualstudio.com/v2/track>
2026-03-30 13:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-75KGV5DF.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-OXIZJZO4.js)
2026-03-30 13:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://dc.services.visualstudio.com/v2/track>
2026-03-30 13:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-be.svg>
2026-03-30 13:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-es.svg>
2026-03-30 13:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-de.svg>
2026-03-30 13:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-it.svg>
2026-03-30 13:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/down.svg>
2026-03-30 13:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-FX6676C7.js>
2026-03-30 13:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-BK6NFD4R.js>
2026-03-30 13:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/otSDKStub.js> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-03-30 13:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/flags/be.svg>
2026-03-30 13:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-75KGV5DF.js>
2026-03-30 13:30:17 [ayvens.es] INFO: ✅ Intercepted token: 3b2cc62fd26c4e29a762db3de181266b
2026-03-30 13:30:17 [ayvens.es] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 0
2026-03-30 13:30:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 13:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/otSDKStub.js>
2026-03-30 13:30:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-30 13:30:22 [ayvens.es] INFO: Found listing with ID: 1989221
2026-03-30 13:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989221%27 HTTP/1.1" 200 None
2026-03-30 13:30:22 [ayvens.es] INFO: Scrape type for 1989221: 1
2026-03-30 13:30:22 [ayvens.es] INFO: Extracting data for car ID: 1989221
2026-03-30 13:30:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b6c73bb-e21d-5bcf-9829-323dd82fe7a2 with identifier: 1989221
2026-03-30 13:30:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b6c73bb-e21d-5bcf-9829-323dd82fe7a2 with scrape type 1
2026-03-30 13:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6b6c73bb-e21d-5bcf-9829-323dd82fe7a2
2026-03-30 13:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F963%252F41072ea3b449478aa0e62b2391ab4870%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/963/41072ea3b449478aa0e62b2391ab4870/images/large/1.jpg not downloaded yet
2026-03-30 13:30:22 [ayvens.es] INFO: Found listing with ID: 1989222
2026-03-30 13:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989222%27 HTTP/1.1" 200 None
2026-03-30 13:30:22 [ayvens.es] INFO: Scrape type for 1989222: 1
2026-03-30 13:30:22 [ayvens.es] INFO: Extracting data for car ID: 1989222
2026-03-30 13:30:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77723f21-d053-5067-bfd6-b7a65618efde with identifier: 1989222
2026-03-30 13:30:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77723f21-d053-5067-bfd6-b7a65618efde with scrape type 1
2026-03-30 13:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 77723f21-d053-5067-bfd6-b7a65618efde
2026-03-30 13:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F018%252F3abfde34c77547fbb9029a4f4dba3058%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/018/3abfde34c77547fbb9029a4f4dba3058/images/large/1.jpg not downloaded yet
2026-03-30 13:30:22 [ayvens.es] INFO: Found listing with ID: 1989223
2026-03-30 13:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989223%27 HTTP/1.1" 200 None
2026-03-30 13:30:22 [ayvens.es] INFO: Scrape type for 1989223: 1
2026-03-30 13:30:22 [ayvens.es] INFO: Extracting data for car ID: 1989223
2026-03-30 13:30:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14abf95e-e540-5458-908b-614de6b6a4e5 with identifier: 1989223
2026-03-30 13:30:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14abf95e-e540-5458-908b-614de6b6a4e5 with scrape type 1
2026-03-30 13:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 14abf95e-e540-5458-908b-614de6b6a4e5
2026-03-30 13:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F474%252F60a89dedceb04cbdb35ae809e58f84c4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/474/60a89dedceb04cbdb35ae809e58f84c4/images/large/1.jpg not downloaded yet
2026-03-30 13:30:22 [ayvens.es] INFO: Found listing with ID: 1989224
2026-03-30 13:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989224%27 HTTP/1.1" 200 None
2026-03-30 13:30:22 [ayvens.es] INFO: Scrape type for 1989224: 1
2026-03-30 13:30:22 [ayvens.es] INFO: Extracting data for car ID: 1989224
2026-03-30 13:30:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f89b665e-0f49-5f44-a882-c83afeea4ab6 with identifier: 1989224
2026-03-30 13:30:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f89b665e-0f49-5f44-a882-c83afeea4ab6 with scrape type 1
2026-03-30 13:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f89b665e-0f49-5f44-a882-c83afeea4ab6
2026-03-30 13:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F239%252F5d99deab23114f0487cd183d678c37e7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/239/5d99deab23114f0487cd183d678c37e7/images/large/1.jpg not downloaded yet
2026-03-30 13:30:22 [ayvens.es] INFO: Found listing with ID: 1989225
2026-03-30 13:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989225%27 HTTP/1.1" 200 None
2026-03-30 13:30:22 [ayvens.es] INFO: Scrape type for 1989225: 1
2026-03-30 13:30:22 [ayvens.es] INFO: Extracting data for car ID: 1989225
2026-03-30 13:30:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc97412a-2655-5927-addb-badd5491f8c3 with identifier: 1989225
2026-03-30 13:30:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc97412a-2655-5927-addb-badd5491f8c3 with scrape type 1
2026-03-30 13:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item dc97412a-2655-5927-addb-badd5491f8c3
2026-03-30 13:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F984%252F911b032d4d6845a79191c6ff82e4fa54%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/984/911b032d4d6845a79191c6ff82e4fa54/images/large/1.jpg not downloaded yet
2026-03-30 13:30:22 [ayvens.es] INFO: Found listing with ID: 1989226
2026-03-30 13:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989226%27 HTTP/1.1" 200 None
2026-03-30 13:30:22 [ayvens.es] INFO: Scrape type for 1989226: 1
2026-03-30 13:30:22 [ayvens.es] INFO: Extracting data for car ID: 1989226
2026-03-30 13:30:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8435786-b76b-5ca3-9199-55df63224846 with identifier: 1989226
2026-03-30 13:30:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8435786-b76b-5ca3-9199-55df63224846 with scrape type 1
2026-03-30 13:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d8435786-b76b-5ca3-9199-55df63224846
2026-03-30 13:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F490%252F97aef8da414c4dbba3bcabe18b919858%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/490/97aef8da414c4dbba3bcabe18b919858/images/large/1.jpg not downloaded yet
2026-03-30 13:30:22 [ayvens.es] INFO: Found listing with ID: 1989227
2026-03-30 13:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989227%27 HTTP/1.1" 200 None
2026-03-30 13:30:22 [ayvens.es] INFO: Scrape type for 1989227: 1
2026-03-30 13:30:22 [ayvens.es] INFO: Extracting data for car ID: 1989227
2026-03-30 13:30:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c647a8e-2125-5f67-b483-b4758eff4372 with identifier: 1989227
2026-03-30 13:30:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c647a8e-2125-5f67-b483-b4758eff4372 with scrape type 1
2026-03-30 13:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2c647a8e-2125-5f67-b483-b4758eff4372
2026-03-30 13:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F847%252F4df1b6f6601745b799c17c78366d066d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/847/4df1b6f6601745b799c17c78366d066d/images/large/1.jpg not downloaded yet
2026-03-30 13:30:23 [ayvens.es] INFO: Found listing with ID: 1989228
2026-03-30 13:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989228%27 HTTP/1.1" 200 None
2026-03-30 13:30:23 [ayvens.es] INFO: Scrape type for 1989228: 1
2026-03-30 13:30:23 [ayvens.es] INFO: Extracting data for car ID: 1989228
2026-03-30 13:30:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7de92083-ebbe-519f-8c2e-3f1bfeb1764f with identifier: 1989228
2026-03-30 13:30:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7de92083-ebbe-519f-8c2e-3f1bfeb1764f with scrape type 1
2026-03-30 13:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7de92083-ebbe-519f-8c2e-3f1bfeb1764f
2026-03-30 13:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F457%252Fc657780fad7d4aaebaae8b129573743d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/457/c657780fad7d4aaebaae8b129573743d/images/large/1.jpg not downloaded yet
2026-03-30 13:30:23 [ayvens.es] INFO: Found listing with ID: 1989229
2026-03-30 13:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989229%27 HTTP/1.1" 200 None
2026-03-30 13:30:23 [ayvens.es] INFO: Scrape type for 1989229: 1
2026-03-30 13:30:23 [ayvens.es] INFO: Extracting data for car ID: 1989229
2026-03-30 13:30:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5059c1e5-db96-570e-94c4-68b525c8245e with identifier: 1989229
2026-03-30 13:30:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5059c1e5-db96-570e-94c4-68b525c8245e with scrape type 1
2026-03-30 13:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5059c1e5-db96-570e-94c4-68b525c8245e
2026-03-30 13:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F571%252Fafa8ea6b265f4f6fb2b1243519353a96%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/571/afa8ea6b265f4f6fb2b1243519353a96/images/large/1.jpg not downloaded yet
2026-03-30 13:30:23 [ayvens.es] INFO: Found listing with ID: 1989230
2026-03-30 13:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989230%27 HTTP/1.1" 200 None
2026-03-30 13:30:23 [ayvens.es] INFO: Scrape type for 1989230: 1
2026-03-30 13:30:23 [ayvens.es] INFO: Extracting data for car ID: 1989230
2026-03-30 13:30:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1cf4a48a-95e6-5a5a-8ae6-0358fa2f7158 with identifier: 1989230
2026-03-30 13:30:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cf4a48a-95e6-5a5a-8ae6-0358fa2f7158 with scrape type 1
2026-03-30 13:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1cf4a48a-95e6-5a5a-8ae6-0358fa2f7158
2026-03-30 13:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F823%252F517fca1e3b35414d83951389f7491d73%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/823/517fca1e3b35414d83951389f7491d73/images/large/1.jpg not downloaded yet
2026-03-30 13:30:23 [ayvens.es] INFO: Found listing with ID: 1989231
2026-03-30 13:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989231%27 HTTP/1.1" 200 None
2026-03-30 13:30:23 [ayvens.es] INFO: Scrape type for 1989231: 1
2026-03-30 13:30:23 [ayvens.es] INFO: Extracting data for car ID: 1989231
2026-03-30 13:30:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6859d09-8505-55fd-a889-7ba9abd341ea with identifier: 1989231
2026-03-30 13:30:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6859d09-8505-55fd-a889-7ba9abd341ea with scrape type 1
2026-03-30 13:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e6859d09-8505-55fd-a889-7ba9abd341ea
2026-03-30 13:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F849%252Fb669a6dd83d6459882e179d9126d5a8b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/849/b669a6dd83d6459882e179d9126d5a8b/images/large/1.jpg not downloaded yet
2026-03-30 13:30:23 [ayvens.es] INFO: Found listing with ID: 1989232
2026-03-30 13:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989232%27 HTTP/1.1" 200 None
2026-03-30 13:30:23 [ayvens.es] INFO: Scrape type for 1989232: 1
2026-03-30 13:30:23 [ayvens.es] INFO: Extracting data for car ID: 1989232
2026-03-30 13:30:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ac77b58-1541-54b5-9319-f7eed2119282 with identifier: 1989232
2026-03-30 13:30:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ac77b58-1541-54b5-9319-f7eed2119282 with scrape type 1
2026-03-30 13:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1ac77b58-1541-54b5-9319-f7eed2119282
2026-03-30 13:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F821%252F9cb518bcf6644bcb85a2e5bfe5771387%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/821/9cb518bcf6644bcb85a2e5bfe5771387/images/large/1.jpg not downloaded yet
2026-03-30 13:30:23 [ayvens.es] INFO: Found listing with ID: 1989233
2026-03-30 13:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989233%27 HTTP/1.1" 200 None
2026-03-30 13:30:23 [ayvens.es] INFO: Scrape type for 1989233: 1
2026-03-30 13:30:23 [ayvens.es] INFO: Extracting data for car ID: 1989233
2026-03-30 13:30:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c231bff0-b898-56e1-a788-99dc5b82a8f7 with identifier: 1989233
2026-03-30 13:30:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c231bff0-b898-56e1-a788-99dc5b82a8f7 with scrape type 1
2026-03-30 13:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c231bff0-b898-56e1-a788-99dc5b82a8f7
2026-03-30 13:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F860%252F7e45035c1bc74be0ba72df595b9a255c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/860/7e45035c1bc74be0ba72df595b9a255c/images/large/1.jpg not downloaded yet
2026-03-30 13:30:23 [ayvens.es] INFO: Found listing with ID: 1989234
2026-03-30 13:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989234%27 HTTP/1.1" 200 None
2026-03-30 13:30:23 [ayvens.es] INFO: Scrape type for 1989234: 1
2026-03-30 13:30:23 [ayvens.es] INFO: Extracting data for car ID: 1989234
2026-03-30 13:30:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2784a475-0766-50f2-a747-0e50cc60c6a9 with identifier: 1989234
2026-03-30 13:30:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2784a475-0766-50f2-a747-0e50cc60c6a9 with scrape type 1
2026-03-30 13:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 2784a475-0766-50f2-a747-0e50cc60c6a9
2026-03-30 13:30:23 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 2784a475-0766-50f2-a747-0e50cc60c6a9
2026-03-30 13:30:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2784a475-0766-50f2-a747-0e50cc60c6a9, identifier: 1989234
2026-03-30 13:30:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2784a475-0766-50f2-a747-0e50cc60c6a9 with identifier: 1989234
2026-03-30 13:30:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 13:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-30 13:30:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 13:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-30 13:30:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2784a475-0766-50f2-a747-0e50cc60c6a9 with identifier: 1989234
2026-03-30 13:30:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 2784a475-0766-50f2-a747-0e50cc60c6a9 with identifier: 1989234 to the API
2026-03-30 13:30:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:30:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:30:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Gris urano',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '2784a475-0766-50f2-a747-0e50cc60c6a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT',
 'odometer': 192735,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT Business 2.0 TDI 90kW (122CV) DSG',
 'transmission': 'manual',
 'trim': 'Business 2.0 TDI 90kW (122CV) DSG',
 'vin': None,
 'year': 2021}
2026-03-30 13:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989234%27 HTTP/1.1" 200 None
2026-03-30 13:30:24 [ayvens.es] INFO: Saving data for 1989234: {'created_time': 1774877424.075438, 'last_price_update_time': 1774877424.075453, 'auction_closing_time': 1774954800.0}
2026-03-30 13:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989234') HTTP/1.1" 204 0
2026-03-30 13:30:24 [ayvens.es] INFO: Found listing with ID: 1989235
2026-03-30 13:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989235%27 HTTP/1.1" 200 None
2026-03-30 13:30:24 [ayvens.es] INFO: Scrape type for 1989235: 1
2026-03-30 13:30:24 [ayvens.es] INFO: Extracting data for car ID: 1989235
2026-03-30 13:30:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a416044d-96d2-53fa-a5c9-7aa18f88bd37 with identifier: 1989235
2026-03-30 13:30:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a416044d-96d2-53fa-a5c9-7aa18f88bd37 with scrape type 1
2026-03-30 13:30:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a416044d-96d2-53fa-a5c9-7aa18f88bd37
2026-03-30 13:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F378%252Ffb79d6bdf2d14a8c928e06c31c2e8a8f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:30:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/378/fb79d6bdf2d14a8c928e06c31c2e8a8f/images/large/1.jpg not downloaded yet
2026-03-30 13:30:24 [ayvens.es] INFO: Found listing with ID: 1989236
2026-03-30 13:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989236%27 HTTP/1.1" 200 None
2026-03-30 13:30:24 [ayvens.es] INFO: Scrape type for 1989236: 1
2026-03-30 13:30:24 [ayvens.es] INFO: Extracting data for car ID: 1989236
2026-03-30 13:30:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64b0b343-8bf9-50d1-b603-cd5d16c22666 with identifier: 1989236
2026-03-30 13:30:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64b0b343-8bf9-50d1-b603-cd5d16c22666 with scrape type 1
2026-03-30 13:30:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 64b0b343-8bf9-50d1-b603-cd5d16c22666
2026-03-30 13:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F998%252Fb88bf53c2e094583b072912d6a269432%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:30:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/998/b88bf53c2e094583b072912d6a269432/images/large/1.jpg not downloaded yet
2026-03-30 13:30:24 [ayvens.es] INFO: Found listing with ID: 1989237
2026-03-30 13:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989237%27 HTTP/1.1" 200 None
2026-03-30 13:30:24 [ayvens.es] INFO: Scrape type for 1989237: 1
2026-03-30 13:30:24 [ayvens.es] INFO: Extracting data for car ID: 1989237
2026-03-30 13:30:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0eb631ad-7e19-5553-b3b7-afdfc3dc60c1 with identifier: 1989237
2026-03-30 13:30:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0eb631ad-7e19-5553-b3b7-afdfc3dc60c1 with scrape type 1
2026-03-30 13:30:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0eb631ad-7e19-5553-b3b7-afdfc3dc60c1
2026-03-30 13:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F341%252F82552c88cabd40d0bcb887ba416d28e0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:30:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/341/82552c88cabd40d0bcb887ba416d28e0/images/large/1.jpg not downloaded yet
2026-03-30 13:30:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/018/3abfde34c77547fbb9029a4f4dba3058/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:30:24 [ayvens.es] INFO: Found listing with ID: 1989238
2026-03-30 13:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989238%27 HTTP/1.1" 200 None
2026-03-30 13:30:24 [ayvens.es] INFO: Scrape type for 1989238: 1
2026-03-30 13:30:24 [ayvens.es] INFO: Extracting data for car ID: 1989238
2026-03-30 13:30:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a1ab3a5-8688-5001-b4c4-d80753d5e348 with identifier: 1989238
2026-03-30 13:30:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a1ab3a5-8688-5001-b4c4-d80753d5e348 with scrape type 1
2026-03-30 13:30:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9a1ab3a5-8688-5001-b4c4-d80753d5e348
2026-03-30 13:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F862%252Ffde0ccff237c45fcbb7031479a7cd646%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:30:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/862/fde0ccff237c45fcbb7031479a7cd646/images/large/1.jpg not downloaded yet
2026-03-30 13:30:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/984/911b032d4d6845a79191c6ff82e4fa54/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:30:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/474/60a89dedceb04cbdb35ae809e58f84c4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:30:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/963/41072ea3b449478aa0e62b2391ab4870/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:30:24 [ayvens.es] INFO: Found listing with ID: 1989239
2026-03-30 13:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989239%27 HTTP/1.1" 200 None
2026-03-30 13:30:24 [ayvens.es] INFO: Scrape type for 1989239: 1
2026-03-30 13:30:24 [ayvens.es] INFO: Extracting data for car ID: 1989239
2026-03-30 13:30:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebaab330-58c5-5e5e-b6db-150727157b17 with identifier: 1989239
2026-03-30 13:30:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebaab330-58c5-5e5e-b6db-150727157b17 with scrape type 1
2026-03-30 13:30:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ebaab330-58c5-5e5e-b6db-150727157b17
2026-03-30 13:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F837%252F9ae386000cc8423a84c909f9a73c060b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:30:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/837/9ae386000cc8423a84c909f9a73c060b/images/large/1.jpg not downloaded yet
2026-03-30 13:30:24 [ayvens.es] INFO: Found listing with ID: 1989240
2026-03-30 13:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989240%27 HTTP/1.1" 200 None
2026-03-30 13:30:24 [ayvens.es] INFO: Scrape type for 1989240: 1
2026-03-30 13:30:24 [ayvens.es] INFO: Extracting data for car ID: 1989240
2026-03-30 13:30:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2273165-d107-5aee-a314-da02c7232858 with identifier: 1989240
2026-03-30 13:30:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2273165-d107-5aee-a314-da02c7232858 with scrape type 1
2026-03-30 13:30:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f2273165-d107-5aee-a314-da02c7232858
2026-03-30 13:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F276%252Fcd2414985f884d89aca71ababb0bd244%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:30:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/276/cd2414985f884d89aca71ababb0bd244/images/large/1.jpg not downloaded yet
2026-03-30 13:30:24 [ayvens.es] INFO: Found listing with ID: 1989241
2026-03-30 13:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989241%27 HTTP/1.1" 200 None
2026-03-30 13:30:24 [ayvens.es] INFO: Scrape type for 1989241: 1
2026-03-30 13:30:24 [ayvens.es] INFO: Extracting data for car ID: 1989241
2026-03-30 13:30:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c29ea40e-b322-58fb-ab5b-540c2898d1c0 with identifier: 1989241
2026-03-30 13:30:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c29ea40e-b322-58fb-ab5b-540c2898d1c0 with scrape type 1
2026-03-30 13:30:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c29ea40e-b322-58fb-ab5b-540c2898d1c0
2026-03-30 13:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F527%252F00704c0134f14f62ab945b38fed9fe1d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:30:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/527/00704c0134f14f62ab945b38fed9fe1d/images/large/1.jpg not downloaded yet
2026-03-30 13:30:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-30 13:30:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-30 13:30:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:30:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705d466cd0>
2026-03-30 13:30:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:30:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 13:30:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2115
2026-03-30 13:30:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-30 13:30:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:30:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:30:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77723f21-d053-5067-bfd6-b7a65618efde/77723f21-d053-5067-bfd6-b7a65618efde_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F018%252F3abfde34c77547fbb9029a4f4dba3058%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/018/3abfde34c77547fbb9029a4f4dba3058/images/large/1.jpg saved to cache
2026-03-30 13:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 77723f21-d053-5067-bfd6-b7a65618efde
2026-03-30 13:30:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 77723f21-d053-5067-bfd6-b7a65618efde, skipping ID generation
2026-03-30 13:30:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77723f21-d053-5067-bfd6-b7a65618efde with scrape type 1
2026-03-30 13:30:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 77723f21-d053-5067-bfd6-b7a65618efde sending to next pipeline
2026-03-30 13:30:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 77723f21-d053-5067-bfd6-b7a65618efde, identifier: 1989222
2026-03-30 13:30:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:30:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705f7f4e10>
2026-03-30 13:30:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:30:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:30:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:30:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc97412a-2655-5927-addb-badd5491f8c3/dc97412a-2655-5927-addb-badd5491f8c3_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F984%252F911b032d4d6845a79191c6ff82e4fa54%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/984/911b032d4d6845a79191c6ff82e4fa54/images/large/1.jpg saved to cache
2026-03-30 13:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dc97412a-2655-5927-addb-badd5491f8c3
2026-03-30 13:30:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dc97412a-2655-5927-addb-badd5491f8c3, skipping ID generation
2026-03-30 13:30:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc97412a-2655-5927-addb-badd5491f8c3 with scrape type 1
2026-03-30 13:30:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dc97412a-2655-5927-addb-badd5491f8c3 sending to next pipeline
2026-03-30 13:30:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: dc97412a-2655-5927-addb-badd5491f8c3, identifier: 1989225
2026-03-30 13:30:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:30:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705ce3fa90>
2026-03-30 13:30:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:30:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:30:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:30:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14abf95e-e540-5458-908b-614de6b6a4e5/14abf95e-e540-5458-908b-614de6b6a4e5_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F474%252F60a89dedceb04cbdb35ae809e58f84c4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/474/60a89dedceb04cbdb35ae809e58f84c4/images/large/1.jpg saved to cache
2026-03-30 13:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 14abf95e-e540-5458-908b-614de6b6a4e5
2026-03-30 13:30:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 14abf95e-e540-5458-908b-614de6b6a4e5, skipping ID generation
2026-03-30 13:30:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14abf95e-e540-5458-908b-614de6b6a4e5 with scrape type 1
2026-03-30 13:30:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 14abf95e-e540-5458-908b-614de6b6a4e5 sending to next pipeline
2026-03-30 13:30:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 14abf95e-e540-5458-908b-614de6b6a4e5, identifier: 1989223
2026-03-30 13:30:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:30:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705d45e210>
2026-03-30 13:30:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:30:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:30:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:30:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b6c73bb-e21d-5bcf-9829-323dd82fe7a2/6b6c73bb-e21d-5bcf-9829-323dd82fe7a2_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F963%252F41072ea3b449478aa0e62b2391ab4870%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/963/41072ea3b449478aa0e62b2391ab4870/images/large/1.jpg saved to cache
2026-03-30 13:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6b6c73bb-e21d-5bcf-9829-323dd82fe7a2
2026-03-30 13:30:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6b6c73bb-e21d-5bcf-9829-323dd82fe7a2, skipping ID generation
2026-03-30 13:30:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b6c73bb-e21d-5bcf-9829-323dd82fe7a2 with scrape type 1
2026-03-30 13:30:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6b6c73bb-e21d-5bcf-9829-323dd82fe7a2 sending to next pipeline
2026-03-30 13:30:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6b6c73bb-e21d-5bcf-9829-323dd82fe7a2, identifier: 1989221
2026-03-30 13:30:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/239/5d99deab23114f0487cd183d678c37e7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:30:25 [ayvens.es] INFO: Found listing with ID: 1989242
2026-03-30 13:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989242%27 HTTP/1.1" 200 None
2026-03-30 13:30:25 [ayvens.es] INFO: Scrape type for 1989242: 1
2026-03-30 13:30:25 [ayvens.es] INFO: Extracting data for car ID: 1989242
2026-03-30 13:30:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7685133c-3553-5e06-9abe-e20d4478abbf with identifier: 1989242
2026-03-30 13:30:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7685133c-3553-5e06-9abe-e20d4478abbf with scrape type 1
2026-03-30 13:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7685133c-3553-5e06-9abe-e20d4478abbf
2026-03-30 13:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F946%252Ff2a3133a1e5041d2833e177869a2a62b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/946/f2a3133a1e5041d2833e177869a2a62b/images/large/1.jpg not downloaded yet
2026-03-30 13:30:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 77723f21-d053-5067-bfd6-b7a65618efde with identifier: 1989222
2026-03-30 13:30:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 13:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-30 13:30:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 77723f21-d053-5067-bfd6-b7a65618efde with identifier: 1989222
2026-03-30 13:30:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 77723f21-d053-5067-bfd6-b7a65618efde with identifier: 1989222 to the API
2026-03-30 13:30:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:30:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:30:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/018/3abfde34c77547fbb9029a4f4dba3058/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '77723f21-d053-5067-bfd6-b7a65618efde',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 106105,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77723f21-d053-5067-bfd6-b7a65618efde/77723f21-d053-5067-bfd6-b7a65618efde_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 348137,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/018/3abfde34c77547fbb9029a4f4dba3058/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON 1.6 TDI 85kW (115CV) S&S Style Visio Ed',
 'transmission': 'manual',
 'trim': '1.6 TDI 85kW (115CV) S&S Style Visio Ed',
 'vin': None,
 'year': 2019}
2026-03-30 13:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989222%27 HTTP/1.1" 200 None
2026-03-30 13:30:26 [ayvens.es] INFO: Saving data for 1989222: {'created_time': 1774877426.189049, 'last_price_update_time': 1774877426.189061, 'auction_closing_time': 1774954800.0}
2026-03-30 13:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989222') HTTP/1.1" 204 0
2026-03-30 13:30:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: dc97412a-2655-5927-addb-badd5491f8c3 with identifier: 1989225
2026-03-30 13:30:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: dc97412a-2655-5927-addb-badd5491f8c3 with identifier: 1989225
2026-03-30 13:30:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: dc97412a-2655-5927-addb-badd5491f8c3 with identifier: 1989225 to the API
2026-03-30 13:30:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:30:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:30:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/984/911b032d4d6845a79191c6ff82e4fa54/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 179,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.4L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'dc97412a-2655-5927-addb-badd5491f8c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'HILUX',
 'odometer': 10581,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc97412a-2655-5927-addb-badd5491f8c3/dc97412a-2655-5927-addb-badd5491f8c3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 341031,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/984/911b032d4d6845a79191c6ff82e4fa54/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA HILUX 2.4 D-4D Cabina Doble GX**revisar peritacion**',
 'transmission': 'manual',
 'trim': '2.4 D-4D Cabina Doble GX**revisar peritacion**',
 'vin': None,
 'year': 2021}
2026-03-30 13:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989225%27 HTTP/1.1" 200 None
2026-03-30 13:30:26 [ayvens.es] INFO: Saving data for 1989225: {'created_time': 1774877426.751323, 'last_price_update_time': 1774877426.751333, 'auction_closing_time': 1774954800.0}
2026-03-30 13:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989225') HTTP/1.1" 204 0
2026-03-30 13:30:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 14abf95e-e540-5458-908b-614de6b6a4e5 with identifier: 1989223
2026-03-30 13:30:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 13:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-30 13:30:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 14abf95e-e540-5458-908b-614de6b6a4e5 with identifier: 1989223
2026-03-30 13:30:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 14abf95e-e540-5458-908b-614de6b6a4e5 with identifier: 1989223 to the API
2026-03-30 13:30:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:30:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:30:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/474/60a89dedceb04cbdb35ae809e58f84c4/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Negro profundo',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '14abf95e-e540-5458-908b-614de6b6a4e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN',
 'odometer': 106784,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14abf95e-e540-5458-908b-614de6b6a4e5/14abf95e-e540-5458-908b-614de6b6a4e5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 334253,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/474/60a89dedceb04cbdb35ae809e58f84c4/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN Life 2.0 TDI 110kW (150CV) DSG',
 'transmission': 'manual',
 'trim': 'Life 2.0 TDI 110kW (150CV) DSG',
 'vin': None,
 'year': 2022}
2026-03-30 13:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989223%27 HTTP/1.1" 200 None
2026-03-30 13:30:27 [ayvens.es] INFO: Saving data for 1989223: {'created_time': 1774877427.43345, 'last_price_update_time': 1774877427.433462, 'auction_closing_time': 1774954800.0}
2026-03-30 13:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989223') HTTP/1.1" 204 0
2026-03-30 13:30:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6b6c73bb-e21d-5bcf-9829-323dd82fe7a2 with identifier: 1989221
2026-03-30 13:30:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6b6c73bb-e21d-5bcf-9829-323dd82fe7a2 with identifier: 1989221
2026-03-30 13:30:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 6b6c73bb-e21d-5bcf-9829-323dd82fe7a2 with identifier: 1989221 to the API
2026-03-30 13:30:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:30:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:30:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/963/41072ea3b449478aa0e62b2391ab4870/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '6b6c73bb-e21d-5bcf-9829-323dd82fe7a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 262743,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b6c73bb-e21d-5bcf-9829-323dd82fe7a2/6b6c73bb-e21d-5bcf-9829-323dd82fe7a2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 512571,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/963/41072ea3b449478aa0e62b2391ab4870/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-19',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS Profesional dCi 55 kW (75 CV)**revisar '
          'peritacion**',
 'transmission': 'manual',
 'trim': 'Profesional dCi 55 kW (75 CV)**revisar peritacion**',
 'vin': None,
 'year': 2019}
2026-03-30 13:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989221%27 HTTP/1.1" 200 None
2026-03-30 13:30:28 [ayvens.es] INFO: Saving data for 1989221: {'created_time': 1774877428.882124, 'last_price_update_time': 1774877428.882138, 'auction_closing_time': 1774954800.0}
2026-03-30 13:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989221') HTTP/1.1" 204 0
2026-03-30 13:30:28 [ayvens.es] INFO: Found listing with ID: 1989243
2026-03-30 13:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989243%27 HTTP/1.1" 200 None
2026-03-30 13:30:28 [ayvens.es] INFO: Scrape type for 1989243: 1
2026-03-30 13:30:28 [ayvens.es] INFO: Extracting data for car ID: 1989243
2026-03-30 13:30:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 857ee5a2-9856-5d68-96d1-4bd325d8f6e7 with identifier: 1989243
2026-03-30 13:30:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 857ee5a2-9856-5d68-96d1-4bd325d8f6e7 with scrape type 1
2026-03-30 13:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 857ee5a2-9856-5d68-96d1-4bd325d8f6e7
2026-03-30 13:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F573%252F2dca291a87ee420891450ce2dea0cba2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/573/2dca291a87ee420891450ce2dea0cba2/images/large/1.jpg not downloaded yet
2026-03-30 13:30:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/571/afa8ea6b265f4f6fb2b1243519353a96/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:30:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/847/4df1b6f6601745b799c17c78366d066d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:30:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/849/b669a6dd83d6459882e179d9126d5a8b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:30:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/457/c657780fad7d4aaebaae8b129573743d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:30:28 [ayvens.es] INFO: Found listing with ID: 1989244
2026-03-30 13:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989244%27 HTTP/1.1" 200 None
2026-03-30 13:30:28 [ayvens.es] INFO: Scrape type for 1989244: 1
2026-03-30 13:30:28 [ayvens.es] INFO: Extracting data for car ID: 1989244
2026-03-30 13:30:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6fef7d9f-36f5-5910-af51-7e94b9eb3f76 with identifier: 1989244
2026-03-30 13:30:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fef7d9f-36f5-5910-af51-7e94b9eb3f76 with scrape type 1
2026-03-30 13:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6fef7d9f-36f5-5910-af51-7e94b9eb3f76
2026-03-30 13:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F848%252F035fff5ebc5d434181c78968e46da20b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/848/035fff5ebc5d434181c78968e46da20b/images/large/1.jpg not downloaded yet
2026-03-30 13:30:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:30:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705c5403d0>
2026-03-30 13:30:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:30:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:30:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:30:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f89b665e-0f49-5f44-a882-c83afeea4ab6/f89b665e-0f49-5f44-a882-c83afeea4ab6_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F239%252F5d99deab23114f0487cd183d678c37e7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/239/5d99deab23114f0487cd183d678c37e7/images/large/1.jpg saved to cache
2026-03-30 13:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f89b665e-0f49-5f44-a882-c83afeea4ab6
2026-03-30 13:30:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f89b665e-0f49-5f44-a882-c83afeea4ab6, skipping ID generation
2026-03-30 13:30:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f89b665e-0f49-5f44-a882-c83afeea4ab6 with scrape type 1
2026-03-30 13:30:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f89b665e-0f49-5f44-a882-c83afeea4ab6 sending to next pipeline
2026-03-30 13:30:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f89b665e-0f49-5f44-a882-c83afeea4ab6, identifier: 1989224
2026-03-30 13:30:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/823/517fca1e3b35414d83951389f7491d73/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:30:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/821/9cb518bcf6644bcb85a2e5bfe5771387/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:30:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f89b665e-0f49-5f44-a882-c83afeea4ab6 with identifier: 1989224
2026-03-30 13:30:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 13:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-30 13:30:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f89b665e-0f49-5f44-a882-c83afeea4ab6 with identifier: 1989224
2026-03-30 13:30:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f89b665e-0f49-5f44-a882-c83afeea4ab6 with identifier: 1989224 to the API
2026-03-30 13:30:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:30:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:30:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/239/5d99deab23114f0487cd183d678c37e7/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'f89b665e-0f49-5f44-a882-c83afeea4ab6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'COROLLA',
 'odometer': 168096,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f89b665e-0f49-5f44-a882-c83afeea4ab6/f89b665e-0f49-5f44-a882-c83afeea4ab6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 341278,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/239/5d99deab23114f0487cd183d678c37e7/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA COROLLA 1.8 125H ACTIVE TECH E-CVT',
 'transmission': 'manual',
 'trim': '1.8 125H ACTIVE TECH E-CVT',
 'vin': None,
 'year': 2021}
2026-03-30 13:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989224%27 HTTP/1.1" 200 None
2026-03-30 13:30:29 [ayvens.es] INFO: Saving data for 1989224: {'created_time': 1774877429.776879, 'last_price_update_time': 1774877429.776892, 'auction_closing_time': 1774954800.0}
2026-03-30 13:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989224') HTTP/1.1" 204 0
2026-03-30 13:30:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/490/97aef8da414c4dbba3bcabe18b919858/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:30:29 [ayvens.es] INFO: Found listing with ID: 1989245
2026-03-30 13:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989245%27 HTTP/1.1" 200 None
2026-03-30 13:30:29 [ayvens.es] INFO: Scrape type for 1989245: 1
2026-03-30 13:30:29 [ayvens.es] INFO: Extracting data for car ID: 1989245
2026-03-30 13:30:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc82b4a1-4b8b-57b2-a929-ace326ab6cdc with identifier: 1989245
2026-03-30 13:30:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc82b4a1-4b8b-57b2-a929-ace326ab6cdc with scrape type 1
2026-03-30 13:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item cc82b4a1-4b8b-57b2-a929-ace326ab6cdc
2026-03-30 13:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F718%252Fb8a53f4c51a74273901aa32eeea68252%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/718/b8a53f4c51a74273901aa32eeea68252/images/large/1.jpg not downloaded yet
2026-03-30 13:30:29 [ayvens.es] INFO: Found listing with ID: 1989246
2026-03-30 13:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989246%27 HTTP/1.1" 200 None
2026-03-30 13:30:29 [ayvens.es] INFO: Scrape type for 1989246: 1
2026-03-30 13:30:29 [ayvens.es] INFO: Extracting data for car ID: 1989246
2026-03-30 13:30:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb607d7c-09f0-5d8e-a6fa-48de898a143f with identifier: 1989246
2026-03-30 13:30:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb607d7c-09f0-5d8e-a6fa-48de898a143f with scrape type 1
2026-03-30 13:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item eb607d7c-09f0-5d8e-a6fa-48de898a143f
2026-03-30 13:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F382%252F1aa1c12e4ddc4976a270ede37c74f362%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/382/1aa1c12e4ddc4976a270ede37c74f362/images/large/1.jpg not downloaded yet
2026-03-30 13:30:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:30:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705c359b10>
2026-03-30 13:30:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:30:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:30:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:30:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5059c1e5-db96-570e-94c4-68b525c8245e/5059c1e5-db96-570e-94c4-68b525c8245e_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F571%252Fafa8ea6b265f4f6fb2b1243519353a96%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/571/afa8ea6b265f4f6fb2b1243519353a96/images/large/1.jpg saved to cache
2026-03-30 13:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5059c1e5-db96-570e-94c4-68b525c8245e
2026-03-30 13:30:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5059c1e5-db96-570e-94c4-68b525c8245e, skipping ID generation
2026-03-30 13:30:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5059c1e5-db96-570e-94c4-68b525c8245e with scrape type 1
2026-03-30 13:30:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5059c1e5-db96-570e-94c4-68b525c8245e sending to next pipeline
2026-03-30 13:30:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5059c1e5-db96-570e-94c4-68b525c8245e, identifier: 1989229
2026-03-30 13:30:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:30:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705c537e90>
2026-03-30 13:30:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:30:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c647a8e-2125-5f67-b483-b4758eff4372/2c647a8e-2125-5f67-b483-b4758eff4372_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F847%252F4df1b6f6601745b799c17c78366d066d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/847/4df1b6f6601745b799c17c78366d066d/images/large/1.jpg saved to cache
2026-03-30 13:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2c647a8e-2125-5f67-b483-b4758eff4372
2026-03-30 13:30:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2c647a8e-2125-5f67-b483-b4758eff4372, skipping ID generation
2026-03-30 13:30:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c647a8e-2125-5f67-b483-b4758eff4372 with scrape type 1
2026-03-30 13:30:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2c647a8e-2125-5f67-b483-b4758eff4372 sending to next pipeline
2026-03-30 13:30:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2c647a8e-2125-5f67-b483-b4758eff4372, identifier: 1989227
2026-03-30 13:30:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:30:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705c5466d0>
2026-03-30 13:30:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:30:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6859d09-8505-55fd-a889-7ba9abd341ea/e6859d09-8505-55fd-a889-7ba9abd341ea_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F849%252Fb669a6dd83d6459882e179d9126d5a8b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/849/b669a6dd83d6459882e179d9126d5a8b/images/large/1.jpg saved to cache
2026-03-30 13:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e6859d09-8505-55fd-a889-7ba9abd341ea
2026-03-30 13:30:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e6859d09-8505-55fd-a889-7ba9abd341ea, skipping ID generation
2026-03-30 13:30:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6859d09-8505-55fd-a889-7ba9abd341ea with scrape type 1
2026-03-30 13:30:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e6859d09-8505-55fd-a889-7ba9abd341ea sending to next pipeline
2026-03-30 13:30:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e6859d09-8505-55fd-a889-7ba9abd341ea, identifier: 1989231
2026-03-30 13:30:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:30:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705d17cc50>
2026-03-30 13:30:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:30:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7de92083-ebbe-519f-8c2e-3f1bfeb1764f/7de92083-ebbe-519f-8c2e-3f1bfeb1764f_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F457%252Fc657780fad7d4aaebaae8b129573743d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/457/c657780fad7d4aaebaae8b129573743d/images/large/1.jpg saved to cache
2026-03-30 13:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7de92083-ebbe-519f-8c2e-3f1bfeb1764f
2026-03-30 13:30:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7de92083-ebbe-519f-8c2e-3f1bfeb1764f, skipping ID generation
2026-03-30 13:30:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7de92083-ebbe-519f-8c2e-3f1bfeb1764f with scrape type 1
2026-03-30 13:30:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7de92083-ebbe-519f-8c2e-3f1bfeb1764f sending to next pipeline
2026-03-30 13:30:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7de92083-ebbe-519f-8c2e-3f1bfeb1764f, identifier: 1989228
2026-03-30 13:30:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:30:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705c537e50>
2026-03-30 13:30:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:30:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:30:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:30:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cf4a48a-95e6-5a5a-8ae6-0358fa2f7158/1cf4a48a-95e6-5a5a-8ae6-0358fa2f7158_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F823%252F517fca1e3b35414d83951389f7491d73%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/823/517fca1e3b35414d83951389f7491d73/images/large/1.jpg saved to cache
2026-03-30 13:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1cf4a48a-95e6-5a5a-8ae6-0358fa2f7158
2026-03-30 13:30:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1cf4a48a-95e6-5a5a-8ae6-0358fa2f7158, skipping ID generation
2026-03-30 13:30:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cf4a48a-95e6-5a5a-8ae6-0358fa2f7158 with scrape type 1
2026-03-30 13:30:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1cf4a48a-95e6-5a5a-8ae6-0358fa2f7158 sending to next pipeline
2026-03-30 13:30:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1cf4a48a-95e6-5a5a-8ae6-0358fa2f7158, identifier: 1989230
2026-03-30 13:30:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:30:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705d467390>
2026-03-30 13:30:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:30:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:30:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:30:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ac77b58-1541-54b5-9319-f7eed2119282/1ac77b58-1541-54b5-9319-f7eed2119282_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F821%252F9cb518bcf6644bcb85a2e5bfe5771387%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/821/9cb518bcf6644bcb85a2e5bfe5771387/images/large/1.jpg saved to cache
2026-03-30 13:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1ac77b58-1541-54b5-9319-f7eed2119282
2026-03-30 13:30:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1ac77b58-1541-54b5-9319-f7eed2119282, skipping ID generation
2026-03-30 13:30:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ac77b58-1541-54b5-9319-f7eed2119282 with scrape type 1
2026-03-30 13:30:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1ac77b58-1541-54b5-9319-f7eed2119282 sending to next pipeline
2026-03-30 13:30:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1ac77b58-1541-54b5-9319-f7eed2119282, identifier: 1989232
2026-03-30 13:30:31 [ayvens.es] INFO: Found listing with ID: 1989247
2026-03-30 13:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989247%27 HTTP/1.1" 200 None
2026-03-30 13:30:31 [ayvens.es] INFO: Scrape type for 1989247: 1
2026-03-30 13:30:31 [ayvens.es] INFO: Extracting data for car ID: 1989247
2026-03-30 13:30:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e22a57a-4237-5be8-a542-b747c6a138e1 with identifier: 1989247
2026-03-30 13:30:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e22a57a-4237-5be8-a542-b747c6a138e1 with scrape type 1
2026-03-30 13:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5e22a57a-4237-5be8-a542-b747c6a138e1
2026-03-30 13:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F167%252F533271a09fcb4a7690d806acb804ab45%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/167/533271a09fcb4a7690d806acb804ab45/images/large/1.jpg not downloaded yet
2026-03-30 13:30:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5059c1e5-db96-570e-94c4-68b525c8245e with identifier: 1989229
2026-03-30 13:30:31 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 13:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-30 13:30:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5059c1e5-db96-570e-94c4-68b525c8245e with identifier: 1989229
2026-03-30 13:30:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5059c1e5-db96-570e-94c4-68b525c8245e with identifier: 1989229 to the API
2026-03-30 13:30:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:30:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:30:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/571/afa8ea6b265f4f6fb2b1243519353a96/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'color': 'Blanco suave',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '5059c1e5-db96-570e-94c4-68b525c8245e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 68021,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5059c1e5-db96-570e-94c4-68b525c8245e/5059c1e5-db96-570e-94c4-68b525c8245e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332835,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/571/afa8ea6b265f4f6fb2b1243519353a96/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON 2.0 TDI 85kW S&S Style Go',
 'transmission': 'manual',
 'trim': '2.0 TDI 85kW S&S Style Go',
 'vin': None,
 'year': 2021}
2026-03-30 13:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989229%27 HTTP/1.1" 200 None
2026-03-30 13:30:32 [ayvens.es] INFO: Saving data for 1989229: {'created_time': 1774877432.855692, 'last_price_update_time': 1774877432.855709, 'auction_closing_time': 1774954800.0}
2026-03-30 13:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989229') HTTP/1.1" 204 0
2026-03-30 13:30:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2c647a8e-2125-5f67-b483-b4758eff4372 with identifier: 1989227
2026-03-30 13:30:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2c647a8e-2125-5f67-b483-b4758eff4372 with identifier: 1989227
2026-03-30 13:30:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 2c647a8e-2125-5f67-b483-b4758eff4372 with identifier: 1989227 to the API
2026-03-30 13:30:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:30:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:30:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/847/4df1b6f6601745b799c17c78366d066d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': '2c647a8e-2125-5f67-b483-b4758eff4372',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'COROLLA',
 'odometer': 104030,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c647a8e-2125-5f67-b483-b4758eff4372/2c647a8e-2125-5f67-b483-b4758eff4372_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 294442,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/847/4df1b6f6601745b799c17c78366d066d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA COROLLA 1.8 125H ACTIVE TECH E-CVT TOU SPORT',
 'transmission': 'manual',
 'trim': '1.8 125H ACTIVE TECH E-CVT TOU SPORT',
 'vin': None,
 'year': 2021}
2026-03-30 13:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989227%27 HTTP/1.1" 200 None
2026-03-30 13:30:33 [ayvens.es] INFO: Saving data for 1989227: {'created_time': 1774877433.655919, 'last_price_update_time': 1774877433.655931, 'auction_closing_time': 1774954800.0}
2026-03-30 13:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989227') HTTP/1.1" 204 0
2026-03-30 13:30:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e6859d09-8505-55fd-a889-7ba9abd341ea with identifier: 1989231
2026-03-30 13:30:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e6859d09-8505-55fd-a889-7ba9abd341ea with identifier: 1989231
2026-03-30 13:30:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e6859d09-8505-55fd-a889-7ba9abd341ea with identifier: 1989231 to the API
2026-03-30 13:30:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:30:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:30:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/849/b669a6dd83d6459882e179d9126d5a8b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e6859d09-8505-55fd-a889-7ba9abd341ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 96517,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6859d09-8505-55fd-a889-7ba9abd341ea/e6859d09-8505-55fd-a889-7ba9abd341ea_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 339162,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/849/b669a6dd83d6459882e179d9126d5a8b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 Active Pack BlueHDI 81kW (110CV)',
 'transmission': 'manual',
 'trim': 'Active Pack BlueHDI 81kW (110CV)',
 'vin': None,
 'year': 2021}
2026-03-30 13:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989231%27 HTTP/1.1" 200 None
2026-03-30 13:30:34 [ayvens.es] INFO: Saving data for 1989231: {'created_time': 1774877434.144768, 'last_price_update_time': 1774877434.144781, 'auction_closing_time': 1774954800.0}
2026-03-30 13:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989231') HTTP/1.1" 204 0
2026-03-30 13:30:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7de92083-ebbe-519f-8c2e-3f1bfeb1764f with identifier: 1989228
2026-03-30 13:30:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7de92083-ebbe-519f-8c2e-3f1bfeb1764f with identifier: 1989228
2026-03-30 13:30:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7de92083-ebbe-519f-8c2e-3f1bfeb1764f with identifier: 1989228 to the API
2026-03-30 13:30:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:30:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:30:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/457/c657780fad7d4aaebaae8b129573743d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 85,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '7de92083-ebbe-519f-8c2e-3f1bfeb1764f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 182093,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7de92083-ebbe-519f-8c2e-3f1bfeb1764f/7de92083-ebbe-519f-8c2e-3f1bfeb1764f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 335795,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/457/c657780fad7d4aaebaae8b129573743d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO Business Energy dCi 75',
 'transmission': 'manual',
 'trim': 'Business Energy dCi 75',
 'vin': None,
 'year': 2017}
2026-03-30 13:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989228%27 HTTP/1.1" 200 None
2026-03-30 13:30:34 [ayvens.es] INFO: Saving data for 1989228: {'created_time': 1774877434.487188, 'last_price_update_time': 1774877434.487199, 'auction_closing_time': 1774954800.0}
2026-03-30 13:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989228') HTTP/1.1" 204 0
2026-03-30 13:30:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1cf4a48a-95e6-5a5a-8ae6-0358fa2f7158 with identifier: 1989230
2026-03-30 13:30:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1cf4a48a-95e6-5a5a-8ae6-0358fa2f7158 with identifier: 1989230
2026-03-30 13:30:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1cf4a48a-95e6-5a5a-8ae6-0358fa2f7158 with identifier: 1989230 to the API
2026-03-30 13:30:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:30:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:30:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/823/517fca1e3b35414d83951389f7491d73/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'color': 'Blanco suave',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '1cf4a48a-95e6-5a5a-8ae6-0358fa2f7158',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 63816,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cf4a48a-95e6-5a5a-8ae6-0358fa2f7158/1cf4a48a-95e6-5a5a-8ae6-0358fa2f7158_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 331013,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/823/517fca1e3b35414d83951389f7491d73/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON 2.0 TDI 85kW S&S Style Go S',
 'transmission': 'manual',
 'trim': '2.0 TDI 85kW S&S Style Go S',
 'vin': None,
 'year': 2022}
2026-03-30 13:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989230%27 HTTP/1.1" 200 None
2026-03-30 13:30:34 [ayvens.es] INFO: Saving data for 1989230: {'created_time': 1774877434.839725, 'last_price_update_time': 1774877434.839737, 'auction_closing_time': 1774954800.0}
2026-03-30 13:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989230') HTTP/1.1" 204 0
2026-03-30 13:30:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1ac77b58-1541-54b5-9319-f7eed2119282 with identifier: 1989232
2026-03-30 13:30:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1ac77b58-1541-54b5-9319-f7eed2119282 with identifier: 1989232
2026-03-30 13:30:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1ac77b58-1541-54b5-9319-f7eed2119282 with identifier: 1989232 to the API
2026-03-30 13:30:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:30:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:30:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/821/9cb518bcf6644bcb85a2e5bfe5771387/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': '1ac77b58-1541-54b5-9319-f7eed2119282',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'COROLLA',
 'odometer': 61146,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ac77b58-1541-54b5-9319-f7eed2119282/1ac77b58-1541-54b5-9319-f7eed2119282_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 333392,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/821/9cb518bcf6644bcb85a2e5bfe5771387/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA COROLLA 1.8 125H ACTIVE TECH E-CVT TOU SPORT',
 'transmission': 'manual',
 'trim': '1.8 125H ACTIVE TECH E-CVT TOU SPORT',
 'vin': None,
 'year': 2021}
2026-03-30 13:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989232%27 HTTP/1.1" 200 None
2026-03-30 13:30:35 [ayvens.es] INFO: Saving data for 1989232: {'created_time': 1774877435.186493, 'last_price_update_time': 1774877435.186505, 'auction_closing_time': 1774954800.0}
2026-03-30 13:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989232') HTTP/1.1" 204 0
2026-03-30 13:30:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/862/fde0ccff237c45fcbb7031479a7cd646/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:30:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/998/b88bf53c2e094583b072912d6a269432/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:30:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/341/82552c88cabd40d0bcb887ba416d28e0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:30:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/378/fb79d6bdf2d14a8c928e06c31c2e8a8f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:30:35 [ayvens.es] INFO: Found listing with ID: 1989248
2026-03-30 13:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989248%27 HTTP/1.1" 200 None
2026-03-30 13:30:35 [ayvens.es] INFO: Scrape type for 1989248: 1
2026-03-30 13:30:35 [ayvens.es] INFO: Extracting data for car ID: 1989248
2026-03-30 13:30:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a712bd5a-fba4-5b07-bcdb-1921139c2996 with identifier: 1989248
2026-03-30 13:30:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a712bd5a-fba4-5b07-bcdb-1921139c2996 with scrape type 1
2026-03-30 13:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a712bd5a-fba4-5b07-bcdb-1921139c2996
2026-03-30 13:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F243%252Ff293659b311c431299b2759e8fbc6a7d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/243/f293659b311c431299b2759e8fbc6a7d/images/large/1.jpg not downloaded yet
2026-03-30 13:30:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:30:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705d515350>
2026-03-30 13:30:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:30:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:30:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:30:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8435786-b76b-5ca3-9199-55df63224846/d8435786-b76b-5ca3-9199-55df63224846_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F490%252F97aef8da414c4dbba3bcabe18b919858%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/490/97aef8da414c4dbba3bcabe18b919858/images/large/1.jpg saved to cache
2026-03-30 13:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d8435786-b76b-5ca3-9199-55df63224846
2026-03-30 13:30:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d8435786-b76b-5ca3-9199-55df63224846, skipping ID generation
2026-03-30 13:30:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8435786-b76b-5ca3-9199-55df63224846 with scrape type 1
2026-03-30 13:30:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d8435786-b76b-5ca3-9199-55df63224846 sending to next pipeline
2026-03-30 13:30:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d8435786-b76b-5ca3-9199-55df63224846, identifier: 1989226
2026-03-30 13:30:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d8435786-b76b-5ca3-9199-55df63224846 with identifier: 1989226
2026-03-30 13:30:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 13:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-30 13:30:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d8435786-b76b-5ca3-9199-55df63224846 with identifier: 1989226
2026-03-30 13:30:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d8435786-b76b-5ca3-9199-55df63224846 with identifier: 1989226 to the API
2026-03-30 13:30:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:30:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:30:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/490/97aef8da414c4dbba3bcabe18b919858/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'petrol',
 'id': 'd8435786-b76b-5ca3-9199-55df63224846',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ARONA',
 'odometer': 38636,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8435786-b76b-5ca3-9199-55df63224846/d8435786-b76b-5ca3-9199-55df63224846_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 560055,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/490/97aef8da414c4dbba3bcabe18b919858/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ARONA 1.0 TSI 81kW (110CV) Style',
 'transmission': 'manual',
 'trim': '1.0 TSI 81kW (110CV) Style',
 'vin': None,
 'year': 2021}
2026-03-30 13:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989226%27 HTTP/1.1" 200 None
2026-03-30 13:30:35 [ayvens.es] INFO: Saving data for 1989226: {'created_time': 1774877435.837696, 'last_price_update_time': 1774877435.837713, 'auction_closing_time': 1774954800.0}
2026-03-30 13:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989226') HTTP/1.1" 204 0
2026-03-30 13:30:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/860/7e45035c1bc74be0ba72df595b9a255c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:30:35 [ayvens.es] INFO: Found listing with ID: 1989249
2026-03-30 13:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989249%27 HTTP/1.1" 200 None
2026-03-30 13:30:35 [ayvens.es] INFO: Scrape type for 1989249: 1
2026-03-30 13:30:35 [ayvens.es] INFO: Extracting data for car ID: 1989249
2026-03-30 13:30:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75a25fd4-ce89-5e86-bb8b-f9f651302212 with identifier: 1989249
2026-03-30 13:30:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75a25fd4-ce89-5e86-bb8b-f9f651302212 with scrape type 1
2026-03-30 13:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 75a25fd4-ce89-5e86-bb8b-f9f651302212
2026-03-30 13:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F081%252F5b7242bac49e483aae5d570717099a01%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/081/5b7242bac49e483aae5d570717099a01/images/large/1.jpg not downloaded yet
2026-03-30 13:30:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/276/cd2414985f884d89aca71ababb0bd244/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:30:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/837/9ae386000cc8423a84c909f9a73c060b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:30:35 [ayvens.es] INFO: Found listing with ID: 1989250
2026-03-30 13:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989250%27 HTTP/1.1" 200 None
2026-03-30 13:30:35 [ayvens.es] INFO: Scrape type for 1989250: 1
2026-03-30 13:30:35 [ayvens.es] INFO: Extracting data for car ID: 1989250
2026-03-30 13:30:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4e1167a-1039-59f7-aba6-40ded8b17c95 with identifier: 1989250
2026-03-30 13:30:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4e1167a-1039-59f7-aba6-40ded8b17c95 with scrape type 1
2026-03-30 13:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b4e1167a-1039-59f7-aba6-40ded8b17c95
2026-03-30 13:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F940%252F1332d96f4fc0403fb95c0ec3fa72e2bf%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/940/1332d96f4fc0403fb95c0ec3fa72e2bf/images/large/1.jpg not downloaded yet
2026-03-30 13:30:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:30:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705c501bd0>
2026-03-30 13:30:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:30:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:30:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:30:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a1ab3a5-8688-5001-b4c4-d80753d5e348/9a1ab3a5-8688-5001-b4c4-d80753d5e348_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F862%252Ffde0ccff237c45fcbb7031479a7cd646%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/862/fde0ccff237c45fcbb7031479a7cd646/images/large/1.jpg saved to cache
2026-03-30 13:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9a1ab3a5-8688-5001-b4c4-d80753d5e348
2026-03-30 13:30:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9a1ab3a5-8688-5001-b4c4-d80753d5e348, skipping ID generation
2026-03-30 13:30:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a1ab3a5-8688-5001-b4c4-d80753d5e348 with scrape type 1
2026-03-30 13:30:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9a1ab3a5-8688-5001-b4c4-d80753d5e348 sending to next pipeline
2026-03-30 13:30:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9a1ab3a5-8688-5001-b4c4-d80753d5e348, identifier: 1989238
2026-03-30 13:30:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:30:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705c517950>
2026-03-30 13:30:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:30:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:30:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:30:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64b0b343-8bf9-50d1-b603-cd5d16c22666/64b0b343-8bf9-50d1-b603-cd5d16c22666_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F998%252Fb88bf53c2e094583b072912d6a269432%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/998/b88bf53c2e094583b072912d6a269432/images/large/1.jpg saved to cache
2026-03-30 13:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 64b0b343-8bf9-50d1-b603-cd5d16c22666
2026-03-30 13:30:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 64b0b343-8bf9-50d1-b603-cd5d16c22666, skipping ID generation
2026-03-30 13:30:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64b0b343-8bf9-50d1-b603-cd5d16c22666 with scrape type 1
2026-03-30 13:30:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 64b0b343-8bf9-50d1-b603-cd5d16c22666 sending to next pipeline
2026-03-30 13:30:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 64b0b343-8bf9-50d1-b603-cd5d16c22666, identifier: 1989236
2026-03-30 13:30:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:30:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705c50c990>
2026-03-30 13:30:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:30:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:30:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:30:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eb631ad-7e19-5553-b3b7-afdfc3dc60c1/0eb631ad-7e19-5553-b3b7-afdfc3dc60c1_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F341%252F82552c88cabd40d0bcb887ba416d28e0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/341/82552c88cabd40d0bcb887ba416d28e0/images/large/1.jpg saved to cache
2026-03-30 13:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0eb631ad-7e19-5553-b3b7-afdfc3dc60c1
2026-03-30 13:30:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0eb631ad-7e19-5553-b3b7-afdfc3dc60c1, skipping ID generation
2026-03-30 13:30:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0eb631ad-7e19-5553-b3b7-afdfc3dc60c1 with scrape type 1
2026-03-30 13:30:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0eb631ad-7e19-5553-b3b7-afdfc3dc60c1 sending to next pipeline
2026-03-30 13:30:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0eb631ad-7e19-5553-b3b7-afdfc3dc60c1, identifier: 1989237
2026-03-30 13:30:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:30:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705d3cd090>
2026-03-30 13:30:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:30:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:30:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:30:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a416044d-96d2-53fa-a5c9-7aa18f88bd37/a416044d-96d2-53fa-a5c9-7aa18f88bd37_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F378%252Ffb79d6bdf2d14a8c928e06c31c2e8a8f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/378/fb79d6bdf2d14a8c928e06c31c2e8a8f/images/large/1.jpg saved to cache
2026-03-30 13:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a416044d-96d2-53fa-a5c9-7aa18f88bd37
2026-03-30 13:30:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a416044d-96d2-53fa-a5c9-7aa18f88bd37, skipping ID generation
2026-03-30 13:30:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a416044d-96d2-53fa-a5c9-7aa18f88bd37 with scrape type 1
2026-03-30 13:30:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a416044d-96d2-53fa-a5c9-7aa18f88bd37 sending to next pipeline
2026-03-30 13:30:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a416044d-96d2-53fa-a5c9-7aa18f88bd37, identifier: 1989235
2026-03-30 13:30:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/527/00704c0134f14f62ab945b38fed9fe1d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:30:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9a1ab3a5-8688-5001-b4c4-d80753d5e348 with identifier: 1989238
2026-03-30 13:30:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 13:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-30 13:30:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9a1ab3a5-8688-5001-b4c4-d80753d5e348 with identifier: 1989238
2026-03-30 13:30:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9a1ab3a5-8688-5001-b4c4-d80753d5e348 with identifier: 1989238 to the API
2026-03-30 13:30:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:30:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:30:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/862/fde0ccff237c45fcbb7031479a7cd646/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'color': 'Pintura roja',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '9a1ab3a5-8688-5001-b4c4-d80753d5e348',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'BERLINGO',
 'odometer': 137983,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a1ab3a5-8688-5001-b4c4-d80753d5e348/9a1ab3a5-8688-5001-b4c4-d80753d5e348_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 358337,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/862/fde0ccff237c45fcbb7031479a7cd646/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-27',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROËN BERLINGO Talla M BlueHDi 100 CONTROL',
 'transmission': 'manual',
 'trim': 'Talla M BlueHDi 100 CONTROL',
 'vin': None,
 'year': 2022}
2026-03-30 13:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989238%27 HTTP/1.1" 200 None
2026-03-30 13:30:37 [ayvens.es] INFO: Saving data for 1989238: {'created_time': 1774877437.376979, 'last_price_update_time': 1774877437.376993, 'auction_closing_time': 1774954800.0}
2026-03-30 13:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989238') HTTP/1.1" 204 0
2026-03-30 13:30:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 64b0b343-8bf9-50d1-b603-cd5d16c22666 with identifier: 1989236
2026-03-30 13:30:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 64b0b343-8bf9-50d1-b603-cd5d16c22666 with identifier: 1989236
2026-03-30 13:30:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 64b0b343-8bf9-50d1-b603-cd5d16c22666 with identifier: 1989236 to the API
2026-03-30 13:30:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:30:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:30:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/998/b88bf53c2e094583b072912d6a269432/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.6L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '64b0b343-8bf9-50d1-b603-cd5d16c22666',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'BERLINGO',
 'odometer': 193836,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64b0b343-8bf9-50d1-b603-cd5d16c22666/64b0b343-8bf9-50d1-b603-cd5d16c22666_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 341625,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/998/b88bf53c2e094583b072912d6a269432/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-28',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROËN BERLINGO Talla M BlueHDi 55kW CONTROL**revisar peritacion**',
 'transmission': 'manual',
 'trim': 'Talla M BlueHDi 55kW CONTROL**revisar peritacion**',
 'vin': None,
 'year': 2019}
2026-03-30 13:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989236%27 HTTP/1.1" 200 None
2026-03-30 13:30:37 [ayvens.es] INFO: Saving data for 1989236: {'created_time': 1774877437.785642, 'last_price_update_time': 1774877437.785654, 'auction_closing_time': 1774954800.0}
2026-03-30 13:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989236') HTTP/1.1" 204 0
2026-03-30 13:30:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0eb631ad-7e19-5553-b3b7-afdfc3dc60c1 with identifier: 1989237
2026-03-30 13:30:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0eb631ad-7e19-5553-b3b7-afdfc3dc60c1 with identifier: 1989237
2026-03-30 13:30:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0eb631ad-7e19-5553-b3b7-afdfc3dc60c1 with identifier: 1989237 to the API
2026-03-30 13:30:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:30:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:30:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/341/82552c88cabd40d0bcb887ba416d28e0/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 193,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '0eb631ad-7e19-5553-b3b7-afdfc3dc60c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT CUSTOM',
 'odometer': 126063,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eb631ad-7e19-5553-b3b7-afdfc3dc60c1/0eb631ad-7e19-5553-b3b7-afdfc3dc60c1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 334607,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/341/82552c88cabd40d0bcb887ba416d28e0/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-11',
 'seats_number': 6,
 'seller_name': None,
 'title': 'FORD TRANSIT CUSTOM Mixto 2.0 TDCI 96kW 320 L1 Trend M1',
 'transmission': 'manual',
 'trim': 'Mixto 2.0 TDCI 96kW 320 L1 Trend M1',
 'vin': None,
 'year': 2022}
2026-03-30 13:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989237%27 HTTP/1.1" 200 None
2026-03-30 13:30:38 [ayvens.es] INFO: Saving data for 1989237: {'created_time': 1774877438.149333, 'last_price_update_time': 1774877438.149347, 'auction_closing_time': 1774954800.0}
2026-03-30 13:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989237') HTTP/1.1" 204 0
2026-03-30 13:30:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a416044d-96d2-53fa-a5c9-7aa18f88bd37 with identifier: 1989235
2026-03-30 13:30:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a416044d-96d2-53fa-a5c9-7aa18f88bd37 with identifier: 1989235
2026-03-30 13:30:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a416044d-96d2-53fa-a5c9-7aa18f88bd37 with identifier: 1989235 to the API
2026-03-30 13:30:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:30:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:30:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/378/fb79d6bdf2d14a8c928e06c31c2e8a8f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'petrol',
 'id': 'a416044d-96d2-53fa-a5c9-7aa18f88bd37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'CORSA',
 'odometer': 66280,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a416044d-96d2-53fa-a5c9-7aa18f88bd37/a416044d-96d2-53fa-a5c9-7aa18f88bd37_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328557,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/378/fb79d6bdf2d14a8c928e06c31c2e8a8f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL CORSA 1.2T XHL 74kW (100CV) Edition',
 'transmission': 'manual',
 'trim': '1.2T XHL 74kW (100CV) Edition',
 'vin': None,
 'year': 2021}
2026-03-30 13:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989235%27 HTTP/1.1" 200 None
2026-03-30 13:30:38 [ayvens.es] INFO: Saving data for 1989235: {'created_time': 1774877438.530735, 'last_price_update_time': 1774877438.530749, 'auction_closing_time': 1774954800.0}
2026-03-30 13:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989235') HTTP/1.1" 204 0
2026-03-30 13:30:38 [ayvens.es] INFO: Found listing with ID: 1989251
2026-03-30 13:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989251%27 HTTP/1.1" 200 None
2026-03-30 13:30:38 [ayvens.es] INFO: Scrape type for 1989251: 1
2026-03-30 13:30:38 [ayvens.es] INFO: Extracting data for car ID: 1989251
2026-03-30 13:30:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7bda24e3-4ed0-5d5c-ad7c-174644c489c4 with identifier: 1989251
2026-03-30 13:30:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bda24e3-4ed0-5d5c-ad7c-174644c489c4 with scrape type 1
2026-03-30 13:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7bda24e3-4ed0-5d5c-ad7c-174644c489c4
2026-03-30 13:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F742%252Ff222bf04b8184efbb7a5c50e846897f8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/742/f222bf04b8184efbb7a5c50e846897f8/images/large/1.jpg not downloaded yet
2026-03-30 13:30:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:30:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705c4fb710>
2026-03-30 13:30:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:30:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c231bff0-b898-56e1-a788-99dc5b82a8f7/c231bff0-b898-56e1-a788-99dc5b82a8f7_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F860%252F7e45035c1bc74be0ba72df595b9a255c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/860/7e45035c1bc74be0ba72df595b9a255c/images/large/1.jpg saved to cache
2026-03-30 13:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c231bff0-b898-56e1-a788-99dc5b82a8f7
2026-03-30 13:30:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c231bff0-b898-56e1-a788-99dc5b82a8f7, skipping ID generation
2026-03-30 13:30:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c231bff0-b898-56e1-a788-99dc5b82a8f7 with scrape type 1
2026-03-30 13:30:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c231bff0-b898-56e1-a788-99dc5b82a8f7 sending to next pipeline
2026-03-30 13:30:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c231bff0-b898-56e1-a788-99dc5b82a8f7, identifier: 1989233
2026-03-30 13:30:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:30:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705c516a10>
2026-03-30 13:30:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:30:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2273165-d107-5aee-a314-da02c7232858/f2273165-d107-5aee-a314-da02c7232858_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F276%252Fcd2414985f884d89aca71ababb0bd244%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/276/cd2414985f884d89aca71ababb0bd244/images/large/1.jpg saved to cache
2026-03-30 13:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f2273165-d107-5aee-a314-da02c7232858
2026-03-30 13:30:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f2273165-d107-5aee-a314-da02c7232858, skipping ID generation
2026-03-30 13:30:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2273165-d107-5aee-a314-da02c7232858 with scrape type 1
2026-03-30 13:30:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f2273165-d107-5aee-a314-da02c7232858 sending to next pipeline
2026-03-30 13:30:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f2273165-d107-5aee-a314-da02c7232858, identifier: 1989240
2026-03-30 13:30:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:30:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705c38afd0>
2026-03-30 13:30:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:30:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:30:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebaab330-58c5-5e5e-b6db-150727157b17/ebaab330-58c5-5e5e-b6db-150727157b17_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F837%252F9ae386000cc8423a84c909f9a73c060b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/837/9ae386000cc8423a84c909f9a73c060b/images/large/1.jpg saved to cache
2026-03-30 13:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ebaab330-58c5-5e5e-b6db-150727157b17
2026-03-30 13:30:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ebaab330-58c5-5e5e-b6db-150727157b17, skipping ID generation
2026-03-30 13:30:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebaab330-58c5-5e5e-b6db-150727157b17 with scrape type 1
2026-03-30 13:30:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ebaab330-58c5-5e5e-b6db-150727157b17 sending to next pipeline
2026-03-30 13:30:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ebaab330-58c5-5e5e-b6db-150727157b17, identifier: 1989239
2026-03-30 13:30:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/848/035fff5ebc5d434181c78968e46da20b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:30:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/573/2dca291a87ee420891450ce2dea0cba2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:30:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/946/f2a3133a1e5041d2833e177869a2a62b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:30:39 [ayvens.es] INFO: Found listing with ID: 1989252
2026-03-30 13:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989252%27 HTTP/1.1" 200 None
2026-03-30 13:30:39 [ayvens.es] INFO: Scrape type for 1989252: 1
2026-03-30 13:30:39 [ayvens.es] INFO: Extracting data for car ID: 1989252
2026-03-30 13:30:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3491c86-151b-57c5-b449-4ba7b7c0c03e with identifier: 1989252
2026-03-30 13:30:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3491c86-151b-57c5-b449-4ba7b7c0c03e with scrape type 1
2026-03-30 13:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b3491c86-151b-57c5-b449-4ba7b7c0c03e
2026-03-30 13:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F008%252F41ee6f1db67445cf9647d357f961d2ab%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/008/41ee6f1db67445cf9647d357f961d2ab/images/large/1.jpg not downloaded yet
2026-03-30 13:30:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c231bff0-b898-56e1-a788-99dc5b82a8f7 with identifier: 1989233
2026-03-30 13:30:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c231bff0-b898-56e1-a788-99dc5b82a8f7 with identifier: 1989233
2026-03-30 13:30:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c231bff0-b898-56e1-a788-99dc5b82a8f7 with identifier: 1989233 to the API
2026-03-30 13:30:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:30:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:30:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/860/7e45035c1bc74be0ba72df595b9a255c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'c231bff0-b898-56e1-a788-99dc5b82a8f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'COROLLA',
 'odometer': 140475,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c231bff0-b898-56e1-a788-99dc5b82a8f7/c231bff0-b898-56e1-a788-99dc5b82a8f7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 539709,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/860/7e45035c1bc74be0ba72df595b9a255c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA COROLLA 1.8 125H ACTIVE TECH E-CVT TOU SPORT',
 'transmission': 'manual',
 'trim': '1.8 125H ACTIVE TECH E-CVT TOU SPORT',
 'vin': None,
 'year': 2021}
2026-03-30 13:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989233%27 HTTP/1.1" 200 None
2026-03-30 13:30:39 [ayvens.es] INFO: Saving data for 1989233: {'created_time': 1774877439.612643, 'last_price_update_time': 1774877439.612689, 'auction_closing_time': 1774954800.0}
2026-03-30 13:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989233') HTTP/1.1" 204 0
2026-03-30 13:30:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f2273165-d107-5aee-a314-da02c7232858 with identifier: 1989240
2026-03-30 13:30:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f2273165-d107-5aee-a314-da02c7232858 with identifier: 1989240
2026-03-30 13:30:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f2273165-d107-5aee-a314-da02c7232858 with identifier: 1989240 to the API
2026-03-30 13:30:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:30:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:30:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/276/cd2414985f884d89aca71ababb0bd244/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.6L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f2273165-d107-5aee-a314-da02c7232858',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'BERLINGO',
 'odometer': 241974,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2273165-d107-5aee-a314-da02c7232858/f2273165-d107-5aee-a314-da02c7232858_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 319572,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/276/cd2414985f884d89aca71ababb0bd244/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN BERLINGO (O) Multispace LIVE Edit.BlueHDi 55KW (7',
 'transmission': 'manual',
 'trim': '(O) Multispace LIVE Edit.BlueHDi 55KW (7',
 'vin': None,
 'year': 2018}
2026-03-30 13:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989240%27 HTTP/1.1" 200 None
2026-03-30 13:30:39 [ayvens.es] INFO: Saving data for 1989240: {'created_time': 1774877439.955598, 'last_price_update_time': 1774877439.955611, 'auction_closing_time': 1774954800.0}
2026-03-30 13:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989240') HTTP/1.1" 204 0
2026-03-30 13:30:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ebaab330-58c5-5e5e-b6db-150727157b17 with identifier: 1989239
2026-03-30 13:30:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 13:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-30 13:30:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ebaab330-58c5-5e5e-b6db-150727157b17 with identifier: 1989239
2026-03-30 13:30:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ebaab330-58c5-5e5e-b6db-150727157b17 with identifier: 1989239 to the API
2026-03-30 13:30:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:30:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:30:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/837/9ae386000cc8423a84c909f9a73c060b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Pintura corporativa',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.6L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ebaab330-58c5-5e5e-b6db-150727157b17',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'BERLINGO',
 'odometer': 134295,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebaab330-58c5-5e5e-b6db-150727157b17/ebaab330-58c5-5e5e-b6db-150727157b17_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332935,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/837/9ae386000cc8423a84c909f9a73c060b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-28',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROËN BERLINGO (O) BlueHDi 55KW (75CV)',
 'transmission': 'manual',
 'trim': '(O) BlueHDi 55KW (75CV)',
 'vin': None,
 'year': 2018}
2026-03-30 13:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989239%27 HTTP/1.1" 200 None
2026-03-30 13:30:40 [ayvens.es] INFO: Saving data for 1989239: {'created_time': 1774877440.329764, 'last_price_update_time': 1774877440.329776, 'auction_closing_time': 1774954800.0}
2026-03-30 13:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989239') HTTP/1.1" 204 0
2026-03-30 13:30:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:30:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705ce39610>
2026-03-30 13:30:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:30:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c29ea40e-b322-58fb-ab5b-540c2898d1c0/c29ea40e-b322-58fb-ab5b-540c2898d1c0_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F527%252F00704c0134f14f62ab945b38fed9fe1d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/527/00704c0134f14f62ab945b38fed9fe1d/images/large/1.jpg saved to cache
2026-03-30 13:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c29ea40e-b322-58fb-ab5b-540c2898d1c0
2026-03-30 13:30:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c29ea40e-b322-58fb-ab5b-540c2898d1c0, skipping ID generation
2026-03-30 13:30:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c29ea40e-b322-58fb-ab5b-540c2898d1c0 with scrape type 1
2026-03-30 13:30:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c29ea40e-b322-58fb-ab5b-540c2898d1c0 sending to next pipeline
2026-03-30 13:30:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c29ea40e-b322-58fb-ab5b-540c2898d1c0, identifier: 1989241
2026-03-30 13:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/718/b8a53f4c51a74273901aa32eeea68252/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:30:40 [ayvens.es] INFO: Found listing with ID: 1989253
2026-03-30 13:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989253%27 HTTP/1.1" 200 None
2026-03-30 13:30:40 [ayvens.es] INFO: Scrape type for 1989253: 1
2026-03-30 13:30:40 [ayvens.es] INFO: Extracting data for car ID: 1989253
2026-03-30 13:30:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19402bd6-9afb-52a9-8c87-c9b3a78c27a7 with identifier: 1989253
2026-03-30 13:30:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19402bd6-9afb-52a9-8c87-c9b3a78c27a7 with scrape type 1
2026-03-30 13:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 19402bd6-9afb-52a9-8c87-c9b3a78c27a7
2026-03-30 13:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F389%252F5df26869b73d4d008395d33b611d7ad3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/389/5df26869b73d4d008395d33b611d7ad3/images/large/1.jpg not downloaded yet
2026-03-30 13:30:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c29ea40e-b322-58fb-ab5b-540c2898d1c0 with identifier: 1989241
2026-03-30 13:30:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c29ea40e-b322-58fb-ab5b-540c2898d1c0 with identifier: 1989241
2026-03-30 13:30:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c29ea40e-b322-58fb-ab5b-540c2898d1c0 with identifier: 1989241 to the API
2026-03-30 13:30:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:30:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:30:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/527/00704c0134f14f62ab945b38fed9fe1d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c29ea40e-b322-58fb-ab5b-540c2898d1c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'BERLINGO',
 'odometer': 56000,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c29ea40e-b322-58fb-ab5b-540c2898d1c0/c29ea40e-b322-58fb-ab5b-540c2898d1c0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 419833,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/527/00704c0134f14f62ab945b38fed9fe1d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN BERLINGO Talla M BlueHDi 100 S&S LIVE PACK BUSINE',
 'transmission': 'manual',
 'trim': 'Talla M BlueHDi 100 S&S LIVE PACK BUSINE',
 'vin': None,
 'year': 2022}
2026-03-30 13:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989241%27 HTTP/1.1" 200 None
2026-03-30 13:30:41 [ayvens.es] INFO: Saving data for 1989241: {'created_time': 1774877441.139051, 'last_price_update_time': 1774877441.139062, 'auction_closing_time': 1774954800.0}
2026-03-30 13:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989241') HTTP/1.1" 204 0
2026-03-30 13:30:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/382/1aa1c12e4ddc4976a270ede37c74f362/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:30:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:30:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705d18dad0>
2026-03-30 13:30:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:30:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fef7d9f-36f5-5910-af51-7e94b9eb3f76/6fef7d9f-36f5-5910-af51-7e94b9eb3f76_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F848%252F035fff5ebc5d434181c78968e46da20b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/848/035fff5ebc5d434181c78968e46da20b/images/large/1.jpg saved to cache
2026-03-30 13:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6fef7d9f-36f5-5910-af51-7e94b9eb3f76
2026-03-30 13:30:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6fef7d9f-36f5-5910-af51-7e94b9eb3f76, skipping ID generation
2026-03-30 13:30:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fef7d9f-36f5-5910-af51-7e94b9eb3f76 with scrape type 1
2026-03-30 13:30:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6fef7d9f-36f5-5910-af51-7e94b9eb3f76 sending to next pipeline
2026-03-30 13:30:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6fef7d9f-36f5-5910-af51-7e94b9eb3f76, identifier: 1989244
2026-03-30 13:30:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:30:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705c4764d0>
2026-03-30 13:30:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:30:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_857ee5a2-9856-5d68-96d1-4bd325d8f6e7/857ee5a2-9856-5d68-96d1-4bd325d8f6e7_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F573%252F2dca291a87ee420891450ce2dea0cba2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/573/2dca291a87ee420891450ce2dea0cba2/images/large/1.jpg saved to cache
2026-03-30 13:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 857ee5a2-9856-5d68-96d1-4bd325d8f6e7
2026-03-30 13:30:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 857ee5a2-9856-5d68-96d1-4bd325d8f6e7, skipping ID generation
2026-03-30 13:30:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 857ee5a2-9856-5d68-96d1-4bd325d8f6e7 with scrape type 1
2026-03-30 13:30:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 857ee5a2-9856-5d68-96d1-4bd325d8f6e7 sending to next pipeline
2026-03-30 13:30:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 857ee5a2-9856-5d68-96d1-4bd325d8f6e7, identifier: 1989243
2026-03-30 13:30:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:30:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705c497c10>
2026-03-30 13:30:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:30:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7685133c-3553-5e06-9abe-e20d4478abbf/7685133c-3553-5e06-9abe-e20d4478abbf_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F946%252Ff2a3133a1e5041d2833e177869a2a62b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/946/f2a3133a1e5041d2833e177869a2a62b/images/large/1.jpg saved to cache
2026-03-30 13:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7685133c-3553-5e06-9abe-e20d4478abbf
2026-03-30 13:30:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7685133c-3553-5e06-9abe-e20d4478abbf, skipping ID generation
2026-03-30 13:30:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7685133c-3553-5e06-9abe-e20d4478abbf with scrape type 1
2026-03-30 13:30:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7685133c-3553-5e06-9abe-e20d4478abbf sending to next pipeline
2026-03-30 13:30:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7685133c-3553-5e06-9abe-e20d4478abbf, identifier: 1989242
2026-03-30 13:30:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/243/f293659b311c431299b2759e8fbc6a7d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:30:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/167/533271a09fcb4a7690d806acb804ab45/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:30:41 [ayvens.es] INFO: Found listing with ID: 1989254
2026-03-30 13:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989254%27 HTTP/1.1" 200 None
2026-03-30 13:30:41 [ayvens.es] INFO: Scrape type for 1989254: 1
2026-03-30 13:30:41 [ayvens.es] INFO: Extracting data for car ID: 1989254
2026-03-30 13:30:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 285ebede-2905-574b-a68a-be3e476ba19a with identifier: 1989254
2026-03-30 13:30:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 285ebede-2905-574b-a68a-be3e476ba19a with scrape type 1
2026-03-30 13:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 285ebede-2905-574b-a68a-be3e476ba19a
2026-03-30 13:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F316%252F6df30a8eeefc4d919ed8efee30f10dfa%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/316/6df30a8eeefc4d919ed8efee30f10dfa/images/large/1.jpg not downloaded yet
2026-03-30 13:30:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6fef7d9f-36f5-5910-af51-7e94b9eb3f76 with identifier: 1989244
2026-03-30 13:30:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6fef7d9f-36f5-5910-af51-7e94b9eb3f76 with identifier: 1989244
2026-03-30 13:30:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 6fef7d9f-36f5-5910-af51-7e94b9eb3f76 with identifier: 1989244 to the API
2026-03-30 13:30:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:30:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:30:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/848/035fff5ebc5d434181c78968e46da20b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '6fef7d9f-36f5-5910-af51-7e94b9eb3f76',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 210571,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fef7d9f-36f5-5910-af51-7e94b9eb3f76/6fef7d9f-36f5-5910-af51-7e94b9eb3f76_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 341838,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/848/035fff5ebc5d434181c78968e46da20b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-28',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS (O) Profesional dCi 55 kW (75 CV)**revisar '
          'peritacion**',
 'transmission': 'manual',
 'trim': '(O) Profesional dCi 55 kW (75 CV)**revisar peritacion**',
 'vin': None,
 'year': 2020}
2026-03-30 13:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989244%27 HTTP/1.1" 200 None
2026-03-30 13:30:42 [ayvens.es] INFO: Saving data for 1989244: {'created_time': 1774877442.194832, 'last_price_update_time': 1774877442.194842, 'auction_closing_time': 1774954800.0}
2026-03-30 13:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989244') HTTP/1.1" 204 0
2026-03-30 13:30:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 857ee5a2-9856-5d68-96d1-4bd325d8f6e7 with identifier: 1989243
2026-03-30 13:30:42 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 13:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-30 13:30:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 857ee5a2-9856-5d68-96d1-4bd325d8f6e7 with identifier: 1989243
2026-03-30 13:30:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 857ee5a2-9856-5d68-96d1-4bd325d8f6e7 with identifier: 1989243 to the API
2026-03-30 13:30:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:30:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:30:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/573/2dca291a87ee420891450ce2dea0cba2/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Verde',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'petrol',
 'id': '857ee5a2-9856-5d68-96d1-4bd325d8f6e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'COUNTRYMAN',
 'odometer': 51509,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_857ee5a2-9856-5d68-96d1-4bd325d8f6e7/857ee5a2-9856-5d68-96d1-4bd325d8f6e7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 356343,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/573/2dca291a87ee420891450ce2dea0cba2/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI COUNTRYMAN Cooper',
 'transmission': 'manual',
 'trim': 'Cooper',
 'vin': None,
 'year': 2021}
2026-03-30 13:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989243%27 HTTP/1.1" 200 None
2026-03-30 13:30:42 [ayvens.es] INFO: Saving data for 1989243: {'created_time': 1774877442.716335, 'last_price_update_time': 1774877442.716346, 'auction_closing_time': 1774954800.0}
2026-03-30 13:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989243') HTTP/1.1" 204 0
2026-03-30 13:30:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7685133c-3553-5e06-9abe-e20d4478abbf with identifier: 1989242
2026-03-30 13:30:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7685133c-3553-5e06-9abe-e20d4478abbf with identifier: 1989242
2026-03-30 13:30:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7685133c-3553-5e06-9abe-e20d4478abbf with identifier: 1989242 to the API
2026-03-30 13:30:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:30:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:30:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/946/f2a3133a1e5041d2833e177869a2a62b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '7685133c-3553-5e06-9abe-e20d4478abbf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': 199896,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7685133c-3553-5e06-9abe-e20d4478abbf/7685133c-3553-5e06-9abe-e20d4478abbf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 352083,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/946/f2a3133a1e5041d2833e177869a2a62b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FOCUS 1.5 Ecoblue 70kW Trend+',
 'transmission': 'manual',
 'trim': '1.5 Ecoblue 70kW Trend+',
 'vin': None,
 'year': 2022}
2026-03-30 13:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989242%27 HTTP/1.1" 200 None
2026-03-30 13:30:43 [ayvens.es] INFO: Saving data for 1989242: {'created_time': 1774877443.732475, 'last_price_update_time': 1774877443.732487, 'auction_closing_time': 1774954800.0}
2026-03-30 13:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989242') HTTP/1.1" 204 0
2026-03-30 13:30:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:30:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705c496a10>
2026-03-30 13:30:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:30:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:30:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:30:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc82b4a1-4b8b-57b2-a929-ace326ab6cdc/cc82b4a1-4b8b-57b2-a929-ace326ab6cdc_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F718%252Fb8a53f4c51a74273901aa32eeea68252%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/718/b8a53f4c51a74273901aa32eeea68252/images/large/1.jpg saved to cache
2026-03-30 13:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cc82b4a1-4b8b-57b2-a929-ace326ab6cdc
2026-03-30 13:30:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cc82b4a1-4b8b-57b2-a929-ace326ab6cdc, skipping ID generation
2026-03-30 13:30:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc82b4a1-4b8b-57b2-a929-ace326ab6cdc with scrape type 1
2026-03-30 13:30:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cc82b4a1-4b8b-57b2-a929-ace326ab6cdc sending to next pipeline
2026-03-30 13:30:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: cc82b4a1-4b8b-57b2-a929-ace326ab6cdc, identifier: 1989245
2026-03-30 13:30:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/081/5b7242bac49e483aae5d570717099a01/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:30:43 [ayvens.es] INFO: Found listing with ID: 1989255
2026-03-30 13:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989255%27 HTTP/1.1" 200 None
2026-03-30 13:30:43 [ayvens.es] INFO: Scrape type for 1989255: 1
2026-03-30 13:30:43 [ayvens.es] INFO: Extracting data for car ID: 1989255
2026-03-30 13:30:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bda27e27-2d9f-5aed-bfe9-efb88f5f9ecf with identifier: 1989255
2026-03-30 13:30:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bda27e27-2d9f-5aed-bfe9-efb88f5f9ecf with scrape type 1
2026-03-30 13:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item bda27e27-2d9f-5aed-bfe9-efb88f5f9ecf
2026-03-30 13:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F630%252Fe21e30cdf46c4229a22d0ee2ae0e25fc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/630/e21e30cdf46c4229a22d0ee2ae0e25fc/images/large/1.jpg not downloaded yet
2026-03-30 13:30:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: cc82b4a1-4b8b-57b2-a929-ace326ab6cdc with identifier: 1989245
2026-03-30 13:30:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: cc82b4a1-4b8b-57b2-a929-ace326ab6cdc with identifier: 1989245
2026-03-30 13:30:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: cc82b4a1-4b8b-57b2-a929-ace326ab6cdc with identifier: 1989245 to the API
2026-03-30 13:30:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:30:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:30:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/718/b8a53f4c51a74273901aa32eeea68252/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'cc82b4a1-4b8b-57b2-a929-ace326ab6cdc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'COMBO',
 'odometer': 154827,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc82b4a1-4b8b-57b2-a929-ace326ab6cdc/cc82b4a1-4b8b-57b2-a929-ace326ab6cdc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 487121,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/718/b8a53f4c51a74273901aa32eeea68252/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-19',
 'seats_number': 2,
 'seller_name': None,
 'title': 'OPEL COMBO Cargo L 650kg Diesel 1.5 100HP S&S MT E6',
 'transmission': 'manual',
 'trim': 'Cargo L 650kg Diesel 1.5 100HP S&S MT E6',
 'vin': None,
 'year': 2022}
2026-03-30 13:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989245%27 HTTP/1.1" 200 None
2026-03-30 13:30:44 [ayvens.es] INFO: Saving data for 1989245: {'created_time': 1774877444.571848, 'last_price_update_time': 1774877444.571862, 'auction_closing_time': 1774954800.0}
2026-03-30 13:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989245') HTTP/1.1" 204 0
2026-03-30 13:30:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:30:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705ce28390>
2026-03-30 13:30:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:30:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb607d7c-09f0-5d8e-a6fa-48de898a143f/eb607d7c-09f0-5d8e-a6fa-48de898a143f_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F382%252F1aa1c12e4ddc4976a270ede37c74f362%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/382/1aa1c12e4ddc4976a270ede37c74f362/images/large/1.jpg saved to cache
2026-03-30 13:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eb607d7c-09f0-5d8e-a6fa-48de898a143f
2026-03-30 13:30:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eb607d7c-09f0-5d8e-a6fa-48de898a143f, skipping ID generation
2026-03-30 13:30:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb607d7c-09f0-5d8e-a6fa-48de898a143f with scrape type 1
2026-03-30 13:30:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eb607d7c-09f0-5d8e-a6fa-48de898a143f sending to next pipeline
2026-03-30 13:30:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: eb607d7c-09f0-5d8e-a6fa-48de898a143f, identifier: 1989246
2026-03-30 13:30:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:30:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705d659d50>
2026-03-30 13:30:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:30:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:30:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a712bd5a-fba4-5b07-bcdb-1921139c2996/a712bd5a-fba4-5b07-bcdb-1921139c2996_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F243%252Ff293659b311c431299b2759e8fbc6a7d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/243/f293659b311c431299b2759e8fbc6a7d/images/large/1.jpg saved to cache
2026-03-30 13:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a712bd5a-fba4-5b07-bcdb-1921139c2996
2026-03-30 13:30:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a712bd5a-fba4-5b07-bcdb-1921139c2996, skipping ID generation
2026-03-30 13:30:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a712bd5a-fba4-5b07-bcdb-1921139c2996 with scrape type 1
2026-03-30 13:30:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a712bd5a-fba4-5b07-bcdb-1921139c2996 sending to next pipeline
2026-03-30 13:30:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a712bd5a-fba4-5b07-bcdb-1921139c2996, identifier: 1989248
2026-03-30 13:30:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:30:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705ce284d0>
2026-03-30 13:30:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:30:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e22a57a-4237-5be8-a542-b747c6a138e1/5e22a57a-4237-5be8-a542-b747c6a138e1_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F167%252F533271a09fcb4a7690d806acb804ab45%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/167/533271a09fcb4a7690d806acb804ab45/images/large/1.jpg saved to cache
2026-03-30 13:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5e22a57a-4237-5be8-a542-b747c6a138e1
2026-03-30 13:30:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5e22a57a-4237-5be8-a542-b747c6a138e1, skipping ID generation
2026-03-30 13:30:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e22a57a-4237-5be8-a542-b747c6a138e1 with scrape type 1
2026-03-30 13:30:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5e22a57a-4237-5be8-a542-b747c6a138e1 sending to next pipeline
2026-03-30 13:30:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5e22a57a-4237-5be8-a542-b747c6a138e1, identifier: 1989247
2026-03-30 13:30:45 [ayvens.es] INFO: Found listing with ID: 1989256
2026-03-30 13:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989256%27 HTTP/1.1" 200 None
2026-03-30 13:30:45 [ayvens.es] INFO: Scrape type for 1989256: 1
2026-03-30 13:30:45 [ayvens.es] INFO: Extracting data for car ID: 1989256
2026-03-30 13:30:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4fd1d53-6446-52f3-8b62-033bbfdba921 with identifier: 1989256
2026-03-30 13:30:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4fd1d53-6446-52f3-8b62-033bbfdba921 with scrape type 1
2026-03-30 13:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d4fd1d53-6446-52f3-8b62-033bbfdba921
2026-03-30 13:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F947%252F12102ec787c14e31b68dc7e9a900c2ce%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/947/12102ec787c14e31b68dc7e9a900c2ce/images/large/1.jpg not downloaded yet
2026-03-30 13:30:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: eb607d7c-09f0-5d8e-a6fa-48de898a143f with identifier: 1989246
2026-03-30 13:30:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 13:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-30 13:30:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: eb607d7c-09f0-5d8e-a6fa-48de898a143f with identifier: 1989246
2026-03-30 13:30:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: eb607d7c-09f0-5d8e-a6fa-48de898a143f with identifier: 1989246 to the API
2026-03-30 13:30:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:30:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:30:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/382/1aa1c12e4ddc4976a270ede37c74f362/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'Blanco nacarado',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'eb607d7c-09f0-5d8e-a6fa-48de898a143f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008',
 'odometer': 122782,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb607d7c-09f0-5d8e-a6fa-48de898a143f/eb607d7c-09f0-5d8e-a6fa-48de898a143f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 346367,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/382/1aa1c12e4ddc4976a270ede37c74f362/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-21',
 'seats_number': 7,
 'seller_name': None,
 'title': 'PEUGEOT 5008 1.5 BlueHDi 96kW (130CV) S&S Allure',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi 96kW (130CV) S&S Allure',
 'vin': None,
 'year': 2022}
2026-03-30 13:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989246%27 HTTP/1.1" 200 None
2026-03-30 13:30:45 [ayvens.es] INFO: Saving data for 1989246: {'created_time': 1774877445.655635, 'last_price_update_time': 1774877445.655645, 'auction_closing_time': 1774954800.0}
2026-03-30 13:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989246') HTTP/1.1" 204 0
2026-03-30 13:30:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a712bd5a-fba4-5b07-bcdb-1921139c2996 with identifier: 1989248
2026-03-30 13:30:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a712bd5a-fba4-5b07-bcdb-1921139c2996 with identifier: 1989248
2026-03-30 13:30:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a712bd5a-fba4-5b07-bcdb-1921139c2996 with identifier: 1989248 to the API
2026-03-30 13:30:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:30:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:30:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/243/f293659b311c431299b2759e8fbc6a7d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a712bd5a-fba4-5b07-bcdb-1921139c2996',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN',
 'odometer': 159681,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a712bd5a-fba4-5b07-bcdb-1921139c2996/a712bd5a-fba4-5b07-bcdb-1921139c2996_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 350958,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/243/f293659b311c431299b2759e8fbc6a7d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN Life 2.0 TDI 110kW (150CV) DSG',
 'transmission': 'manual',
 'trim': 'Life 2.0 TDI 110kW (150CV) DSG',
 'vin': None,
 'year': 2021}
2026-03-30 13:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989248%27 HTTP/1.1" 200 None
2026-03-30 13:30:45 [ayvens.es] INFO: Saving data for 1989248: {'created_time': 1774877445.986755, 'last_price_update_time': 1774877445.986767, 'auction_closing_time': 1774954800.0}
2026-03-30 13:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989248') HTTP/1.1" 204 0
2026-03-30 13:30:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5e22a57a-4237-5be8-a542-b747c6a138e1 with identifier: 1989247
2026-03-30 13:30:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 13:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-30 13:30:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5e22a57a-4237-5be8-a542-b747c6a138e1 with identifier: 1989247
2026-03-30 13:30:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5e22a57a-4237-5be8-a542-b747c6a138e1 with identifier: 1989247 to the API
2026-03-30 13:30:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:30:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:30:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/167/533271a09fcb4a7690d806acb804ab45/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Gris amazonite',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '5e22a57a-4237-5be8-a542-b747c6a138e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508',
 'odometer': 157407,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e22a57a-4237-5be8-a542-b747c6a138e1/5e22a57a-4237-5be8-a542-b747c6a138e1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 371411,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/167/533271a09fcb4a7690d806acb804ab45/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 SW Business Line BlueHDi 96kW S&S EAT8',
 'transmission': 'manual',
 'trim': 'SW Business Line BlueHDi 96kW S&S EAT8',
 'vin': None,
 'year': 2021}
2026-03-30 13:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989247%27 HTTP/1.1" 200 None
2026-03-30 13:30:46 [ayvens.es] INFO: Saving data for 1989247: {'created_time': 1774877446.316261, 'last_price_update_time': 1774877446.316272, 'auction_closing_time': 1774954800.0}
2026-03-30 13:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989247') HTTP/1.1" 204 0
2026-03-30 13:30:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:30:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705f3aae90>
2026-03-30 13:30:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:30:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75a25fd4-ce89-5e86-bb8b-f9f651302212/75a25fd4-ce89-5e86-bb8b-f9f651302212_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F081%252F5b7242bac49e483aae5d570717099a01%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/081/5b7242bac49e483aae5d570717099a01/images/large/1.jpg saved to cache
2026-03-30 13:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 75a25fd4-ce89-5e86-bb8b-f9f651302212
2026-03-30 13:30:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 75a25fd4-ce89-5e86-bb8b-f9f651302212, skipping ID generation
2026-03-30 13:30:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75a25fd4-ce89-5e86-bb8b-f9f651302212 with scrape type 1
2026-03-30 13:30:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 75a25fd4-ce89-5e86-bb8b-f9f651302212 sending to next pipeline
2026-03-30 13:30:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 75a25fd4-ce89-5e86-bb8b-f9f651302212, identifier: 1989249
2026-03-30 13:30:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/940/1332d96f4fc0403fb95c0ec3fa72e2bf/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:30:46 [ayvens.es] INFO: Found listing with ID: 1989257
2026-03-30 13:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989257%27 HTTP/1.1" 200 None
2026-03-30 13:30:46 [ayvens.es] INFO: Scrape type for 1989257: 1
2026-03-30 13:30:46 [ayvens.es] INFO: Extracting data for car ID: 1989257
2026-03-30 13:30:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0b759d8-3609-5d1c-8236-5f947d445361 with identifier: 1989257
2026-03-30 13:30:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0b759d8-3609-5d1c-8236-5f947d445361 with scrape type 1
2026-03-30 13:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e0b759d8-3609-5d1c-8236-5f947d445361
2026-03-30 13:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F428%252F45d731818c694b26a841fab31738c88f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/428/45d731818c694b26a841fab31738c88f/images/large/1.jpg not downloaded yet
2026-03-30 13:30:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 75a25fd4-ce89-5e86-bb8b-f9f651302212 with identifier: 1989249
2026-03-30 13:30:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 75a25fd4-ce89-5e86-bb8b-f9f651302212 with identifier: 1989249
2026-03-30 13:30:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 75a25fd4-ce89-5e86-bb8b-f9f651302212 with identifier: 1989249 to the API
2026-03-30 13:30:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:30:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:30:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/081/5b7242bac49e483aae5d570717099a01/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '75a25fd4-ce89-5e86-bb8b-f9f651302212',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ARONA',
 'odometer': 224819,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75a25fd4-ce89-5e86-bb8b-f9f651302212/75a25fd4-ce89-5e86-bb8b-f9f651302212_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 339748,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/081/5b7242bac49e483aae5d570717099a01/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ARONA 1.6 TDI 70kW (95CV) Style Ecomotive',
 'transmission': 'manual',
 'trim': '1.6 TDI 70kW (95CV) Style Ecomotive',
 'vin': None,
 'year': 2020}
2026-03-30 13:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989249%27 HTTP/1.1" 200 None
2026-03-30 13:30:46 [ayvens.es] INFO: Saving data for 1989249: {'created_time': 1774877446.964155, 'last_price_update_time': 1774877446.964166, 'auction_closing_time': 1774954800.0}
2026-03-30 13:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989249') HTTP/1.1" 204 0
2026-03-30 13:30:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/008/41ee6f1db67445cf9647d357f961d2ab/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:30:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/742/f222bf04b8184efbb7a5c50e846897f8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:30:46 [ayvens.es] INFO: Found listing with ID: 1989258
2026-03-30 13:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989258%27 HTTP/1.1" 200 None
2026-03-30 13:30:47 [ayvens.es] INFO: Scrape type for 1989258: 1
2026-03-30 13:30:47 [ayvens.es] INFO: Extracting data for car ID: 1989258
2026-03-30 13:30:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ac70fe0-3d28-5522-9a63-2d230bd1f920 with identifier: 1989258
2026-03-30 13:30:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ac70fe0-3d28-5522-9a63-2d230bd1f920 with scrape type 1
2026-03-30 13:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2ac70fe0-3d28-5522-9a63-2d230bd1f920
2026-03-30 13:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F652%252Fd8c0d1c149024061bfe2a9131e6043e7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/652/d8c0d1c149024061bfe2a9131e6043e7/images/large/1.jpg not downloaded yet
2026-03-30 13:30:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:30:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705c35e150>
2026-03-30 13:30:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:30:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4e1167a-1039-59f7-aba6-40ded8b17c95/b4e1167a-1039-59f7-aba6-40ded8b17c95_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F940%252F1332d96f4fc0403fb95c0ec3fa72e2bf%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/940/1332d96f4fc0403fb95c0ec3fa72e2bf/images/large/1.jpg saved to cache
2026-03-30 13:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b4e1167a-1039-59f7-aba6-40ded8b17c95
2026-03-30 13:30:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b4e1167a-1039-59f7-aba6-40ded8b17c95, skipping ID generation
2026-03-30 13:30:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4e1167a-1039-59f7-aba6-40ded8b17c95 with scrape type 1
2026-03-30 13:30:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b4e1167a-1039-59f7-aba6-40ded8b17c95 sending to next pipeline
2026-03-30 13:30:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b4e1167a-1039-59f7-aba6-40ded8b17c95, identifier: 1989250
2026-03-30 13:30:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/389/5df26869b73d4d008395d33b611d7ad3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:30:47 [ayvens.es] INFO: Found listing with ID: 1989259
2026-03-30 13:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989259%27 HTTP/1.1" 200 None
2026-03-30 13:30:47 [ayvens.es] INFO: Scrape type for 1989259: 1
2026-03-30 13:30:47 [ayvens.es] INFO: Extracting data for car ID: 1989259
2026-03-30 13:30:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2488b4a2-7793-53d1-a7dc-2bece275fb9f with identifier: 1989259
2026-03-30 13:30:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2488b4a2-7793-53d1-a7dc-2bece275fb9f with scrape type 1
2026-03-30 13:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2488b4a2-7793-53d1-a7dc-2bece275fb9f
2026-03-30 13:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F753%252Fbcf1e84dd56f4e13802fc5407b547942%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/753/bcf1e84dd56f4e13802fc5407b547942/images/large/1.jpg not downloaded yet
2026-03-30 13:30:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b4e1167a-1039-59f7-aba6-40ded8b17c95 with identifier: 1989250
2026-03-30 13:30:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b4e1167a-1039-59f7-aba6-40ded8b17c95 with identifier: 1989250
2026-03-30 13:30:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b4e1167a-1039-59f7-aba6-40ded8b17c95 with identifier: 1989250 to the API
2026-03-30 13:30:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:30:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:30:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/940/1332d96f4fc0403fb95c0ec3fa72e2bf/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 206,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '2.1L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b4e1167a-1039-59f7-aba6-40ded8b17c95',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'SPRINTER',
 'odometer': 244722,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4e1167a-1039-59f7-aba6-40ded8b17c95/b4e1167a-1039-59f7-aba6-40ded8b17c95_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 446614,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/940/1332d96f4fc0403fb95c0ec3fa72e2bf/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-11',
 'seats_number': 3,
 'seller_name': None,
 'title': 'MERCEDES-BENZ SPRINTER 314 CDI MEDIO 3.5T',
 'transmission': 'manual',
 'trim': '314 CDI MEDIO 3.5T',
 'vin': None,
 'year': 2019}
2026-03-30 13:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989250%27 HTTP/1.1" 200 None
2026-03-30 13:30:47 [ayvens.es] INFO: Saving data for 1989250: {'created_time': 1774877447.670975, 'last_price_update_time': 1774877447.670985, 'auction_closing_time': 1774954800.0}
2026-03-30 13:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989250') HTTP/1.1" 204 0
2026-03-30 13:30:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/316/6df30a8eeefc4d919ed8efee30f10dfa/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:30:47 [ayvens.es] INFO: Found listing with ID: 1989260
2026-03-30 13:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989260%27 HTTP/1.1" 200 None
2026-03-30 13:30:47 [ayvens.es] INFO: Scrape type for 1989260: 1
2026-03-30 13:30:47 [ayvens.es] INFO: Extracting data for car ID: 1989260
2026-03-30 13:30:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72d72db8-e3d6-5496-b7b5-b05e2d99a4ac with identifier: 1989260
2026-03-30 13:30:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72d72db8-e3d6-5496-b7b5-b05e2d99a4ac with scrape type 1
2026-03-30 13:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 72d72db8-e3d6-5496-b7b5-b05e2d99a4ac
2026-03-30 13:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F400%252Fb969babe26ee4b0bb5bb9a29a530a93a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/400/b969babe26ee4b0bb5bb9a29a530a93a/images/large/1.jpg not downloaded yet
2026-03-30 13:30:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:30:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705c4f1550>
2026-03-30 13:30:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:30:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3491c86-151b-57c5-b449-4ba7b7c0c03e/b3491c86-151b-57c5-b449-4ba7b7c0c03e_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F008%252F41ee6f1db67445cf9647d357f961d2ab%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/008/41ee6f1db67445cf9647d357f961d2ab/images/large/1.jpg saved to cache
2026-03-30 13:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b3491c86-151b-57c5-b449-4ba7b7c0c03e
2026-03-30 13:30:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b3491c86-151b-57c5-b449-4ba7b7c0c03e, skipping ID generation
2026-03-30 13:30:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3491c86-151b-57c5-b449-4ba7b7c0c03e with scrape type 1
2026-03-30 13:30:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b3491c86-151b-57c5-b449-4ba7b7c0c03e sending to next pipeline
2026-03-30 13:30:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b3491c86-151b-57c5-b449-4ba7b7c0c03e, identifier: 1989252
2026-03-30 13:30:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:30:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705c4936d0>
2026-03-30 13:30:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:30:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bda24e3-4ed0-5d5c-ad7c-174644c489c4/7bda24e3-4ed0-5d5c-ad7c-174644c489c4_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F742%252Ff222bf04b8184efbb7a5c50e846897f8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/742/f222bf04b8184efbb7a5c50e846897f8/images/large/1.jpg saved to cache
2026-03-30 13:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7bda24e3-4ed0-5d5c-ad7c-174644c489c4
2026-03-30 13:30:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7bda24e3-4ed0-5d5c-ad7c-174644c489c4, skipping ID generation
2026-03-30 13:30:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bda24e3-4ed0-5d5c-ad7c-174644c489c4 with scrape type 1
2026-03-30 13:30:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7bda24e3-4ed0-5d5c-ad7c-174644c489c4 sending to next pipeline
2026-03-30 13:30:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7bda24e3-4ed0-5d5c-ad7c-174644c489c4, identifier: 1989251
2026-03-30 13:30:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:30:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705c35c2d0>
2026-03-30 13:30:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:30:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19402bd6-9afb-52a9-8c87-c9b3a78c27a7/19402bd6-9afb-52a9-8c87-c9b3a78c27a7_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F389%252F5df26869b73d4d008395d33b611d7ad3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/389/5df26869b73d4d008395d33b611d7ad3/images/large/1.jpg saved to cache
2026-03-30 13:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 19402bd6-9afb-52a9-8c87-c9b3a78c27a7
2026-03-30 13:30:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 19402bd6-9afb-52a9-8c87-c9b3a78c27a7, skipping ID generation
2026-03-30 13:30:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19402bd6-9afb-52a9-8c87-c9b3a78c27a7 with scrape type 1
2026-03-30 13:30:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 19402bd6-9afb-52a9-8c87-c9b3a78c27a7 sending to next pipeline
2026-03-30 13:30:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 19402bd6-9afb-52a9-8c87-c9b3a78c27a7, identifier: 1989253
2026-03-30 13:30:48 [ayvens.es] INFO: Found listing with ID: 1989261
2026-03-30 13:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989261%27 HTTP/1.1" 200 None
2026-03-30 13:30:48 [ayvens.es] INFO: Scrape type for 1989261: 1
2026-03-30 13:30:48 [ayvens.es] INFO: Extracting data for car ID: 1989261
2026-03-30 13:30:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee6982a3-cca8-524f-bb1d-e41664c9645a with identifier: 1989261
2026-03-30 13:30:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee6982a3-cca8-524f-bb1d-e41664c9645a with scrape type 1
2026-03-30 13:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ee6982a3-cca8-524f-bb1d-e41664c9645a
2026-03-30 13:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F210%252F50c5678c197d4369bbb3c89d6237a443%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/210/50c5678c197d4369bbb3c89d6237a443/images/large/1.jpg not downloaded yet
2026-03-30 13:30:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b3491c86-151b-57c5-b449-4ba7b7c0c03e with identifier: 1989252
2026-03-30 13:30:48 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 13:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-30 13:30:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b3491c86-151b-57c5-b449-4ba7b7c0c03e with identifier: 1989252
2026-03-30 13:30:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b3491c86-151b-57c5-b449-4ba7b7c0c03e with identifier: 1989252 to the API
2026-03-30 13:30:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:30:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:30:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/008/41ee6f1db67445cf9647d357f961d2ab/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'color': 'Gris artense',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b3491c86-151b-57c5-b449-4ba7b7c0c03e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 104675,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3491c86-151b-57c5-b449-4ba7b7c0c03e/b3491c86-151b-57c5-b449-4ba7b7c0c03e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 370046,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/008/41ee6f1db67445cf9647d357f961d2ab/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.5 BlueHDi 96kW S&S GT EAT8',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi 96kW S&S GT EAT8',
 'vin': None,
 'year': 2022}
2026-03-30 13:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989252%27 HTTP/1.1" 200 None
2026-03-30 13:30:48 [ayvens.es] INFO: Saving data for 1989252: {'created_time': 1774877448.874175, 'last_price_update_time': 1774877448.87419, 'auction_closing_time': 1774954800.0}
2026-03-30 13:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989252') HTTP/1.1" 204 0
2026-03-30 13:30:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7bda24e3-4ed0-5d5c-ad7c-174644c489c4 with identifier: 1989251
2026-03-30 13:30:48 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 13:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-30 13:30:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7bda24e3-4ed0-5d5c-ad7c-174644c489c4 with identifier: 1989251
2026-03-30 13:30:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7bda24e3-4ed0-5d5c-ad7c-174644c489c4 with identifier: 1989251 to the API
2026-03-30 13:30:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:30:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:30:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/742/f222bf04b8184efbb7a5c50e846897f8/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'color': 'Candy blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '7bda24e3-4ed0-5d5c-ad7c-174644c489c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CADDY',
 'odometer': 203487,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bda24e3-4ed0-5d5c-ad7c-174644c489c4/7bda24e3-4ed0-5d5c-ad7c-174644c489c4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 495134,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/742/f222bf04b8184efbb7a5c50e846897f8/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-22',
 'seats_number': 2,
 'seller_name': None,
 'title': 'VOLKSWAGEN CADDY (E) Business 2.0 TDI 90kW (122CV) BMT 4M',
 'transmission': 'manual',
 'trim': '(E) Business 2.0 TDI 90kW (122CV) BMT 4M',
 'vin': None,
 'year': 2019}
2026-03-30 13:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989251%27 HTTP/1.1" 200 None
2026-03-30 13:30:49 [ayvens.es] INFO: Saving data for 1989251: {'created_time': 1774877449.250449, 'last_price_update_time': 1774877449.250464, 'auction_closing_time': 1774954800.0}
2026-03-30 13:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989251') HTTP/1.1" 204 0
2026-03-30 13:30:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 19402bd6-9afb-52a9-8c87-c9b3a78c27a7 with identifier: 1989253
2026-03-30 13:30:49 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 13:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-30 13:30:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 19402bd6-9afb-52a9-8c87-c9b3a78c27a7 with identifier: 1989253
2026-03-30 13:30:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 19402bd6-9afb-52a9-8c87-c9b3a78c27a7 with identifier: 1989253 to the API
2026-03-30 13:30:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:30:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:30:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/389/5df26869b73d4d008395d33b611d7ad3/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '19402bd6-9afb-52a9-8c87-c9b3a78c27a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 109052,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19402bd6-9afb-52a9-8c87-c9b3a78c27a7/19402bd6-9afb-52a9-8c87-c9b3a78c27a7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 352206,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/389/5df26869b73d4d008395d33b611d7ad3/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI dCi 85 kW (115 CV) E6D ACENTA',
 'transmission': 'manual',
 'trim': 'dCi 85 kW (115 CV) E6D ACENTA',
 'vin': None,
 'year': 2020}
2026-03-30 13:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989253%27 HTTP/1.1" 200 None
2026-03-30 13:30:49 [ayvens.es] INFO: Saving data for 1989253: {'created_time': 1774877449.665748, 'last_price_update_time': 1774877449.665763, 'auction_closing_time': 1774954800.0}
2026-03-30 13:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989253') HTTP/1.1" 204 0
2026-03-30 13:30:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/630/e21e30cdf46c4229a22d0ee2ae0e25fc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:30:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/947/12102ec787c14e31b68dc7e9a900c2ce/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:30:49 [ayvens.es] INFO: Found listing with ID: 1989262
2026-03-30 13:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989262%27 HTTP/1.1" 200 None
2026-03-30 13:30:49 [ayvens.es] INFO: Scrape type for 1989262: 1
2026-03-30 13:30:49 [ayvens.es] INFO: Extracting data for car ID: 1989262
2026-03-30 13:30:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b53169db-f7a4-57b9-adfd-b04d4db79c89 with identifier: 1989262
2026-03-30 13:30:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b53169db-f7a4-57b9-adfd-b04d4db79c89 with scrape type 1
2026-03-30 13:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b53169db-f7a4-57b9-adfd-b04d4db79c89
2026-03-30 13:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F642%252F458c2d57d6b04850aaa3f1a294df24e7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/642/458c2d57d6b04850aaa3f1a294df24e7/images/large/1.jpg not downloaded yet
2026-03-30 13:30:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:30:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705dba56d0>
2026-03-30 13:30:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:30:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_285ebede-2905-574b-a68a-be3e476ba19a/285ebede-2905-574b-a68a-be3e476ba19a_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F316%252F6df30a8eeefc4d919ed8efee30f10dfa%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/316/6df30a8eeefc4d919ed8efee30f10dfa/images/large/1.jpg saved to cache
2026-03-30 13:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 285ebede-2905-574b-a68a-be3e476ba19a
2026-03-30 13:30:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 285ebede-2905-574b-a68a-be3e476ba19a, skipping ID generation
2026-03-30 13:30:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 285ebede-2905-574b-a68a-be3e476ba19a with scrape type 1
2026-03-30 13:30:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 285ebede-2905-574b-a68a-be3e476ba19a sending to next pipeline
2026-03-30 13:30:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 285ebede-2905-574b-a68a-be3e476ba19a, identifier: 1989254
2026-03-30 13:30:49 [ayvens.es] INFO: Found listing with ID: 1989263
2026-03-30 13:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989263%27 HTTP/1.1" 200 None
2026-03-30 13:30:49 [ayvens.es] INFO: Scrape type for 1989263: 1
2026-03-30 13:30:49 [ayvens.es] INFO: Extracting data for car ID: 1989263
2026-03-30 13:30:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6d41d45-ffdc-5edf-945f-b806391bbb1b with identifier: 1989263
2026-03-30 13:30:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6d41d45-ffdc-5edf-945f-b806391bbb1b with scrape type 1
2026-03-30 13:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b6d41d45-ffdc-5edf-945f-b806391bbb1b
2026-03-30 13:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F857%252F62fd73612bfe4c879759d3eae010deb1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/857/62fd73612bfe4c879759d3eae010deb1/images/large/1.jpg not downloaded yet
2026-03-30 13:30:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 285ebede-2905-574b-a68a-be3e476ba19a with identifier: 1989254
2026-03-30 13:30:50 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 13:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-30 13:30:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 285ebede-2905-574b-a68a-be3e476ba19a with identifier: 1989254
2026-03-30 13:30:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 285ebede-2905-574b-a68a-be3e476ba19a with identifier: 1989254 to the API
2026-03-30 13:30:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:30:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:30:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/316/6df30a8eeefc4d919ed8efee30f10dfa/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 173,
 'color': 'Fuji white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '285ebede-2905-574b-a68a-be3e476ba19a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER EVOQUE',
 'odometer': 35427,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_285ebede-2905-574b-a68a-be3e476ba19a/285ebede-2905-574b-a68a-be3e476ba19a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330814,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/316/6df30a8eeefc4d919ed8efee30f10dfa/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER RANGE ROVER EVOQUE 2.0 D204 SE AUTO 4WD MHEV',
 'transmission': 'manual',
 'trim': '2.0 D204 SE AUTO 4WD MHEV',
 'vin': None,
 'year': 2022}
2026-03-30 13:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989254%27 HTTP/1.1" 200 None
2026-03-30 13:30:50 [ayvens.es] INFO: Saving data for 1989254: {'created_time': 1774877450.393832, 'last_price_update_time': 1774877450.393842, 'auction_closing_time': 1774954800.0}
2026-03-30 13:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989254') HTTP/1.1" 204 0
2026-03-30 13:30:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/652/d8c0d1c149024061bfe2a9131e6043e7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:30:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/428/45d731818c694b26a841fab31738c88f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:30:50 [ayvens.es] INFO: Found listing with ID: 1989264
2026-03-30 13:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989264%27 HTTP/1.1" 200 None
2026-03-30 13:30:50 [ayvens.es] INFO: Scrape type for 1989264: 1
2026-03-30 13:30:50 [ayvens.es] INFO: Extracting data for car ID: 1989264
2026-03-30 13:30:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30490ab1-0d79-59a1-8a75-0f10967f5de1 with identifier: 1989264
2026-03-30 13:30:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30490ab1-0d79-59a1-8a75-0f10967f5de1 with scrape type 1
2026-03-30 13:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 30490ab1-0d79-59a1-8a75-0f10967f5de1
2026-03-30 13:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F617%252Ff27f5e2300e14f2788655851f722816a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/617/f27f5e2300e14f2788655851f722816a/images/large/1.jpg not downloaded yet
2026-03-30 13:30:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:30:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705d489690>
2026-03-30 13:30:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:30:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bda27e27-2d9f-5aed-bfe9-efb88f5f9ecf/bda27e27-2d9f-5aed-bfe9-efb88f5f9ecf_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F630%252Fe21e30cdf46c4229a22d0ee2ae0e25fc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/630/e21e30cdf46c4229a22d0ee2ae0e25fc/images/large/1.jpg saved to cache
2026-03-30 13:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bda27e27-2d9f-5aed-bfe9-efb88f5f9ecf
2026-03-30 13:30:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bda27e27-2d9f-5aed-bfe9-efb88f5f9ecf, skipping ID generation
2026-03-30 13:30:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bda27e27-2d9f-5aed-bfe9-efb88f5f9ecf with scrape type 1
2026-03-30 13:30:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bda27e27-2d9f-5aed-bfe9-efb88f5f9ecf sending to next pipeline
2026-03-30 13:30:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: bda27e27-2d9f-5aed-bfe9-efb88f5f9ecf, identifier: 1989255
2026-03-30 13:30:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:30:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705d3e8b90>
2026-03-30 13:30:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:30:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4fd1d53-6446-52f3-8b62-033bbfdba921/d4fd1d53-6446-52f3-8b62-033bbfdba921_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F947%252F12102ec787c14e31b68dc7e9a900c2ce%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/947/12102ec787c14e31b68dc7e9a900c2ce/images/large/1.jpg saved to cache
2026-03-30 13:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d4fd1d53-6446-52f3-8b62-033bbfdba921
2026-03-30 13:30:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d4fd1d53-6446-52f3-8b62-033bbfdba921, skipping ID generation
2026-03-30 13:30:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4fd1d53-6446-52f3-8b62-033bbfdba921 with scrape type 1
2026-03-30 13:30:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d4fd1d53-6446-52f3-8b62-033bbfdba921 sending to next pipeline
2026-03-30 13:30:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d4fd1d53-6446-52f3-8b62-033bbfdba921, identifier: 1989256
2026-03-30 13:30:50 [ayvens.es] INFO: Found listing with ID: 1989265
2026-03-30 13:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989265%27 HTTP/1.1" 200 None
2026-03-30 13:30:50 [ayvens.es] INFO: Scrape type for 1989265: 1
2026-03-30 13:30:50 [ayvens.es] INFO: Extracting data for car ID: 1989265
2026-03-30 13:30:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a55b84a6-287b-5a62-b4a1-f1516cef988c with identifier: 1989265
2026-03-30 13:30:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a55b84a6-287b-5a62-b4a1-f1516cef988c with scrape type 1
2026-03-30 13:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a55b84a6-287b-5a62-b4a1-f1516cef988c
2026-03-30 13:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F955%252F4c2649323831499b9c6a946467cfe2c1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/955/4c2649323831499b9c6a946467cfe2c1/images/large/1.jpg not downloaded yet
2026-03-30 13:30:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: bda27e27-2d9f-5aed-bfe9-efb88f5f9ecf with identifier: 1989255
2026-03-30 13:30:50 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 13:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-30 13:30:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: bda27e27-2d9f-5aed-bfe9-efb88f5f9ecf with identifier: 1989255
2026-03-30 13:30:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: bda27e27-2d9f-5aed-bfe9-efb88f5f9ecf with identifier: 1989255 to the API
2026-03-30 13:30:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:30:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:30:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/630/e21e30cdf46c4229a22d0ee2ae0e25fc/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'Plata',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'petrol',
 'id': 'bda27e27-2d9f-5aed-bfe9-efb88f5f9ecf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': 182653,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bda27e27-2d9f-5aed-bfe9-efb88f5f9ecf/bda27e27-2d9f-5aed-bfe9-efb88f5f9ecf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 516121,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/630/e21e30cdf46c4229a22d0ee2ae0e25fc/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FOCUS 1.0 Ecoboost MHEV 92kW Trend+',
 'transmission': 'manual',
 'trim': '1.0 Ecoboost MHEV 92kW Trend+',
 'vin': None,
 'year': 2021}
2026-03-30 13:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989255%27 HTTP/1.1" 200 None
2026-03-30 13:30:51 [ayvens.es] INFO: Saving data for 1989255: {'created_time': 1774877451.256839, 'last_price_update_time': 1774877451.256849, 'auction_closing_time': 1774954800.0}
2026-03-30 13:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989255') HTTP/1.1" 204 0
2026-03-30 13:30:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d4fd1d53-6446-52f3-8b62-033bbfdba921 with identifier: 1989256
2026-03-30 13:30:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d4fd1d53-6446-52f3-8b62-033bbfdba921 with identifier: 1989256
2026-03-30 13:30:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d4fd1d53-6446-52f3-8b62-033bbfdba921 with identifier: 1989256 to the API
2026-03-30 13:30:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:30:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:30:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/947/12102ec787c14e31b68dc7e9a900c2ce/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd4fd1d53-6446-52f3-8b62-033bbfdba921',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': 198846,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4fd1d53-6446-52f3-8b62-033bbfdba921/d4fd1d53-6446-52f3-8b62-033bbfdba921_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347167,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/947/12102ec787c14e31b68dc7e9a900c2ce/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FOCUS 1.5 Ecoblue 70kW Trend+',
 'transmission': 'manual',
 'trim': '1.5 Ecoblue 70kW Trend+',
 'vin': None,
 'year': 2022}
2026-03-30 13:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989256%27 HTTP/1.1" 200 None
2026-03-30 13:30:51 [ayvens.es] INFO: Saving data for 1989256: {'created_time': 1774877451.601977, 'last_price_update_time': 1774877451.601988, 'auction_closing_time': 1774954800.0}
2026-03-30 13:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989256') HTTP/1.1" 204 0
2026-03-30 13:30:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/753/bcf1e84dd56f4e13802fc5407b547942/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:30:51 [ayvens.es] INFO: Found listing with ID: 1989266
2026-03-30 13:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989266%27 HTTP/1.1" 200 None
2026-03-30 13:30:51 [ayvens.es] INFO: Scrape type for 1989266: 1
2026-03-30 13:30:51 [ayvens.es] INFO: Extracting data for car ID: 1989266
2026-03-30 13:30:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46d629d3-075c-5761-99f9-e31614cea42e with identifier: 1989266
2026-03-30 13:30:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46d629d3-075c-5761-99f9-e31614cea42e with scrape type 1
2026-03-30 13:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 46d629d3-075c-5761-99f9-e31614cea42e
2026-03-30 13:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F973%252F1b7eb8bec35547e2aed7500257e37157%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/973/1b7eb8bec35547e2aed7500257e37157/images/large/1.jpg not downloaded yet
2026-03-30 13:30:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:30:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f70609d52d0>
2026-03-30 13:30:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:30:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:30:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:30:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ac70fe0-3d28-5522-9a63-2d230bd1f920/2ac70fe0-3d28-5522-9a63-2d230bd1f920_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F652%252Fd8c0d1c149024061bfe2a9131e6043e7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/652/d8c0d1c149024061bfe2a9131e6043e7/images/large/1.jpg saved to cache
2026-03-30 13:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2ac70fe0-3d28-5522-9a63-2d230bd1f920
2026-03-30 13:30:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2ac70fe0-3d28-5522-9a63-2d230bd1f920, skipping ID generation
2026-03-30 13:30:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ac70fe0-3d28-5522-9a63-2d230bd1f920 with scrape type 1
2026-03-30 13:30:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2ac70fe0-3d28-5522-9a63-2d230bd1f920 sending to next pipeline
2026-03-30 13:30:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2ac70fe0-3d28-5522-9a63-2d230bd1f920, identifier: 1989258
2026-03-30 13:30:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:30:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705d419b10>
2026-03-30 13:30:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:30:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:30:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:30:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0b759d8-3609-5d1c-8236-5f947d445361/e0b759d8-3609-5d1c-8236-5f947d445361_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F428%252F45d731818c694b26a841fab31738c88f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/428/45d731818c694b26a841fab31738c88f/images/large/1.jpg saved to cache
2026-03-30 13:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e0b759d8-3609-5d1c-8236-5f947d445361
2026-03-30 13:30:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e0b759d8-3609-5d1c-8236-5f947d445361, skipping ID generation
2026-03-30 13:30:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0b759d8-3609-5d1c-8236-5f947d445361 with scrape type 1
2026-03-30 13:30:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e0b759d8-3609-5d1c-8236-5f947d445361 sending to next pipeline
2026-03-30 13:30:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e0b759d8-3609-5d1c-8236-5f947d445361, identifier: 1989257
2026-03-30 13:30:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/400/b969babe26ee4b0bb5bb9a29a530a93a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:30:52 [ayvens.es] INFO: Found listing with ID: 1989267
2026-03-30 13:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989267%27 HTTP/1.1" 200 None
2026-03-30 13:30:52 [ayvens.es] INFO: Scrape type for 1989267: 1
2026-03-30 13:30:52 [ayvens.es] INFO: Extracting data for car ID: 1989267
2026-03-30 13:30:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 243c7d6b-add0-50b0-ac26-da18c4aaa991 with identifier: 1989267
2026-03-30 13:30:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 243c7d6b-add0-50b0-ac26-da18c4aaa991 with scrape type 1
2026-03-30 13:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 243c7d6b-add0-50b0-ac26-da18c4aaa991
2026-03-30 13:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F302%252F86e3775aa5a143349d5915591a72ee14%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/302/86e3775aa5a143349d5915591a72ee14/images/large/1.jpg not downloaded yet
2026-03-30 13:30:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2ac70fe0-3d28-5522-9a63-2d230bd1f920 with identifier: 1989258
2026-03-30 13:30:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2ac70fe0-3d28-5522-9a63-2d230bd1f920 with identifier: 1989258
2026-03-30 13:30:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 2ac70fe0-3d28-5522-9a63-2d230bd1f920 with identifier: 1989258 to the API
2026-03-30 13:30:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:30:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:30:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/652/d8c0d1c149024061bfe2a9131e6043e7/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 96,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '2ac70fe0-3d28-5522-9a63-2d230bd1f920',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C3',
 'odometer': 168264,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ac70fe0-3d28-5522-9a63-2d230bd1f920/2ac70fe0-3d28-5522-9a63-2d230bd1f920_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 320579,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/652/d8c0d1c149024061bfe2a9131e6043e7/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-30',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROËN C3 BlueHDi 73KW (100CV) S&S Comercial',
 'transmission': 'manual',
 'trim': 'BlueHDi 73KW (100CV) S&S Comercial',
 'vin': None,
 'year': 2019}
2026-03-30 13:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989258%27 HTTP/1.1" 200 None
2026-03-30 13:30:52 [ayvens.es] INFO: Saving data for 1989258: {'created_time': 1774877452.491034, 'last_price_update_time': 1774877452.491045, 'auction_closing_time': 1774954800.0}
2026-03-30 13:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989258') HTTP/1.1" 204 0
2026-03-30 13:30:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e0b759d8-3609-5d1c-8236-5f947d445361 with identifier: 1989257
2026-03-30 13:30:52 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 13:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-30 13:30:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e0b759d8-3609-5d1c-8236-5f947d445361 with identifier: 1989257
2026-03-30 13:30:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e0b759d8-3609-5d1c-8236-5f947d445361 with identifier: 1989257 to the API
2026-03-30 13:30:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:30:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:30:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/428/45d731818c694b26a841fab31738c88f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'color': 'Sapporo white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'petrol',
 'id': 'e0b759d8-3609-5d1c-8236-5f947d445361',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 29752,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0b759d8-3609-5d1c-8236-5f947d445361/e0b759d8-3609-5d1c-8236-5f947d445361_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 338212,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/428/45d731818c694b26a841fab31738c88f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-09-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI DIG-T 103kW (140CV) mHEV 4x2 Acenta',
 'transmission': 'manual',
 'trim': 'DIG-T 103kW (140CV) mHEV 4x2 Acenta',
 'vin': None,
 'year': 2023}
2026-03-30 13:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989257%27 HTTP/1.1" 200 None
2026-03-30 13:30:52 [ayvens.es] INFO: Saving data for 1989257: {'created_time': 1774877452.876427, 'last_price_update_time': 1774877452.876443, 'auction_closing_time': 1774954800.0}
2026-03-30 13:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989257') HTTP/1.1" 204 0
2026-03-30 13:30:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/210/50c5678c197d4369bbb3c89d6237a443/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:30:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/642/458c2d57d6b04850aaa3f1a294df24e7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:30:52 [ayvens.es] INFO: Found listing with ID: 1989268
2026-03-30 13:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989268%27 HTTP/1.1" 200 None
2026-03-30 13:30:52 [ayvens.es] INFO: Scrape type for 1989268: 1
2026-03-30 13:30:52 [ayvens.es] INFO: Extracting data for car ID: 1989268
2026-03-30 13:30:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 823578ad-d40a-5fda-be13-1af5136ff1d8 with identifier: 1989268
2026-03-30 13:30:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 823578ad-d40a-5fda-be13-1af5136ff1d8 with scrape type 1
2026-03-30 13:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 823578ad-d40a-5fda-be13-1af5136ff1d8
2026-03-30 13:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F782%252Fbf70ffc6ae6b4488be7ee1194caaf10a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/782/bf70ffc6ae6b4488be7ee1194caaf10a/images/large/1.jpg not downloaded yet
2026-03-30 13:30:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:30:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705d5f0850>
2026-03-30 13:30:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:30:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:30:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:30:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2488b4a2-7793-53d1-a7dc-2bece275fb9f/2488b4a2-7793-53d1-a7dc-2bece275fb9f_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F753%252Fbcf1e84dd56f4e13802fc5407b547942%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/753/bcf1e84dd56f4e13802fc5407b547942/images/large/1.jpg saved to cache
2026-03-30 13:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2488b4a2-7793-53d1-a7dc-2bece275fb9f
2026-03-30 13:30:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2488b4a2-7793-53d1-a7dc-2bece275fb9f, skipping ID generation
2026-03-30 13:30:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2488b4a2-7793-53d1-a7dc-2bece275fb9f with scrape type 1
2026-03-30 13:30:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2488b4a2-7793-53d1-a7dc-2bece275fb9f sending to next pipeline
2026-03-30 13:30:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2488b4a2-7793-53d1-a7dc-2bece275fb9f, identifier: 1989259
2026-03-30 13:30:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:30:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705c51c110>
2026-03-30 13:30:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:30:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:30:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:30:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72d72db8-e3d6-5496-b7b5-b05e2d99a4ac/72d72db8-e3d6-5496-b7b5-b05e2d99a4ac_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F400%252Fb969babe26ee4b0bb5bb9a29a530a93a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/400/b969babe26ee4b0bb5bb9a29a530a93a/images/large/1.jpg saved to cache
2026-03-30 13:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 72d72db8-e3d6-5496-b7b5-b05e2d99a4ac
2026-03-30 13:30:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 72d72db8-e3d6-5496-b7b5-b05e2d99a4ac, skipping ID generation
2026-03-30 13:30:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72d72db8-e3d6-5496-b7b5-b05e2d99a4ac with scrape type 1
2026-03-30 13:30:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 72d72db8-e3d6-5496-b7b5-b05e2d99a4ac sending to next pipeline
2026-03-30 13:30:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 72d72db8-e3d6-5496-b7b5-b05e2d99a4ac, identifier: 1989260
2026-03-30 13:30:53 [ayvens.es] INFO: Found listing with ID: 1989269
2026-03-30 13:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989269%27 HTTP/1.1" 200 None
2026-03-30 13:30:53 [ayvens.es] INFO: Scrape type for 1989269: 1
2026-03-30 13:30:53 [ayvens.es] INFO: Extracting data for car ID: 1989269
2026-03-30 13:30:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fbf038e2-0f59-59df-964e-c4979a1d2c9d with identifier: 1989269
2026-03-30 13:30:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbf038e2-0f59-59df-964e-c4979a1d2c9d with scrape type 1
2026-03-30 13:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item fbf038e2-0f59-59df-964e-c4979a1d2c9d
2026-03-30 13:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F875%252Fc24a1dff6eeb40a58af56bd50684e0c3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/875/c24a1dff6eeb40a58af56bd50684e0c3/images/large/1.jpg not downloaded yet
2026-03-30 13:30:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2488b4a2-7793-53d1-a7dc-2bece275fb9f with identifier: 1989259
2026-03-30 13:30:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2488b4a2-7793-53d1-a7dc-2bece275fb9f with identifier: 1989259
2026-03-30 13:30:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 2488b4a2-7793-53d1-a7dc-2bece275fb9f with identifier: 1989259 to the API
2026-03-30 13:30:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:30:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:30:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/753/bcf1e84dd56f4e13802fc5407b547942/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '2488b4a2-7793-53d1-a7dc-2bece275fb9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT CONNECT',
 'odometer': 179677,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2488b4a2-7793-53d1-a7dc-2bece275fb9f/2488b4a2-7793-53d1-a7dc-2bece275fb9f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 341916,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/753/bcf1e84dd56f4e13802fc5407b547942/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-24',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FORD TRANSIT CONNECT Van 1.5 TDCi 74kW Trend 200 L1',
 'transmission': 'manual',
 'trim': 'Van 1.5 TDCi 74kW Trend 200 L1',
 'vin': None,
 'year': 2019}
2026-03-30 13:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989259%27 HTTP/1.1" 200 None
2026-03-30 13:30:53 [ayvens.es] INFO: Saving data for 1989259: {'created_time': 1774877453.92769, 'last_price_update_time': 1774877453.927702, 'auction_closing_time': 1774954800.0}
2026-03-30 13:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989259') HTTP/1.1" 204 0
2026-03-30 13:30:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 72d72db8-e3d6-5496-b7b5-b05e2d99a4ac with identifier: 1989260
2026-03-30 13:30:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 72d72db8-e3d6-5496-b7b5-b05e2d99a4ac with identifier: 1989260
2026-03-30 13:30:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 72d72db8-e3d6-5496-b7b5-b05e2d99a4ac with identifier: 1989260 to the API
2026-03-30 13:30:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:30:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:30:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/400/b969babe26ee4b0bb5bb9a29a530a93a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '72d72db8-e3d6-5496-b7b5-b05e2d99a4ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN',
 'odometer': 92124,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72d72db8-e3d6-5496-b7b5-b05e2d99a4ac/72d72db8-e3d6-5496-b7b5-b05e2d99a4ac_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 493281,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/400/b969babe26ee4b0bb5bb9a29a530a93a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN Urban Sport 2.0 TDI 110kW (150CV)',
 'transmission': 'manual',
 'trim': 'Urban Sport 2.0 TDI 110kW (150CV)',
 'vin': None,
 'year': 2022}
2026-03-30 13:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989260%27 HTTP/1.1" 200 None
2026-03-30 13:30:54 [ayvens.es] INFO: Saving data for 1989260: {'created_time': 1774877454.29713, 'last_price_update_time': 1774877454.297143, 'auction_closing_time': 1774954800.0}
2026-03-30 13:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989260') HTTP/1.1" 204 0
2026-03-30 13:30:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/857/62fd73612bfe4c879759d3eae010deb1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:30:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/617/f27f5e2300e14f2788655851f722816a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:30:54 [ayvens.es] INFO: Found listing with ID: 1989270
2026-03-30 13:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989270%27 HTTP/1.1" 200 None
2026-03-30 13:30:54 [ayvens.es] INFO: Scrape type for 1989270: 1
2026-03-30 13:30:54 [ayvens.es] INFO: Extracting data for car ID: 1989270
2026-03-30 13:30:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e5d96e7-5cc5-50a2-9d7d-5ed51484e97f with identifier: 1989270
2026-03-30 13:30:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e5d96e7-5cc5-50a2-9d7d-5ed51484e97f with scrape type 1
2026-03-30 13:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4e5d96e7-5cc5-50a2-9d7d-5ed51484e97f
2026-03-30 13:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F278%252F8d61fd8a9a4a4393b5de56f466efa796%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/278/8d61fd8a9a4a4393b5de56f466efa796/images/large/1.jpg not downloaded yet
2026-03-30 13:30:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:30:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705d5f2e50>
2026-03-30 13:30:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:30:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee6982a3-cca8-524f-bb1d-e41664c9645a/ee6982a3-cca8-524f-bb1d-e41664c9645a_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F210%252F50c5678c197d4369bbb3c89d6237a443%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/210/50c5678c197d4369bbb3c89d6237a443/images/large/1.jpg saved to cache
2026-03-30 13:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ee6982a3-cca8-524f-bb1d-e41664c9645a
2026-03-30 13:30:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ee6982a3-cca8-524f-bb1d-e41664c9645a, skipping ID generation
2026-03-30 13:30:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee6982a3-cca8-524f-bb1d-e41664c9645a with scrape type 1
2026-03-30 13:30:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ee6982a3-cca8-524f-bb1d-e41664c9645a sending to next pipeline
2026-03-30 13:30:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ee6982a3-cca8-524f-bb1d-e41664c9645a, identifier: 1989261
2026-03-30 13:30:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:30:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705c372f50>
2026-03-30 13:30:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:30:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b53169db-f7a4-57b9-adfd-b04d4db79c89/b53169db-f7a4-57b9-adfd-b04d4db79c89_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F642%252F458c2d57d6b04850aaa3f1a294df24e7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/642/458c2d57d6b04850aaa3f1a294df24e7/images/large/1.jpg saved to cache
2026-03-30 13:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b53169db-f7a4-57b9-adfd-b04d4db79c89
2026-03-30 13:30:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b53169db-f7a4-57b9-adfd-b04d4db79c89, skipping ID generation
2026-03-30 13:30:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b53169db-f7a4-57b9-adfd-b04d4db79c89 with scrape type 1
2026-03-30 13:30:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b53169db-f7a4-57b9-adfd-b04d4db79c89 sending to next pipeline
2026-03-30 13:30:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b53169db-f7a4-57b9-adfd-b04d4db79c89, identifier: 1989262
2026-03-30 13:30:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ee6982a3-cca8-524f-bb1d-e41664c9645a with identifier: 1989261
2026-03-30 13:30:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ee6982a3-cca8-524f-bb1d-e41664c9645a with identifier: 1989261
2026-03-30 13:30:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ee6982a3-cca8-524f-bb1d-e41664c9645a with identifier: 1989261 to the API
2026-03-30 13:30:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:30:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:30:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/210/50c5678c197d4369bbb3c89d6237a443/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ee6982a3-cca8-524f-bb1d-e41664c9645a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 164783,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee6982a3-cca8-524f-bb1d-e41664c9645a/ee6982a3-cca8-524f-bb1d-e41664c9645a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344397,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/210/50c5678c197d4369bbb3c89d6237a443/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO (O) Limited dCi 55kW (75CV) -18',
 'transmission': 'manual',
 'trim': '(O) Limited dCi 55kW (75CV) -18',
 'vin': None,
 'year': 2020}
2026-03-30 13:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989261%27 HTTP/1.1" 200 None
2026-03-30 13:30:55 [ayvens.es] INFO: Saving data for 1989261: {'created_time': 1774877455.093422, 'last_price_update_time': 1774877455.093437, 'auction_closing_time': 1774954800.0}
2026-03-30 13:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989261') HTTP/1.1" 204 0
2026-03-30 13:30:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b53169db-f7a4-57b9-adfd-b04d4db79c89 with identifier: 1989262
2026-03-30 13:30:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b53169db-f7a4-57b9-adfd-b04d4db79c89 with identifier: 1989262
2026-03-30 13:30:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b53169db-f7a4-57b9-adfd-b04d4db79c89 with identifier: 1989262 to the API
2026-03-30 13:30:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:30:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:30:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/642/458c2d57d6b04850aaa3f1a294df24e7/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b53169db-f7a4-57b9-adfd-b04d4db79c89',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 277004,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b53169db-f7a4-57b9-adfd-b04d4db79c89/b53169db-f7a4-57b9-adfd-b04d4db79c89_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 358633,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/642/458c2d57d6b04850aaa3f1a294df24e7/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO (O) Intens Blue dCi 74kW (100CV)',
 'transmission': 'manual',
 'trim': '(O) Intens Blue dCi 74kW (100CV)',
 'vin': None,
 'year': 2022}
2026-03-30 13:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989262%27 HTTP/1.1" 200 None
2026-03-30 13:30:55 [ayvens.es] INFO: Saving data for 1989262: {'created_time': 1774877455.509984, 'last_price_update_time': 1774877455.509996, 'auction_closing_time': 1774954800.0}
2026-03-30 13:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989262') HTTP/1.1" 204 0
2026-03-30 13:30:55 [ayvens.es] INFO: Found listing with ID: 1989271
2026-03-30 13:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989271%27 HTTP/1.1" 200 None
2026-03-30 13:30:55 [ayvens.es] INFO: Scrape type for 1989271: 1
2026-03-30 13:30:55 [ayvens.es] INFO: Extracting data for car ID: 1989271
2026-03-30 13:30:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebbcd4b5-69dd-58f3-ab9a-0f949da01601 with identifier: 1989271
2026-03-30 13:30:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebbcd4b5-69dd-58f3-ab9a-0f949da01601 with scrape type 1
2026-03-30 13:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ebbcd4b5-69dd-58f3-ab9a-0f949da01601
2026-03-30 13:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F578%252F735a09b0a1e1447eb39e5421ce57aacc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/578/735a09b0a1e1447eb39e5421ce57aacc/images/large/1.jpg not downloaded yet
2026-03-30 13:30:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:30:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705c4531d0>
2026-03-30 13:30:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:30:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:30:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:30:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6d41d45-ffdc-5edf-945f-b806391bbb1b/b6d41d45-ffdc-5edf-945f-b806391bbb1b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F857%252F62fd73612bfe4c879759d3eae010deb1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/857/62fd73612bfe4c879759d3eae010deb1/images/large/1.jpg saved to cache
2026-03-30 13:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b6d41d45-ffdc-5edf-945f-b806391bbb1b
2026-03-30 13:30:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b6d41d45-ffdc-5edf-945f-b806391bbb1b, skipping ID generation
2026-03-30 13:30:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6d41d45-ffdc-5edf-945f-b806391bbb1b with scrape type 1
2026-03-30 13:30:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b6d41d45-ffdc-5edf-945f-b806391bbb1b sending to next pipeline
2026-03-30 13:30:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b6d41d45-ffdc-5edf-945f-b806391bbb1b, identifier: 1989263
2026-03-30 13:30:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:30:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705d417710>
2026-03-30 13:30:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:30:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:30:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:30:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30490ab1-0d79-59a1-8a75-0f10967f5de1/30490ab1-0d79-59a1-8a75-0f10967f5de1_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F617%252Ff27f5e2300e14f2788655851f722816a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/617/f27f5e2300e14f2788655851f722816a/images/large/1.jpg saved to cache
2026-03-30 13:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 30490ab1-0d79-59a1-8a75-0f10967f5de1
2026-03-30 13:30:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 30490ab1-0d79-59a1-8a75-0f10967f5de1, skipping ID generation
2026-03-30 13:30:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30490ab1-0d79-59a1-8a75-0f10967f5de1 with scrape type 1
2026-03-30 13:30:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 30490ab1-0d79-59a1-8a75-0f10967f5de1 sending to next pipeline
2026-03-30 13:30:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 30490ab1-0d79-59a1-8a75-0f10967f5de1, identifier: 1989264
2026-03-30 13:30:56 [ayvens.es] INFO: Found listing with ID: 1989272
2026-03-30 13:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989272%27 HTTP/1.1" 200 None
2026-03-30 13:30:56 [ayvens.es] INFO: Scrape type for 1989272: 1
2026-03-30 13:30:56 [ayvens.es] INFO: Extracting data for car ID: 1989272
2026-03-30 13:30:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 260f55de-20e6-59ec-852a-a5646e4ae7bc with identifier: 1989272
2026-03-30 13:30:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 260f55de-20e6-59ec-852a-a5646e4ae7bc with scrape type 1
2026-03-30 13:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 260f55de-20e6-59ec-852a-a5646e4ae7bc
2026-03-30 13:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F703%252Faefd809bc4144381a18667143a7fb189%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/703/aefd809bc4144381a18667143a7fb189/images/large/1.jpg not downloaded yet
2026-03-30 13:30:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b6d41d45-ffdc-5edf-945f-b806391bbb1b with identifier: 1989263
2026-03-30 13:30:56 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 13:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-30 13:30:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b6d41d45-ffdc-5edf-945f-b806391bbb1b with identifier: 1989263
2026-03-30 13:30:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b6d41d45-ffdc-5edf-945f-b806391bbb1b with identifier: 1989263 to the API
2026-03-30 13:30:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:30:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:30:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/857/62fd73612bfe4c879759d3eae010deb1/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'color': 'Azul atlantico',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b6d41d45-ffdc-5edf-945f-b806391bbb1b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN',
 'odometer': 104232,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6d41d45-ffdc-5edf-945f-b806391bbb1b/b6d41d45-ffdc-5edf-945f-b806391bbb1b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 373019,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/857/62fd73612bfe4c879759d3eae010deb1/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN Sport 2.0 TDI 110kW (150CV) DSG',
 'transmission': 'manual',
 'trim': 'Sport 2.0 TDI 110kW (150CV) DSG',
 'vin': None,
 'year': 2018}
2026-03-30 13:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989263%27 HTTP/1.1" 200 None
2026-03-30 13:30:56 [ayvens.es] INFO: Saving data for 1989263: {'created_time': 1774877456.456269, 'last_price_update_time': 1774877456.456282, 'auction_closing_time': 1774954800.0}
2026-03-30 13:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989263') HTTP/1.1" 204 0
2026-03-30 13:30:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 30490ab1-0d79-59a1-8a75-0f10967f5de1 with identifier: 1989264
2026-03-30 13:30:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 30490ab1-0d79-59a1-8a75-0f10967f5de1 with identifier: 1989264
2026-03-30 13:30:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 30490ab1-0d79-59a1-8a75-0f10967f5de1 with identifier: 1989264 to the API
2026-03-30 13:30:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:30:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:30:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/617/f27f5e2300e14f2788655851f722816a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 188,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '30490ab1-0d79-59a1-8a75-0f10967f5de1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'TRAFIC',
 'odometer': 48882,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30490ab1-0d79-59a1-8a75-0f10967f5de1/30490ab1-0d79-59a1-8a75-0f10967f5de1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332789,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/617/f27f5e2300e14f2788655851f722816a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-06-21',
 'seats_number': 9,
 'seller_name': None,
 'title': 'RENAULT TRAFIC (O) Authentic Energy Blue dCi 81 kW (110CV)',
 'transmission': 'manual',
 'trim': '(O) Authentic Energy Blue dCi 81 kW (110CV)',
 'vin': None,
 'year': 2024}
2026-03-30 13:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989264%27 HTTP/1.1" 200 None
2026-03-30 13:30:56 [ayvens.es] INFO: Saving data for 1989264: {'created_time': 1774877456.782233, 'last_price_update_time': 1774877456.782244, 'auction_closing_time': 1774954800.0}
2026-03-30 13:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989264') HTTP/1.1" 204 0
2026-03-30 13:30:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/955/4c2649323831499b9c6a946467cfe2c1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:30:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/973/1b7eb8bec35547e2aed7500257e37157/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:30:56 [ayvens.es] INFO: Found listing with ID: 1989273
2026-03-30 13:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989273%27 HTTP/1.1" 200 None
2026-03-30 13:30:56 [ayvens.es] INFO: Scrape type for 1989273: 1
2026-03-30 13:30:56 [ayvens.es] INFO: Extracting data for car ID: 1989273
2026-03-30 13:30:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a83cfc18-24f7-55c5-8346-f0965293cfd4 with identifier: 1989273
2026-03-30 13:30:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a83cfc18-24f7-55c5-8346-f0965293cfd4 with scrape type 1
2026-03-30 13:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a83cfc18-24f7-55c5-8346-f0965293cfd4
2026-03-30 13:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F786%252Fe637e31db2e14ce78bb20102e5708d34%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/786/e637e31db2e14ce78bb20102e5708d34/images/large/1.jpg not downloaded yet
2026-03-30 13:30:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/782/bf70ffc6ae6b4488be7ee1194caaf10a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:30:56 [ayvens.es] INFO: Found listing with ID: 1989274
2026-03-30 13:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989274%27 HTTP/1.1" 200 None
2026-03-30 13:30:56 [ayvens.es] INFO: Scrape type for 1989274: 1
2026-03-30 13:30:56 [ayvens.es] INFO: Extracting data for car ID: 1989274
2026-03-30 13:30:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fed88f4a-70aa-5e07-88b6-2156d1c2d510 with identifier: 1989274
2026-03-30 13:30:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fed88f4a-70aa-5e07-88b6-2156d1c2d510 with scrape type 1
2026-03-30 13:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item fed88f4a-70aa-5e07-88b6-2156d1c2d510
2026-03-30 13:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F680%252F5c53ed9b25884a5aa431cc16401537cd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/680/5c53ed9b25884a5aa431cc16401537cd/images/large/1.jpg not downloaded yet
2026-03-30 13:30:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/302/86e3775aa5a143349d5915591a72ee14/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:30:56 [ayvens.es] INFO: Found listing with ID: 1989275
2026-03-30 13:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989275%27 HTTP/1.1" 200 None
2026-03-30 13:30:56 [ayvens.es] INFO: Scrape type for 1989275: 1
2026-03-30 13:30:56 [ayvens.es] INFO: Extracting data for car ID: 1989275
2026-03-30 13:30:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e23dcefd-bd2f-5621-b1d5-28677d57f8c2 with identifier: 1989275
2026-03-30 13:30:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e23dcefd-bd2f-5621-b1d5-28677d57f8c2 with scrape type 1
2026-03-30 13:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e23dcefd-bd2f-5621-b1d5-28677d57f8c2
2026-03-30 13:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F476%252F2d1274c42820446b90bb2ea98991d614%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/476/2d1274c42820446b90bb2ea98991d614/images/large/1.jpg not downloaded yet
2026-03-30 13:30:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/278/8d61fd8a9a4a4393b5de56f466efa796/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:30:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:30:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705ce3ed90>
2026-03-30 13:30:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:30:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:30:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:30:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a55b84a6-287b-5a62-b4a1-f1516cef988c/a55b84a6-287b-5a62-b4a1-f1516cef988c_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F955%252F4c2649323831499b9c6a946467cfe2c1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/955/4c2649323831499b9c6a946467cfe2c1/images/large/1.jpg saved to cache
2026-03-30 13:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a55b84a6-287b-5a62-b4a1-f1516cef988c
2026-03-30 13:30:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a55b84a6-287b-5a62-b4a1-f1516cef988c, skipping ID generation
2026-03-30 13:30:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a55b84a6-287b-5a62-b4a1-f1516cef988c with scrape type 1
2026-03-30 13:30:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a55b84a6-287b-5a62-b4a1-f1516cef988c sending to next pipeline
2026-03-30 13:30:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a55b84a6-287b-5a62-b4a1-f1516cef988c, identifier: 1989265
2026-03-30 13:30:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:30:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705d438f90>
2026-03-30 13:30:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:30:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:30:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:30:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46d629d3-075c-5761-99f9-e31614cea42e/46d629d3-075c-5761-99f9-e31614cea42e_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F973%252F1b7eb8bec35547e2aed7500257e37157%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/973/1b7eb8bec35547e2aed7500257e37157/images/large/1.jpg saved to cache
2026-03-30 13:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 46d629d3-075c-5761-99f9-e31614cea42e
2026-03-30 13:30:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 46d629d3-075c-5761-99f9-e31614cea42e, skipping ID generation
2026-03-30 13:30:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46d629d3-075c-5761-99f9-e31614cea42e with scrape type 1
2026-03-30 13:30:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 46d629d3-075c-5761-99f9-e31614cea42e sending to next pipeline
2026-03-30 13:30:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 46d629d3-075c-5761-99f9-e31614cea42e, identifier: 1989266
2026-03-30 13:30:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/875/c24a1dff6eeb40a58af56bd50684e0c3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:30:57 [ayvens.es] INFO: Found listing with ID: 1989276
2026-03-30 13:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989276%27 HTTP/1.1" 200 None
2026-03-30 13:30:57 [ayvens.es] INFO: Scrape type for 1989276: 1
2026-03-30 13:30:57 [ayvens.es] INFO: Extracting data for car ID: 1989276
2026-03-30 13:30:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cbdfaa93-d2eb-5da4-86c2-4186621b2084 with identifier: 1989276
2026-03-30 13:30:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbdfaa93-d2eb-5da4-86c2-4186621b2084 with scrape type 1
2026-03-30 13:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item cbdfaa93-d2eb-5da4-86c2-4186621b2084
2026-03-30 13:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F404%252Fac2ecb7ba4614e558d54200d60f0b17d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/404/ac2ecb7ba4614e558d54200d60f0b17d/images/large/1.jpg not downloaded yet
2026-03-30 13:30:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a55b84a6-287b-5a62-b4a1-f1516cef988c with identifier: 1989265
2026-03-30 13:30:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a55b84a6-287b-5a62-b4a1-f1516cef988c with identifier: 1989265
2026-03-30 13:30:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a55b84a6-287b-5a62-b4a1-f1516cef988c with identifier: 1989265 to the API
2026-03-30 13:30:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:30:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:30:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/955/4c2649323831499b9c6a946467cfe2c1/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'petrol',
 'id': 'a55b84a6-287b-5a62-b4a1-f1516cef988c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'CORSA',
 'odometer': 54534,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a55b84a6-287b-5a62-b4a1-f1516cef988c/a55b84a6-287b-5a62-b4a1-f1516cef988c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 505770,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/955/4c2649323831499b9c6a946467cfe2c1/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL CORSA 1.2T XHL 74kW (100CV) Edition',
 'transmission': 'manual',
 'trim': '1.2T XHL 74kW (100CV) Edition',
 'vin': None,
 'year': 2021}
2026-03-30 13:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989265%27 HTTP/1.1" 200 None
2026-03-30 13:30:57 [ayvens.es] INFO: Saving data for 1989265: {'created_time': 1774877457.875387, 'last_price_update_time': 1774877457.875398, 'auction_closing_time': 1774954800.0}
2026-03-30 13:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989265') HTTP/1.1" 204 0
2026-03-30 13:30:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 46d629d3-075c-5761-99f9-e31614cea42e with identifier: 1989266
2026-03-30 13:30:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 46d629d3-075c-5761-99f9-e31614cea42e with identifier: 1989266
2026-03-30 13:30:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 46d629d3-075c-5761-99f9-e31614cea42e with identifier: 1989266 to the API
2026-03-30 13:30:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:30:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:30:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/973/1b7eb8bec35547e2aed7500257e37157/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 95,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '46d629d3-075c-5761-99f9-e31614cea42e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MEGANE',
 'odometer': 331309,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46d629d3-075c-5761-99f9-e31614cea42e/46d629d3-075c-5761-99f9-e31614cea42e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 470388,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/973/1b7eb8bec35547e2aed7500257e37157/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT MEGANE Business Energy dCi 66kW (90CV)',
 'transmission': 'manual',
 'trim': 'Business Energy dCi 66kW (90CV)',
 'vin': None,
 'year': 2017}
2026-03-30 13:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989266%27 HTTP/1.1" 200 None
2026-03-30 13:30:58 [ayvens.es] INFO: Saving data for 1989266: {'created_time': 1774877458.235421, 'last_price_update_time': 1774877458.235432, 'auction_closing_time': 1774954800.0}
2026-03-30 13:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989266') HTTP/1.1" 204 0
2026-03-30 13:30:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:30:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705c470590>
2026-03-30 13:30:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:30:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:30:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:30:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_823578ad-d40a-5fda-be13-1af5136ff1d8/823578ad-d40a-5fda-be13-1af5136ff1d8_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F782%252Fbf70ffc6ae6b4488be7ee1194caaf10a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/782/bf70ffc6ae6b4488be7ee1194caaf10a/images/large/1.jpg saved to cache
2026-03-30 13:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 823578ad-d40a-5fda-be13-1af5136ff1d8
2026-03-30 13:30:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 823578ad-d40a-5fda-be13-1af5136ff1d8, skipping ID generation
2026-03-30 13:30:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 823578ad-d40a-5fda-be13-1af5136ff1d8 with scrape type 1
2026-03-30 13:30:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 823578ad-d40a-5fda-be13-1af5136ff1d8 sending to next pipeline
2026-03-30 13:30:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 823578ad-d40a-5fda-be13-1af5136ff1d8, identifier: 1989268
2026-03-30 13:30:58 [ayvens.es] INFO: Found listing with ID: 1989277
2026-03-30 13:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989277%27 HTTP/1.1" 200 None
2026-03-30 13:30:58 [ayvens.es] INFO: Scrape type for 1989277: 1
2026-03-30 13:30:58 [ayvens.es] INFO: Extracting data for car ID: 1989277
2026-03-30 13:30:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb90919c-827a-53c6-afc1-5647b138c6c9 with identifier: 1989277
2026-03-30 13:30:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb90919c-827a-53c6-afc1-5647b138c6c9 with scrape type 1
2026-03-30 13:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item fb90919c-827a-53c6-afc1-5647b138c6c9
2026-03-30 13:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F829%252Fba5e131250d44aa0b8f292c0d8e4e455%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/829/ba5e131250d44aa0b8f292c0d8e4e455/images/large/1.jpg not downloaded yet
2026-03-30 13:30:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 823578ad-d40a-5fda-be13-1af5136ff1d8 with identifier: 1989268
2026-03-30 13:30:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 823578ad-d40a-5fda-be13-1af5136ff1d8 with identifier: 1989268
2026-03-30 13:30:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 823578ad-d40a-5fda-be13-1af5136ff1d8 with identifier: 1989268 to the API
2026-03-30 13:30:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:30:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:30:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/782/bf70ffc6ae6b4488be7ee1194caaf10a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 188,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '823578ad-d40a-5fda-be13-1af5136ff1d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'TRAFIC',
 'odometer': 33683,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_823578ad-d40a-5fda-be13-1af5136ff1d8/823578ad-d40a-5fda-be13-1af5136ff1d8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336977,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/782/bf70ffc6ae6b4488be7ee1194caaf10a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-07-11',
 'seats_number': 9,
 'seller_name': None,
 'title': 'RENAULT TRAFIC (O) Authentic Energy Blue dCi 81 kW (110CV)',
 'transmission': 'manual',
 'trim': '(O) Authentic Energy Blue dCi 81 kW (110CV)',
 'vin': None,
 'year': 2024}
2026-03-30 13:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989268%27 HTTP/1.1" 200 None
2026-03-30 13:30:58 [ayvens.es] INFO: Saving data for 1989268: {'created_time': 1774877458.878794, 'last_price_update_time': 1774877458.878808, 'auction_closing_time': 1774954800.0}
2026-03-30 13:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989268') HTTP/1.1" 204 0
2026-03-30 13:30:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:30:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705c516ed0>
2026-03-30 13:30:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:30:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:30:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:30:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_243c7d6b-add0-50b0-ac26-da18c4aaa991/243c7d6b-add0-50b0-ac26-da18c4aaa991_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F302%252F86e3775aa5a143349d5915591a72ee14%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/302/86e3775aa5a143349d5915591a72ee14/images/large/1.jpg saved to cache
2026-03-30 13:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 243c7d6b-add0-50b0-ac26-da18c4aaa991
2026-03-30 13:30:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 243c7d6b-add0-50b0-ac26-da18c4aaa991, skipping ID generation
2026-03-30 13:30:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 243c7d6b-add0-50b0-ac26-da18c4aaa991 with scrape type 1
2026-03-30 13:30:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 243c7d6b-add0-50b0-ac26-da18c4aaa991 sending to next pipeline
2026-03-30 13:30:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 243c7d6b-add0-50b0-ac26-da18c4aaa991, identifier: 1989267
2026-03-30 13:30:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:30:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705c5336d0>
2026-03-30 13:30:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:30:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:30:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:30:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e5d96e7-5cc5-50a2-9d7d-5ed51484e97f/4e5d96e7-5cc5-50a2-9d7d-5ed51484e97f_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F278%252F8d61fd8a9a4a4393b5de56f466efa796%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/278/8d61fd8a9a4a4393b5de56f466efa796/images/large/1.jpg saved to cache
2026-03-30 13:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4e5d96e7-5cc5-50a2-9d7d-5ed51484e97f
2026-03-30 13:30:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4e5d96e7-5cc5-50a2-9d7d-5ed51484e97f, skipping ID generation
2026-03-30 13:30:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e5d96e7-5cc5-50a2-9d7d-5ed51484e97f with scrape type 1
2026-03-30 13:30:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4e5d96e7-5cc5-50a2-9d7d-5ed51484e97f sending to next pipeline
2026-03-30 13:30:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4e5d96e7-5cc5-50a2-9d7d-5ed51484e97f, identifier: 1989270
2026-03-30 13:30:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:30:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705d45f790>
2026-03-30 13:30:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:30:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:30:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:30:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbf038e2-0f59-59df-964e-c4979a1d2c9d/fbf038e2-0f59-59df-964e-c4979a1d2c9d_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F875%252Fc24a1dff6eeb40a58af56bd50684e0c3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/875/c24a1dff6eeb40a58af56bd50684e0c3/images/large/1.jpg saved to cache
2026-03-30 13:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fbf038e2-0f59-59df-964e-c4979a1d2c9d
2026-03-30 13:30:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fbf038e2-0f59-59df-964e-c4979a1d2c9d, skipping ID generation
2026-03-30 13:30:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbf038e2-0f59-59df-964e-c4979a1d2c9d with scrape type 1
2026-03-30 13:30:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fbf038e2-0f59-59df-964e-c4979a1d2c9d sending to next pipeline
2026-03-30 13:30:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: fbf038e2-0f59-59df-964e-c4979a1d2c9d, identifier: 1989269
2026-03-30 13:30:59 [ayvens.es] INFO: Found listing with ID: 1989278
2026-03-30 13:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989278%27 HTTP/1.1" 200 None
2026-03-30 13:30:59 [ayvens.es] INFO: Scrape type for 1989278: 1
2026-03-30 13:30:59 [ayvens.es] INFO: Extracting data for car ID: 1989278
2026-03-30 13:30:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebb1cdc5-78ba-55f5-9ed3-52cacbd87d50 with identifier: 1989278
2026-03-30 13:30:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebb1cdc5-78ba-55f5-9ed3-52cacbd87d50 with scrape type 1
2026-03-30 13:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ebb1cdc5-78ba-55f5-9ed3-52cacbd87d50
2026-03-30 13:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F809%252F83a816673f6d421988904b3bcbe85ca3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/809/83a816673f6d421988904b3bcbe85ca3/images/large/1.jpg not downloaded yet
2026-03-30 13:30:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 243c7d6b-add0-50b0-ac26-da18c4aaa991 with identifier: 1989267
2026-03-30 13:30:59 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 13:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-30 13:30:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 243c7d6b-add0-50b0-ac26-da18c4aaa991 with identifier: 1989267
2026-03-30 13:30:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 243c7d6b-add0-50b0-ac26-da18c4aaa991 with identifier: 1989267 to the API
2026-03-30 13:30:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:30:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:30:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/302/86e3775aa5a143349d5915591a72ee14/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 171,
 'color': 'Eiger grey',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '243c7d6b-add0-50b0-ac26-da18c4aaa991',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER EVOQUE',
 'odometer': 36925,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_243c7d6b-add0-50b0-ac26-da18c4aaa991/243c7d6b-add0-50b0-ac26-da18c4aaa991_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 548139,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/302/86e3775aa5a143349d5915591a72ee14/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER RANGE ROVER EVOQUE 2.0 D163 R-Dynamic S AUTO 4WD MHEV',
 'transmission': 'manual',
 'trim': '2.0 D163 R-Dynamic S AUTO 4WD MHEV',
 'vin': None,
 'year': 2022}
2026-03-30 13:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989267%27 HTTP/1.1" 200 None
2026-03-30 13:30:59 [ayvens.es] INFO: Saving data for 1989267: {'created_time': 1774877459.880472, 'last_price_update_time': 1774877459.880483, 'auction_closing_time': 1774954800.0}
2026-03-30 13:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989267') HTTP/1.1" 204 0
2026-03-30 13:30:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4e5d96e7-5cc5-50a2-9d7d-5ed51484e97f with identifier: 1989270
2026-03-30 13:30:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4e5d96e7-5cc5-50a2-9d7d-5ed51484e97f with identifier: 1989270
2026-03-30 13:30:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 4e5d96e7-5cc5-50a2-9d7d-5ed51484e97f with identifier: 1989270 to the API
2026-03-30 13:30:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:31:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:31:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/278/8d61fd8a9a4a4393b5de56f466efa796/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '4e5d96e7-5cc5-50a2-9d7d-5ed51484e97f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO',
 'odometer': 32258,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e5d96e7-5cc5-50a2-9d7d-5ed51484e97f/4e5d96e7-5cc5-50a2-9d7d-5ed51484e97f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353222,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/278/8d61fd8a9a4a4393b5de56f466efa796/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT KANGOO Profesional M1-AF En. dCi 55kW (75CV) E6',
 'transmission': 'manual',
 'trim': 'Profesional M1-AF En. dCi 55kW (75CV) E6',
 'vin': None,
 'year': 2017}
2026-03-30 13:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989270%27 HTTP/1.1" 200 None
2026-03-30 13:31:00 [ayvens.es] INFO: Saving data for 1989270: {'created_time': 1774877460.268803, 'last_price_update_time': 1774877460.268815, 'auction_closing_time': 1774954800.0}
2026-03-30 13:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989270') HTTP/1.1" 204 0
2026-03-30 13:31:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: fbf038e2-0f59-59df-964e-c4979a1d2c9d with identifier: 1989269
2026-03-30 13:31:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: fbf038e2-0f59-59df-964e-c4979a1d2c9d with identifier: 1989269
2026-03-30 13:31:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: fbf038e2-0f59-59df-964e-c4979a1d2c9d with identifier: 1989269 to the API
2026-03-30 13:31:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:31:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:31:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/875/c24a1dff6eeb40a58af56bd50684e0c3/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'fbf038e2-0f59-59df-964e-c4979a1d2c9d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'COROLLA',
 'odometer': 90150,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbf038e2-0f59-59df-964e-c4979a1d2c9d/fbf038e2-0f59-59df-964e-c4979a1d2c9d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 499675,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/875/c24a1dff6eeb40a58af56bd50684e0c3/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA COROLLA 1.8 125H ACTIVE TECH E-CVT TOU SPORT**revisar '
          'peritacion**',
 'transmission': 'manual',
 'trim': '1.8 125H ACTIVE TECH E-CVT TOU SPORT**revisar peritacion**',
 'vin': None,
 'year': 2021}
2026-03-30 13:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989269%27 HTTP/1.1" 200 None
2026-03-30 13:31:00 [ayvens.es] INFO: Saving data for 1989269: {'created_time': 1774877460.899507, 'last_price_update_time': 1774877460.899518, 'auction_closing_time': 1774954800.0}
2026-03-30 13:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989269') HTTP/1.1" 204 0
2026-03-30 13:31:00 [ayvens.es] INFO: Found listing with ID: 1989279
2026-03-30 13:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989279%27 HTTP/1.1" 200 None
2026-03-30 13:31:00 [ayvens.es] INFO: Scrape type for 1989279: 1
2026-03-30 13:31:00 [ayvens.es] INFO: Extracting data for car ID: 1989279
2026-03-30 13:31:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48098480-8512-509b-a08c-37ba17ed0201 with identifier: 1989279
2026-03-30 13:31:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48098480-8512-509b-a08c-37ba17ed0201 with scrape type 1
2026-03-30 13:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 48098480-8512-509b-a08c-37ba17ed0201
2026-03-30 13:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F523%252F5fda110fddc2437fbb01848cfb6e0c6e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/523/5fda110fddc2437fbb01848cfb6e0c6e/images/large/1.jpg not downloaded yet
2026-03-30 13:31:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/578/735a09b0a1e1447eb39e5421ce57aacc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:31:00 [ayvens.es] INFO: Found listing with ID: 1989280
2026-03-30 13:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989280%27 HTTP/1.1" 200 None
2026-03-30 13:31:00 [ayvens.es] INFO: Scrape type for 1989280: 1
2026-03-30 13:31:00 [ayvens.es] INFO: Extracting data for car ID: 1989280
2026-03-30 13:31:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f66e61f-c0dc-584e-8921-434a8414fc99 with identifier: 1989280
2026-03-30 13:31:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f66e61f-c0dc-584e-8921-434a8414fc99 with scrape type 1
2026-03-30 13:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4f66e61f-c0dc-584e-8921-434a8414fc99
2026-03-30 13:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F270%252F61e0b8fef9d445ba97551630ad645c24%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/270/61e0b8fef9d445ba97551630ad645c24/images/large/1.jpg not downloaded yet
2026-03-30 13:31:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/703/aefd809bc4144381a18667143a7fb189/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:31:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/786/e637e31db2e14ce78bb20102e5708d34/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:31:01 [ayvens.es] INFO: Found listing with ID: 1989281
2026-03-30 13:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989281%27 HTTP/1.1" 200 None
2026-03-30 13:31:01 [ayvens.es] INFO: Scrape type for 1989281: 1
2026-03-30 13:31:01 [ayvens.es] INFO: Extracting data for car ID: 1989281
2026-03-30 13:31:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: febdf4c3-9a6a-5495-83c4-7174d4dbf417 with identifier: 1989281
2026-03-30 13:31:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item febdf4c3-9a6a-5495-83c4-7174d4dbf417 with scrape type 1
2026-03-30 13:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item febdf4c3-9a6a-5495-83c4-7174d4dbf417
2026-03-30 13:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F422%252Fd70591b0d2e84031b91c099f931727b1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/422/d70591b0d2e84031b91c099f931727b1/images/large/1.jpg not downloaded yet
2026-03-30 13:31:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/680/5c53ed9b25884a5aa431cc16401537cd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:31:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/476/2d1274c42820446b90bb2ea98991d614/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:31:01 [ayvens.es] INFO: Found listing with ID: 1989282
2026-03-30 13:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989282%27 HTTP/1.1" 200 None
2026-03-30 13:31:01 [ayvens.es] INFO: Scrape type for 1989282: 1
2026-03-30 13:31:01 [ayvens.es] INFO: Extracting data for car ID: 1989282
2026-03-30 13:31:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 783d9d61-3f23-5caa-8d7d-e96c786a18da with identifier: 1989282
2026-03-30 13:31:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 783d9d61-3f23-5caa-8d7d-e96c786a18da with scrape type 1
2026-03-30 13:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 783d9d61-3f23-5caa-8d7d-e96c786a18da
2026-03-30 13:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F940%252F650df9f576a846afa755aea13be7bd06%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/940/650df9f576a846afa755aea13be7bd06/images/large/1.jpg not downloaded yet
2026-03-30 13:31:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/404/ac2ecb7ba4614e558d54200d60f0b17d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:31:01 [ayvens.es] INFO: Found listing with ID: 1989283
2026-03-30 13:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989283%27 HTTP/1.1" 200 None
2026-03-30 13:31:01 [ayvens.es] INFO: Scrape type for 1989283: 1
2026-03-30 13:31:01 [ayvens.es] INFO: Extracting data for car ID: 1989283
2026-03-30 13:31:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63cc4681-52bf-5c25-aa2a-d6125d4a8cdc with identifier: 1989283
2026-03-30 13:31:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63cc4681-52bf-5c25-aa2a-d6125d4a8cdc with scrape type 1
2026-03-30 13:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 63cc4681-52bf-5c25-aa2a-d6125d4a8cdc
2026-03-30 13:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F588%252F24a1a57f707d48c9b3b4e6241dd5e49b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/588/24a1a57f707d48c9b3b4e6241dd5e49b/images/large/1.jpg not downloaded yet
2026-03-30 13:31:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:31:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705d45c810>
2026-03-30 13:31:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:31:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebbcd4b5-69dd-58f3-ab9a-0f949da01601/ebbcd4b5-69dd-58f3-ab9a-0f949da01601_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F578%252F735a09b0a1e1447eb39e5421ce57aacc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/578/735a09b0a1e1447eb39e5421ce57aacc/images/large/1.jpg saved to cache
2026-03-30 13:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ebbcd4b5-69dd-58f3-ab9a-0f949da01601
2026-03-30 13:31:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ebbcd4b5-69dd-58f3-ab9a-0f949da01601, skipping ID generation
2026-03-30 13:31:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebbcd4b5-69dd-58f3-ab9a-0f949da01601 with scrape type 1
2026-03-30 13:31:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ebbcd4b5-69dd-58f3-ab9a-0f949da01601 sending to next pipeline
2026-03-30 13:31:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ebbcd4b5-69dd-58f3-ab9a-0f949da01601, identifier: 1989271
2026-03-30 13:31:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:31:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705c4728d0>
2026-03-30 13:31:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:31:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_260f55de-20e6-59ec-852a-a5646e4ae7bc/260f55de-20e6-59ec-852a-a5646e4ae7bc_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F703%252Faefd809bc4144381a18667143a7fb189%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/703/aefd809bc4144381a18667143a7fb189/images/large/1.jpg saved to cache
2026-03-30 13:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 260f55de-20e6-59ec-852a-a5646e4ae7bc
2026-03-30 13:31:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 260f55de-20e6-59ec-852a-a5646e4ae7bc, skipping ID generation
2026-03-30 13:31:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 260f55de-20e6-59ec-852a-a5646e4ae7bc with scrape type 1
2026-03-30 13:31:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 260f55de-20e6-59ec-852a-a5646e4ae7bc sending to next pipeline
2026-03-30 13:31:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 260f55de-20e6-59ec-852a-a5646e4ae7bc, identifier: 1989272
2026-03-30 13:31:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:31:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705efd8590>
2026-03-30 13:31:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:31:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a83cfc18-24f7-55c5-8346-f0965293cfd4/a83cfc18-24f7-55c5-8346-f0965293cfd4_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F786%252Fe637e31db2e14ce78bb20102e5708d34%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/786/e637e31db2e14ce78bb20102e5708d34/images/large/1.jpg saved to cache
2026-03-30 13:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a83cfc18-24f7-55c5-8346-f0965293cfd4
2026-03-30 13:31:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a83cfc18-24f7-55c5-8346-f0965293cfd4, skipping ID generation
2026-03-30 13:31:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a83cfc18-24f7-55c5-8346-f0965293cfd4 with scrape type 1
2026-03-30 13:31:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a83cfc18-24f7-55c5-8346-f0965293cfd4 sending to next pipeline
2026-03-30 13:31:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a83cfc18-24f7-55c5-8346-f0965293cfd4, identifier: 1989273
2026-03-30 13:31:01 [ayvens.es] INFO: Found listing with ID: 1989284
2026-03-30 13:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989284%27 HTTP/1.1" 200 None
2026-03-30 13:31:01 [ayvens.es] INFO: Scrape type for 1989284: 1
2026-03-30 13:31:01 [ayvens.es] INFO: Extracting data for car ID: 1989284
2026-03-30 13:31:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94af0a33-90a1-5148-ac1e-df2108f51800 with identifier: 1989284
2026-03-30 13:31:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94af0a33-90a1-5148-ac1e-df2108f51800 with scrape type 1
2026-03-30 13:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 94af0a33-90a1-5148-ac1e-df2108f51800
2026-03-30 13:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F186%252F841dc5fc0ff944ab925be094b1b3f519%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/186/841dc5fc0ff944ab925be094b1b3f519/images/large/1.jpg not downloaded yet
2026-03-30 13:31:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ebbcd4b5-69dd-58f3-ab9a-0f949da01601 with identifier: 1989271
2026-03-30 13:31:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ebbcd4b5-69dd-58f3-ab9a-0f949da01601 with identifier: 1989271
2026-03-30 13:31:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ebbcd4b5-69dd-58f3-ab9a-0f949da01601 with identifier: 1989271 to the API
2026-03-30 13:31:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:31:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:31:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/578/735a09b0a1e1447eb39e5421ce57aacc/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'ebbcd4b5-69dd-58f3-ab9a-0f949da01601',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'COROLLA',
 'odometer': 197377,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebbcd4b5-69dd-58f3-ab9a-0f949da01601/ebbcd4b5-69dd-58f3-ab9a-0f949da01601_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 507446,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/578/735a09b0a1e1447eb39e5421ce57aacc/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA COROLLA 1.8 125H ACTIVE TECH E-CVT TOU SPORT',
 'transmission': 'manual',
 'trim': '1.8 125H ACTIVE TECH E-CVT TOU SPORT',
 'vin': None,
 'year': 2021}
2026-03-30 13:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989271%27 HTTP/1.1" 200 None
2026-03-30 13:31:02 [ayvens.es] INFO: Saving data for 1989271: {'created_time': 1774877462.312324, 'last_price_update_time': 1774877462.312339, 'auction_closing_time': 1774954800.0}
2026-03-30 13:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989271') HTTP/1.1" 204 0
2026-03-30 13:31:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 260f55de-20e6-59ec-852a-a5646e4ae7bc with identifier: 1989272
2026-03-30 13:31:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 260f55de-20e6-59ec-852a-a5646e4ae7bc with identifier: 1989272
2026-03-30 13:31:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 260f55de-20e6-59ec-852a-a5646e4ae7bc with identifier: 1989272 to the API
2026-03-30 13:31:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:31:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:31:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/703/aefd809bc4144381a18667143a7fb189/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'petrol',
 'id': '260f55de-20e6-59ec-852a-a5646e4ae7bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 156343,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_260f55de-20e6-59ec-852a-a5646e4ae7bc/260f55de-20e6-59ec-852a-a5646e4ae7bc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 565302,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/703/aefd809bc4144381a18667143a7fb189/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI DIG-T 103kW (140CV) mHEV 4x2 Acenta',
 'transmission': 'manual',
 'trim': 'DIG-T 103kW (140CV) mHEV 4x2 Acenta',
 'vin': None,
 'year': 2021}
2026-03-30 13:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989272%27 HTTP/1.1" 200 None
2026-03-30 13:31:02 [ayvens.es] INFO: Saving data for 1989272: {'created_time': 1774877462.754984, 'last_price_update_time': 1774877462.754998, 'auction_closing_time': 1774954800.0}
2026-03-30 13:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989272') HTTP/1.1" 204 0
2026-03-30 13:31:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a83cfc18-24f7-55c5-8346-f0965293cfd4 with identifier: 1989273
2026-03-30 13:31:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 13:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-30 13:31:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a83cfc18-24f7-55c5-8346-f0965293cfd4 with identifier: 1989273
2026-03-30 13:31:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a83cfc18-24f7-55c5-8346-f0965293cfd4 with identifier: 1989273 to the API
2026-03-30 13:31:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:31:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:31:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/786/e637e31db2e14ce78bb20102e5708d34/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 94,
 'color': 'Blanco glaciar',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a83cfc18-24f7-55c5-8346-f0965293cfd4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 107319,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a83cfc18-24f7-55c5-8346-f0965293cfd4/a83cfc18-24f7-55c5-8346-f0965293cfd4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 529378,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/786/e637e31db2e14ce78bb20102e5708d34/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO (O) Business Blue dCi 63 kW (85CV)',
 'transmission': 'manual',
 'trim': '(O) Business Blue dCi 63 kW (85CV)',
 'vin': None,
 'year': 2020}
2026-03-30 13:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989273%27 HTTP/1.1" 200 None
2026-03-30 13:31:03 [ayvens.es] INFO: Saving data for 1989273: {'created_time': 1774877463.120606, 'last_price_update_time': 1774877463.120619, 'auction_closing_time': 1774954800.0}
2026-03-30 13:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989273') HTTP/1.1" 204 0
2026-03-30 13:31:03 [ayvens.es] INFO: Found listing with ID: 1989285
2026-03-30 13:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989285%27 HTTP/1.1" 200 None
2026-03-30 13:31:03 [ayvens.es] INFO: Scrape type for 1989285: 1
2026-03-30 13:31:03 [ayvens.es] INFO: Extracting data for car ID: 1989285
2026-03-30 13:31:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 958710f8-cab3-56cc-9d0f-e985939a6826 with identifier: 1989285
2026-03-30 13:31:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 958710f8-cab3-56cc-9d0f-e985939a6826 with scrape type 1
2026-03-30 13:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 958710f8-cab3-56cc-9d0f-e985939a6826
2026-03-30 13:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F209%252Fcc27dfb29f1c467ea5d2b3e2bcfd92d8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/209/cc27dfb29f1c467ea5d2b3e2bcfd92d8/images/large/1.jpg not downloaded yet
2026-03-30 13:31:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:31:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705c4b9990>
2026-03-30 13:31:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:31:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:31:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:31:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fed88f4a-70aa-5e07-88b6-2156d1c2d510/fed88f4a-70aa-5e07-88b6-2156d1c2d510_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F680%252F5c53ed9b25884a5aa431cc16401537cd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/680/5c53ed9b25884a5aa431cc16401537cd/images/large/1.jpg saved to cache
2026-03-30 13:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fed88f4a-70aa-5e07-88b6-2156d1c2d510
2026-03-30 13:31:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fed88f4a-70aa-5e07-88b6-2156d1c2d510, skipping ID generation
2026-03-30 13:31:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fed88f4a-70aa-5e07-88b6-2156d1c2d510 with scrape type 1
2026-03-30 13:31:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fed88f4a-70aa-5e07-88b6-2156d1c2d510 sending to next pipeline
2026-03-30 13:31:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: fed88f4a-70aa-5e07-88b6-2156d1c2d510, identifier: 1989274
2026-03-30 13:31:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:31:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705ce38dd0>
2026-03-30 13:31:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:31:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:31:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:31:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e23dcefd-bd2f-5621-b1d5-28677d57f8c2/e23dcefd-bd2f-5621-b1d5-28677d57f8c2_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F476%252F2d1274c42820446b90bb2ea98991d614%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/476/2d1274c42820446b90bb2ea98991d614/images/large/1.jpg saved to cache
2026-03-30 13:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e23dcefd-bd2f-5621-b1d5-28677d57f8c2
2026-03-30 13:31:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e23dcefd-bd2f-5621-b1d5-28677d57f8c2, skipping ID generation
2026-03-30 13:31:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e23dcefd-bd2f-5621-b1d5-28677d57f8c2 with scrape type 1
2026-03-30 13:31:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e23dcefd-bd2f-5621-b1d5-28677d57f8c2 sending to next pipeline
2026-03-30 13:31:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e23dcefd-bd2f-5621-b1d5-28677d57f8c2, identifier: 1989275
2026-03-30 13:31:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:31:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705c5385d0>
2026-03-30 13:31:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:31:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:31:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:31:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbdfaa93-d2eb-5da4-86c2-4186621b2084/cbdfaa93-d2eb-5da4-86c2-4186621b2084_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F404%252Fac2ecb7ba4614e558d54200d60f0b17d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/404/ac2ecb7ba4614e558d54200d60f0b17d/images/large/1.jpg saved to cache
2026-03-30 13:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cbdfaa93-d2eb-5da4-86c2-4186621b2084
2026-03-30 13:31:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cbdfaa93-d2eb-5da4-86c2-4186621b2084, skipping ID generation
2026-03-30 13:31:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbdfaa93-d2eb-5da4-86c2-4186621b2084 with scrape type 1
2026-03-30 13:31:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cbdfaa93-d2eb-5da4-86c2-4186621b2084 sending to next pipeline
2026-03-30 13:31:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: cbdfaa93-d2eb-5da4-86c2-4186621b2084, identifier: 1989276
2026-03-30 13:31:03 [scrapy.extensions.logstats] INFO: Crawled 2 pages (at 2 pages/min), scraped 53 items (at 53 items/min)
2026-03-30 13:31:03 [scrapy.extensions.memusage] INFO: Peak memory usage is 179MiB
2026-03-30 13:31:03 [ayvens.es] INFO: Found listing with ID: 1989286
2026-03-30 13:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989286%27 HTTP/1.1" 200 None
2026-03-30 13:31:03 [ayvens.es] INFO: Scrape type for 1989286: 1
2026-03-30 13:31:03 [ayvens.es] INFO: Extracting data for car ID: 1989286
2026-03-30 13:31:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1318cc3-1f53-5f09-aaf9-3b34c34d154e with identifier: 1989286
2026-03-30 13:31:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1318cc3-1f53-5f09-aaf9-3b34c34d154e with scrape type 1
2026-03-30 13:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b1318cc3-1f53-5f09-aaf9-3b34c34d154e
2026-03-30 13:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F639%252F8fb5e57845ad4ea78f37d0188059b493%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/639/8fb5e57845ad4ea78f37d0188059b493/images/large/1.jpg not downloaded yet
2026-03-30 13:31:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: fed88f4a-70aa-5e07-88b6-2156d1c2d510 with identifier: 1989274
2026-03-30 13:31:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: fed88f4a-70aa-5e07-88b6-2156d1c2d510 with identifier: 1989274
2026-03-30 13:31:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: fed88f4a-70aa-5e07-88b6-2156d1c2d510 with identifier: 1989274 to the API
2026-03-30 13:31:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:31:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:31:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/680/5c53ed9b25884a5aa431cc16401537cd/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'fed88f4a-70aa-5e07-88b6-2156d1c2d510',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 74179,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fed88f4a-70aa-5e07-88b6-2156d1c2d510/fed88f4a-70aa-5e07-88b6-2156d1c2d510_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 589058,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/680/5c53ed9b25884a5aa431cc16401537cd/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO (O) Business Blue dCi 74kW (100CV)',
 'transmission': 'manual',
 'trim': '(O) Business Blue dCi 74kW (100CV)',
 'vin': None,
 'year': 2021}
2026-03-30 13:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989274%27 HTTP/1.1" 200 None
2026-03-30 13:31:04 [ayvens.es] INFO: Saving data for 1989274: {'created_time': 1774877464.305061, 'last_price_update_time': 1774877464.305074, 'auction_closing_time': 1774954800.0}
2026-03-30 13:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989274') HTTP/1.1" 204 0
2026-03-30 13:31:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e23dcefd-bd2f-5621-b1d5-28677d57f8c2 with identifier: 1989275
2026-03-30 13:31:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e23dcefd-bd2f-5621-b1d5-28677d57f8c2 with identifier: 1989275
2026-03-30 13:31:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e23dcefd-bd2f-5621-b1d5-28677d57f8c2 with identifier: 1989275 to the API
2026-03-30 13:31:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:31:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:31:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/476/2d1274c42820446b90bb2ea98991d614/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'e23dcefd-bd2f-5621-b1d5-28677d57f8c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'C-HR',
 'odometer': 87688,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e23dcefd-bd2f-5621-b1d5-28677d57f8c2/e23dcefd-bd2f-5621-b1d5-28677d57f8c2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 486583,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/476/2d1274c42820446b90bb2ea98991d614/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA C-HR 1.8 125H Advance',
 'transmission': 'manual',
 'trim': '1.8 125H Advance',
 'vin': None,
 'year': 2022}
2026-03-30 13:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989275%27 HTTP/1.1" 200 None
2026-03-30 13:31:04 [ayvens.es] INFO: Saving data for 1989275: {'created_time': 1774877464.703285, 'last_price_update_time': 1774877464.703298, 'auction_closing_time': 1774954800.0}
2026-03-30 13:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989275') HTTP/1.1" 204 0
2026-03-30 13:31:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: cbdfaa93-d2eb-5da4-86c2-4186621b2084 with identifier: 1989276
2026-03-30 13:31:04 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 13:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-30 13:31:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: cbdfaa93-d2eb-5da4-86c2-4186621b2084 with identifier: 1989276
2026-03-30 13:31:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: cbdfaa93-d2eb-5da4-86c2-4186621b2084 with identifier: 1989276 to the API
2026-03-30 13:31:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:31:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:31:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/404/ac2ecb7ba4614e558d54200d60f0b17d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'British green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'petrol',
 'id': 'cbdfaa93-d2eb-5da4-86c2-4186621b2084',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'COUNTRYMAN',
 'odometer': 43918,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbdfaa93-d2eb-5da4-86c2-4186621b2084/cbdfaa93-d2eb-5da4-86c2-4186621b2084_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 528719,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/404/ac2ecb7ba4614e558d54200d60f0b17d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI COUNTRYMAN Cooper',
 'transmission': 'manual',
 'trim': 'Cooper',
 'vin': None,
 'year': 2022}
2026-03-30 13:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989276%27 HTTP/1.1" 200 None
2026-03-30 13:31:05 [ayvens.es] INFO: Saving data for 1989276: {'created_time': 1774877465.059276, 'last_price_update_time': 1774877465.059288, 'auction_closing_time': 1774954800.0}
2026-03-30 13:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989276') HTTP/1.1" 204 0
2026-03-30 13:31:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/829/ba5e131250d44aa0b8f292c0d8e4e455/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:31:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/523/5fda110fddc2437fbb01848cfb6e0c6e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:31:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/422/d70591b0d2e84031b91c099f931727b1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:31:05 [ayvens.es] INFO: Found listing with ID: 1989287
2026-03-30 13:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989287%27 HTTP/1.1" 200 None
2026-03-30 13:31:05 [ayvens.es] INFO: Scrape type for 1989287: 1
2026-03-30 13:31:05 [ayvens.es] INFO: Extracting data for car ID: 1989287
2026-03-30 13:31:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d88d5a0d-9535-514a-bbd1-c7fdbd193c61 with identifier: 1989287
2026-03-30 13:31:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d88d5a0d-9535-514a-bbd1-c7fdbd193c61 with scrape type 1
2026-03-30 13:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d88d5a0d-9535-514a-bbd1-c7fdbd193c61
2026-03-30 13:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F626%252Febec3c1cf77c427f8e2e1a91741ee0df%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/626/ebec3c1cf77c427f8e2e1a91741ee0df/images/large/1.jpg not downloaded yet
2026-03-30 13:31:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/809/83a816673f6d421988904b3bcbe85ca3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:31:05 [ayvens.es] INFO: Found listing with ID: 1989288
2026-03-30 13:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989288%27 HTTP/1.1" 200 None
2026-03-30 13:31:05 [ayvens.es] INFO: Scrape type for 1989288: 1
2026-03-30 13:31:05 [ayvens.es] INFO: Extracting data for car ID: 1989288
2026-03-30 13:31:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c052114c-6fa8-595e-b397-f38ccb691c7b with identifier: 1989288
2026-03-30 13:31:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c052114c-6fa8-595e-b397-f38ccb691c7b with scrape type 1
2026-03-30 13:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c052114c-6fa8-595e-b397-f38ccb691c7b
2026-03-30 13:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F985%252F54428117127c432fa2d2895cfa0eb82d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/985/54428117127c432fa2d2895cfa0eb82d/images/large/1.jpg not downloaded yet
2026-03-30 13:31:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/270/61e0b8fef9d445ba97551630ad645c24/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:31:05 [ayvens.es] INFO: Found listing with ID: 1989289
2026-03-30 13:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989289%27 HTTP/1.1" 200 None
2026-03-30 13:31:05 [ayvens.es] INFO: Scrape type for 1989289: 1
2026-03-30 13:31:05 [ayvens.es] INFO: Extracting data for car ID: 1989289
2026-03-30 13:31:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c10a9b1f-e475-51db-8bc9-8529a798339b with identifier: 1989289
2026-03-30 13:31:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c10a9b1f-e475-51db-8bc9-8529a798339b with scrape type 1
2026-03-30 13:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c10a9b1f-e475-51db-8bc9-8529a798339b
2026-03-30 13:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F145%252F423664cc70894c5a90cd1d4a1b9fcdf9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/145/423664cc70894c5a90cd1d4a1b9fcdf9/images/large/1.jpg not downloaded yet
2026-03-30 13:31:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/588/24a1a57f707d48c9b3b4e6241dd5e49b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:31:05 [ayvens.es] INFO: Found listing with ID: 1989290
2026-03-30 13:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989290%27 HTTP/1.1" 200 None
2026-03-30 13:31:05 [ayvens.es] INFO: Scrape type for 1989290: 1
2026-03-30 13:31:05 [ayvens.es] INFO: Extracting data for car ID: 1989290
2026-03-30 13:31:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6abac8b7-daad-5d28-a2b4-a39fc823c197 with identifier: 1989290
2026-03-30 13:31:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6abac8b7-daad-5d28-a2b4-a39fc823c197 with scrape type 1
2026-03-30 13:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6abac8b7-daad-5d28-a2b4-a39fc823c197
2026-03-30 13:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F142%252F6cfc4df8353442d0b57d34cf8cf26321%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/142/6cfc4df8353442d0b57d34cf8cf26321/images/large/1.jpg not downloaded yet
2026-03-30 13:31:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/940/650df9f576a846afa755aea13be7bd06/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:31:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:31:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705c466110>
2026-03-30 13:31:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:31:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb90919c-827a-53c6-afc1-5647b138c6c9/fb90919c-827a-53c6-afc1-5647b138c6c9_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F829%252Fba5e131250d44aa0b8f292c0d8e4e455%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/829/ba5e131250d44aa0b8f292c0d8e4e455/images/large/1.jpg saved to cache
2026-03-30 13:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fb90919c-827a-53c6-afc1-5647b138c6c9
2026-03-30 13:31:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fb90919c-827a-53c6-afc1-5647b138c6c9, skipping ID generation
2026-03-30 13:31:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb90919c-827a-53c6-afc1-5647b138c6c9 with scrape type 1
2026-03-30 13:31:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fb90919c-827a-53c6-afc1-5647b138c6c9 sending to next pipeline
2026-03-30 13:31:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: fb90919c-827a-53c6-afc1-5647b138c6c9, identifier: 1989277
2026-03-30 13:31:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:31:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705d154250>
2026-03-30 13:31:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:31:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48098480-8512-509b-a08c-37ba17ed0201/48098480-8512-509b-a08c-37ba17ed0201_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F523%252F5fda110fddc2437fbb01848cfb6e0c6e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/523/5fda110fddc2437fbb01848cfb6e0c6e/images/large/1.jpg saved to cache
2026-03-30 13:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 48098480-8512-509b-a08c-37ba17ed0201
2026-03-30 13:31:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 48098480-8512-509b-a08c-37ba17ed0201, skipping ID generation
2026-03-30 13:31:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48098480-8512-509b-a08c-37ba17ed0201 with scrape type 1
2026-03-30 13:31:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 48098480-8512-509b-a08c-37ba17ed0201 sending to next pipeline
2026-03-30 13:31:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 48098480-8512-509b-a08c-37ba17ed0201, identifier: 1989279
2026-03-30 13:31:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:31:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705ce37850>
2026-03-30 13:31:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:31:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_febdf4c3-9a6a-5495-83c4-7174d4dbf417/febdf4c3-9a6a-5495-83c4-7174d4dbf417_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F422%252Fd70591b0d2e84031b91c099f931727b1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/422/d70591b0d2e84031b91c099f931727b1/images/large/1.jpg saved to cache
2026-03-30 13:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item febdf4c3-9a6a-5495-83c4-7174d4dbf417
2026-03-30 13:31:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: febdf4c3-9a6a-5495-83c4-7174d4dbf417, skipping ID generation
2026-03-30 13:31:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item febdf4c3-9a6a-5495-83c4-7174d4dbf417 with scrape type 1
2026-03-30 13:31:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item febdf4c3-9a6a-5495-83c4-7174d4dbf417 sending to next pipeline
2026-03-30 13:31:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: febdf4c3-9a6a-5495-83c4-7174d4dbf417, identifier: 1989281
2026-03-30 13:31:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:31:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705d3aba90>
2026-03-30 13:31:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:31:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebb1cdc5-78ba-55f5-9ed3-52cacbd87d50/ebb1cdc5-78ba-55f5-9ed3-52cacbd87d50_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F809%252F83a816673f6d421988904b3bcbe85ca3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/809/83a816673f6d421988904b3bcbe85ca3/images/large/1.jpg saved to cache
2026-03-30 13:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ebb1cdc5-78ba-55f5-9ed3-52cacbd87d50
2026-03-30 13:31:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ebb1cdc5-78ba-55f5-9ed3-52cacbd87d50, skipping ID generation
2026-03-30 13:31:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebb1cdc5-78ba-55f5-9ed3-52cacbd87d50 with scrape type 1
2026-03-30 13:31:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ebb1cdc5-78ba-55f5-9ed3-52cacbd87d50 sending to next pipeline
2026-03-30 13:31:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ebb1cdc5-78ba-55f5-9ed3-52cacbd87d50, identifier: 1989278
2026-03-30 13:31:06 [ayvens.es] INFO: Found listing with ID: 1989291
2026-03-30 13:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989291%27 HTTP/1.1" 200 None
2026-03-30 13:31:06 [ayvens.es] INFO: Scrape type for 1989291: 1
2026-03-30 13:31:06 [ayvens.es] INFO: Extracting data for car ID: 1989291
2026-03-30 13:31:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: faf79212-c74e-50a6-8eb5-ece7c8db8ba1 with identifier: 1989291
2026-03-30 13:31:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item faf79212-c74e-50a6-8eb5-ece7c8db8ba1 with scrape type 1
2026-03-30 13:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item faf79212-c74e-50a6-8eb5-ece7c8db8ba1
2026-03-30 13:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F189%252F8bbdc538f86d4549a4c0041733fb7696%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/189/8bbdc538f86d4549a4c0041733fb7696/images/large/1.jpg not downloaded yet
2026-03-30 13:31:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: fb90919c-827a-53c6-afc1-5647b138c6c9 with identifier: 1989277
2026-03-30 13:31:06 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 13:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-30 13:31:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: fb90919c-827a-53c6-afc1-5647b138c6c9 with identifier: 1989277
2026-03-30 13:31:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: fb90919c-827a-53c6-afc1-5647b138c6c9 with identifier: 1989277 to the API
2026-03-30 13:31:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:31:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:31:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/829/ba5e131250d44aa0b8f292c0d8e4e455/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'Blanco perlado',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'fb90919c-827a-53c6-afc1-5647b138c6c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'C-HR',
 'odometer': 68040,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb90919c-827a-53c6-afc1-5647b138c6c9/fb90919c-827a-53c6-afc1-5647b138c6c9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 398034,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/829/ba5e131250d44aa0b8f292c0d8e4e455/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA C-HR 1.8 125H Advance',
 'transmission': 'manual',
 'trim': '1.8 125H Advance',
 'vin': None,
 'year': 2022}
2026-03-30 13:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989277%27 HTTP/1.1" 200 None
2026-03-30 13:31:06 [ayvens.es] INFO: Saving data for 1989277: {'created_time': 1774877466.672669, 'last_price_update_time': 1774877466.672681, 'auction_closing_time': 1774954800.0}
2026-03-30 13:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989277') HTTP/1.1" 204 0
2026-03-30 13:31:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 48098480-8512-509b-a08c-37ba17ed0201 with identifier: 1989279
2026-03-30 13:31:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 48098480-8512-509b-a08c-37ba17ed0201 with identifier: 1989279
2026-03-30 13:31:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 48098480-8512-509b-a08c-37ba17ed0201 with identifier: 1989279 to the API
2026-03-30 13:31:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:31:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:31:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/523/5fda110fddc2437fbb01848cfb6e0c6e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '48098480-8512-509b-a08c-37ba17ed0201',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C3 AIRCROSS',
 'odometer': 120065,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48098480-8512-509b-a08c-37ba17ed0201/48098480-8512-509b-a08c-37ba17ed0201_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 352261,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/523/5fda110fddc2437fbb01848cfb6e0c6e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C3 AIRCROSS BlueHDi 81kW (110CV) S&S Live Pack',
 'transmission': 'manual',
 'trim': 'BlueHDi 81kW (110CV) S&S Live Pack',
 'vin': None,
 'year': 2022}
2026-03-30 13:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989279%27 HTTP/1.1" 200 None
2026-03-30 13:31:07 [ayvens.es] INFO: Saving data for 1989279: {'created_time': 1774877467.03222, 'last_price_update_time': 1774877467.032232, 'auction_closing_time': 1774954800.0}
2026-03-30 13:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989279') HTTP/1.1" 204 0
2026-03-30 13:31:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: febdf4c3-9a6a-5495-83c4-7174d4dbf417 with identifier: 1989281
2026-03-30 13:31:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: febdf4c3-9a6a-5495-83c4-7174d4dbf417 with identifier: 1989281
2026-03-30 13:31:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: febdf4c3-9a6a-5495-83c4-7174d4dbf417 with identifier: 1989281 to the API
2026-03-30 13:31:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:31:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:31:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/422/d70591b0d2e84031b91c099f931727b1/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'febdf4c3-9a6a-5495-83c4-7174d4dbf417',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 114131,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_febdf4c3-9a6a-5495-83c4-7174d4dbf417/febdf4c3-9a6a-5495-83c4-7174d4dbf417_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329274,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/422/d70591b0d2e84031b91c099f931727b1/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 Active BlueHDI 81kW (110CV)',
 'transmission': 'manual',
 'trim': 'Active BlueHDI 81kW (110CV)',
 'vin': None,
 'year': 2022}
2026-03-30 13:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989281%27 HTTP/1.1" 200 None
2026-03-30 13:31:07 [ayvens.es] INFO: Saving data for 1989281: {'created_time': 1774877467.372292, 'last_price_update_time': 1774877467.372303, 'auction_closing_time': 1774954800.0}
2026-03-30 13:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989281') HTTP/1.1" 204 0
2026-03-30 13:31:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ebb1cdc5-78ba-55f5-9ed3-52cacbd87d50 with identifier: 1989278
2026-03-30 13:31:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ebb1cdc5-78ba-55f5-9ed3-52cacbd87d50 with identifier: 1989278
2026-03-30 13:31:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ebb1cdc5-78ba-55f5-9ed3-52cacbd87d50 with identifier: 1989278 to the API
2026-03-30 13:31:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:31:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:31:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/809/83a816673f6d421988904b3bcbe85ca3/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'Blanco perlado',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'ebb1cdc5-78ba-55f5-9ed3-52cacbd87d50',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'C-HR',
 'odometer': 75918,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebb1cdc5-78ba-55f5-9ed3-52cacbd87d50/ebb1cdc5-78ba-55f5-9ed3-52cacbd87d50_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 531245,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/809/83a816673f6d421988904b3bcbe85ca3/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA C-HR 1.8 125H Advance',
 'transmission': 'manual',
 'trim': '1.8 125H Advance',
 'vin': None,
 'year': 2022}
2026-03-30 13:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989278%27 HTTP/1.1" 200 None
2026-03-30 13:31:07 [ayvens.es] INFO: Saving data for 1989278: {'created_time': 1774877467.739709, 'last_price_update_time': 1774877467.739721, 'auction_closing_time': 1774954800.0}
2026-03-30 13:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989278') HTTP/1.1" 204 0
2026-03-30 13:31:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:31:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705c35f210>
2026-03-30 13:31:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:31:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:31:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:31:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f66e61f-c0dc-584e-8921-434a8414fc99/4f66e61f-c0dc-584e-8921-434a8414fc99_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F270%252F61e0b8fef9d445ba97551630ad645c24%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/270/61e0b8fef9d445ba97551630ad645c24/images/large/1.jpg saved to cache
2026-03-30 13:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4f66e61f-c0dc-584e-8921-434a8414fc99
2026-03-30 13:31:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4f66e61f-c0dc-584e-8921-434a8414fc99, skipping ID generation
2026-03-30 13:31:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f66e61f-c0dc-584e-8921-434a8414fc99 with scrape type 1
2026-03-30 13:31:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4f66e61f-c0dc-584e-8921-434a8414fc99 sending to next pipeline
2026-03-30 13:31:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4f66e61f-c0dc-584e-8921-434a8414fc99, identifier: 1989280
2026-03-30 13:31:07 [ayvens.es] INFO: Found listing with ID: 1989292
2026-03-30 13:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989292%27 HTTP/1.1" 200 None
2026-03-30 13:31:07 [ayvens.es] INFO: Scrape type for 1989292: 1
2026-03-30 13:31:07 [ayvens.es] INFO: Extracting data for car ID: 1989292
2026-03-30 13:31:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64232063-89a5-5458-b0e6-60745ca7ef15 with identifier: 1989292
2026-03-30 13:31:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64232063-89a5-5458-b0e6-60745ca7ef15 with scrape type 1
2026-03-30 13:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 64232063-89a5-5458-b0e6-60745ca7ef15
2026-03-30 13:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F068%252Fab09c25db681409a8761843c44b99867%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/068/ab09c25db681409a8761843c44b99867/images/large/1.jpg not downloaded yet
2026-03-30 13:31:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4f66e61f-c0dc-584e-8921-434a8414fc99 with identifier: 1989280
2026-03-30 13:31:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4f66e61f-c0dc-584e-8921-434a8414fc99 with identifier: 1989280
2026-03-30 13:31:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 4f66e61f-c0dc-584e-8921-434a8414fc99 with identifier: 1989280 to the API
2026-03-30 13:31:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:31:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:31:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/270/61e0b8fef9d445ba97551630ad645c24/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 100,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '4f66e61f-c0dc-584e-8921-434a8414fc99',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 128953,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f66e61f-c0dc-584e-8921-434a8414fc99/4f66e61f-c0dc-584e-8921-434a8414fc99_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 619547,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/270/61e0b8fef9d445ba97551630ad645c24/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI dCi 85 kW (115 CV) E6D ACENTA**revisar peritacion**',
 'transmission': 'manual',
 'trim': 'dCi 85 kW (115 CV) E6D ACENTA**revisar peritacion**',
 'vin': None,
 'year': 2020}
2026-03-30 13:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989280%27 HTTP/1.1" 200 None
2026-03-30 13:31:08 [ayvens.es] INFO: Saving data for 1989280: {'created_time': 1774877468.360866, 'last_price_update_time': 1774877468.360878, 'auction_closing_time': 1774954800.0}
2026-03-30 13:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989280') HTTP/1.1" 204 0
2026-03-30 13:31:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:31:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705db15f90>
2026-03-30 13:31:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:31:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63cc4681-52bf-5c25-aa2a-d6125d4a8cdc/63cc4681-52bf-5c25-aa2a-d6125d4a8cdc_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F588%252F24a1a57f707d48c9b3b4e6241dd5e49b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/588/24a1a57f707d48c9b3b4e6241dd5e49b/images/large/1.jpg saved to cache
2026-03-30 13:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 63cc4681-52bf-5c25-aa2a-d6125d4a8cdc
2026-03-30 13:31:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 63cc4681-52bf-5c25-aa2a-d6125d4a8cdc, skipping ID generation
2026-03-30 13:31:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63cc4681-52bf-5c25-aa2a-d6125d4a8cdc with scrape type 1
2026-03-30 13:31:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 63cc4681-52bf-5c25-aa2a-d6125d4a8cdc sending to next pipeline
2026-03-30 13:31:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 63cc4681-52bf-5c25-aa2a-d6125d4a8cdc, identifier: 1989283
2026-03-30 13:31:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:31:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705db16210>
2026-03-30 13:31:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:31:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_783d9d61-3f23-5caa-8d7d-e96c786a18da/783d9d61-3f23-5caa-8d7d-e96c786a18da_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F940%252F650df9f576a846afa755aea13be7bd06%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/940/650df9f576a846afa755aea13be7bd06/images/large/1.jpg saved to cache
2026-03-30 13:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 783d9d61-3f23-5caa-8d7d-e96c786a18da
2026-03-30 13:31:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 783d9d61-3f23-5caa-8d7d-e96c786a18da, skipping ID generation
2026-03-30 13:31:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 783d9d61-3f23-5caa-8d7d-e96c786a18da with scrape type 1
2026-03-30 13:31:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 783d9d61-3f23-5caa-8d7d-e96c786a18da sending to next pipeline
2026-03-30 13:31:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 783d9d61-3f23-5caa-8d7d-e96c786a18da, identifier: 1989282
2026-03-30 13:31:08 [ayvens.es] INFO: Found listing with ID: 1989293
2026-03-30 13:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989293%27 HTTP/1.1" 200 None
2026-03-30 13:31:08 [ayvens.es] INFO: Scrape type for 1989293: 1
2026-03-30 13:31:08 [ayvens.es] INFO: Extracting data for car ID: 1989293
2026-03-30 13:31:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20e6966f-01b1-55f0-8985-2351fa853a49 with identifier: 1989293
2026-03-30 13:31:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20e6966f-01b1-55f0-8985-2351fa853a49 with scrape type 1
2026-03-30 13:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 20e6966f-01b1-55f0-8985-2351fa853a49
2026-03-30 13:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F047%252F649cb748b4984228bad3fffc00b72fea%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/047/649cb748b4984228bad3fffc00b72fea/images/large/1.jpg not downloaded yet
2026-03-30 13:31:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 63cc4681-52bf-5c25-aa2a-d6125d4a8cdc with identifier: 1989283
2026-03-30 13:31:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 63cc4681-52bf-5c25-aa2a-d6125d4a8cdc with identifier: 1989283
2026-03-30 13:31:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 63cc4681-52bf-5c25-aa2a-d6125d4a8cdc with identifier: 1989283 to the API
2026-03-30 13:31:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:31:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:31:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/588/24a1a57f707d48c9b3b4e6241dd5e49b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '63cc4681-52bf-5c25-aa2a-d6125d4a8cdc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 79382,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63cc4681-52bf-5c25-aa2a-d6125d4a8cdc/63cc4681-52bf-5c25-aa2a-d6125d4a8cdc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 521617,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/588/24a1a57f707d48c9b3b4e6241dd5e49b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON SP 2.0 TDI 85kW Style Go',
 'transmission': 'manual',
 'trim': 'SP 2.0 TDI 85kW Style Go',
 'vin': None,
 'year': 2021}
2026-03-30 13:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989283%27 HTTP/1.1" 200 None
2026-03-30 13:31:09 [ayvens.es] INFO: Saving data for 1989283: {'created_time': 1774877469.164195, 'last_price_update_time': 1774877469.164205, 'auction_closing_time': 1774954800.0}
2026-03-30 13:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989283') HTTP/1.1" 204 0
2026-03-30 13:31:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 783d9d61-3f23-5caa-8d7d-e96c786a18da with identifier: 1989282
2026-03-30 13:31:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 783d9d61-3f23-5caa-8d7d-e96c786a18da with identifier: 1989282
2026-03-30 13:31:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 783d9d61-3f23-5caa-8d7d-e96c786a18da with identifier: 1989282 to the API
2026-03-30 13:31:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:31:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:31:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/940/650df9f576a846afa755aea13be7bd06/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Blanco nacarado',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '783d9d61-3f23-5caa-8d7d-e96c786a18da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 35993,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_783d9d61-3f23-5caa-8d7d-e96c786a18da/783d9d61-3f23-5caa-8d7d-e96c786a18da_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 574602,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/940/650df9f576a846afa755aea13be7bd06/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.5 BlueHDi 96kW (130CV) S&S Active Pack',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi 96kW (130CV) S&S Active Pack',
 'vin': None,
 'year': 2021}
2026-03-30 13:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989282%27 HTTP/1.1" 200 None
2026-03-30 13:31:09 [ayvens.es] INFO: Saving data for 1989282: {'created_time': 1774877469.490321, 'last_price_update_time': 1774877469.490333, 'auction_closing_time': 1774954800.0}
2026-03-30 13:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989282') HTTP/1.1" 204 0
2026-03-30 13:31:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/639/8fb5e57845ad4ea78f37d0188059b493/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:31:09 [ayvens.es] INFO: Found listing with ID: 1989294
2026-03-30 13:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989294%27 HTTP/1.1" 200 None
2026-03-30 13:31:09 [ayvens.es] INFO: Scrape type for 1989294: 1
2026-03-30 13:31:09 [ayvens.es] INFO: Extracting data for car ID: 1989294
2026-03-30 13:31:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c43fea25-7c32-5258-a944-017a2fb3af24 with identifier: 1989294
2026-03-30 13:31:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c43fea25-7c32-5258-a944-017a2fb3af24 with scrape type 1
2026-03-30 13:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c43fea25-7c32-5258-a944-017a2fb3af24
2026-03-30 13:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F877%252F76130f15f17e480d94f0aeab88818118%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/877/76130f15f17e480d94f0aeab88818118/images/large/1.jpg not downloaded yet
2026-03-30 13:31:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/209/cc27dfb29f1c467ea5d2b3e2bcfd92d8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:31:09 [ayvens.es] INFO: Found listing with ID: 1989295
2026-03-30 13:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989295%27 HTTP/1.1" 200 None
2026-03-30 13:31:09 [ayvens.es] INFO: Scrape type for 1989295: 1
2026-03-30 13:31:09 [ayvens.es] INFO: Extracting data for car ID: 1989295
2026-03-30 13:31:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1484a54-6b3a-575e-b277-4a549ffeecaf with identifier: 1989295
2026-03-30 13:31:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1484a54-6b3a-575e-b277-4a549ffeecaf with scrape type 1
2026-03-30 13:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c1484a54-6b3a-575e-b277-4a549ffeecaf
2026-03-30 13:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F240%252Fb4e0ba9abf394b98b4338234ae0612b1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/240/b4e0ba9abf394b98b4338234ae0612b1/images/large/1.jpg not downloaded yet
2026-03-30 13:31:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/186/841dc5fc0ff944ab925be094b1b3f519/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:31:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/626/ebec3c1cf77c427f8e2e1a91741ee0df/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:31:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/985/54428117127c432fa2d2895cfa0eb82d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:31:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/145/423664cc70894c5a90cd1d4a1b9fcdf9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:31:09 [ayvens.es] INFO: Found listing with ID: 1989296
2026-03-30 13:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989296%27 HTTP/1.1" 200 None
2026-03-30 13:31:09 [ayvens.es] INFO: Scrape type for 1989296: 1
2026-03-30 13:31:09 [ayvens.es] INFO: Extracting data for car ID: 1989296
2026-03-30 13:31:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 832a6a52-5d95-5ef2-8dfa-da2f06b8141f with identifier: 1989296
2026-03-30 13:31:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 832a6a52-5d95-5ef2-8dfa-da2f06b8141f with scrape type 1
2026-03-30 13:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 832a6a52-5d95-5ef2-8dfa-da2f06b8141f
2026-03-30 13:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F188%252F2f8b326b508e4aec8724fb831791f6a0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/188/2f8b326b508e4aec8724fb831791f6a0/images/large/1.jpg not downloaded yet
2026-03-30 13:31:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/189/8bbdc538f86d4549a4c0041733fb7696/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:31:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/142/6cfc4df8353442d0b57d34cf8cf26321/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:31:09 [ayvens.es] INFO: Found listing with ID: 1989297
2026-03-30 13:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989297%27 HTTP/1.1" 200 None
2026-03-30 13:31:09 [ayvens.es] INFO: Scrape type for 1989297: 1
2026-03-30 13:31:09 [ayvens.es] INFO: Extracting data for car ID: 1989297
2026-03-30 13:31:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 356b6385-5c14-5168-8787-25febf5f7989 with identifier: 1989297
2026-03-30 13:31:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 356b6385-5c14-5168-8787-25febf5f7989 with scrape type 1
2026-03-30 13:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 356b6385-5c14-5168-8787-25febf5f7989
2026-03-30 13:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F175%252F9808ec2426b54f70a3c935b11febf031%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/175/9808ec2426b54f70a3c935b11febf031/images/large/1.jpg not downloaded yet
2026-03-30 13:31:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:31:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705db147d0>
2026-03-30 13:31:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:31:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1318cc3-1f53-5f09-aaf9-3b34c34d154e/b1318cc3-1f53-5f09-aaf9-3b34c34d154e_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F639%252F8fb5e57845ad4ea78f37d0188059b493%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/639/8fb5e57845ad4ea78f37d0188059b493/images/large/1.jpg saved to cache
2026-03-30 13:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b1318cc3-1f53-5f09-aaf9-3b34c34d154e
2026-03-30 13:31:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b1318cc3-1f53-5f09-aaf9-3b34c34d154e, skipping ID generation
2026-03-30 13:31:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1318cc3-1f53-5f09-aaf9-3b34c34d154e with scrape type 1
2026-03-30 13:31:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b1318cc3-1f53-5f09-aaf9-3b34c34d154e sending to next pipeline
2026-03-30 13:31:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b1318cc3-1f53-5f09-aaf9-3b34c34d154e, identifier: 1989286
2026-03-30 13:31:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:31:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705c4ff150>
2026-03-30 13:31:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:31:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_958710f8-cab3-56cc-9d0f-e985939a6826/958710f8-cab3-56cc-9d0f-e985939a6826_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F209%252Fcc27dfb29f1c467ea5d2b3e2bcfd92d8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/209/cc27dfb29f1c467ea5d2b3e2bcfd92d8/images/large/1.jpg saved to cache
2026-03-30 13:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 958710f8-cab3-56cc-9d0f-e985939a6826
2026-03-30 13:31:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 958710f8-cab3-56cc-9d0f-e985939a6826, skipping ID generation
2026-03-30 13:31:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 958710f8-cab3-56cc-9d0f-e985939a6826 with scrape type 1
2026-03-30 13:31:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 958710f8-cab3-56cc-9d0f-e985939a6826 sending to next pipeline
2026-03-30 13:31:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 958710f8-cab3-56cc-9d0f-e985939a6826, identifier: 1989285
2026-03-30 13:31:10 [ayvens.es] INFO: Found listing with ID: 1989298
2026-03-30 13:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989298%27 HTTP/1.1" 200 None
2026-03-30 13:31:10 [ayvens.es] INFO: Scrape type for 1989298: 1
2026-03-30 13:31:10 [ayvens.es] INFO: Extracting data for car ID: 1989298
2026-03-30 13:31:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8084af2-3760-583a-9062-ed5cd82d956c with identifier: 1989298
2026-03-30 13:31:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8084af2-3760-583a-9062-ed5cd82d956c with scrape type 1
2026-03-30 13:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c8084af2-3760-583a-9062-ed5cd82d956c
2026-03-30 13:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F834%252F8958473093564ff6a6181d540741860a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/834/8958473093564ff6a6181d540741860a/images/large/1.jpg not downloaded yet
2026-03-30 13:31:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b1318cc3-1f53-5f09-aaf9-3b34c34d154e with identifier: 1989286
2026-03-30 13:31:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b1318cc3-1f53-5f09-aaf9-3b34c34d154e with identifier: 1989286
2026-03-30 13:31:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b1318cc3-1f53-5f09-aaf9-3b34c34d154e with identifier: 1989286 to the API
2026-03-30 13:31:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:31:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:31:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/639/8fb5e57845ad4ea78f37d0188059b493/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b1318cc3-1f53-5f09-aaf9-3b34c34d154e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 130591,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1318cc3-1f53-5f09-aaf9-3b34c34d154e/b1318cc3-1f53-5f09-aaf9-3b34c34d154e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342608,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/639/8fb5e57845ad4ea78f37d0188059b493/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 Active Pack BlueHDI 81kW (110CV)',
 'transmission': 'manual',
 'trim': 'Active Pack BlueHDI 81kW (110CV)',
 'vin': None,
 'year': 2021}
2026-03-30 13:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989286%27 HTTP/1.1" 200 None
2026-03-30 13:31:10 [ayvens.es] INFO: Saving data for 1989286: {'created_time': 1774877470.5199, 'last_price_update_time': 1774877470.51991, 'auction_closing_time': 1774954800.0}
2026-03-30 13:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989286') HTTP/1.1" 204 0
2026-03-30 13:31:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 958710f8-cab3-56cc-9d0f-e985939a6826 with identifier: 1989285
2026-03-30 13:31:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 958710f8-cab3-56cc-9d0f-e985939a6826 with identifier: 1989285
2026-03-30 13:31:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 958710f8-cab3-56cc-9d0f-e985939a6826 with identifier: 1989285 to the API
2026-03-30 13:31:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:31:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:31:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/209/cc27dfb29f1c467ea5d2b3e2bcfd92d8/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'color': 'Blanco suave',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '958710f8-cab3-56cc-9d0f-e985939a6826',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 160516,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_958710f8-cab3-56cc-9d0f-e985939a6826/958710f8-cab3-56cc-9d0f-e985939a6826_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 601607,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/209/cc27dfb29f1c467ea5d2b3e2bcfd92d8/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON 2.0 TDI 85kW S&S Style Go',
 'transmission': 'manual',
 'trim': '2.0 TDI 85kW S&S Style Go',
 'vin': None,
 'year': 2021}
2026-03-30 13:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989285%27 HTTP/1.1" 200 None
2026-03-30 13:31:10 [ayvens.es] INFO: Saving data for 1989285: {'created_time': 1774877470.983553, 'last_price_update_time': 1774877470.983567, 'auction_closing_time': 1774954800.0}
2026-03-30 13:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989285') HTTP/1.1" 204 0
2026-03-30 13:31:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:31:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705db08210>
2026-03-30 13:31:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:31:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94af0a33-90a1-5148-ac1e-df2108f51800/94af0a33-90a1-5148-ac1e-df2108f51800_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F186%252F841dc5fc0ff944ab925be094b1b3f519%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/186/841dc5fc0ff944ab925be094b1b3f519/images/large/1.jpg saved to cache
2026-03-30 13:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 94af0a33-90a1-5148-ac1e-df2108f51800
2026-03-30 13:31:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 94af0a33-90a1-5148-ac1e-df2108f51800, skipping ID generation
2026-03-30 13:31:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94af0a33-90a1-5148-ac1e-df2108f51800 with scrape type 1
2026-03-30 13:31:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 94af0a33-90a1-5148-ac1e-df2108f51800 sending to next pipeline
2026-03-30 13:31:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 94af0a33-90a1-5148-ac1e-df2108f51800, identifier: 1989284
2026-03-30 13:31:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:31:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705daa9c50>
2026-03-30 13:31:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:31:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d88d5a0d-9535-514a-bbd1-c7fdbd193c61/d88d5a0d-9535-514a-bbd1-c7fdbd193c61_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F626%252Febec3c1cf77c427f8e2e1a91741ee0df%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/626/ebec3c1cf77c427f8e2e1a91741ee0df/images/large/1.jpg saved to cache
2026-03-30 13:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d88d5a0d-9535-514a-bbd1-c7fdbd193c61
2026-03-30 13:31:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d88d5a0d-9535-514a-bbd1-c7fdbd193c61, skipping ID generation
2026-03-30 13:31:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d88d5a0d-9535-514a-bbd1-c7fdbd193c61 with scrape type 1
2026-03-30 13:31:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d88d5a0d-9535-514a-bbd1-c7fdbd193c61 sending to next pipeline
2026-03-30 13:31:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d88d5a0d-9535-514a-bbd1-c7fdbd193c61, identifier: 1989287
2026-03-30 13:31:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:31:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705d6a1810>
2026-03-30 13:31:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:31:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c052114c-6fa8-595e-b397-f38ccb691c7b/c052114c-6fa8-595e-b397-f38ccb691c7b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F985%252F54428117127c432fa2d2895cfa0eb82d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/985/54428117127c432fa2d2895cfa0eb82d/images/large/1.jpg saved to cache
2026-03-30 13:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c052114c-6fa8-595e-b397-f38ccb691c7b
2026-03-30 13:31:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c052114c-6fa8-595e-b397-f38ccb691c7b, skipping ID generation
2026-03-30 13:31:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c052114c-6fa8-595e-b397-f38ccb691c7b with scrape type 1
2026-03-30 13:31:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c052114c-6fa8-595e-b397-f38ccb691c7b sending to next pipeline
2026-03-30 13:31:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c052114c-6fa8-595e-b397-f38ccb691c7b, identifier: 1989288
2026-03-30 13:31:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:31:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705d6a1c50>
2026-03-30 13:31:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:31:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c10a9b1f-e475-51db-8bc9-8529a798339b/c10a9b1f-e475-51db-8bc9-8529a798339b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F145%252F423664cc70894c5a90cd1d4a1b9fcdf9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/145/423664cc70894c5a90cd1d4a1b9fcdf9/images/large/1.jpg saved to cache
2026-03-30 13:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c10a9b1f-e475-51db-8bc9-8529a798339b
2026-03-30 13:31:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c10a9b1f-e475-51db-8bc9-8529a798339b, skipping ID generation
2026-03-30 13:31:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c10a9b1f-e475-51db-8bc9-8529a798339b with scrape type 1
2026-03-30 13:31:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c10a9b1f-e475-51db-8bc9-8529a798339b sending to next pipeline
2026-03-30 13:31:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c10a9b1f-e475-51db-8bc9-8529a798339b, identifier: 1989289
2026-03-30 13:31:11 [ayvens.es] INFO: Found listing with ID: 1989299
2026-03-30 13:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989299%27 HTTP/1.1" 200 None
2026-03-30 13:31:12 [ayvens.es] INFO: Scrape type for 1989299: 1
2026-03-30 13:31:12 [ayvens.es] INFO: Extracting data for car ID: 1989299
2026-03-30 13:31:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 360cb534-6fe5-5577-ac9d-e99abc1d4446 with identifier: 1989299
2026-03-30 13:31:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 360cb534-6fe5-5577-ac9d-e99abc1d4446 with scrape type 1
2026-03-30 13:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 360cb534-6fe5-5577-ac9d-e99abc1d4446
2026-03-30 13:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F129%252F9fdf4e3c2ab6455aaa0ee7ec3848c1d3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/129/9fdf4e3c2ab6455aaa0ee7ec3848c1d3/images/large/1.jpg not downloaded yet
2026-03-30 13:31:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 94af0a33-90a1-5148-ac1e-df2108f51800 with identifier: 1989284
2026-03-30 13:31:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 94af0a33-90a1-5148-ac1e-df2108f51800 with identifier: 1989284
2026-03-30 13:31:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 94af0a33-90a1-5148-ac1e-df2108f51800 with identifier: 1989284 to the API
2026-03-30 13:31:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:31:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:31:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/186/841dc5fc0ff944ab925be094b1b3f519/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '94af0a33-90a1-5148-ac1e-df2108f51800',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 193328,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94af0a33-90a1-5148-ac1e-df2108f51800/94af0a33-90a1-5148-ac1e-df2108f51800_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 607599,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/186/841dc5fc0ff944ab925be094b1b3f519/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON SP 2.0 TDI 85kW Style Go',
 'transmission': 'manual',
 'trim': 'SP 2.0 TDI 85kW Style Go',
 'vin': None,
 'year': 2021}
2026-03-30 13:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989284%27 HTTP/1.1" 200 None
2026-03-30 13:31:12 [ayvens.es] INFO: Saving data for 1989284: {'created_time': 1774877472.374344, 'last_price_update_time': 1774877472.374361, 'auction_closing_time': 1774954800.0}
2026-03-30 13:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989284') HTTP/1.1" 204 0
2026-03-30 13:31:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d88d5a0d-9535-514a-bbd1-c7fdbd193c61 with identifier: 1989287
2026-03-30 13:31:12 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 13:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-30 13:31:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d88d5a0d-9535-514a-bbd1-c7fdbd193c61 with identifier: 1989287
2026-03-30 13:31:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d88d5a0d-9535-514a-bbd1-c7fdbd193c61 with identifier: 1989287 to the API
2026-03-30 13:31:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:31:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:31:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/626/ebec3c1cf77c427f8e2e1a91741ee0df/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 76,
 'color': 'Gris manhattan',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'd88d5a0d-9535-514a-bbd1-c7fdbd193c61',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'COROLLA',
 'odometer': 105939,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d88d5a0d-9535-514a-bbd1-c7fdbd193c61/d88d5a0d-9535-514a-bbd1-c7fdbd193c61_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 642052,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/626/ebec3c1cf77c427f8e2e1a91741ee0df/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA COROLLA 1.8 125H ACTIVE TECH E-CVT TOU SPORT',
 'transmission': 'manual',
 'trim': '1.8 125H ACTIVE TECH E-CVT TOU SPORT',
 'vin': None,
 'year': 2021}
2026-03-30 13:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989287%27 HTTP/1.1" 200 None
2026-03-30 13:31:12 [ayvens.es] INFO: Saving data for 1989287: {'created_time': 1774877472.75869, 'last_price_update_time': 1774877472.758706, 'auction_closing_time': 1774954800.0}
2026-03-30 13:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989287') HTTP/1.1" 204 0
2026-03-30 13:31:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c052114c-6fa8-595e-b397-f38ccb691c7b with identifier: 1989288
2026-03-30 13:31:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c052114c-6fa8-595e-b397-f38ccb691c7b with identifier: 1989288
2026-03-30 13:31:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c052114c-6fa8-595e-b397-f38ccb691c7b with identifier: 1989288 to the API
2026-03-30 13:31:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:31:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:31:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/985/54428117127c432fa2d2895cfa0eb82d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 85,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c052114c-6fa8-595e-b397-f38ccb691c7b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '208',
 'odometer': 122860,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c052114c-6fa8-595e-b397-f38ccb691c7b/c052114c-6fa8-595e-b397-f38ccb691c7b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 556828,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/985/54428117127c432fa2d2895cfa0eb82d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 208 BlueHDi 73kW (100CV) Active',
 'transmission': 'manual',
 'trim': 'BlueHDi 73kW (100CV) Active',
 'vin': None,
 'year': 2020}
2026-03-30 13:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989288%27 HTTP/1.1" 200 None
2026-03-30 13:31:13 [ayvens.es] INFO: Saving data for 1989288: {'created_time': 1774877473.154966, 'last_price_update_time': 1774877473.154979, 'auction_closing_time': 1774954800.0}
2026-03-30 13:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989288') HTTP/1.1" 204 0
2026-03-30 13:31:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c10a9b1f-e475-51db-8bc9-8529a798339b with identifier: 1989289
2026-03-30 13:31:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c10a9b1f-e475-51db-8bc9-8529a798339b with identifier: 1989289
2026-03-30 13:31:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c10a9b1f-e475-51db-8bc9-8529a798339b with identifier: 1989289 to the API
2026-03-30 13:31:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:31:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:31:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/145/423664cc70894c5a90cd1d4a1b9fcdf9/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'Blanco perlado',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'c10a9b1f-e475-51db-8bc9-8529a798339b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'C-HR',
 'odometer': 171863,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c10a9b1f-e475-51db-8bc9-8529a798339b/c10a9b1f-e475-51db-8bc9-8529a798339b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 483937,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/145/423664cc70894c5a90cd1d4a1b9fcdf9/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA C-HR 1.8 125H Advance',
 'transmission': 'manual',
 'trim': '1.8 125H Advance',
 'vin': None,
 'year': 2022}
2026-03-30 13:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989289%27 HTTP/1.1" 200 None
2026-03-30 13:31:13 [ayvens.es] INFO: Saving data for 1989289: {'created_time': 1774877473.484452, 'last_price_update_time': 1774877473.484468, 'auction_closing_time': 1774954800.0}
2026-03-30 13:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989289') HTTP/1.1" 204 0
2026-03-30 13:31:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:31:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705d6a31d0>
2026-03-30 13:31:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:31:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:31:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:31:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_faf79212-c74e-50a6-8eb5-ece7c8db8ba1/faf79212-c74e-50a6-8eb5-ece7c8db8ba1_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F189%252F8bbdc538f86d4549a4c0041733fb7696%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/189/8bbdc538f86d4549a4c0041733fb7696/images/large/1.jpg saved to cache
2026-03-30 13:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item faf79212-c74e-50a6-8eb5-ece7c8db8ba1
2026-03-30 13:31:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: faf79212-c74e-50a6-8eb5-ece7c8db8ba1, skipping ID generation
2026-03-30 13:31:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item faf79212-c74e-50a6-8eb5-ece7c8db8ba1 with scrape type 1
2026-03-30 13:31:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item faf79212-c74e-50a6-8eb5-ece7c8db8ba1 sending to next pipeline
2026-03-30 13:31:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: faf79212-c74e-50a6-8eb5-ece7c8db8ba1, identifier: 1989291
2026-03-30 13:31:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:31:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705d3ff650>
2026-03-30 13:31:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:31:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:31:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:31:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6abac8b7-daad-5d28-a2b4-a39fc823c197/6abac8b7-daad-5d28-a2b4-a39fc823c197_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F142%252F6cfc4df8353442d0b57d34cf8cf26321%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/142/6cfc4df8353442d0b57d34cf8cf26321/images/large/1.jpg saved to cache
2026-03-30 13:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6abac8b7-daad-5d28-a2b4-a39fc823c197
2026-03-30 13:31:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6abac8b7-daad-5d28-a2b4-a39fc823c197, skipping ID generation
2026-03-30 13:31:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6abac8b7-daad-5d28-a2b4-a39fc823c197 with scrape type 1
2026-03-30 13:31:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6abac8b7-daad-5d28-a2b4-a39fc823c197 sending to next pipeline
2026-03-30 13:31:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6abac8b7-daad-5d28-a2b4-a39fc823c197, identifier: 1989290
2026-03-30 13:31:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/047/649cb748b4984228bad3fffc00b72fea/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:31:13 [ayvens.es] INFO: Found listing with ID: 1989300
2026-03-30 13:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989300%27 HTTP/1.1" 200 None
2026-03-30 13:31:13 [ayvens.es] INFO: Scrape type for 1989300: 1
2026-03-30 13:31:13 [ayvens.es] INFO: Extracting data for car ID: 1989300
2026-03-30 13:31:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9cd7f4e-d960-5524-8f7b-77200975a702 with identifier: 1989300
2026-03-30 13:31:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9cd7f4e-d960-5524-8f7b-77200975a702 with scrape type 1
2026-03-30 13:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c9cd7f4e-d960-5524-8f7b-77200975a702
2026-03-30 13:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F279%252F9a48b2618e5d431d840dc877b531740c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/279/9a48b2618e5d431d840dc877b531740c/images/large/1.jpg not downloaded yet
2026-03-30 13:31:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: faf79212-c74e-50a6-8eb5-ece7c8db8ba1 with identifier: 1989291
2026-03-30 13:31:14 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 13:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-30 13:31:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: faf79212-c74e-50a6-8eb5-ece7c8db8ba1 with identifier: 1989291
2026-03-30 13:31:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: faf79212-c74e-50a6-8eb5-ece7c8db8ba1 with identifier: 1989291 to the API
2026-03-30 13:31:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:31:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:31:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/189/8bbdc538f86d4549a4c0041733fb7696/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 85,
 'color': 'Azul',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'faf79212-c74e-50a6-8eb5-ece7c8db8ba1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 134232,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faf79212-c74e-50a6-8eb5-ece7c8db8ba1/faf79212-c74e-50a6-8eb5-ece7c8db8ba1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 385348,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/189/8bbdc538f86d4549a4c0041733fb7696/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO Business Energy dCi 75',
 'transmission': 'manual',
 'trim': 'Business Energy dCi 75',
 'vin': None,
 'year': 2018}
2026-03-30 13:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989291%27 HTTP/1.1" 200 None
2026-03-30 13:31:14 [ayvens.es] INFO: Saving data for 1989291: {'created_time': 1774877474.51561, 'last_price_update_time': 1774877474.515624, 'auction_closing_time': 1774954800.0}
2026-03-30 13:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989291') HTTP/1.1" 204 0
2026-03-30 13:31:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6abac8b7-daad-5d28-a2b4-a39fc823c197 with identifier: 1989290
2026-03-30 13:31:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6abac8b7-daad-5d28-a2b4-a39fc823c197 with identifier: 1989290
2026-03-30 13:31:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 6abac8b7-daad-5d28-a2b4-a39fc823c197 with identifier: 1989290 to the API
2026-03-30 13:31:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:31:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:31:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/142/6cfc4df8353442d0b57d34cf8cf26321/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': '6abac8b7-daad-5d28-a2b4-a39fc823c197',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'COROLLA',
 'odometer': 79905,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6abac8b7-daad-5d28-a2b4-a39fc823c197/6abac8b7-daad-5d28-a2b4-a39fc823c197_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 509765,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/142/6cfc4df8353442d0b57d34cf8cf26321/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA COROLLA 1.8 125H ACTIVE TECH E-CVT',
 'transmission': 'manual',
 'trim': '1.8 125H ACTIVE TECH E-CVT',
 'vin': None,
 'year': 2021}
2026-03-30 13:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989290%27 HTTP/1.1" 200 None
2026-03-30 13:31:15 [ayvens.es] INFO: Saving data for 1989290: {'created_time': 1774877475.027478, 'last_price_update_time': 1774877475.02749, 'auction_closing_time': 1774954800.0}
2026-03-30 13:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989290') HTTP/1.1" 204 0
2026-03-30 13:31:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/240/b4e0ba9abf394b98b4338234ae0612b1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:31:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/877/76130f15f17e480d94f0aeab88818118/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:31:15 [ayvens.es] INFO: Found listing with ID: 1989301
2026-03-30 13:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989301%27 HTTP/1.1" 200 None
2026-03-30 13:31:15 [ayvens.es] INFO: Scrape type for 1989301: 1
2026-03-30 13:31:15 [ayvens.es] INFO: Extracting data for car ID: 1989301
2026-03-30 13:31:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23f8d5e7-4fea-5628-b79f-193dad0799fa with identifier: 1989301
2026-03-30 13:31:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23f8d5e7-4fea-5628-b79f-193dad0799fa with scrape type 1
2026-03-30 13:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 23f8d5e7-4fea-5628-b79f-193dad0799fa
2026-03-30 13:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F832%252F6a56d53e47d1422ea2db70de334efaad%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/832/6a56d53e47d1422ea2db70de334efaad/images/large/1.jpg not downloaded yet
2026-03-30 13:31:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/068/ab09c25db681409a8761843c44b99867/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:31:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:31:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705d670150>
2026-03-30 13:31:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:31:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:31:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:31:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20e6966f-01b1-55f0-8985-2351fa853a49/20e6966f-01b1-55f0-8985-2351fa853a49_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F047%252F649cb748b4984228bad3fffc00b72fea%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/047/649cb748b4984228bad3fffc00b72fea/images/large/1.jpg saved to cache
2026-03-30 13:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 20e6966f-01b1-55f0-8985-2351fa853a49
2026-03-30 13:31:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 20e6966f-01b1-55f0-8985-2351fa853a49, skipping ID generation
2026-03-30 13:31:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20e6966f-01b1-55f0-8985-2351fa853a49 with scrape type 1
2026-03-30 13:31:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 20e6966f-01b1-55f0-8985-2351fa853a49 sending to next pipeline
2026-03-30 13:31:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 20e6966f-01b1-55f0-8985-2351fa853a49, identifier: 1989293
2026-03-30 13:31:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/188/2f8b326b508e4aec8724fb831791f6a0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:31:15 [ayvens.es] INFO: Found listing with ID: 1989302
2026-03-30 13:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989302%27 HTTP/1.1" 200 None
2026-03-30 13:31:15 [ayvens.es] INFO: Scrape type for 1989302: 1
2026-03-30 13:31:15 [ayvens.es] INFO: Extracting data for car ID: 1989302
2026-03-30 13:31:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b09c77f0-b246-58a1-bd7c-e14d7272a1f1 with identifier: 1989302
2026-03-30 13:31:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b09c77f0-b246-58a1-bd7c-e14d7272a1f1 with scrape type 1
2026-03-30 13:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b09c77f0-b246-58a1-bd7c-e14d7272a1f1
2026-03-30 13:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F212%252Fa74872e03fae40c2a1daa039260ce223%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/212/a74872e03fae40c2a1daa039260ce223/images/large/1.jpg not downloaded yet
2026-03-30 13:31:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 20e6966f-01b1-55f0-8985-2351fa853a49 with identifier: 1989293
2026-03-30 13:31:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 20e6966f-01b1-55f0-8985-2351fa853a49 with identifier: 1989293
2026-03-30 13:31:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 20e6966f-01b1-55f0-8985-2351fa853a49 with identifier: 1989293 to the API
2026-03-30 13:31:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:31:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:31:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/047/649cb748b4984228bad3fffc00b72fea/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 86,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'hybrid',
 'id': '20e6966f-01b1-55f0-8985-2351fa853a49',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'C-HR',
 'odometer': 106616,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20e6966f-01b1-55f0-8985-2351fa853a49/20e6966f-01b1-55f0-8985-2351fa853a49_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 306622,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/047/649cb748b4984228bad3fffc00b72fea/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA C-HR 1.8 125H Active',
 'transmission': 'manual',
 'trim': '1.8 125H Active',
 'vin': None,
 'year': 2021}
2026-03-30 13:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989293%27 HTTP/1.1" 200 None
2026-03-30 13:31:15 [ayvens.es] INFO: Saving data for 1989293: {'created_time': 1774877475.860066, 'last_price_update_time': 1774877475.860084, 'auction_closing_time': 1774954800.0}
2026-03-30 13:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989293') HTTP/1.1" 204 0
2026-03-30 13:31:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/175/9808ec2426b54f70a3c935b11febf031/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:31:15 [ayvens.es] INFO: Found listing with ID: 1989303
2026-03-30 13:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989303%27 HTTP/1.1" 200 None
2026-03-30 13:31:15 [ayvens.es] INFO: Scrape type for 1989303: 1
2026-03-30 13:31:15 [ayvens.es] INFO: Extracting data for car ID: 1989303
2026-03-30 13:31:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5a478c4-11d5-5a0a-b1dc-5983c8b6bf8b with identifier: 1989303
2026-03-30 13:31:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5a478c4-11d5-5a0a-b1dc-5983c8b6bf8b with scrape type 1
2026-03-30 13:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e5a478c4-11d5-5a0a-b1dc-5983c8b6bf8b
2026-03-30 13:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F929%252F305c76fbde5c446ebcb8e25c17da39e9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/929/305c76fbde5c446ebcb8e25c17da39e9/images/large/1.jpg not downloaded yet
2026-03-30 13:31:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:31:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705c5258d0>
2026-03-30 13:31:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:31:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:31:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:31:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1484a54-6b3a-575e-b277-4a549ffeecaf/c1484a54-6b3a-575e-b277-4a549ffeecaf_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F240%252Fb4e0ba9abf394b98b4338234ae0612b1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/240/b4e0ba9abf394b98b4338234ae0612b1/images/large/1.jpg saved to cache
2026-03-30 13:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c1484a54-6b3a-575e-b277-4a549ffeecaf
2026-03-30 13:31:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c1484a54-6b3a-575e-b277-4a549ffeecaf, skipping ID generation
2026-03-30 13:31:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1484a54-6b3a-575e-b277-4a549ffeecaf with scrape type 1
2026-03-30 13:31:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c1484a54-6b3a-575e-b277-4a549ffeecaf sending to next pipeline
2026-03-30 13:31:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c1484a54-6b3a-575e-b277-4a549ffeecaf, identifier: 1989295
2026-03-30 13:31:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:31:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705c519590>
2026-03-30 13:31:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:31:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:31:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:31:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c43fea25-7c32-5258-a944-017a2fb3af24/c43fea25-7c32-5258-a944-017a2fb3af24_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F877%252F76130f15f17e480d94f0aeab88818118%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/877/76130f15f17e480d94f0aeab88818118/images/large/1.jpg saved to cache
2026-03-30 13:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c43fea25-7c32-5258-a944-017a2fb3af24
2026-03-30 13:31:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c43fea25-7c32-5258-a944-017a2fb3af24, skipping ID generation
2026-03-30 13:31:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c43fea25-7c32-5258-a944-017a2fb3af24 with scrape type 1
2026-03-30 13:31:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c43fea25-7c32-5258-a944-017a2fb3af24 sending to next pipeline
2026-03-30 13:31:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c43fea25-7c32-5258-a944-017a2fb3af24, identifier: 1989294
2026-03-30 13:31:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:31:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705c354790>
2026-03-30 13:31:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:31:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:31:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:31:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64232063-89a5-5458-b0e6-60745ca7ef15/64232063-89a5-5458-b0e6-60745ca7ef15_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F068%252Fab09c25db681409a8761843c44b99867%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/068/ab09c25db681409a8761843c44b99867/images/large/1.jpg saved to cache
2026-03-30 13:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 64232063-89a5-5458-b0e6-60745ca7ef15
2026-03-30 13:31:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 64232063-89a5-5458-b0e6-60745ca7ef15, skipping ID generation
2026-03-30 13:31:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64232063-89a5-5458-b0e6-60745ca7ef15 with scrape type 1
2026-03-30 13:31:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 64232063-89a5-5458-b0e6-60745ca7ef15 sending to next pipeline
2026-03-30 13:31:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 64232063-89a5-5458-b0e6-60745ca7ef15, identifier: 1989292
2026-03-30 13:31:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:31:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705d417910>
2026-03-30 13:31:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:31:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:31:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:31:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_832a6a52-5d95-5ef2-8dfa-da2f06b8141f/832a6a52-5d95-5ef2-8dfa-da2f06b8141f_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F188%252F2f8b326b508e4aec8724fb831791f6a0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/188/2f8b326b508e4aec8724fb831791f6a0/images/large/1.jpg saved to cache
2026-03-30 13:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 832a6a52-5d95-5ef2-8dfa-da2f06b8141f
2026-03-30 13:31:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 832a6a52-5d95-5ef2-8dfa-da2f06b8141f, skipping ID generation
2026-03-30 13:31:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 832a6a52-5d95-5ef2-8dfa-da2f06b8141f with scrape type 1
2026-03-30 13:31:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 832a6a52-5d95-5ef2-8dfa-da2f06b8141f sending to next pipeline
2026-03-30 13:31:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 832a6a52-5d95-5ef2-8dfa-da2f06b8141f, identifier: 1989296
2026-03-30 13:31:16 [ayvens.es] INFO: Found listing with ID: 1989304
2026-03-30 13:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989304%27 HTTP/1.1" 200 None
2026-03-30 13:31:16 [ayvens.es] INFO: Scrape type for 1989304: 1
2026-03-30 13:31:16 [ayvens.es] INFO: Extracting data for car ID: 1989304
2026-03-30 13:31:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33be3c2d-9dbb-5582-8836-e37a01e979bb with identifier: 1989304
2026-03-30 13:31:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33be3c2d-9dbb-5582-8836-e37a01e979bb with scrape type 1
2026-03-30 13:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 33be3c2d-9dbb-5582-8836-e37a01e979bb
2026-03-30 13:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F619%252F5a0341b9f11f456da816fb113dabe078%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/619/5a0341b9f11f456da816fb113dabe078/images/large/1.jpg not downloaded yet
2026-03-30 13:31:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c1484a54-6b3a-575e-b277-4a549ffeecaf with identifier: 1989295
2026-03-30 13:31:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c1484a54-6b3a-575e-b277-4a549ffeecaf with identifier: 1989295
2026-03-30 13:31:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c1484a54-6b3a-575e-b277-4a549ffeecaf with identifier: 1989295 to the API
2026-03-30 13:31:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:31:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:31:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/240/b4e0ba9abf394b98b4338234ae0612b1/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c1484a54-6b3a-575e-b277-4a549ffeecaf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ARONA',
 'odometer': 169230,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1484a54-6b3a-575e-b277-4a549ffeecaf/c1484a54-6b3a-575e-b277-4a549ffeecaf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 341323,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/240/b4e0ba9abf394b98b4338234ae0612b1/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ARONA 1.6 TDI 70kW (95CV) Style Go Eco',
 'transmission': 'manual',
 'trim': '1.6 TDI 70kW (95CV) Style Go Eco',
 'vin': None,
 'year': 2020}
2026-03-30 13:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989295%27 HTTP/1.1" 200 None
2026-03-30 13:31:17 [ayvens.es] INFO: Saving data for 1989295: {'created_time': 1774877477.386987, 'last_price_update_time': 1774877477.387, 'auction_closing_time': 1774954800.0}
2026-03-30 13:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989295') HTTP/1.1" 204 0
2026-03-30 13:31:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c43fea25-7c32-5258-a944-017a2fb3af24 with identifier: 1989294
2026-03-30 13:31:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 13:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-30 13:31:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c43fea25-7c32-5258-a944-017a2fb3af24 with identifier: 1989294
2026-03-30 13:31:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c43fea25-7c32-5258-a944-017a2fb3af24 with identifier: 1989294 to the API
2026-03-30 13:31:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:31:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:31:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/877/76130f15f17e480d94f0aeab88818118/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'Blanco banquise',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c43fea25-7c32-5258-a944-017a2fb3af24',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 52651,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c43fea25-7c32-5258-a944-017a2fb3af24/c43fea25-7c32-5258-a944-017a2fb3af24_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 351034,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/877/76130f15f17e480d94f0aeab88818118/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 Active Pack BlueHDI 81kW (110CV)',
 'transmission': 'manual',
 'trim': 'Active Pack BlueHDI 81kW (110CV)',
 'vin': None,
 'year': 2021}
2026-03-30 13:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989294%27 HTTP/1.1" 200 None
2026-03-30 13:31:17 [ayvens.es] INFO: Saving data for 1989294: {'created_time': 1774877477.760124, 'last_price_update_time': 1774877477.760136, 'auction_closing_time': 1774954800.0}
2026-03-30 13:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989294') HTTP/1.1" 204 0
2026-03-30 13:31:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 64232063-89a5-5458-b0e6-60745ca7ef15 with identifier: 1989292
2026-03-30 13:31:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 64232063-89a5-5458-b0e6-60745ca7ef15 with identifier: 1989292
2026-03-30 13:31:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 64232063-89a5-5458-b0e6-60745ca7ef15 with identifier: 1989292 to the API
2026-03-30 13:31:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:31:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:31:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/068/ab09c25db681409a8761843c44b99867/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Plata',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '64232063-89a5-5458-b0e6-60745ca7ef15',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT',
 'odometer': 86713,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64232063-89a5-5458-b0e6-60745ca7ef15/64232063-89a5-5458-b0e6-60745ca7ef15_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 503871,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/068/ab09c25db681409a8761843c44b99867/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT Business 2.0 TDI 90kW (122CV) DSG',
 'transmission': 'manual',
 'trim': 'Business 2.0 TDI 90kW (122CV) DSG',
 'vin': None,
 'year': 2020}
2026-03-30 13:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989292%27 HTTP/1.1" 200 None
2026-03-30 13:31:18 [ayvens.es] INFO: Saving data for 1989292: {'created_time': 1774877478.117303, 'last_price_update_time': 1774877478.117315, 'auction_closing_time': 1774954800.0}
2026-03-30 13:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989292') HTTP/1.1" 204 0
2026-03-30 13:31:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 832a6a52-5d95-5ef2-8dfa-da2f06b8141f with identifier: 1989296
2026-03-30 13:31:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 832a6a52-5d95-5ef2-8dfa-da2f06b8141f with identifier: 1989296
2026-03-30 13:31:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 832a6a52-5d95-5ef2-8dfa-da2f06b8141f with identifier: 1989296 to the API
2026-03-30 13:31:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:31:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:31:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/188/2f8b326b508e4aec8724fb831791f6a0/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 85,
 'color': 'Azul',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '832a6a52-5d95-5ef2-8dfa-da2f06b8141f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 101159,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_832a6a52-5d95-5ef2-8dfa-da2f06b8141f/832a6a52-5d95-5ef2-8dfa-da2f06b8141f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 383632,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/188/2f8b326b508e4aec8724fb831791f6a0/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO Business Energy dCi 75',
 'transmission': 'manual',
 'trim': 'Business Energy dCi 75',
 'vin': None,
 'year': 2018}
2026-03-30 13:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989296%27 HTTP/1.1" 200 None
2026-03-30 13:31:18 [ayvens.es] INFO: Saving data for 1989296: {'created_time': 1774877478.454773, 'last_price_update_time': 1774877478.454786, 'auction_closing_time': 1774954800.0}
2026-03-30 13:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989296') HTTP/1.1" 204 0
2026-03-30 13:31:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/834/8958473093564ff6a6181d540741860a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:31:18 [ayvens.es] INFO: Found listing with ID: 1989305
2026-03-30 13:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989305%27 HTTP/1.1" 200 None
2026-03-30 13:31:18 [ayvens.es] INFO: Scrape type for 1989305: 1
2026-03-30 13:31:18 [ayvens.es] INFO: Extracting data for car ID: 1989305
2026-03-30 13:31:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47e1952e-c5ff-5480-a2f4-89737d164955 with identifier: 1989305
2026-03-30 13:31:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47e1952e-c5ff-5480-a2f4-89737d164955 with scrape type 1
2026-03-30 13:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 47e1952e-c5ff-5480-a2f4-89737d164955
2026-03-30 13:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F733%252F92e7c3a3068e4d0c8251f6f9dc92fadd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/733/92e7c3a3068e4d0c8251f6f9dc92fadd/images/large/1.jpg not downloaded yet
2026-03-30 13:31:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:31:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705c470f10>
2026-03-30 13:31:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:31:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:31:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:31:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_356b6385-5c14-5168-8787-25febf5f7989/356b6385-5c14-5168-8787-25febf5f7989_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F175%252F9808ec2426b54f70a3c935b11febf031%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/175/9808ec2426b54f70a3c935b11febf031/images/large/1.jpg saved to cache
2026-03-30 13:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 356b6385-5c14-5168-8787-25febf5f7989
2026-03-30 13:31:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 356b6385-5c14-5168-8787-25febf5f7989, skipping ID generation
2026-03-30 13:31:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 356b6385-5c14-5168-8787-25febf5f7989 with scrape type 1
2026-03-30 13:31:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 356b6385-5c14-5168-8787-25febf5f7989 sending to next pipeline
2026-03-30 13:31:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 356b6385-5c14-5168-8787-25febf5f7989, identifier: 1989297
2026-03-30 13:31:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/129/9fdf4e3c2ab6455aaa0ee7ec3848c1d3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:31:18 [ayvens.es] INFO: Found listing with ID: 1989306
2026-03-30 13:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989306%27 HTTP/1.1" 200 None
2026-03-30 13:31:18 [ayvens.es] INFO: Scrape type for 1989306: 1
2026-03-30 13:31:18 [ayvens.es] INFO: Extracting data for car ID: 1989306
2026-03-30 13:31:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d262aff6-2d29-592c-966c-8acfdbf103b9 with identifier: 1989306
2026-03-30 13:31:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d262aff6-2d29-592c-966c-8acfdbf103b9 with scrape type 1
2026-03-30 13:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d262aff6-2d29-592c-966c-8acfdbf103b9
2026-03-30 13:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F826%252F5b659c4bb9894d4aadc4721e28534d66%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/826/5b659c4bb9894d4aadc4721e28534d66/images/large/1.jpg not downloaded yet
2026-03-30 13:31:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 356b6385-5c14-5168-8787-25febf5f7989 with identifier: 1989297
2026-03-30 13:31:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 13:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-30 13:31:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 356b6385-5c14-5168-8787-25febf5f7989 with identifier: 1989297
2026-03-30 13:31:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 356b6385-5c14-5168-8787-25febf5f7989 with identifier: 1989297 to the API
2026-03-30 13:31:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:31:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:31:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/175/9808ec2426b54f70a3c935b11febf031/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Negro perla nera',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '356b6385-5c14-5168-8787-25febf5f7989',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508',
 'odometer': 77276,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_356b6385-5c14-5168-8787-25febf5f7989/356b6385-5c14-5168-8787-25febf5f7989_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 363568,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/175/9808ec2426b54f70a3c935b11febf031/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 5P Allure Pack BlueHDi 130 S&S EAT8',
 'transmission': 'manual',
 'trim': '5P Allure Pack BlueHDi 130 S&S EAT8',
 'vin': None,
 'year': 2022}
2026-03-30 13:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989297%27 HTTP/1.1" 200 None
2026-03-30 13:31:19 [ayvens.es] INFO: Saving data for 1989297: {'created_time': 1774877479.108445, 'last_price_update_time': 1774877479.108457, 'auction_closing_time': 1774954800.0}
2026-03-30 13:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989297') HTTP/1.1" 204 0
2026-03-30 13:31:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/279/9a48b2618e5d431d840dc877b531740c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:31:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/832/6a56d53e47d1422ea2db70de334efaad/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:31:19 [ayvens.es] INFO: Found listing with ID: 1989307
2026-03-30 13:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989307%27 HTTP/1.1" 200 None
2026-03-30 13:31:19 [ayvens.es] INFO: Scrape type for 1989307: 1
2026-03-30 13:31:19 [ayvens.es] INFO: Extracting data for car ID: 1989307
2026-03-30 13:31:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb2a44db-6e0c-5028-a867-1513e003a3a5 with identifier: 1989307
2026-03-30 13:31:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb2a44db-6e0c-5028-a867-1513e003a3a5 with scrape type 1
2026-03-30 13:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item bb2a44db-6e0c-5028-a867-1513e003a3a5
2026-03-30 13:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F024%252Fbbb5611cf7fa40b9b0f156400a2c5a6d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/024/bbb5611cf7fa40b9b0f156400a2c5a6d/images/large/1.jpg not downloaded yet
2026-03-30 13:31:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:31:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705d43b410>
2026-03-30 13:31:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:31:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8084af2-3760-583a-9062-ed5cd82d956c/c8084af2-3760-583a-9062-ed5cd82d956c_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F834%252F8958473093564ff6a6181d540741860a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/834/8958473093564ff6a6181d540741860a/images/large/1.jpg saved to cache
2026-03-30 13:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c8084af2-3760-583a-9062-ed5cd82d956c
2026-03-30 13:31:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c8084af2-3760-583a-9062-ed5cd82d956c, skipping ID generation
2026-03-30 13:31:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8084af2-3760-583a-9062-ed5cd82d956c with scrape type 1
2026-03-30 13:31:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c8084af2-3760-583a-9062-ed5cd82d956c sending to next pipeline
2026-03-30 13:31:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c8084af2-3760-583a-9062-ed5cd82d956c, identifier: 1989298
2026-03-30 13:31:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:31:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705d41ba90>
2026-03-30 13:31:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:31:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_360cb534-6fe5-5577-ac9d-e99abc1d4446/360cb534-6fe5-5577-ac9d-e99abc1d4446_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F129%252F9fdf4e3c2ab6455aaa0ee7ec3848c1d3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/129/9fdf4e3c2ab6455aaa0ee7ec3848c1d3/images/large/1.jpg saved to cache
2026-03-30 13:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 360cb534-6fe5-5577-ac9d-e99abc1d4446
2026-03-30 13:31:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 360cb534-6fe5-5577-ac9d-e99abc1d4446, skipping ID generation
2026-03-30 13:31:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 360cb534-6fe5-5577-ac9d-e99abc1d4446 with scrape type 1
2026-03-30 13:31:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 360cb534-6fe5-5577-ac9d-e99abc1d4446 sending to next pipeline
2026-03-30 13:31:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 360cb534-6fe5-5577-ac9d-e99abc1d4446, identifier: 1989299
2026-03-30 13:31:19 [ayvens.es] INFO: Found listing with ID: 1989308
2026-03-30 13:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989308%27 HTTP/1.1" 200 None
2026-03-30 13:31:19 [ayvens.es] INFO: Scrape type for 1989308: 1
2026-03-30 13:31:19 [ayvens.es] INFO: Extracting data for car ID: 1989308
2026-03-30 13:31:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5447e8a-9776-57ef-9a3c-6a6a6587144b with identifier: 1989308
2026-03-30 13:31:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5447e8a-9776-57ef-9a3c-6a6a6587144b with scrape type 1
2026-03-30 13:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b5447e8a-9776-57ef-9a3c-6a6a6587144b
2026-03-30 13:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F317%252F1b74e304be664a7a952b8e386aa5f961%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/317/1b74e304be664a7a952b8e386aa5f961/images/large/1.jpg not downloaded yet
2026-03-30 13:31:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c8084af2-3760-583a-9062-ed5cd82d956c with identifier: 1989298
2026-03-30 13:31:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c8084af2-3760-583a-9062-ed5cd82d956c with identifier: 1989298
2026-03-30 13:31:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c8084af2-3760-583a-9062-ed5cd82d956c with identifier: 1989298 to the API
2026-03-30 13:31:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:31:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:31:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/834/8958473093564ff6a6181d540741860a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'Blanco banquise',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c8084af2-3760-583a-9062-ed5cd82d956c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 28678,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8084af2-3760-583a-9062-ed5cd82d956c/c8084af2-3760-583a-9062-ed5cd82d956c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325715,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/834/8958473093564ff6a6181d540741860a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 Active Pack BlueHDI 81kW (110CV)',
 'transmission': 'manual',
 'trim': 'Active Pack BlueHDI 81kW (110CV)',
 'vin': None,
 'year': 2021}
2026-03-30 13:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989298%27 HTTP/1.1" 200 None
2026-03-30 13:31:19 [ayvens.es] INFO: Saving data for 1989298: {'created_time': 1774877479.993722, 'last_price_update_time': 1774877479.993733, 'auction_closing_time': 1774954800.0}
2026-03-30 13:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989298') HTTP/1.1" 204 0
2026-03-30 13:31:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 360cb534-6fe5-5577-ac9d-e99abc1d4446 with identifier: 1989299
2026-03-30 13:31:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 13:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-30 13:31:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 360cb534-6fe5-5577-ac9d-e99abc1d4446 with identifier: 1989299
2026-03-30 13:31:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 360cb534-6fe5-5577-ac9d-e99abc1d4446 with identifier: 1989299 to the API
2026-03-30 13:31:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:31:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:31:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/129/9fdf4e3c2ab6455aaa0ee7ec3848c1d3/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'color': 'Gris plata',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '360cb534-6fe5-5577-ac9d-e99abc1d4446',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 93155,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_360cb534-6fe5-5577-ac9d-e99abc1d4446/360cb534-6fe5-5577-ac9d-e99abc1d4446_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 493596,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/129/9fdf4e3c2ab6455aaa0ee7ec3848c1d3/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON 2.0 TDI 110kW S&S Xcellence',
 'transmission': 'manual',
 'trim': '2.0 TDI 110kW S&S Xcellence',
 'vin': None,
 'year': 2020}
2026-03-30 13:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989299%27 HTTP/1.1" 200 None
2026-03-30 13:31:20 [ayvens.es] INFO: Saving data for 1989299: {'created_time': 1774877480.388032, 'last_price_update_time': 1774877480.388047, 'auction_closing_time': 1774954800.0}
2026-03-30 13:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989299') HTTP/1.1" 204 0
2026-03-30 13:31:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/212/a74872e03fae40c2a1daa039260ce223/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:31:20 [ayvens.es] INFO: Found listing with ID: 1989309
2026-03-30 13:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989309%27 HTTP/1.1" 200 None
2026-03-30 13:31:20 [ayvens.es] INFO: Scrape type for 1989309: 1
2026-03-30 13:31:20 [ayvens.es] INFO: Extracting data for car ID: 1989309
2026-03-30 13:31:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 662e1622-3572-5b4d-a914-813caf4b4e35 with identifier: 1989309
2026-03-30 13:31:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 662e1622-3572-5b4d-a914-813caf4b4e35 with scrape type 1
2026-03-30 13:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 662e1622-3572-5b4d-a914-813caf4b4e35
2026-03-30 13:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F849%252Fc6b1a9e7d2c14002b4f9299a2036ebec%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/849/c6b1a9e7d2c14002b4f9299a2036ebec/images/large/1.jpg not downloaded yet
2026-03-30 13:31:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:31:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705efec250>
2026-03-30 13:31:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:31:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9cd7f4e-d960-5524-8f7b-77200975a702/c9cd7f4e-d960-5524-8f7b-77200975a702_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F279%252F9a48b2618e5d431d840dc877b531740c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/279/9a48b2618e5d431d840dc877b531740c/images/large/1.jpg saved to cache
2026-03-30 13:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c9cd7f4e-d960-5524-8f7b-77200975a702
2026-03-30 13:31:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c9cd7f4e-d960-5524-8f7b-77200975a702, skipping ID generation
2026-03-30 13:31:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9cd7f4e-d960-5524-8f7b-77200975a702 with scrape type 1
2026-03-30 13:31:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c9cd7f4e-d960-5524-8f7b-77200975a702 sending to next pipeline
2026-03-30 13:31:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c9cd7f4e-d960-5524-8f7b-77200975a702, identifier: 1989300
2026-03-30 13:31:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:31:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705c516410>
2026-03-30 13:31:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:31:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23f8d5e7-4fea-5628-b79f-193dad0799fa/23f8d5e7-4fea-5628-b79f-193dad0799fa_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F832%252F6a56d53e47d1422ea2db70de334efaad%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/832/6a56d53e47d1422ea2db70de334efaad/images/large/1.jpg saved to cache
2026-03-30 13:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 23f8d5e7-4fea-5628-b79f-193dad0799fa
2026-03-30 13:31:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 23f8d5e7-4fea-5628-b79f-193dad0799fa, skipping ID generation
2026-03-30 13:31:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23f8d5e7-4fea-5628-b79f-193dad0799fa with scrape type 1
2026-03-30 13:31:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 23f8d5e7-4fea-5628-b79f-193dad0799fa sending to next pipeline
2026-03-30 13:31:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 23f8d5e7-4fea-5628-b79f-193dad0799fa, identifier: 1989301
2026-03-30 13:31:20 [ayvens.es] INFO: Found listing with ID: 1989310
2026-03-30 13:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989310%27 HTTP/1.1" 200 None
2026-03-30 13:31:20 [ayvens.es] INFO: Scrape type for 1989310: 1
2026-03-30 13:31:20 [ayvens.es] INFO: Extracting data for car ID: 1989310
2026-03-30 13:31:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0adba50b-99a8-577a-b615-98ef67d70604 with identifier: 1989310
2026-03-30 13:31:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0adba50b-99a8-577a-b615-98ef67d70604 with scrape type 1
2026-03-30 13:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0adba50b-99a8-577a-b615-98ef67d70604
2026-03-30 13:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F860%252F0c95f51885074b639c24bc30f5813871%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/860/0c95f51885074b639c24bc30f5813871/images/large/1.jpg not downloaded yet
2026-03-30 13:31:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c9cd7f4e-d960-5524-8f7b-77200975a702 with identifier: 1989300
2026-03-30 13:31:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c9cd7f4e-d960-5524-8f7b-77200975a702 with identifier: 1989300
2026-03-30 13:31:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c9cd7f4e-d960-5524-8f7b-77200975a702 with identifier: 1989300 to the API
2026-03-30 13:31:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:31:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:31:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/279/9a48b2618e5d431d840dc877b531740c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c9cd7f4e-d960-5524-8f7b-77200975a702',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 62538,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9cd7f4e-d960-5524-8f7b-77200975a702/c9cd7f4e-d960-5524-8f7b-77200975a702_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 548708,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/279/9a48b2618e5d431d840dc877b531740c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON SP 2.0 TDI 85kW Style',
 'transmission': 'manual',
 'trim': 'SP 2.0 TDI 85kW Style',
 'vin': None,
 'year': 2021}
2026-03-30 13:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989300%27 HTTP/1.1" 200 None
2026-03-30 13:31:21 [ayvens.es] INFO: Saving data for 1989300: {'created_time': 1774877481.245588, 'last_price_update_time': 1774877481.2456, 'auction_closing_time': 1774954800.0}
2026-03-30 13:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989300') HTTP/1.1" 204 0
2026-03-30 13:31:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 23f8d5e7-4fea-5628-b79f-193dad0799fa with identifier: 1989301
2026-03-30 13:31:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 23f8d5e7-4fea-5628-b79f-193dad0799fa with identifier: 1989301
2026-03-30 13:31:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 23f8d5e7-4fea-5628-b79f-193dad0799fa with identifier: 1989301 to the API
2026-03-30 13:31:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:31:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:31:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/832/6a56d53e47d1422ea2db70de334efaad/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 95,
 'color': 'Gris plata',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '23f8d5e7-4fea-5628-b79f-193dad0799fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MEGANE',
 'odometer': 125791,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23f8d5e7-4fea-5628-b79f-193dad0799fa/23f8d5e7-4fea-5628-b79f-193dad0799fa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 349483,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/832/6a56d53e47d1422ea2db70de334efaad/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT MEGANE Business Energy dCi 110',
 'transmission': 'manual',
 'trim': 'Business Energy dCi 110',
 'vin': None,
 'year': 2017}
2026-03-30 13:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989301%27 HTTP/1.1" 200 None
2026-03-30 13:31:21 [ayvens.es] INFO: Saving data for 1989301: {'created_time': 1774877481.672506, 'last_price_update_time': 1774877481.672518, 'auction_closing_time': 1774954800.0}
2026-03-30 13:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989301') HTTP/1.1" 204 0
2026-03-30 13:31:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/929/305c76fbde5c446ebcb8e25c17da39e9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:31:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/619/5a0341b9f11f456da816fb113dabe078/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:31:21 [ayvens.es] INFO: Found listing with ID: 1989311
2026-03-30 13:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989311%27 HTTP/1.1" 200 None
2026-03-30 13:31:21 [ayvens.es] INFO: Scrape type for 1989311: 1
2026-03-30 13:31:21 [ayvens.es] INFO: Extracting data for car ID: 1989311
2026-03-30 13:31:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9287a3d-df00-529b-8e81-12c212ce4ae0 with identifier: 1989311
2026-03-30 13:31:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9287a3d-df00-529b-8e81-12c212ce4ae0 with scrape type 1
2026-03-30 13:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b9287a3d-df00-529b-8e81-12c212ce4ae0
2026-03-30 13:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F625%252F1a340bd431ba4a3eb6eae6fbb265f274%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/625/1a340bd431ba4a3eb6eae6fbb265f274/images/large/1.jpg not downloaded yet
2026-03-30 13:31:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:31:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705f4c5690>
2026-03-30 13:31:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:31:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:31:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:31:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b09c77f0-b246-58a1-bd7c-e14d7272a1f1/b09c77f0-b246-58a1-bd7c-e14d7272a1f1_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F212%252Fa74872e03fae40c2a1daa039260ce223%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/212/a74872e03fae40c2a1daa039260ce223/images/large/1.jpg saved to cache
2026-03-30 13:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b09c77f0-b246-58a1-bd7c-e14d7272a1f1
2026-03-30 13:31:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b09c77f0-b246-58a1-bd7c-e14d7272a1f1, skipping ID generation
2026-03-30 13:31:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b09c77f0-b246-58a1-bd7c-e14d7272a1f1 with scrape type 1
2026-03-30 13:31:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b09c77f0-b246-58a1-bd7c-e14d7272a1f1 sending to next pipeline
2026-03-30 13:31:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b09c77f0-b246-58a1-bd7c-e14d7272a1f1, identifier: 1989302
2026-03-30 13:31:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/733/92e7c3a3068e4d0c8251f6f9dc92fadd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:31:21 [ayvens.es] INFO: Found listing with ID: 1989312
2026-03-30 13:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989312%27 HTTP/1.1" 200 None
2026-03-30 13:31:22 [ayvens.es] INFO: Scrape type for 1989312: 1
2026-03-30 13:31:22 [ayvens.es] INFO: Extracting data for car ID: 1989312
2026-03-30 13:31:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f0c835f-93e2-5056-a03c-a73ca90875df with identifier: 1989312
2026-03-30 13:31:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f0c835f-93e2-5056-a03c-a73ca90875df with scrape type 1
2026-03-30 13:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9f0c835f-93e2-5056-a03c-a73ca90875df
2026-03-30 13:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F825%252F9712fd5a30dd489388ddb78e6628c74d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/825/9712fd5a30dd489388ddb78e6628c74d/images/large/1.jpg not downloaded yet
2026-03-30 13:31:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b09c77f0-b246-58a1-bd7c-e14d7272a1f1 with identifier: 1989302
2026-03-30 13:31:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b09c77f0-b246-58a1-bd7c-e14d7272a1f1 with identifier: 1989302
2026-03-30 13:31:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b09c77f0-b246-58a1-bd7c-e14d7272a1f1 with identifier: 1989302 to the API
2026-03-30 13:31:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:31:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:31:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/212/a74872e03fae40c2a1daa039260ce223/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'color': 'Plata',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b09c77f0-b246-58a1-bd7c-e14d7272a1f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN',
 'odometer': 74728,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b09c77f0-b246-58a1-bd7c-e14d7272a1f1/b09c77f0-b246-58a1-bd7c-e14d7272a1f1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 541659,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/212/a74872e03fae40c2a1daa039260ce223/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN R-Line 2.0 TDI 110kW (150CV) DSG',
 'transmission': 'manual',
 'trim': 'R-Line 2.0 TDI 110kW (150CV) DSG',
 'vin': None,
 'year': 2021}
2026-03-30 13:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989302%27 HTTP/1.1" 200 None
2026-03-30 13:31:22 [ayvens.es] INFO: Saving data for 1989302: {'created_time': 1774877482.375045, 'last_price_update_time': 1774877482.375059, 'auction_closing_time': 1774954800.0}
2026-03-30 13:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989302') HTTP/1.1" 204 0
2026-03-30 13:31:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/826/5b659c4bb9894d4aadc4721e28534d66/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:31:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/024/bbb5611cf7fa40b9b0f156400a2c5a6d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:31:22 [ayvens.es] INFO: Found listing with ID: 1989313
2026-03-30 13:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989313%27 HTTP/1.1" 200 None
2026-03-30 13:31:22 [ayvens.es] INFO: Scrape type for 1989313: 1
2026-03-30 13:31:22 [ayvens.es] INFO: Extracting data for car ID: 1989313
2026-03-30 13:31:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce336c03-2f79-5688-998e-bad45e5068c8 with identifier: 1989313
2026-03-30 13:31:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce336c03-2f79-5688-998e-bad45e5068c8 with scrape type 1
2026-03-30 13:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ce336c03-2f79-5688-998e-bad45e5068c8
2026-03-30 13:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F585%252F14dfb8d297354668a6125e8d9dba8c5f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/585/14dfb8d297354668a6125e8d9dba8c5f/images/large/1.jpg not downloaded yet
2026-03-30 13:31:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:31:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705efe4850>
2026-03-30 13:31:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:31:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:31:22 [urllib3.connectionpool] DEBUG: Resetting dropped connection: alxproduction.blob.core.windows.net
2026-03-30 13:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5a478c4-11d5-5a0a-b1dc-5983c8b6bf8b/e5a478c4-11d5-5a0a-b1dc-5983c8b6bf8b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F929%252F305c76fbde5c446ebcb8e25c17da39e9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/929/305c76fbde5c446ebcb8e25c17da39e9/images/large/1.jpg saved to cache
2026-03-30 13:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e5a478c4-11d5-5a0a-b1dc-5983c8b6bf8b
2026-03-30 13:31:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e5a478c4-11d5-5a0a-b1dc-5983c8b6bf8b, skipping ID generation
2026-03-30 13:31:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5a478c4-11d5-5a0a-b1dc-5983c8b6bf8b with scrape type 1
2026-03-30 13:31:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e5a478c4-11d5-5a0a-b1dc-5983c8b6bf8b sending to next pipeline
2026-03-30 13:31:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e5a478c4-11d5-5a0a-b1dc-5983c8b6bf8b, identifier: 1989303
2026-03-30 13:31:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:31:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705d4f2250>
2026-03-30 13:31:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:31:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33be3c2d-9dbb-5582-8836-e37a01e979bb/33be3c2d-9dbb-5582-8836-e37a01e979bb_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F619%252F5a0341b9f11f456da816fb113dabe078%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/619/5a0341b9f11f456da816fb113dabe078/images/large/1.jpg saved to cache
2026-03-30 13:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 33be3c2d-9dbb-5582-8836-e37a01e979bb
2026-03-30 13:31:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 33be3c2d-9dbb-5582-8836-e37a01e979bb, skipping ID generation
2026-03-30 13:31:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33be3c2d-9dbb-5582-8836-e37a01e979bb with scrape type 1
2026-03-30 13:31:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 33be3c2d-9dbb-5582-8836-e37a01e979bb sending to next pipeline
2026-03-30 13:31:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 33be3c2d-9dbb-5582-8836-e37a01e979bb, identifier: 1989304
2026-03-30 13:31:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:31:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705c5041d0>
2026-03-30 13:31:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:31:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:31:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47e1952e-c5ff-5480-a2f4-89737d164955/47e1952e-c5ff-5480-a2f4-89737d164955_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F733%252F92e7c3a3068e4d0c8251f6f9dc92fadd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/733/92e7c3a3068e4d0c8251f6f9dc92fadd/images/large/1.jpg saved to cache
2026-03-30 13:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 47e1952e-c5ff-5480-a2f4-89737d164955
2026-03-30 13:31:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 47e1952e-c5ff-5480-a2f4-89737d164955, skipping ID generation
2026-03-30 13:31:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47e1952e-c5ff-5480-a2f4-89737d164955 with scrape type 1
2026-03-30 13:31:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 47e1952e-c5ff-5480-a2f4-89737d164955 sending to next pipeline
2026-03-30 13:31:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 47e1952e-c5ff-5480-a2f4-89737d164955, identifier: 1989305
2026-03-30 13:31:23 [ayvens.es] INFO: Found listing with ID: 1989314
2026-03-30 13:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989314%27 HTTP/1.1" 200 None
2026-03-30 13:31:23 [ayvens.es] INFO: Scrape type for 1989314: 1
2026-03-30 13:31:23 [ayvens.es] INFO: Extracting data for car ID: 1989314
2026-03-30 13:31:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 134af499-0832-5f1e-bd50-c4154915d586 with identifier: 1989314
2026-03-30 13:31:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 134af499-0832-5f1e-bd50-c4154915d586 with scrape type 1
2026-03-30 13:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 134af499-0832-5f1e-bd50-c4154915d586
2026-03-30 13:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F389%252Fc7de8e3ba2d3419eabcd13bdaf776c2a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/389/c7de8e3ba2d3419eabcd13bdaf776c2a/images/large/1.jpg not downloaded yet
2026-03-30 13:31:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e5a478c4-11d5-5a0a-b1dc-5983c8b6bf8b with identifier: 1989303
2026-03-30 13:31:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 13:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-30 13:31:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e5a478c4-11d5-5a0a-b1dc-5983c8b6bf8b with identifier: 1989303
2026-03-30 13:31:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e5a478c4-11d5-5a0a-b1dc-5983c8b6bf8b with identifier: 1989303 to the API
2026-03-30 13:31:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:31:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:31:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/929/305c76fbde5c446ebcb8e25c17da39e9/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Rojo elixir',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e5a478c4-11d5-5a0a-b1dc-5983c8b6bf8b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508',
 'odometer': 52782,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5a478c4-11d5-5a0a-b1dc-5983c8b6bf8b/e5a478c4-11d5-5a0a-b1dc-5983c8b6bf8b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 609657,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/929/305c76fbde5c446ebcb8e25c17da39e9/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 5P Allure Pack BlueHDi 130 S&S EAT8',
 'transmission': 'manual',
 'trim': '5P Allure Pack BlueHDi 130 S&S EAT8',
 'vin': None,
 'year': 2021}
2026-03-30 13:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989303%27 HTTP/1.1" 200 None
2026-03-30 13:31:23 [ayvens.es] INFO: Saving data for 1989303: {'created_time': 1774877483.666278, 'last_price_update_time': 1774877483.666288, 'auction_closing_time': 1774954800.0}
2026-03-30 13:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989303') HTTP/1.1" 204 0
2026-03-30 13:31:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 33be3c2d-9dbb-5582-8836-e37a01e979bb with identifier: 1989304
2026-03-30 13:31:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 13:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-30 13:31:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 33be3c2d-9dbb-5582-8836-e37a01e979bb with identifier: 1989304
2026-03-30 13:31:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 33be3c2d-9dbb-5582-8836-e37a01e979bb with identifier: 1989304 to the API
2026-03-30 13:31:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:31:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:31:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/619/5a0341b9f11f456da816fb113dabe078/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'Blanco everest',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'petrol',
 'id': '33be3c2d-9dbb-5582-8836-e37a01e979bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'JUKE',
 'odometer': 79799,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33be3c2d-9dbb-5582-8836-e37a01e979bb/33be3c2d-9dbb-5582-8836-e37a01e979bb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 346965,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/619/5a0341b9f11f456da816fb113dabe078/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN JUKE DIG-T 84 kW (114 CV) 6M/T Acenta',
 'transmission': 'manual',
 'trim': 'DIG-T 84 kW (114 CV) 6M/T Acenta',
 'vin': None,
 'year': 2021}
2026-03-30 13:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989304%27 HTTP/1.1" 200 None
2026-03-30 13:31:24 [ayvens.es] INFO: Saving data for 1989304: {'created_time': 1774877484.017287, 'last_price_update_time': 1774877484.017298, 'auction_closing_time': 1774954800.0}
2026-03-30 13:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989304') HTTP/1.1" 204 0
2026-03-30 13:31:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 47e1952e-c5ff-5480-a2f4-89737d164955 with identifier: 1989305
2026-03-30 13:31:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 47e1952e-c5ff-5480-a2f4-89737d164955 with identifier: 1989305
2026-03-30 13:31:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 47e1952e-c5ff-5480-a2f4-89737d164955 with identifier: 1989305 to the API
2026-03-30 13:31:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:31:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:31:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/733/92e7c3a3068e4d0c8251f6f9dc92fadd/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 101,
 'color': 'Negro perla nera',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '47e1952e-c5ff-5480-a2f4-89737d164955',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 73109,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47e1952e-c5ff-5480-a2f4-89737d164955/47e1952e-c5ff-5480-a2f4-89737d164955_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 494170,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/733/92e7c3a3068e4d0c8251f6f9dc92fadd/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.5 BlueHDi 96kW S&S GT Line EAT8',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi 96kW S&S GT Line EAT8',
 'vin': None,
 'year': 2020}
2026-03-30 13:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989305%27 HTTP/1.1" 200 None
2026-03-30 13:31:24 [ayvens.es] INFO: Saving data for 1989305: {'created_time': 1774877484.349797, 'last_price_update_time': 1774877484.34981, 'auction_closing_time': 1774954800.0}
2026-03-30 13:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989305') HTTP/1.1" 204 0
2026-03-30 13:31:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/849/c6b1a9e7d2c14002b4f9299a2036ebec/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:31:24 [ayvens.es] INFO: Found listing with ID: 1989315
2026-03-30 13:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989315%27 HTTP/1.1" 200 None
2026-03-30 13:31:24 [ayvens.es] INFO: Scrape type for 1989315: 1
2026-03-30 13:31:24 [ayvens.es] INFO: Extracting data for car ID: 1989315
2026-03-30 13:31:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73daa06e-9d23-555d-a406-f4fa780e970a with identifier: 1989315
2026-03-30 13:31:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73daa06e-9d23-555d-a406-f4fa780e970a with scrape type 1
2026-03-30 13:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 73daa06e-9d23-555d-a406-f4fa780e970a
2026-03-30 13:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F163%252F99f4f28f4f224da18b5ae22c7cf441c5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/163/99f4f28f4f224da18b5ae22c7cf441c5/images/large/1.jpg not downloaded yet
2026-03-30 13:31:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:31:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705d4a2fd0>
2026-03-30 13:31:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:31:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:31:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:31:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d262aff6-2d29-592c-966c-8acfdbf103b9/d262aff6-2d29-592c-966c-8acfdbf103b9_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F826%252F5b659c4bb9894d4aadc4721e28534d66%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/826/5b659c4bb9894d4aadc4721e28534d66/images/large/1.jpg saved to cache
2026-03-30 13:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d262aff6-2d29-592c-966c-8acfdbf103b9
2026-03-30 13:31:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d262aff6-2d29-592c-966c-8acfdbf103b9, skipping ID generation
2026-03-30 13:31:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d262aff6-2d29-592c-966c-8acfdbf103b9 with scrape type 1
2026-03-30 13:31:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d262aff6-2d29-592c-966c-8acfdbf103b9 sending to next pipeline
2026-03-30 13:31:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d262aff6-2d29-592c-966c-8acfdbf103b9, identifier: 1989306
2026-03-30 13:31:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:31:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f706cc7add0>
2026-03-30 13:31:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:31:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:31:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:31:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb2a44db-6e0c-5028-a867-1513e003a3a5/bb2a44db-6e0c-5028-a867-1513e003a3a5_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F024%252Fbbb5611cf7fa40b9b0f156400a2c5a6d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/024/bbb5611cf7fa40b9b0f156400a2c5a6d/images/large/1.jpg saved to cache
2026-03-30 13:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bb2a44db-6e0c-5028-a867-1513e003a3a5
2026-03-30 13:31:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bb2a44db-6e0c-5028-a867-1513e003a3a5, skipping ID generation
2026-03-30 13:31:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb2a44db-6e0c-5028-a867-1513e003a3a5 with scrape type 1
2026-03-30 13:31:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bb2a44db-6e0c-5028-a867-1513e003a3a5 sending to next pipeline
2026-03-30 13:31:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: bb2a44db-6e0c-5028-a867-1513e003a3a5, identifier: 1989307
2026-03-30 13:31:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/317/1b74e304be664a7a952b8e386aa5f961/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:31:24 [ayvens.es] INFO: Found listing with ID: 1989316
2026-03-30 13:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989316%27 HTTP/1.1" 200 None
2026-03-30 13:31:24 [ayvens.es] INFO: Scrape type for 1989316: 1
2026-03-30 13:31:24 [ayvens.es] INFO: Extracting data for car ID: 1989316
2026-03-30 13:31:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffe8660d-48ba-5d2b-b82c-8f885544e854 with identifier: 1989316
2026-03-30 13:31:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffe8660d-48ba-5d2b-b82c-8f885544e854 with scrape type 1
2026-03-30 13:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ffe8660d-48ba-5d2b-b82c-8f885544e854
2026-03-30 13:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F308%252F43b9e592188a454ca66c3e69246299f5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/308/43b9e592188a454ca66c3e69246299f5/images/large/1.jpg not downloaded yet
2026-03-30 13:31:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d262aff6-2d29-592c-966c-8acfdbf103b9 with identifier: 1989306
2026-03-30 13:31:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d262aff6-2d29-592c-966c-8acfdbf103b9 with identifier: 1989306
2026-03-30 13:31:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d262aff6-2d29-592c-966c-8acfdbf103b9 with identifier: 1989306 to the API
2026-03-30 13:31:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:31:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:31:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/826/5b659c4bb9894d4aadc4721e28534d66/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 218,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.4L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd262aff6-2d29-592c-966c-8acfdbf103b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'HILUX',
 'odometer': 39417,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d262aff6-2d29-592c-966c-8acfdbf103b9/d262aff6-2d29-592c-966c-8acfdbf103b9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 355038,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/826/5b659c4bb9894d4aadc4721e28534d66/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA HILUX 2.4 D-4D Cabina Doble GX**revisar peritacion**',
 'transmission': 'manual',
 'trim': '2.4 D-4D Cabina Doble GX**revisar peritacion**',
 'vin': None,
 'year': 2022}
2026-03-30 13:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989306%27 HTTP/1.1" 200 None
2026-03-30 13:31:25 [ayvens.es] INFO: Saving data for 1989306: {'created_time': 1774877485.265892, 'last_price_update_time': 1774877485.265902, 'auction_closing_time': 1774954800.0}
2026-03-30 13:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989306') HTTP/1.1" 204 0
2026-03-30 13:31:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: bb2a44db-6e0c-5028-a867-1513e003a3a5 with identifier: 1989307
2026-03-30 13:31:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: bb2a44db-6e0c-5028-a867-1513e003a3a5 with identifier: 1989307
2026-03-30 13:31:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: bb2a44db-6e0c-5028-a867-1513e003a3a5 with identifier: 1989307 to the API
2026-03-30 13:31:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:31:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:31:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/024/bbb5611cf7fa40b9b0f156400a2c5a6d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 187,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '2.4L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'bb2a44db-6e0c-5028-a867-1513e003a3a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'HILUX',
 'odometer': 59367,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb2a44db-6e0c-5028-a867-1513e003a3a5/bb2a44db-6e0c-5028-a867-1513e003a3a5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 327756,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/024/bbb5611cf7fa40b9b0f156400a2c5a6d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-21',
 'seats_number': 2,
 'seller_name': None,
 'title': 'TOYOTA HILUX 2.4 D-4D Cabina Sencilla GX**revisar peritacion**',
 'transmission': 'manual',
 'trim': '2.4 D-4D Cabina Sencilla GX**revisar peritacion**',
 'vin': None,
 'year': 2018}
2026-03-30 13:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989307%27 HTTP/1.1" 200 None
2026-03-30 13:31:25 [ayvens.es] INFO: Saving data for 1989307: {'created_time': 1774877485.583139, 'last_price_update_time': 1774877485.583149, 'auction_closing_time': 1774954800.0}
2026-03-30 13:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989307') HTTP/1.1" 204 0
2026-03-30 13:31:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/625/1a340bd431ba4a3eb6eae6fbb265f274/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:31:25 [ayvens.es] INFO: Found listing with ID: 1989317
2026-03-30 13:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989317%27 HTTP/1.1" 200 None
2026-03-30 13:31:25 [ayvens.es] INFO: Scrape type for 1989317: 1
2026-03-30 13:31:25 [ayvens.es] INFO: Extracting data for car ID: 1989317
2026-03-30 13:31:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca72a149-8115-5b78-bcae-a29c0c3e0ab7 with identifier: 1989317
2026-03-30 13:31:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca72a149-8115-5b78-bcae-a29c0c3e0ab7 with scrape type 1
2026-03-30 13:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ca72a149-8115-5b78-bcae-a29c0c3e0ab7
2026-03-30 13:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F034%252F72c1ea520e684a99a67af852a2f89a12%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/034/72c1ea520e684a99a67af852a2f89a12/images/large/1.jpg not downloaded yet
2026-03-30 13:31:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:31:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705d87e150>
2026-03-30 13:31:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:31:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:31:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:31:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_662e1622-3572-5b4d-a914-813caf4b4e35/662e1622-3572-5b4d-a914-813caf4b4e35_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F849%252Fc6b1a9e7d2c14002b4f9299a2036ebec%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/849/c6b1a9e7d2c14002b4f9299a2036ebec/images/large/1.jpg saved to cache
2026-03-30 13:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 662e1622-3572-5b4d-a914-813caf4b4e35
2026-03-30 13:31:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 662e1622-3572-5b4d-a914-813caf4b4e35, skipping ID generation
2026-03-30 13:31:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 662e1622-3572-5b4d-a914-813caf4b4e35 with scrape type 1
2026-03-30 13:31:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 662e1622-3572-5b4d-a914-813caf4b4e35 sending to next pipeline
2026-03-30 13:31:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 662e1622-3572-5b4d-a914-813caf4b4e35, identifier: 1989309
2026-03-30 13:31:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:31:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705c4a4b90>
2026-03-30 13:31:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:31:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:31:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:31:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5447e8a-9776-57ef-9a3c-6a6a6587144b/b5447e8a-9776-57ef-9a3c-6a6a6587144b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F317%252F1b74e304be664a7a952b8e386aa5f961%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/317/1b74e304be664a7a952b8e386aa5f961/images/large/1.jpg saved to cache
2026-03-30 13:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b5447e8a-9776-57ef-9a3c-6a6a6587144b
2026-03-30 13:31:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b5447e8a-9776-57ef-9a3c-6a6a6587144b, skipping ID generation
2026-03-30 13:31:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5447e8a-9776-57ef-9a3c-6a6a6587144b with scrape type 1
2026-03-30 13:31:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b5447e8a-9776-57ef-9a3c-6a6a6587144b sending to next pipeline
2026-03-30 13:31:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b5447e8a-9776-57ef-9a3c-6a6a6587144b, identifier: 1989308
2026-03-30 13:31:26 [ayvens.es] INFO: Found listing with ID: 1989318
2026-03-30 13:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989318%27 HTTP/1.1" 200 None
2026-03-30 13:31:26 [ayvens.es] INFO: Scrape type for 1989318: 1
2026-03-30 13:31:26 [ayvens.es] INFO: Extracting data for car ID: 1989318
2026-03-30 13:31:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49d1e343-de0f-5488-929a-8ffb7f7e6389 with identifier: 1989318
2026-03-30 13:31:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49d1e343-de0f-5488-929a-8ffb7f7e6389 with scrape type 1
2026-03-30 13:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 49d1e343-de0f-5488-929a-8ffb7f7e6389
2026-03-30 13:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F059%252Fb2758eaeded0425097b851e1543b068d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/059/b2758eaeded0425097b851e1543b068d/images/large/1.jpg not downloaded yet
2026-03-30 13:31:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 662e1622-3572-5b4d-a914-813caf4b4e35 with identifier: 1989309
2026-03-30 13:31:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 13:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-30 13:31:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 662e1622-3572-5b4d-a914-813caf4b4e35 with identifier: 1989309
2026-03-30 13:31:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 662e1622-3572-5b4d-a914-813caf4b4e35 with identifier: 1989309 to the API
2026-03-30 13:31:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:31:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:31:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/849/c6b1a9e7d2c14002b4f9299a2036ebec/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.6L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'gas',
 'id': '662e1622-3572-5b4d-a914-813caf4b4e35',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'DACIA',
 'model': 'DOKKER',
 'odometer': 179229,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_662e1622-3572-5b4d-a914-813caf4b4e35/662e1622-3572-5b4d-a914-813caf4b4e35_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 292428,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/849/c6b1a9e7d2c14002b4f9299a2036ebec/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-28',
 'seats_number': 2,
 'seller_name': None,
 'title': 'DACIA DOKKER Van Essential 1.6 80kW (107CV) GLP**revisar '
          'peritacion**',
 'transmission': 'manual',
 'trim': 'Van Essential 1.6 80kW (107CV) GLP**revisar peritacion**',
 'vin': None,
 'year': 2019}
2026-03-30 13:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989309%27 HTTP/1.1" 200 None
2026-03-30 13:31:26 [ayvens.es] INFO: Saving data for 1989309: {'created_time': 1774877486.848888, 'last_price_update_time': 1774877486.848904, 'auction_closing_time': 1774954800.0}
2026-03-30 13:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989309') HTTP/1.1" 204 0
2026-03-30 13:31:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b5447e8a-9776-57ef-9a3c-6a6a6587144b with identifier: 1989308
2026-03-30 13:31:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b5447e8a-9776-57ef-9a3c-6a6a6587144b with identifier: 1989308
2026-03-30 13:31:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b5447e8a-9776-57ef-9a3c-6a6a6587144b with identifier: 1989308 to the API
2026-03-30 13:31:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:31:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:31:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/317/1b74e304be664a7a952b8e386aa5f961/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 206,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '2.1L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b5447e8a-9776-57ef-9a3c-6a6a6587144b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'SPRINTER',
 'odometer': 270286,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5447e8a-9776-57ef-9a3c-6a6a6587144b/b5447e8a-9776-57ef-9a3c-6a6a6587144b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 479282,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/317/1b74e304be664a7a952b8e386aa5f961/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-28',
 'seats_number': 3,
 'seller_name': None,
 'title': 'MERCEDES-BENZ SPRINTER 314 CDI MEDIO 3.5T**revisar peritacion**',
 'transmission': 'manual',
 'trim': '314 CDI MEDIO 3.5T**revisar peritacion**',
 'vin': None,
 'year': 2019}
2026-03-30 13:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989308%27 HTTP/1.1" 200 None
2026-03-30 13:31:27 [ayvens.es] INFO: Saving data for 1989308: {'created_time': 1774877487.197629, 'last_price_update_time': 1774877487.197639, 'auction_closing_time': 1774954800.0}
2026-03-30 13:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989308') HTTP/1.1" 204 0
2026-03-30 13:31:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/860/0c95f51885074b639c24bc30f5813871/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:31:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/585/14dfb8d297354668a6125e8d9dba8c5f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:31:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/825/9712fd5a30dd489388ddb78e6628c74d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:31:27 [ayvens.es] INFO: Found listing with ID: 1989319
2026-03-30 13:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989319%27 HTTP/1.1" 200 None
2026-03-30 13:31:27 [ayvens.es] INFO: Scrape type for 1989319: 1
2026-03-30 13:31:27 [ayvens.es] INFO: Extracting data for car ID: 1989319
2026-03-30 13:31:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62f3fce2-0a28-5258-ab85-933a3018e8a1 with identifier: 1989319
2026-03-30 13:31:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62f3fce2-0a28-5258-ab85-933a3018e8a1 with scrape type 1
2026-03-30 13:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 62f3fce2-0a28-5258-ab85-933a3018e8a1
2026-03-30 13:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F602%252F94637135c8aa480fbf0cd13d80e2fa5d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/602/94637135c8aa480fbf0cd13d80e2fa5d/images/large/1.jpg not downloaded yet
2026-03-30 13:31:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:31:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705d446c10>
2026-03-30 13:31:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:31:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9287a3d-df00-529b-8e81-12c212ce4ae0/b9287a3d-df00-529b-8e81-12c212ce4ae0_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F625%252F1a340bd431ba4a3eb6eae6fbb265f274%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/625/1a340bd431ba4a3eb6eae6fbb265f274/images/large/1.jpg saved to cache
2026-03-30 13:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b9287a3d-df00-529b-8e81-12c212ce4ae0
2026-03-30 13:31:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b9287a3d-df00-529b-8e81-12c212ce4ae0, skipping ID generation
2026-03-30 13:31:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9287a3d-df00-529b-8e81-12c212ce4ae0 with scrape type 1
2026-03-30 13:31:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b9287a3d-df00-529b-8e81-12c212ce4ae0 sending to next pipeline
2026-03-30 13:31:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b9287a3d-df00-529b-8e81-12c212ce4ae0, identifier: 1989311
2026-03-30 13:31:27 [ayvens.es] INFO: Found listing with ID: 1989320
2026-03-30 13:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989320%27 HTTP/1.1" 200 None
2026-03-30 13:31:27 [ayvens.es] INFO: Scrape type for 1989320: 1
2026-03-30 13:31:27 [ayvens.es] INFO: Extracting data for car ID: 1989320
2026-03-30 13:31:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86d0ba2e-f412-58da-af00-47fda2c264ef with identifier: 1989320
2026-03-30 13:31:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86d0ba2e-f412-58da-af00-47fda2c264ef with scrape type 1
2026-03-30 13:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 86d0ba2e-f412-58da-af00-47fda2c264ef
2026-03-30 13:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F108%252F45f2b911adda43b386b9866d2de9f119%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/108/45f2b911adda43b386b9866d2de9f119/images/large/1.jpg not downloaded yet
2026-03-30 13:31:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b9287a3d-df00-529b-8e81-12c212ce4ae0 with identifier: 1989311
2026-03-30 13:31:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b9287a3d-df00-529b-8e81-12c212ce4ae0 with identifier: 1989311
2026-03-30 13:31:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b9287a3d-df00-529b-8e81-12c212ce4ae0 with identifier: 1989311 to the API
2026-03-30 13:31:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:31:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:31:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/625/1a340bd431ba4a3eb6eae6fbb265f274/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.6L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'gas',
 'id': 'b9287a3d-df00-529b-8e81-12c212ce4ae0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'DACIA',
 'model': 'DOKKER',
 'odometer': 103155,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9287a3d-df00-529b-8e81-12c212ce4ae0/b9287a3d-df00-529b-8e81-12c212ce4ae0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 298368,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/625/1a340bd431ba4a3eb6eae6fbb265f274/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-28',
 'seats_number': 2,
 'seller_name': None,
 'title': 'DACIA DOKKER Van Essential 1.6 80kW (107CV) GLP**revisar '
          'peritacion**',
 'transmission': 'manual',
 'trim': 'Van Essential 1.6 80kW (107CV) GLP**revisar peritacion**',
 'vin': None,
 'year': 2019}
2026-03-30 13:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989311%27 HTTP/1.1" 200 None
2026-03-30 13:31:27 [ayvens.es] INFO: Saving data for 1989311: {'created_time': 1774877487.95009, 'last_price_update_time': 1774877487.950102, 'auction_closing_time': 1774954800.0}
2026-03-30 13:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989311') HTTP/1.1" 204 0
2026-03-30 13:31:27 [ayvens.es] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 100
2026-03-30 13:31:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/389/c7de8e3ba2d3419eabcd13bdaf776c2a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:31:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:31:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f706d04b050>
2026-03-30 13:31:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:31:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:31:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0adba50b-99a8-577a-b615-98ef67d70604/0adba50b-99a8-577a-b615-98ef67d70604_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F860%252F0c95f51885074b639c24bc30f5813871%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/860/0c95f51885074b639c24bc30f5813871/images/large/1.jpg saved to cache
2026-03-30 13:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0adba50b-99a8-577a-b615-98ef67d70604
2026-03-30 13:31:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0adba50b-99a8-577a-b615-98ef67d70604, skipping ID generation
2026-03-30 13:31:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0adba50b-99a8-577a-b615-98ef67d70604 with scrape type 1
2026-03-30 13:31:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0adba50b-99a8-577a-b615-98ef67d70604 sending to next pipeline
2026-03-30 13:31:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0adba50b-99a8-577a-b615-98ef67d70604, identifier: 1989310
2026-03-30 13:31:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:31:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705c470ed0>
2026-03-30 13:31:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:31:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce336c03-2f79-5688-998e-bad45e5068c8/ce336c03-2f79-5688-998e-bad45e5068c8_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F585%252F14dfb8d297354668a6125e8d9dba8c5f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/585/14dfb8d297354668a6125e8d9dba8c5f/images/large/1.jpg saved to cache
2026-03-30 13:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ce336c03-2f79-5688-998e-bad45e5068c8
2026-03-30 13:31:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ce336c03-2f79-5688-998e-bad45e5068c8, skipping ID generation
2026-03-30 13:31:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce336c03-2f79-5688-998e-bad45e5068c8 with scrape type 1
2026-03-30 13:31:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ce336c03-2f79-5688-998e-bad45e5068c8 sending to next pipeline
2026-03-30 13:31:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ce336c03-2f79-5688-998e-bad45e5068c8, identifier: 1989313
2026-03-30 13:31:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:31:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705c4a5150>
2026-03-30 13:31:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:31:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f0c835f-93e2-5056-a03c-a73ca90875df/9f0c835f-93e2-5056-a03c-a73ca90875df_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F825%252F9712fd5a30dd489388ddb78e6628c74d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/825/9712fd5a30dd489388ddb78e6628c74d/images/large/1.jpg saved to cache
2026-03-30 13:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9f0c835f-93e2-5056-a03c-a73ca90875df
2026-03-30 13:31:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9f0c835f-93e2-5056-a03c-a73ca90875df, skipping ID generation
2026-03-30 13:31:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f0c835f-93e2-5056-a03c-a73ca90875df with scrape type 1
2026-03-30 13:31:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9f0c835f-93e2-5056-a03c-a73ca90875df sending to next pipeline
2026-03-30 13:31:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9f0c835f-93e2-5056-a03c-a73ca90875df, identifier: 1989312
2026-03-30 13:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/163/99f4f28f4f224da18b5ae22c7cf441c5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:31:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0adba50b-99a8-577a-b615-98ef67d70604 with identifier: 1989310
2026-03-30 13:31:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0adba50b-99a8-577a-b615-98ef67d70604 with identifier: 1989310
2026-03-30 13:31:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0adba50b-99a8-577a-b615-98ef67d70604 with identifier: 1989310 to the API
2026-03-30 13:31:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:31:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:31:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/860/0c95f51885074b639c24bc30f5813871/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 239,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '3.0L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '0adba50b-99a8-577a-b615-98ef67d70604',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'NT400 CABSTAR',
 'odometer': 68818,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0adba50b-99a8-577a-b615-98ef67d70604/0adba50b-99a8-577a-b615-98ef67d70604_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 548884,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/860/0c95f51885074b639c24bc30f5813871/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-21',
 'seats_number': 3,
 'seller_name': None,
 'title': 'NISSAN NT400 CABSTAR 35.13/2 Basico CAL Cabina Abatible '
          'Media**revisar peritacion**',
 'transmission': 'manual',
 'trim': '35.13/2 Basico CAL Cabina Abatible Media**revisar peritacion**',
 'vin': None,
 'year': 2018}
2026-03-30 13:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989310%27 HTTP/1.1" 200 None
2026-03-30 13:31:28 [ayvens.es] INFO: Saving data for 1989310: {'created_time': 1774877488.899292, 'last_price_update_time': 1774877488.899302, 'auction_closing_time': 1774954800.0}
2026-03-30 13:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989310') HTTP/1.1" 204 0
2026-03-30 13:31:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ce336c03-2f79-5688-998e-bad45e5068c8 with identifier: 1989313
2026-03-30 13:31:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 13:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-30 13:31:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ce336c03-2f79-5688-998e-bad45e5068c8 with identifier: 1989313
2026-03-30 13:31:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ce336c03-2f79-5688-998e-bad45e5068c8 with identifier: 1989313 to the API
2026-03-30 13:31:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:31:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:31:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/585/14dfb8d297354668a6125e8d9dba8c5f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Rojo',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ce336c03-2f79-5688-998e-bad45e5068c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 217683,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce336c03-2f79-5688-998e-bad45e5068c8/ce336c03-2f79-5688-998e-bad45e5068c8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 350830,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/585/14dfb8d297354668a6125e8d9dba8c5f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-13',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS Profesional dCi 55kW (75CV) Euro 6',
 'transmission': 'manual',
 'trim': 'Profesional dCi 55kW (75CV) Euro 6',
 'vin': None,
 'year': 2018}
2026-03-30 13:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989313%27 HTTP/1.1" 200 None
2026-03-30 13:31:29 [ayvens.es] INFO: Saving data for 1989313: {'created_time': 1774877489.252783, 'last_price_update_time': 1774877489.252795, 'auction_closing_time': 1774954800.0}
2026-03-30 13:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989313') HTTP/1.1" 204 0
2026-03-30 13:31:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9f0c835f-93e2-5056-a03c-a73ca90875df with identifier: 1989312
2026-03-30 13:31:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9f0c835f-93e2-5056-a03c-a73ca90875df with identifier: 1989312
2026-03-30 13:31:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9f0c835f-93e2-5056-a03c-a73ca90875df with identifier: 1989312 to the API
2026-03-30 13:31:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:31:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:31:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/825/9712fd5a30dd489388ddb78e6628c74d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 218,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.4L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '9f0c835f-93e2-5056-a03c-a73ca90875df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'HILUX',
 'odometer': 13367,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f0c835f-93e2-5056-a03c-a73ca90875df/9f0c835f-93e2-5056-a03c-a73ca90875df_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 356066,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/825/9712fd5a30dd489388ddb78e6628c74d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA HILUX 2.4 D-4D Cabina Doble GX',
 'transmission': 'manual',
 'trim': '2.4 D-4D Cabina Doble GX',
 'vin': None,
 'year': 2022}
2026-03-30 13:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989312%27 HTTP/1.1" 200 None
2026-03-30 13:31:29 [ayvens.es] INFO: Saving data for 1989312: {'created_time': 1774877489.854561, 'last_price_update_time': 1774877489.854574, 'auction_closing_time': 1774954800.0}
2026-03-30 13:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989312') HTTP/1.1" 204 0
2026-03-30 13:31:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 13:31:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/034/72c1ea520e684a99a67af852a2f89a12/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:31:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/308/43b9e592188a454ca66c3e69246299f5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:31:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:31:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705d40cbd0>
2026-03-30 13:31:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:31:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:31:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:31:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_134af499-0832-5f1e-bd50-c4154915d586/134af499-0832-5f1e-bd50-c4154915d586_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F389%252Fc7de8e3ba2d3419eabcd13bdaf776c2a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/389/c7de8e3ba2d3419eabcd13bdaf776c2a/images/large/1.jpg saved to cache
2026-03-30 13:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 134af499-0832-5f1e-bd50-c4154915d586
2026-03-30 13:31:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 134af499-0832-5f1e-bd50-c4154915d586, skipping ID generation
2026-03-30 13:31:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 134af499-0832-5f1e-bd50-c4154915d586 with scrape type 1
2026-03-30 13:31:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 134af499-0832-5f1e-bd50-c4154915d586 sending to next pipeline
2026-03-30 13:31:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 134af499-0832-5f1e-bd50-c4154915d586, identifier: 1989314
2026-03-30 13:31:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 134af499-0832-5f1e-bd50-c4154915d586 with identifier: 1989314
2026-03-30 13:31:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 134af499-0832-5f1e-bd50-c4154915d586 with identifier: 1989314
2026-03-30 13:31:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 134af499-0832-5f1e-bd50-c4154915d586 with identifier: 1989314 to the API
2026-03-30 13:31:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:31:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:31:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/389/c7de8e3ba2d3419eabcd13bdaf776c2a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 170,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.6L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '134af499-0832-5f1e-bd50-c4154915d586',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'TRAFIC',
 'odometer': 169000,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_134af499-0832-5f1e-bd50-c4154915d586/134af499-0832-5f1e-bd50-c4154915d586_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 449946,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/389/c7de8e3ba2d3419eabcd13bdaf776c2a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-11',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT TRAFIC Furgon 27 L1H1 dCi 88kW (120CV)',
 'transmission': 'manual',
 'trim': 'Furgon 27 L1H1 dCi 88kW (120CV)',
 'vin': None,
 'year': 2019}
2026-03-30 13:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989314%27 HTTP/1.1" 200 None
2026-03-30 13:31:30 [ayvens.es] INFO: Saving data for 1989314: {'created_time': 1774877490.382181, 'last_price_update_time': 1774877490.382193, 'auction_closing_time': 1774954800.0}
2026-03-30 13:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989314') HTTP/1.1" 204 0
2026-03-30 13:31:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:31:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705f65fad0>
2026-03-30 13:31:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:31:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:31:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:31:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73daa06e-9d23-555d-a406-f4fa780e970a/73daa06e-9d23-555d-a406-f4fa780e970a_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F163%252F99f4f28f4f224da18b5ae22c7cf441c5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/163/99f4f28f4f224da18b5ae22c7cf441c5/images/large/1.jpg saved to cache
2026-03-30 13:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 73daa06e-9d23-555d-a406-f4fa780e970a
2026-03-30 13:31:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 73daa06e-9d23-555d-a406-f4fa780e970a, skipping ID generation
2026-03-30 13:31:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73daa06e-9d23-555d-a406-f4fa780e970a with scrape type 1
2026-03-30 13:31:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 73daa06e-9d23-555d-a406-f4fa780e970a sending to next pipeline
2026-03-30 13:31:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 73daa06e-9d23-555d-a406-f4fa780e970a, identifier: 1989315
2026-03-30 13:31:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/059/b2758eaeded0425097b851e1543b068d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:31:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 73daa06e-9d23-555d-a406-f4fa780e970a with identifier: 1989315
2026-03-30 13:31:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 73daa06e-9d23-555d-a406-f4fa780e970a with identifier: 1989315
2026-03-30 13:31:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 73daa06e-9d23-555d-a406-f4fa780e970a with identifier: 1989315 to the API
2026-03-30 13:31:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:31:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:31:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/163/99f4f28f4f224da18b5ae22c7cf441c5/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '73daa06e-9d23-555d-a406-f4fa780e970a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT CUSTOM',
 'odometer': 177248,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73daa06e-9d23-555d-a406-f4fa780e970a/73daa06e-9d23-555d-a406-f4fa780e970a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 491487,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/163/99f4f28f4f224da18b5ae22c7cf441c5/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-17',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT CUSTOM Van 2.0 TDCI 96kW 320 L1 Trend',
 'transmission': 'manual',
 'trim': 'Van 2.0 TDCI 96kW 320 L1 Trend',
 'vin': None,
 'year': 2020}
2026-03-30 13:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989315%27 HTTP/1.1" 200 None
2026-03-30 13:31:31 [ayvens.es] INFO: Saving data for 1989315: {'created_time': 1774877491.620207, 'last_price_update_time': 1774877491.620218, 'auction_closing_time': 1774954800.0}
2026-03-30 13:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989315') HTTP/1.1" 204 0
2026-03-30 13:31:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:31:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705d3f9dd0>
2026-03-30 13:31:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:31:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:31:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:31:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca72a149-8115-5b78-bcae-a29c0c3e0ab7/ca72a149-8115-5b78-bcae-a29c0c3e0ab7_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F034%252F72c1ea520e684a99a67af852a2f89a12%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/034/72c1ea520e684a99a67af852a2f89a12/images/large/1.jpg saved to cache
2026-03-30 13:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ca72a149-8115-5b78-bcae-a29c0c3e0ab7
2026-03-30 13:31:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ca72a149-8115-5b78-bcae-a29c0c3e0ab7, skipping ID generation
2026-03-30 13:31:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca72a149-8115-5b78-bcae-a29c0c3e0ab7 with scrape type 1
2026-03-30 13:31:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ca72a149-8115-5b78-bcae-a29c0c3e0ab7 sending to next pipeline
2026-03-30 13:31:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ca72a149-8115-5b78-bcae-a29c0c3e0ab7, identifier: 1989317
2026-03-30 13:31:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:31:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705ce13550>
2026-03-30 13:31:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:31:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:31:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:31:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffe8660d-48ba-5d2b-b82c-8f885544e854/ffe8660d-48ba-5d2b-b82c-8f885544e854_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F308%252F43b9e592188a454ca66c3e69246299f5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/308/43b9e592188a454ca66c3e69246299f5/images/large/1.jpg saved to cache
2026-03-30 13:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ffe8660d-48ba-5d2b-b82c-8f885544e854
2026-03-30 13:31:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ffe8660d-48ba-5d2b-b82c-8f885544e854, skipping ID generation
2026-03-30 13:31:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffe8660d-48ba-5d2b-b82c-8f885544e854 with scrape type 1
2026-03-30 13:31:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ffe8660d-48ba-5d2b-b82c-8f885544e854 sending to next pipeline
2026-03-30 13:31:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ffe8660d-48ba-5d2b-b82c-8f885544e854, identifier: 1989316
2026-03-30 13:31:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/602/94637135c8aa480fbf0cd13d80e2fa5d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:31:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ca72a149-8115-5b78-bcae-a29c0c3e0ab7 with identifier: 1989317
2026-03-30 13:31:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ca72a149-8115-5b78-bcae-a29c0c3e0ab7 with identifier: 1989317
2026-03-30 13:31:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ca72a149-8115-5b78-bcae-a29c0c3e0ab7 with identifier: 1989317 to the API
2026-03-30 13:31:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:31:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:31:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/034/72c1ea520e684a99a67af852a2f89a12/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 218,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.4L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ca72a149-8115-5b78-bcae-a29c0c3e0ab7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'HILUX',
 'odometer': 25438,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca72a149-8115-5b78-bcae-a29c0c3e0ab7/ca72a149-8115-5b78-bcae-a29c0c3e0ab7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354759,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/034/72c1ea520e684a99a67af852a2f89a12/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA HILUX 2.4 D-4D Cabina Doble GX',
 'transmission': 'manual',
 'trim': '2.4 D-4D Cabina Doble GX',
 'vin': None,
 'year': 2022}
2026-03-30 13:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989317%27 HTTP/1.1" 200 None
2026-03-30 13:31:32 [ayvens.es] INFO: Saving data for 1989317: {'created_time': 1774877492.321082, 'last_price_update_time': 1774877492.321094, 'auction_closing_time': 1774954800.0}
2026-03-30 13:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989317') HTTP/1.1" 204 0
2026-03-30 13:31:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ffe8660d-48ba-5d2b-b82c-8f885544e854 with identifier: 1989316
2026-03-30 13:31:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ffe8660d-48ba-5d2b-b82c-8f885544e854 with identifier: 1989316
2026-03-30 13:31:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ffe8660d-48ba-5d2b-b82c-8f885544e854 with identifier: 1989316 to the API
2026-03-30 13:31:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:31:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:31:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/308/43b9e592188a454ca66c3e69246299f5/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.6L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'gas',
 'id': 'ffe8660d-48ba-5d2b-b82c-8f885544e854',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'DACIA',
 'model': 'DOKKER',
 'odometer': 162379,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffe8660d-48ba-5d2b-b82c-8f885544e854/ffe8660d-48ba-5d2b-b82c-8f885544e854_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332690,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/308/43b9e592188a454ca66c3e69246299f5/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-01',
 'seats_number': 2,
 'seller_name': None,
 'title': 'DACIA DOKKER Van Essential 1.6 75kW (100CV) GLP',
 'transmission': 'manual',
 'trim': 'Van Essential 1.6 75kW (100CV) GLP',
 'vin': None,
 'year': 2019}
2026-03-30 13:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989316%27 HTTP/1.1" 200 None
2026-03-30 13:31:32 [ayvens.es] INFO: Saving data for 1989316: {'created_time': 1774877492.663894, 'last_price_update_time': 1774877492.663908, 'auction_closing_time': 1774954800.0}
2026-03-30 13:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989316') HTTP/1.1" 204 0
2026-03-30 13:31:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/108/45f2b911adda43b386b9866d2de9f119/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:31:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:31:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705ce145d0>
2026-03-30 13:31:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:31:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:31:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:31:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49d1e343-de0f-5488-929a-8ffb7f7e6389/49d1e343-de0f-5488-929a-8ffb7f7e6389_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F059%252Fb2758eaeded0425097b851e1543b068d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/059/b2758eaeded0425097b851e1543b068d/images/large/1.jpg saved to cache
2026-03-30 13:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 49d1e343-de0f-5488-929a-8ffb7f7e6389
2026-03-30 13:31:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 49d1e343-de0f-5488-929a-8ffb7f7e6389, skipping ID generation
2026-03-30 13:31:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49d1e343-de0f-5488-929a-8ffb7f7e6389 with scrape type 1
2026-03-30 13:31:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 49d1e343-de0f-5488-929a-8ffb7f7e6389 sending to next pipeline
2026-03-30 13:31:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 49d1e343-de0f-5488-929a-8ffb7f7e6389, identifier: 1989318
2026-03-30 13:31:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 49d1e343-de0f-5488-929a-8ffb7f7e6389 with identifier: 1989318
2026-03-30 13:31:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 49d1e343-de0f-5488-929a-8ffb7f7e6389 with identifier: 1989318
2026-03-30 13:31:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 49d1e343-de0f-5488-929a-8ffb7f7e6389 with identifier: 1989318 to the API
2026-03-30 13:31:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:31:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:31:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/059/b2758eaeded0425097b851e1543b068d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.2L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '49d1e343-de0f-5488-929a-8ffb7f7e6389',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'FIORINO',
 'odometer': 135516,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49d1e343-de0f-5488-929a-8ffb7f7e6389/49d1e343-de0f-5488-929a-8ffb7f7e6389_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 318929,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/059/b2758eaeded0425097b851e1543b068d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-07',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FIAT FIORINO Cargo Base N1 1.3 MJet 55kW (75CV) E5+',
 'transmission': 'manual',
 'trim': 'Cargo Base N1 1.3 MJet 55kW (75CV) E5+',
 'vin': None,
 'year': 2017}
2026-03-30 13:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989318%27 HTTP/1.1" 200 None
2026-03-30 13:31:33 [ayvens.es] INFO: Saving data for 1989318: {'created_time': 1774877493.174694, 'last_price_update_time': 1774877493.174711, 'auction_closing_time': 1774954800.0}
2026-03-30 13:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989318') HTTP/1.1" 204 0
2026-03-30 13:31:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:31:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705c357e50>
2026-03-30 13:31:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:31:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62f3fce2-0a28-5258-ab85-933a3018e8a1/62f3fce2-0a28-5258-ab85-933a3018e8a1_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F602%252F94637135c8aa480fbf0cd13d80e2fa5d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/602/94637135c8aa480fbf0cd13d80e2fa5d/images/large/1.jpg saved to cache
2026-03-30 13:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 62f3fce2-0a28-5258-ab85-933a3018e8a1
2026-03-30 13:31:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 62f3fce2-0a28-5258-ab85-933a3018e8a1, skipping ID generation
2026-03-30 13:31:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62f3fce2-0a28-5258-ab85-933a3018e8a1 with scrape type 1
2026-03-30 13:31:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 62f3fce2-0a28-5258-ab85-933a3018e8a1 sending to next pipeline
2026-03-30 13:31:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 62f3fce2-0a28-5258-ab85-933a3018e8a1, identifier: 1989319
2026-03-30 13:31:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 62f3fce2-0a28-5258-ab85-933a3018e8a1 with identifier: 1989319
2026-03-30 13:31:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 62f3fce2-0a28-5258-ab85-933a3018e8a1 with identifier: 1989319
2026-03-30 13:31:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 62f3fce2-0a28-5258-ab85-933a3018e8a1 with identifier: 1989319 to the API
2026-03-30 13:31:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:31:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:31:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/602/94637135c8aa480fbf0cd13d80e2fa5d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '62f3fce2-0a28-5258-ab85-933a3018e8a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 143335,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62f3fce2-0a28-5258-ab85-933a3018e8a1/62f3fce2-0a28-5258-ab85-933a3018e8a1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 488365,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/602/94637135c8aa480fbf0cd13d80e2fa5d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-21',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS Profesional Blue dCi 70kW (95CV)',
 'transmission': 'manual',
 'trim': 'Profesional Blue dCi 70kW (95CV)',
 'vin': None,
 'year': 2021}
2026-03-30 13:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989319%27 HTTP/1.1" 200 None
2026-03-30 13:31:33 [ayvens.es] INFO: Saving data for 1989319: {'created_time': 1774877493.670225, 'last_price_update_time': 1774877493.670238, 'auction_closing_time': 1774954800.0}
2026-03-30 13:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989319') HTTP/1.1" 204 0
2026-03-30 13:31:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:31:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705f2ca4d0>
2026-03-30 13:31:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:31:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86d0ba2e-f412-58da-af00-47fda2c264ef/86d0ba2e-f412-58da-af00-47fda2c264ef_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F108%252F45f2b911adda43b386b9866d2de9f119%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/108/45f2b911adda43b386b9866d2de9f119/images/large/1.jpg saved to cache
2026-03-30 13:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 86d0ba2e-f412-58da-af00-47fda2c264ef
2026-03-30 13:31:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 86d0ba2e-f412-58da-af00-47fda2c264ef, skipping ID generation
2026-03-30 13:31:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86d0ba2e-f412-58da-af00-47fda2c264ef with scrape type 1
2026-03-30 13:31:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 86d0ba2e-f412-58da-af00-47fda2c264ef sending to next pipeline
2026-03-30 13:31:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 86d0ba2e-f412-58da-af00-47fda2c264ef, identifier: 1989320
2026-03-30 13:31:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 86d0ba2e-f412-58da-af00-47fda2c264ef with identifier: 1989320
2026-03-30 13:31:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 86d0ba2e-f412-58da-af00-47fda2c264ef with identifier: 1989320
2026-03-30 13:31:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 86d0ba2e-f412-58da-af00-47fda2c264ef with identifier: 1989320 to the API
2026-03-30 13:31:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:31:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:31:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/108/45f2b911adda43b386b9866d2de9f119/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 220,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '86d0ba2e-f412-58da-af00-47fda2c264ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'RANGER',
 'odometer': 231323,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86d0ba2e-f412-58da-af00-47fda2c264ef/86d0ba2e-f412-58da-af00-47fda2c264ef_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 326419,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/108/45f2b911adda43b386b9866d2de9f119/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD RANGER 2.0 Ecoblue 125kW 4x4 Doble Cab. XL S/S',
 'transmission': 'manual',
 'trim': '2.0 Ecoblue 125kW 4x4 Doble Cab. XL S/S',
 'vin': None,
 'year': 2021}
2026-03-30 13:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989320%27 HTTP/1.1" 200 None
2026-03-30 13:31:34 [ayvens.es] INFO: Saving data for 1989320: {'created_time': 1774877494.235964, 'last_price_update_time': 1774877494.235984, 'auction_closing_time': 1774954800.0}
2026-03-30 13:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989320') HTTP/1.1" 204 0
2026-03-30 13:31:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-30 13:31:34 [ayvens.es] INFO: Found listing with ID: 1989321
2026-03-30 13:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989321%27 HTTP/1.1" 200 None
2026-03-30 13:31:34 [ayvens.es] INFO: Scrape type for 1989321: 1
2026-03-30 13:31:34 [ayvens.es] INFO: Extracting data for car ID: 1989321
2026-03-30 13:31:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c8051ed-2b05-5b44-946b-4068fb780f3c with identifier: 1989321
2026-03-30 13:31:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c8051ed-2b05-5b44-946b-4068fb780f3c with scrape type 1
2026-03-30 13:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2c8051ed-2b05-5b44-946b-4068fb780f3c
2026-03-30 13:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F592%252F6ac228a8fb2f46ed9674264cec93b05d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/592/6ac228a8fb2f46ed9674264cec93b05d/images/large/1.jpg not downloaded yet
2026-03-30 13:31:34 [ayvens.es] INFO: Found listing with ID: 1989322
2026-03-30 13:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989322%27 HTTP/1.1" 200 None
2026-03-30 13:31:34 [ayvens.es] INFO: Scrape type for 1989322: 1
2026-03-30 13:31:34 [ayvens.es] INFO: Extracting data for car ID: 1989322
2026-03-30 13:31:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6713a55-41ce-5ab2-9422-56ccbb1db148 with identifier: 1989322
2026-03-30 13:31:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6713a55-41ce-5ab2-9422-56ccbb1db148 with scrape type 1
2026-03-30 13:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f6713a55-41ce-5ab2-9422-56ccbb1db148
2026-03-30 13:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F705%252F18538e093db241c99ad2d79ea11bec17%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/705/18538e093db241c99ad2d79ea11bec17/images/large/1.jpg not downloaded yet
2026-03-30 13:31:34 [ayvens.es] INFO: Found listing with ID: 1989323
2026-03-30 13:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989323%27 HTTP/1.1" 200 None
2026-03-30 13:31:35 [ayvens.es] INFO: Scrape type for 1989323: 1
2026-03-30 13:31:35 [ayvens.es] INFO: Extracting data for car ID: 1989323
2026-03-30 13:31:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58d3605b-d2b1-5a4d-a345-bee80f04d98e with identifier: 1989323
2026-03-30 13:31:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58d3605b-d2b1-5a4d-a345-bee80f04d98e with scrape type 1
2026-03-30 13:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 58d3605b-d2b1-5a4d-a345-bee80f04d98e
2026-03-30 13:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F338%252F825aec9b66974c3da59ab4e0457dc718%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/338/825aec9b66974c3da59ab4e0457dc718/images/large/1.jpg not downloaded yet
2026-03-30 13:31:35 [ayvens.es] INFO: Found listing with ID: 1989324
2026-03-30 13:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989324%27 HTTP/1.1" 200 None
2026-03-30 13:31:35 [ayvens.es] INFO: Scrape type for 1989324: 1
2026-03-30 13:31:35 [ayvens.es] INFO: Extracting data for car ID: 1989324
2026-03-30 13:31:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80f9aae0-5f59-5c73-8e11-fcbb51169db5 with identifier: 1989324
2026-03-30 13:31:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80f9aae0-5f59-5c73-8e11-fcbb51169db5 with scrape type 1
2026-03-30 13:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 80f9aae0-5f59-5c73-8e11-fcbb51169db5
2026-03-30 13:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F344%252F6bfcfe15ac244d0db49c6a06fa32d721%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/344/6bfcfe15ac244d0db49c6a06fa32d721/images/large/1.jpg not downloaded yet
2026-03-30 13:31:35 [ayvens.es] INFO: Found listing with ID: 1989325
2026-03-30 13:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989325%27 HTTP/1.1" 200 None
2026-03-30 13:31:35 [ayvens.es] INFO: Scrape type for 1989325: 1
2026-03-30 13:31:35 [ayvens.es] INFO: Extracting data for car ID: 1989325
2026-03-30 13:31:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32628796-c6f9-5c88-954e-d8d37c6d99d9 with identifier: 1989325
2026-03-30 13:31:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32628796-c6f9-5c88-954e-d8d37c6d99d9 with scrape type 1
2026-03-30 13:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 32628796-c6f9-5c88-954e-d8d37c6d99d9
2026-03-30 13:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F573%252F29dd9ea2b21049e2a92505d2db79dc5a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/573/29dd9ea2b21049e2a92505d2db79dc5a/images/large/1.jpg not downloaded yet
2026-03-30 13:31:35 [ayvens.es] INFO: Found listing with ID: 1989326
2026-03-30 13:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989326%27 HTTP/1.1" 200 None
2026-03-30 13:31:35 [ayvens.es] INFO: Scrape type for 1989326: 1
2026-03-30 13:31:35 [ayvens.es] INFO: Extracting data for car ID: 1989326
2026-03-30 13:31:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f1d7898-ca26-5b23-9234-beeb1e756bb9 with identifier: 1989326
2026-03-30 13:31:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f1d7898-ca26-5b23-9234-beeb1e756bb9 with scrape type 1
2026-03-30 13:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6f1d7898-ca26-5b23-9234-beeb1e756bb9
2026-03-30 13:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F292%252F0e1475c6077043aab1b24e11dc3444db%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-30 13:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/292/0e1475c6077043aab1b24e11dc3444db/images/large/1.jpg not downloaded yet
2026-03-30 13:31:35 [ayvens.es] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 200
2026-03-30 13:31:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 13:31:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/592/6ac228a8fb2f46ed9674264cec93b05d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:31:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/705/18538e093db241c99ad2d79ea11bec17/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:31:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/338/825aec9b66974c3da59ab4e0457dc718/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:31:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:31:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705f2cabd0>
2026-03-30 13:31:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:31:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:31:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:31:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c8051ed-2b05-5b44-946b-4068fb780f3c/2c8051ed-2b05-5b44-946b-4068fb780f3c_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F592%252F6ac228a8fb2f46ed9674264cec93b05d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/592/6ac228a8fb2f46ed9674264cec93b05d/images/large/1.jpg saved to cache
2026-03-30 13:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2c8051ed-2b05-5b44-946b-4068fb780f3c
2026-03-30 13:31:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2c8051ed-2b05-5b44-946b-4068fb780f3c, skipping ID generation
2026-03-30 13:31:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c8051ed-2b05-5b44-946b-4068fb780f3c with scrape type 1
2026-03-30 13:31:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2c8051ed-2b05-5b44-946b-4068fb780f3c sending to next pipeline
2026-03-30 13:31:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2c8051ed-2b05-5b44-946b-4068fb780f3c, identifier: 1989321
2026-03-30 13:31:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2c8051ed-2b05-5b44-946b-4068fb780f3c with identifier: 1989321
2026-03-30 13:31:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2c8051ed-2b05-5b44-946b-4068fb780f3c with identifier: 1989321
2026-03-30 13:31:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 2c8051ed-2b05-5b44-946b-4068fb780f3c with identifier: 1989321 to the API
2026-03-30 13:31:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:31:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:31:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/592/6ac228a8fb2f46ed9674264cec93b05d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '2c8051ed-2b05-5b44-946b-4068fb780f3c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT CONNECT',
 'odometer': 160456,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c8051ed-2b05-5b44-946b-4068fb780f3c/2c8051ed-2b05-5b44-946b-4068fb780f3c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325648,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/592/6ac228a8fb2f46ed9674264cec93b05d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-05',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FORD TRANSIT CONNECT Van 1.5 TDCi 74kW Trend 200 L1',
 'transmission': 'manual',
 'trim': 'Van 1.5 TDCi 74kW Trend 200 L1',
 'vin': None,
 'year': 2019}
2026-03-30 13:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989321%27 HTTP/1.1" 200 None
2026-03-30 13:31:35 [ayvens.es] INFO: Saving data for 1989321: {'created_time': 1774877495.953425, 'last_price_update_time': 1774877495.953438, 'auction_closing_time': 1774954800.0}
2026-03-30 13:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989321') HTTP/1.1" 204 0
2026-03-30 13:31:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:31:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705d514850>
2026-03-30 13:31:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:31:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6713a55-41ce-5ab2-9422-56ccbb1db148/f6713a55-41ce-5ab2-9422-56ccbb1db148_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F705%252F18538e093db241c99ad2d79ea11bec17%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/705/18538e093db241c99ad2d79ea11bec17/images/large/1.jpg saved to cache
2026-03-30 13:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f6713a55-41ce-5ab2-9422-56ccbb1db148
2026-03-30 13:31:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f6713a55-41ce-5ab2-9422-56ccbb1db148, skipping ID generation
2026-03-30 13:31:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6713a55-41ce-5ab2-9422-56ccbb1db148 with scrape type 1
2026-03-30 13:31:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f6713a55-41ce-5ab2-9422-56ccbb1db148 sending to next pipeline
2026-03-30 13:31:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f6713a55-41ce-5ab2-9422-56ccbb1db148, identifier: 1989322
2026-03-30 13:31:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:31:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705c471d90>
2026-03-30 13:31:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:31:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58d3605b-d2b1-5a4d-a345-bee80f04d98e/58d3605b-d2b1-5a4d-a345-bee80f04d98e_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F338%252F825aec9b66974c3da59ab4e0457dc718%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/338/825aec9b66974c3da59ab4e0457dc718/images/large/1.jpg saved to cache
2026-03-30 13:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 58d3605b-d2b1-5a4d-a345-bee80f04d98e
2026-03-30 13:31:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 58d3605b-d2b1-5a4d-a345-bee80f04d98e, skipping ID generation
2026-03-30 13:31:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58d3605b-d2b1-5a4d-a345-bee80f04d98e with scrape type 1
2026-03-30 13:31:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 58d3605b-d2b1-5a4d-a345-bee80f04d98e sending to next pipeline
2026-03-30 13:31:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 58d3605b-d2b1-5a4d-a345-bee80f04d98e, identifier: 1989323
2026-03-30 13:31:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/573/29dd9ea2b21049e2a92505d2db79dc5a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:31:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/344/6bfcfe15ac244d0db49c6a06fa32d721/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:31:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f6713a55-41ce-5ab2-9422-56ccbb1db148 with identifier: 1989322
2026-03-30 13:31:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f6713a55-41ce-5ab2-9422-56ccbb1db148 with identifier: 1989322
2026-03-30 13:31:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f6713a55-41ce-5ab2-9422-56ccbb1db148 with identifier: 1989322 to the API
2026-03-30 13:31:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:31:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:31:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/705/18538e093db241c99ad2d79ea11bec17/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'color': 'Candy blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f6713a55-41ce-5ab2-9422-56ccbb1db148',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CADDY',
 'odometer': 142455,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6713a55-41ce-5ab2-9422-56ccbb1db148/f6713a55-41ce-5ab2-9422-56ccbb1db148_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 493838,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/705/18538e093db241c99ad2d79ea11bec17/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-22',
 'seats_number': 2,
 'seller_name': None,
 'title': 'VOLKSWAGEN CADDY (E) Business 2.0 TDI 90kW (122CV) BMT 4M',
 'transmission': 'manual',
 'trim': '(E) Business 2.0 TDI 90kW (122CV) BMT 4M',
 'vin': None,
 'year': 2019}
2026-03-30 13:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989322%27 HTTP/1.1" 200 None
2026-03-30 13:31:36 [ayvens.es] INFO: Saving data for 1989322: {'created_time': 1774877496.764863, 'last_price_update_time': 1774877496.764873, 'auction_closing_time': 1774954800.0}
2026-03-30 13:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989322') HTTP/1.1" 204 0
2026-03-30 13:31:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 58d3605b-d2b1-5a4d-a345-bee80f04d98e with identifier: 1989323
2026-03-30 13:31:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 13:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-30 13:31:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 58d3605b-d2b1-5a4d-a345-bee80f04d98e with identifier: 1989323
2026-03-30 13:31:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 58d3605b-d2b1-5a4d-a345-bee80f04d98e with identifier: 1989323 to the API
2026-03-30 13:31:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:31:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:31:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/338/825aec9b66974c3da59ab4e0457dc718/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Rojo vivo',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '58d3605b-d2b1-5a4d-a345-bee80f04d98e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO',
 'odometer': 112942,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58d3605b-d2b1-5a4d-a345-bee80f04d98e/58d3605b-d2b1-5a4d-a345-bee80f04d98e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329200,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/338/825aec9b66974c3da59ab4e0457dc718/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT KANGOO (O) Profes. M1-AF Blue dCi 59 kW (80 CV) -SS',
 'transmission': 'manual',
 'trim': '(O) Profes. M1-AF Blue dCi 59 kW (80 CV) -SS',
 'vin': None,
 'year': 2021}
2026-03-30 13:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989323%27 HTTP/1.1" 200 None
2026-03-30 13:31:37 [ayvens.es] INFO: Saving data for 1989323: {'created_time': 1774877497.144958, 'last_price_update_time': 1774877497.14497, 'auction_closing_time': 1774954800.0}
2026-03-30 13:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989323') HTTP/1.1" 204 0
2026-03-30 13:31:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/292/0e1475c6077043aab1b24e11dc3444db/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-30 13:31:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:31:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705c355450>
2026-03-30 13:31:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:31:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:31:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:31:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32628796-c6f9-5c88-954e-d8d37c6d99d9/32628796-c6f9-5c88-954e-d8d37c6d99d9_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F573%252F29dd9ea2b21049e2a92505d2db79dc5a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/573/29dd9ea2b21049e2a92505d2db79dc5a/images/large/1.jpg saved to cache
2026-03-30 13:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 32628796-c6f9-5c88-954e-d8d37c6d99d9
2026-03-30 13:31:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 32628796-c6f9-5c88-954e-d8d37c6d99d9, skipping ID generation
2026-03-30 13:31:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32628796-c6f9-5c88-954e-d8d37c6d99d9 with scrape type 1
2026-03-30 13:31:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 32628796-c6f9-5c88-954e-d8d37c6d99d9 sending to next pipeline
2026-03-30 13:31:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 32628796-c6f9-5c88-954e-d8d37c6d99d9, identifier: 1989325
2026-03-30 13:31:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:31:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705efdb8d0>
2026-03-30 13:31:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:31:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:31:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:31:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80f9aae0-5f59-5c73-8e11-fcbb51169db5/80f9aae0-5f59-5c73-8e11-fcbb51169db5_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F344%252F6bfcfe15ac244d0db49c6a06fa32d721%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/344/6bfcfe15ac244d0db49c6a06fa32d721/images/large/1.jpg saved to cache
2026-03-30 13:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 80f9aae0-5f59-5c73-8e11-fcbb51169db5
2026-03-30 13:31:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 80f9aae0-5f59-5c73-8e11-fcbb51169db5, skipping ID generation
2026-03-30 13:31:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80f9aae0-5f59-5c73-8e11-fcbb51169db5 with scrape type 1
2026-03-30 13:31:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 80f9aae0-5f59-5c73-8e11-fcbb51169db5 sending to next pipeline
2026-03-30 13:31:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 80f9aae0-5f59-5c73-8e11-fcbb51169db5, identifier: 1989324
2026-03-30 13:31:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 32628796-c6f9-5c88-954e-d8d37c6d99d9 with identifier: 1989325
2026-03-30 13:31:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 32628796-c6f9-5c88-954e-d8d37c6d99d9 with identifier: 1989325
2026-03-30 13:31:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 32628796-c6f9-5c88-954e-d8d37c6d99d9 with identifier: 1989325 to the API
2026-03-30 13:31:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:31:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:31:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/573/29dd9ea2b21049e2a92505d2db79dc5a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '32628796-c6f9-5c88-954e-d8d37c6d99d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'BERLINGO',
 'odometer': 79887,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32628796-c6f9-5c88-954e-d8d37c6d99d9/32628796-c6f9-5c88-954e-d8d37c6d99d9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 312531,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/573/29dd9ea2b21049e2a92505d2db79dc5a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-13',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROËN BERLINGO Talla M BlueHDi 100 CONTROL',
 'transmission': 'manual',
 'trim': 'Talla M BlueHDi 100 CONTROL',
 'vin': None,
 'year': 2020}
2026-03-30 13:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989325%27 HTTP/1.1" 200 None
2026-03-30 13:31:37 [ayvens.es] INFO: Saving data for 1989325: {'created_time': 1774877497.865038, 'last_price_update_time': 1774877497.865049, 'auction_closing_time': 1774954800.0}
2026-03-30 13:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989325') HTTP/1.1" 204 0
2026-03-30 13:31:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 80f9aae0-5f59-5c73-8e11-fcbb51169db5 with identifier: 1989324
2026-03-30 13:31:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 80f9aae0-5f59-5c73-8e11-fcbb51169db5 with identifier: 1989324
2026-03-30 13:31:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 80f9aae0-5f59-5c73-8e11-fcbb51169db5 with identifier: 1989324 to the API
2026-03-30 13:31:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:31:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:31:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/344/6bfcfe15ac244d0db49c6a06fa32d721/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 219,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '80f9aae0-5f59-5c73-8e11-fcbb51169db5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT',
 'odometer': 119886,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80f9aae0-5f59-5c73-8e11-fcbb51169db5/80f9aae0-5f59-5c73-8e11-fcbb51169db5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 334322,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/344/6bfcfe15ac244d0db49c6a06fa32d721/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-28',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 350 96kW L3H2 Van Trend FWD',
 'transmission': 'manual',
 'trim': '350 96kW L3H2 Van Trend FWD',
 'vin': None,
 'year': 2023}
2026-03-30 13:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989324%27 HTTP/1.1" 200 None
2026-03-30 13:31:38 [ayvens.es] INFO: Saving data for 1989324: {'created_time': 1774877498.251207, 'last_price_update_time': 1774877498.251218, 'auction_closing_time': 1774954800.0}
2026-03-30 13:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989324') HTTP/1.1" 204 0
2026-03-30 13:31:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 13:31:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f705c354750>
2026-03-30 13:31:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 13:31:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 13:31:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 13:31:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f1d7898-ca26-5b23-9234-beeb1e756bb9/6f1d7898-ca26-5b23-9234-beeb1e756bb9_image_0.jpg HTTP/1.1" 201 0
2026-03-30 13:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F292%252F0e1475c6077043aab1b24e11dc3444db%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-30 13:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/292/0e1475c6077043aab1b24e11dc3444db/images/large/1.jpg saved to cache
2026-03-30 13:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6f1d7898-ca26-5b23-9234-beeb1e756bb9
2026-03-30 13:31:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6f1d7898-ca26-5b23-9234-beeb1e756bb9, skipping ID generation
2026-03-30 13:31:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f1d7898-ca26-5b23-9234-beeb1e756bb9 with scrape type 1
2026-03-30 13:31:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6f1d7898-ca26-5b23-9234-beeb1e756bb9 sending to next pipeline
2026-03-30 13:31:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6f1d7898-ca26-5b23-9234-beeb1e756bb9, identifier: 1989326
2026-03-30 13:31:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-30 13:31:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6f1d7898-ca26-5b23-9234-beeb1e756bb9 with identifier: 1989326
2026-03-30 13:31:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6f1d7898-ca26-5b23-9234-beeb1e756bb9 with identifier: 1989326
2026-03-30 13:31:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 6f1d7898-ca26-5b23-9234-beeb1e756bb9 with identifier: 1989326 to the API
2026-03-30 13:31:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 13:31:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 13:31:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/292/0e1475c6077043aab1b24e11dc3444db/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-31T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '6f1d7898-ca26-5b23-9234-beeb1e756bb9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41136',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'COMBO',
 'odometer': 101926,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f1d7898-ca26-5b23-9234-beeb1e756bb9/6f1d7898-ca26-5b23-9234-beeb1e756bb9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336422,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/292/0e1475c6077043aab1b24e11dc3444db/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL COMBO 1.5 TD 75kW Business Edition Plus L1 N1',
 'transmission': 'manual',
 'trim': '1.5 TD 75kW Business Edition Plus L1 N1',
 'vin': None,
 'year': 2022}
2026-03-30 13:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271989326%27 HTTP/1.1" 200 None
2026-03-30 13:31:38 [ayvens.es] INFO: Saving data for 1989326: {'created_time': 1774877498.873592, 'last_price_update_time': 1774877498.873609, 'auction_closing_time': 1774954800.0}
2026-03-30 13:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1989326') HTTP/1.1" 204 0
2026-03-30 13:31:38 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-30 13:31:38 [ayvens.es] INFO: ayvens.es Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0, <ScrapeType.BATCH_SKIPPED: 5>: 0}
2026-03-30 13:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 13:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20last_price_update_time%20lt%201774445498 HTTP/1.1" 200 None
2026-03-30 13:31:39 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (106 items) in: file:///var/lib/scrapyd/items/sourcing_v2/ayvens.es/task_38_2026-03-30T13_30_00.jl
2026-03-30 13:31:39 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 53533,
 'downloader/request_count': 109,
 'downloader/request_method_count/GET': 106,
 'downloader/request_method_count/POST': 3,
 'downloader/response_bytes': 43938858,
 'downloader/response_count': 109,
 'downloader/response_status_count/200': 109,
 'elapsed_time_seconds': 95.480185,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 30, 13, 31, 39, 192797, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 106,
 'log_count/DEBUG': 2107,
 'log_count/INFO': 2201,
 'memusage/max': 188473344,
 'memusage/startup': 150323200,
 'photo_download_count': 105,
 'playwright/context_count': 1,
 'playwright/context_count/max_concurrent': 1,
 'playwright/context_count/persistent/False': 1,
 'playwright/context_count/remote/False': 1,
 'playwright/page_count': 1,
 'playwright/page_count/max_concurrent': 1,
 'playwright/request_count': 128,
 'playwright/request_count/aborted': 15,
 'playwright/request_count/method/GET': 124,
 'playwright/request_count/method/POST': 4,
 'playwright/request_count/navigation': 2,
 'playwright/request_count/resource_type/document': 2,
 'playwright/request_count/resource_type/fetch': 1,
 'playwright/request_count/resource_type/font': 16,
 'playwright/request_count/resource_type/image': 25,
 'playwright/request_count/resource_type/script': 79,
 'playwright/request_count/resource_type/stylesheet': 1,
 'playwright/request_count/resource_type/xhr': 4,
 'playwright/response_count': 112,
 'playwright/response_count/method/GET': 109,
 'playwright/response_count/method/POST': 3,
 'playwright/response_count/resource_type/document': 2,
 'playwright/response_count/resource_type/fetch': 1,
 'playwright/response_count/resource_type/font': 16,
 'playwright/response_count/resource_type/image': 10,
 'playwright/response_count/resource_type/script': 79,
 'playwright/response_count/resource_type/stylesheet': 1,
 'playwright/response_count/resource_type/xhr': 3,
 'request_depth_max': 3,
 'response_received_count': 4,
 'scheduler/dequeued': 109,
 'scheduler/dequeued/memory': 109,
 'scheduler/enqueued': 109,
 'scheduler/enqueued/memory': 109,
 'scrape_type/new': 106,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 3,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 4.143547089925657,
 'scrapy-zyte-api/mean_response_seconds': 4.151906971664478,
 'scrapy-zyte-api/processed': 3,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 3,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 3,
 'scrapy-zyte-api/request_args/httpRequestBody': 3,
 'scrapy-zyte-api/request_args/httpRequestMethod': 3,
 'scrapy-zyte-api/request_args/httpResponseBody': 3,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 3,
 'scrapy-zyte-api/request_args/url': 3,
 'scrapy-zyte-api/status_codes/200': 3,
 'scrapy-zyte-api/success': 3,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'start_time': datetime.datetime(2026, 3, 30, 13, 30, 3, 712612, tzinfo=datetime.timezone.utc)}
2026-03-30 13:31:39 [scrapy.core.engine] INFO: Spider closed (finished)