2026-03-25 18:30:04 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-25 18:30:04 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-25 18:30:04 [ayvens.es] INFO: Starting spider ayvens.es
2026-03-25 18:30:04 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-25 18:30:05 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-25 18:30:05 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-25 18:30:05 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-25 18:30:05 [scrapy.extensions.telnet] INFO: Telnet Password: fc72936cc9ee1037
2026-03-25 18:30:05 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-25 18:30:05 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/ayvens.es/task_38_2026-03-25T18_30_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-25 18:30:05 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-25 18:30:05 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-25 18:30:05 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-25 18:30:05 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-25 18:30:05 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-25 18:30:05 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-25 18:30:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-25 18:30:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2106
2026-03-25 18:30:05 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-25 18:30:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-25 18:30:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:05 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: en
2026-03-25 18:30:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27en%27%20and%20RowKey%20eq%20%27en%27 HTTP/1.1" 200 None
2026-03-25 18:30:05 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-25 18:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-25 18:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-25 18:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-25 18:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-25 18:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-25 18:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-25 18:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-25 18:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-25 18:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-25 18:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-25 18:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-25 18:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-25 18:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-25 18:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-25 18:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-25 18:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-25 18:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-25 18:30:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-25 18:30:05 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-25 18:30:05 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-25 18:30:05 [scrapy.core.engine] INFO: Spider opened
2026-03-25 18:30:05 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-25 18:30:05 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-25 18:30:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 141MiB
2026-03-25 18:30:05 [scrapy-playwright] INFO: Starting download handler
2026-03-25 18:30:05 [scrapy-playwright] INFO: Starting download handler
2026-03-25 18:30:10 [scrapy-playwright] INFO: Launching browser firefox
2026-03-25 18:30:10 [scrapy-playwright] INFO: Browser firefox launched
2026-03-25 18:30:11 [scrapy-playwright] DEBUG: Browser context started: 'default' (persistent=False, remote=False)
2026-03-25 18:30:11 [scrapy-playwright] DEBUG: [Context=default] New page created, page count is 1 (1 for all contexts)
2026-03-25 18:30:11 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/lots> (resource type: document)
2026-03-25 18:30:12 [scrapy-playwright] DEBUG: [Context=default] Response: <407 https://carmarket.ayvens.com/en-gb/lots>
2026-03-25 18:30:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/lots> (resource type: document)
2026-03-25 18:30:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/lots>
2026-03-25 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Medium.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Regular.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Semibold.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Bold.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Medium.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Regular.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-SemiBold.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/styles-ETA5EMQJ.css> (resource type: stylesheet, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg>
2026-03-25 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg>
2026-03-25 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/line.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/line.svg>
2026-03-25 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg>
2026-03-25 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/loader.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/loader.svg>
2026-03-25 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-R5GGQAWE.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-YI6GGZZZ.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-NAGGRITV.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-BBQ7R2BV.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HPL7GXW6.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ADG3G2OJ.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7JYRLYWD.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2S63FZXS.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-K7GQAXGO.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-PMQRMPGY.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/polyfills-FFHMD2TL.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/main-NKPAFEH2.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Medium.woff2>
2026-03-25 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Regular.woff2>
2026-03-25 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2>
2026-03-25 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/styles-ETA5EMQJ.css>
2026-03-25 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Semibold.woff2>
2026-03-25 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-25 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-25 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/SourceSans3-Bold-OH3V3LEB.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-25 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/SourceSans3-Regular-VMJBJIXS.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-25 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-25 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/SourceSans3-SemiBold-NPKTOIJ5.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-03-25 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Bold.woff2>
2026-03-25 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Medium.woff2>
2026-03-25 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-SemiBold.woff2>
2026-03-25 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Regular.woff2>
2026-03-25 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2>
2026-03-25 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-YI6GGZZZ.js>
2026-03-25 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-5567JMUS.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-YI6GGZZZ.js)
2026-03-25 18:30:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-4CLCTAJ7.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-YI6GGZZZ.js)
2026-03-25 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-R5GGQAWE.js>
2026-03-25 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-NAGGRITV.js>
2026-03-25 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-QV3UPEBS.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-R5GGQAWE.js)
2026-03-25 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AQBI4CYB.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-R5GGQAWE.js)
2026-03-25 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EIXBRKXP.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-R5GGQAWE.js)
2026-03-25 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-CQOH37XC.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-NAGGRITV.js)
2026-03-25 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HQZHDCQG.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-NAGGRITV.js)
2026-03-25 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2>
2026-03-25 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-BBQ7R2BV.js>
2026-03-25 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HPL7GXW6.js>
2026-03-25 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2S63FZXS.js>
2026-03-25 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7JYRLYWD.js>
2026-03-25 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ADG3G2OJ.js>
2026-03-25 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-PMQRMPGY.js>
2026-03-25 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-K7GQAXGO.js>
2026-03-25 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/polyfills-FFHMD2TL.js>
2026-03-25 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/main-NKPAFEH2.js>
2026-03-25 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-QZ2M64VL.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-BBQ7R2BV.js)
2026-03-25 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EVZDJ3YH.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-25 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2BYH6G4C.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-25 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AHM2LY2L.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-25 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VGUEXTON.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-25 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-SUQC6PCL.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-25 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7DYAUIPQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-25 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-6BXXUPPN.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HPL7GXW6.js)
2026-03-25 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-SALCXTDR.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-K7GQAXGO.js)
2026-03-25 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2>
2026-03-25 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-OF6JT4KC.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-Y6LYHJ33.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ELPOVYM7.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VBU7AOHF.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-SPE4D2IX.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-N2FZW7V7.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VPLHK2CL.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AVZZH6AV.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-KLKMSQPH.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2FANG3NP.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ABBXN5WQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-NPJHDJ36.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-MLMYZRAG.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-5D4JF6DX.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7IEPAGTW.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ZYL3EWWF.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-WWYAPULQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XXARMH2T.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AYT4KML6.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-CX65R3QQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XGLUMAK5.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EHSUL3RU.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7UDVUMWJ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-WRLSZEDX.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XCHSKDZH.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2>
2026-03-25 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2>
2026-03-25 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/SourceSans3-Regular-VMJBJIXS.woff2>
2026-03-25 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/SourceSans3-Bold-OH3V3LEB.woff2>
2026-03-25 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/SourceSans3-SemiBold-NPKTOIJ5.woff2>
2026-03-25 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-4CLCTAJ7.js>
2026-03-25 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-5567JMUS.js>
2026-03-25 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AQBI4CYB.js>
2026-03-25 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-QV3UPEBS.js>
2026-03-25 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EIXBRKXP.js>
2026-03-25 18:30:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-CQOH37XC.js>
2026-03-25 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HQZHDCQG.js>
2026-03-25 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-QZ2M64VL.js>
2026-03-25 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EVZDJ3YH.js>
2026-03-25 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2BYH6G4C.js>
2026-03-25 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VGUEXTON.js>
2026-03-25 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AHM2LY2L.js>
2026-03-25 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-SUQC6PCL.js>
2026-03-25 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7DYAUIPQ.js>
2026-03-25 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-OF6JT4KC.js>
2026-03-25 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-SALCXTDR.js>
2026-03-25 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-6BXXUPPN.js>
2026-03-25 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VBU7AOHF.js>
2026-03-25 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ELPOVYM7.js>
2026-03-25 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AVZZH6AV.js>
2026-03-25 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-N2FZW7V7.js>
2026-03-25 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VPLHK2CL.js>
2026-03-25 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-SPE4D2IX.js>
2026-03-25 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-Y6LYHJ33.js>
2026-03-25 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ABBXN5WQ.js>
2026-03-25 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-KLKMSQPH.js>
2026-03-25 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2FANG3NP.js>
2026-03-25 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-NPJHDJ36.js>
2026-03-25 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-MLMYZRAG.js>
2026-03-25 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-5D4JF6DX.js>
2026-03-25 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7IEPAGTW.js>
2026-03-25 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XXARMH2T.js>
2026-03-25 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-CX65R3QQ.js>
2026-03-25 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AYT4KML6.js>
2026-03-25 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-WWYAPULQ.js>
2026-03-25 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ZYL3EWWF.js>
2026-03-25 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XGLUMAK5.js>
2026-03-25 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EHSUL3RU.js>
2026-03-25 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7UDVUMWJ.js>
2026-03-25 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-WRLSZEDX.js>
2026-03-25 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XCHSKDZH.js>
2026-03-25 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://js.monitor.azure.com/scripts/b/ai.config.1.cfg.json> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-03-25 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-U3DCL5KE.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7HVTDVUE.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens-white-bg_192x192.png> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens-white-bg_192x192.png>
2026-03-25 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens.svg>
2026-03-25 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-U3DCL5KE.js>
2026-03-25 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7HVTDVUE.js>
2026-03-25 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VPZ5PCFV.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-7HVTDVUE.js)
2026-03-25 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://js.monitor.azure.com/scripts/b/ai.config.1.cfg.json>
2026-03-25 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VPZ5PCFV.js>
2026-03-25 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-R57BLUBZ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-VPZ5PCFV.js)
2026-03-25 18:30:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-R57BLUBZ.js>
2026-03-25 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XI7MA6UU.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-253AOQV4.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-Y26P6NOT.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-VPZ5PCFV.js)
2026-03-25 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XI7MA6UU.js>
2026-03-25 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-253AOQV4.js>
2026-03-25 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-E2QM5VHP.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-XI7MA6UU.js)
2026-03-25 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-QVU7EFJH.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-XI7MA6UU.js)
2026-03-25 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-CJQ6ZMFR.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-XI7MA6UU.js)
2026-03-25 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-Y26P6NOT.js>
2026-03-25 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-PU5AH4GE.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-25 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-6AWK7DQQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-25 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-JMKQRIJX.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-25 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-OXIZJZO4.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-25 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-H7VMIGZK.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-25 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-E2QM5VHP.js>
2026-03-25 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-CJQ6ZMFR.js>
2026-03-25 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-QVU7EFJH.js>
2026-03-25 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-6AWK7DQQ.js>
2026-03-25 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-JMKQRIJX.js>
2026-03-25 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-PU5AH4GE.js>
2026-03-25 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-OXIZJZO4.js>
2026-03-25 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-H7VMIGZK.js>
2026-03-25 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/loader.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/loader.svg>
2026-03-25 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/line.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg>
2026-03-25 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/line.svg>
2026-03-25 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg>
2026-03-25 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg>
2026-03-25 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-25 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-BQLC5RJD.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-Y26P6NOT.js)
2026-03-25 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HGLYMGTS.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-PU5AH4GE.js)
2026-03-25 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VNA57F7Z.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-253AOQV4.js)
2026-03-25 18:30:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EXKYPD3J.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-253AOQV4.js)
2026-03-25 18:30:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://carmarket.ayvens.com/en-gb/lots> (referer: None) ['playwright']
2026-03-25 18:30:18 [ayvens.es] INFO: Cookies from Playwright: [{'name': 'ai_user', 'value': '5qUslqumtERObBvgneLwPI|2026-03-25T18:30:16.127Z', 'domain': 'carmarket.ayvens.com', 'path': '/', 'expires': 1805999416, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}, {'name': 'user_culture', 'value': 'en-gb', 'domain': 'carmarket.ayvens.com', 'path': '/', 'expires': -1, 'httpOnly': False, 'secure': False, 'sameSite': 'None'}, {'name': 'ai_session', 'value': '2SkdJai19O8QsfSyVcpBYN|1774463417748|1774463417748', 'domain': 'carmarket.ayvens.com', 'path': '/', 'expires': 1774465217, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}]
2026-03-25 18:30:18 [ayvens.es] INFO: Scrapy-formatted cookies: [{'name': 'ai_user', 'value': '5qUslqumtERObBvgneLwPI|2026-03-25T18:30:16.127Z', 'domain': 'carmarket.ayvens.com', 'path': '/'}, {'name': 'user_culture', 'value': 'en-gb', 'domain': 'carmarket.ayvens.com', 'path': '/'}, {'name': 'ai_session', 'value': '2SkdJai19O8QsfSyVcpBYN|1774463417748|1774463417748', 'domain': 'carmarket.ayvens.com', 'path': '/'}]
2026-03-25 18:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /SpiderData(PartitionKey='Ayvens',RowKey='cookies') HTTP/1.1" 204 0
2026-03-25 18:30:18 [ayvens.es] INFO: Intercepting token...
2026-03-25 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-BQLC5RJD.js>
2026-03-25 18:30:18 [ayvens.es] INFO: Scrolling element to trigger lazy load...
2026-03-25 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EXKYPD3J.js>
2026-03-25 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HGLYMGTS.js>
2026-03-25 18:30:18 [ayvens.es] INFO: GraphQL headers: {'host': 'api-carmarket.ayvens.com', 'user-agent': 'Mozilla/5.0 (X11; Linux x86_64; rv:125.0) Gecko/20100101 Firefox/125.0', 'accept': 'application/json, text/plain, */*', 'accept-language': 'en-US,en;q=0.5', 'accept-encoding': 'gzip, deflate, br', 'content-type': 'application/json', 'content-length': '839', 'referer': 'https://carmarket.ayvens.com/', 'x-ald-subscription-key': '3b2cc62fd26c4e29a762db3de181266b', 'x-tenant': 'ald', 'x-country': 'gb', 'origin': 'https://carmarket.ayvens.com', 'sec-fetch-dest': 'empty', 'sec-fetch-mode': 'cors', 'sec-fetch-site': 'same-site', 'proxy-authorization': 'Basic Y3VzdG9tZXItaW5maW5pdF9zb3VyY2luZ192Ml9XQjdOUi1jYy1HQjozY35+YWdLUmM2MlZaQUw=', 'connection': 'keep-alive'}
2026-03-25 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VNA57F7Z.js>
2026-03-25 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AZBPSD4I.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HGLYMGTS.js)
2026-03-25 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2NCM5KDW.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HGLYMGTS.js)
2026-03-25 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/bell.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/next-breadcrumb.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-25 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VUZVFPNF.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://api-carmarket.ayvens.com/graphql/saleevents> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-25 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/logo-ayvens.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-fr.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-es.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-be.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-de.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-it.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/loader.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-25 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/down.svg>
2026-03-25 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AZBPSD4I.js>
2026-03-25 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2NCM5KDW.js>
2026-03-25 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/next-breadcrumb.svg>
2026-03-25 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/bell.svg>
2026-03-25 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VUZVFPNF.js>
2026-03-25 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/logo-ayvens.svg>
2026-03-25 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-FX6676C7.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-VUZVFPNF.js)
2026-03-25 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/loader.svg>
2026-03-25 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/chevron-down.svg>
2026-03-25 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-BK6NFD4R.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-NKPAFEH2.js)
2026-03-25 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/be.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/fr.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-03-25 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-FX6676C7.js>
2026-03-25 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-75KGV5DF.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-OXIZJZO4.js)
2026-03-25 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/otSDKStub.js> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-03-25 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-es.svg>
2026-03-25 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-de.svg>
2026-03-25 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-it.svg>
2026-03-25 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-fr.svg>
2026-03-25 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-be.svg>
2026-03-25 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-BK6NFD4R.js>
2026-03-25 18:30:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://dc.services.visualstudio.com/v2/track>
2026-03-25 18:30:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/flags/be.svg>
2026-03-25 18:30:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/flags/fr.svg>
2026-03-25 18:30:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-75KGV5DF.js>
2026-03-25 18:30:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://dc.services.visualstudio.com/v2/track>
2026-03-25 18:30:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://dc.services.visualstudio.com/v2/track>
2026-03-25 18:30:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/otSDKStub.js>
2026-03-25 18:30:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/consent/019908df-58e4-7710-aaa7-4d6e79279bd9/019908df-58e4-7710-aaa7-4d6e79279bd9.json> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-03-25 18:30:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/consent/019908df-58e4-7710-aaa7-4d6e79279bd9/019908df-58e4-7710-aaa7-4d6e79279bd9.json>
2026-03-25 18:30:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/202601.1.0/otBannerSdk.js> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-03-25 18:30:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/202601.1.0/otBannerSdk.js>
2026-03-25 18:30:20 [ayvens.es] INFO: ✅ Intercepted token: 3b2cc62fd26c4e29a762db3de181266b
2026-03-25 18:30:20 [ayvens.es] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 0
2026-03-25 18:30:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 18:30:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-25 18:30:22 [ayvens.es] INFO: Found listing with ID: 1982230
2026-03-25 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982230%27 HTTP/1.1" 200 None
2026-03-25 18:30:22 [ayvens.es] INFO: Scrape type for 1982230: 1
2026-03-25 18:30:22 [ayvens.es] INFO: Extracting data for car ID: 1982230
2026-03-25 18:30:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4d129df-6530-5be8-80d6-04fa23d0dc77 with identifier: 1982230
2026-03-25 18:30:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4d129df-6530-5be8-80d6-04fa23d0dc77 with scrape type 1
2026-03-25 18:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e4d129df-6530-5be8-80d6-04fa23d0dc77
2026-03-25 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F363%252F29bb93404e304bb88875bd1fef733a2e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/363/29bb93404e304bb88875bd1fef733a2e/images/large/1.jpg not downloaded yet
2026-03-25 18:30:22 [ayvens.es] INFO: Found listing with ID: 1982231
2026-03-25 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982231%27 HTTP/1.1" 200 None
2026-03-25 18:30:22 [ayvens.es] INFO: Scrape type for 1982231: 1
2026-03-25 18:30:22 [ayvens.es] INFO: Extracting data for car ID: 1982231
2026-03-25 18:30:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8497dc66-f8f9-5fb3-9fb3-78c77341e830 with identifier: 1982231
2026-03-25 18:30:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8497dc66-f8f9-5fb3-9fb3-78c77341e830 with scrape type 1
2026-03-25 18:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8497dc66-f8f9-5fb3-9fb3-78c77341e830
2026-03-25 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F363%252F86a35ac1edda408f9344898fb6296c27%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/363/86a35ac1edda408f9344898fb6296c27/images/large/1.jpg not downloaded yet
2026-03-25 18:30:22 [ayvens.es] INFO: Found listing with ID: 1982232
2026-03-25 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982232%27 HTTP/1.1" 200 None
2026-03-25 18:30:22 [ayvens.es] INFO: Scrape type for 1982232: 1
2026-03-25 18:30:22 [ayvens.es] INFO: Extracting data for car ID: 1982232
2026-03-25 18:30:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab6fd490-f485-5b8d-b29b-77d9ce9dd6fb with identifier: 1982232
2026-03-25 18:30:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab6fd490-f485-5b8d-b29b-77d9ce9dd6fb with scrape type 1
2026-03-25 18:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ab6fd490-f485-5b8d-b29b-77d9ce9dd6fb
2026-03-25 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F426%252F8358447160264811afb0a55b6973b773%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/426/8358447160264811afb0a55b6973b773/images/large/1.jpg not downloaded yet
2026-03-25 18:30:22 [ayvens.es] INFO: Found listing with ID: 1982233
2026-03-25 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982233%27 HTTP/1.1" 200 None
2026-03-25 18:30:22 [ayvens.es] INFO: Scrape type for 1982233: 1
2026-03-25 18:30:22 [ayvens.es] INFO: Extracting data for car ID: 1982233
2026-03-25 18:30:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efea35c6-3c7a-5c99-b8b0-bec4dafef39e with identifier: 1982233
2026-03-25 18:30:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efea35c6-3c7a-5c99-b8b0-bec4dafef39e with scrape type 1
2026-03-25 18:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item efea35c6-3c7a-5c99-b8b0-bec4dafef39e
2026-03-25 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F363%252Fe2b38783f5c9411ab81bb510d759c032%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/363/e2b38783f5c9411ab81bb510d759c032/images/large/1.jpg not downloaded yet
2026-03-25 18:30:22 [ayvens.es] INFO: Found listing with ID: 1982234
2026-03-25 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982234%27 HTTP/1.1" 200 None
2026-03-25 18:30:22 [ayvens.es] INFO: Scrape type for 1982234: 1
2026-03-25 18:30:22 [ayvens.es] INFO: Extracting data for car ID: 1982234
2026-03-25 18:30:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12a8ee06-0429-5b8b-8097-ef4a8fcc5612 with identifier: 1982234
2026-03-25 18:30:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12a8ee06-0429-5b8b-8097-ef4a8fcc5612 with scrape type 1
2026-03-25 18:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 12a8ee06-0429-5b8b-8097-ef4a8fcc5612
2026-03-25 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F189%252F5e25cbcab5b0478e9b6db371800c9e44%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/189/5e25cbcab5b0478e9b6db371800c9e44/images/large/1.jpg not downloaded yet
2026-03-25 18:30:22 [ayvens.es] INFO: Found listing with ID: 1982235
2026-03-25 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982235%27 HTTP/1.1" 200 None
2026-03-25 18:30:22 [ayvens.es] INFO: Scrape type for 1982235: 1
2026-03-25 18:30:22 [ayvens.es] INFO: Extracting data for car ID: 1982235
2026-03-25 18:30:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9bfb164e-72d4-5b8f-be0a-0ac70edec6b7 with identifier: 1982235
2026-03-25 18:30:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9bfb164e-72d4-5b8f-be0a-0ac70edec6b7 with scrape type 1
2026-03-25 18:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9bfb164e-72d4-5b8f-be0a-0ac70edec6b7
2026-03-25 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F363%252Ffcfe60e51ffd4985956e463a4ad34d8d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/363/fcfe60e51ffd4985956e463a4ad34d8d/images/large/1.jpg not downloaded yet
2026-03-25 18:30:22 [ayvens.es] INFO: Found listing with ID: 1982236
2026-03-25 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982236%27 HTTP/1.1" 200 None
2026-03-25 18:30:22 [ayvens.es] INFO: Scrape type for 1982236: 1
2026-03-25 18:30:22 [ayvens.es] INFO: Extracting data for car ID: 1982236
2026-03-25 18:30:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9329d917-7bd1-5a98-9d73-e9ca75ec630e with identifier: 1982236
2026-03-25 18:30:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9329d917-7bd1-5a98-9d73-e9ca75ec630e with scrape type 1
2026-03-25 18:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9329d917-7bd1-5a98-9d73-e9ca75ec630e
2026-03-25 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F188%252F0da95ebc5ee14660a56c89e553aa0af0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/188/0da95ebc5ee14660a56c89e553aa0af0/images/large/1.jpg not downloaded yet
2026-03-25 18:30:22 [ayvens.es] INFO: Found listing with ID: 1982237
2026-03-25 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982237%27 HTTP/1.1" 200 None
2026-03-25 18:30:22 [ayvens.es] INFO: Scrape type for 1982237: 1
2026-03-25 18:30:22 [ayvens.es] INFO: Extracting data for car ID: 1982237
2026-03-25 18:30:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 602fb16d-c7d9-53f0-9435-45af71f80e80 with identifier: 1982237
2026-03-25 18:30:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 602fb16d-c7d9-53f0-9435-45af71f80e80 with scrape type 1
2026-03-25 18:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 602fb16d-c7d9-53f0-9435-45af71f80e80
2026-03-25 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F955%252F34d7ef73e8314a6b90889dc6fd616496%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/955/34d7ef73e8314a6b90889dc6fd616496/images/large/1.jpg not downloaded yet
2026-03-25 18:30:22 [ayvens.es] INFO: Found listing with ID: 1982238
2026-03-25 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982238%27 HTTP/1.1" 200 None
2026-03-25 18:30:22 [ayvens.es] INFO: Scrape type for 1982238: 1
2026-03-25 18:30:22 [ayvens.es] INFO: Extracting data for car ID: 1982238
2026-03-25 18:30:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bd3cbfc-229d-5ccd-b1df-c8ba8f9799d9 with identifier: 1982238
2026-03-25 18:30:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bd3cbfc-229d-5ccd-b1df-c8ba8f9799d9 with scrape type 1
2026-03-25 18:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4bd3cbfc-229d-5ccd-b1df-c8ba8f9799d9
2026-03-25 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F838%252Fc09eaa10de8f4303be385bd9f35fcc9e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/838/c09eaa10de8f4303be385bd9f35fcc9e/images/large/1.jpg not downloaded yet
2026-03-25 18:30:22 [ayvens.es] INFO: Found listing with ID: 1982239
2026-03-25 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982239%27 HTTP/1.1" 200 None
2026-03-25 18:30:22 [ayvens.es] INFO: Scrape type for 1982239: 1
2026-03-25 18:30:22 [ayvens.es] INFO: Extracting data for car ID: 1982239
2026-03-25 18:30:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0af9fc4c-cf6c-5bb2-916c-b94c05ef2b17 with identifier: 1982239
2026-03-25 18:30:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0af9fc4c-cf6c-5bb2-916c-b94c05ef2b17 with scrape type 1
2026-03-25 18:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0af9fc4c-cf6c-5bb2-916c-b94c05ef2b17
2026-03-25 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F585%252F62bb750be9d4459a86a22af9ac00276d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/585/62bb750be9d4459a86a22af9ac00276d/images/large/1.jpg not downloaded yet
2026-03-25 18:30:22 [ayvens.es] INFO: Found listing with ID: 1982240
2026-03-25 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982240%27 HTTP/1.1" 200 None
2026-03-25 18:30:22 [ayvens.es] INFO: Scrape type for 1982240: 1
2026-03-25 18:30:22 [ayvens.es] INFO: Extracting data for car ID: 1982240
2026-03-25 18:30:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06d5e93f-2798-500c-99a2-bf7c7cb0ffc7 with identifier: 1982240
2026-03-25 18:30:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06d5e93f-2798-500c-99a2-bf7c7cb0ffc7 with scrape type 1
2026-03-25 18:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 06d5e93f-2798-500c-99a2-bf7c7cb0ffc7
2026-03-25 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F888%252Fd2397942418b48319f29b857b5e10946%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/888/d2397942418b48319f29b857b5e10946/images/large/1.jpg not downloaded yet
2026-03-25 18:30:22 [ayvens.es] INFO: Found listing with ID: 1982241
2026-03-25 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982241%27 HTTP/1.1" 200 None
2026-03-25 18:30:22 [ayvens.es] INFO: Scrape type for 1982241: 1
2026-03-25 18:30:22 [ayvens.es] INFO: Extracting data for car ID: 1982241
2026-03-25 18:30:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9f2de76-7237-533b-9143-f042179c809e with identifier: 1982241
2026-03-25 18:30:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9f2de76-7237-533b-9143-f042179c809e with scrape type 1
2026-03-25 18:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f9f2de76-7237-533b-9143-f042179c809e
2026-03-25 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F108%252F1dda4896c9a94155af6d0f9187b54ecf%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/108/1dda4896c9a94155af6d0f9187b54ecf/images/large/1.jpg not downloaded yet
2026-03-25 18:30:22 [ayvens.es] INFO: Found listing with ID: 1982242
2026-03-25 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982242%27 HTTP/1.1" 200 None
2026-03-25 18:30:22 [ayvens.es] INFO: Scrape type for 1982242: 1
2026-03-25 18:30:22 [ayvens.es] INFO: Extracting data for car ID: 1982242
2026-03-25 18:30:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ee0cd9c-9991-55a3-9621-2688d4dd85de with identifier: 1982242
2026-03-25 18:30:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ee0cd9c-9991-55a3-9621-2688d4dd85de with scrape type 1
2026-03-25 18:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1ee0cd9c-9991-55a3-9621-2688d4dd85de
2026-03-25 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F426%252F8476dca50da3407bb9d1135effc489e6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/426/8476dca50da3407bb9d1135effc489e6/images/large/1.jpg not downloaded yet
2026-03-25 18:30:22 [ayvens.es] INFO: Found listing with ID: 1982243
2026-03-25 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982243%27 HTTP/1.1" 200 None
2026-03-25 18:30:22 [ayvens.es] INFO: Scrape type for 1982243: 1
2026-03-25 18:30:22 [ayvens.es] INFO: Extracting data for car ID: 1982243
2026-03-25 18:30:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4536f54a-5d41-52ff-a600-b80df3ab56a6 with identifier: 1982243
2026-03-25 18:30:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4536f54a-5d41-52ff-a600-b80df3ab56a6 with scrape type 1
2026-03-25 18:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4536f54a-5d41-52ff-a600-b80df3ab56a6
2026-03-25 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F340%252Fa15a3b8702c740ad83cfa3f376286cd5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/340/a15a3b8702c740ad83cfa3f376286cd5/images/large/1.jpg not downloaded yet
2026-03-25 18:30:22 [ayvens.es] INFO: Found listing with ID: 1982244
2026-03-25 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982244%27 HTTP/1.1" 200 None
2026-03-25 18:30:22 [ayvens.es] INFO: Scrape type for 1982244: 1
2026-03-25 18:30:22 [ayvens.es] INFO: Extracting data for car ID: 1982244
2026-03-25 18:30:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72a9d55b-2742-5e4c-9e62-7f5d7eac3b92 with identifier: 1982244
2026-03-25 18:30:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72a9d55b-2742-5e4c-9e62-7f5d7eac3b92 with scrape type 1
2026-03-25 18:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 72a9d55b-2742-5e4c-9e62-7f5d7eac3b92
2026-03-25 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F940%252Fdfe23c0bc9514d21bfedb3b2fe301deb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/940/dfe23c0bc9514d21bfedb3b2fe301deb/images/large/1.jpg not downloaded yet
2026-03-25 18:30:22 [ayvens.es] INFO: Found listing with ID: 1982245
2026-03-25 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982245%27 HTTP/1.1" 200 None
2026-03-25 18:30:22 [ayvens.es] INFO: Scrape type for 1982245: 1
2026-03-25 18:30:22 [ayvens.es] INFO: Extracting data for car ID: 1982245
2026-03-25 18:30:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93cfce9d-f698-54ed-b9cf-49340e4de6ea with identifier: 1982245
2026-03-25 18:30:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93cfce9d-f698-54ed-b9cf-49340e4de6ea with scrape type 1
2026-03-25 18:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 93cfce9d-f698-54ed-b9cf-49340e4de6ea
2026-03-25 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F214%252F85e28ee4b54745e098f8ae5b0c12f814%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/214/85e28ee4b54745e098f8ae5b0c12f814/images/large/1.jpg not downloaded yet
2026-03-25 18:30:22 [ayvens.es] INFO: Found listing with ID: 1982970
2026-03-25 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982970%27 HTTP/1.1" 200 None
2026-03-25 18:30:23 [ayvens.es] INFO: Scrape type for 1982970: 1
2026-03-25 18:30:23 [ayvens.es] INFO: Extracting data for car ID: 1982970
2026-03-25 18:30:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff0722a2-e6ea-5726-9fc9-b5d25d88ff45 with identifier: 1982970
2026-03-25 18:30:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff0722a2-e6ea-5726-9fc9-b5d25d88ff45 with scrape type 1
2026-03-25 18:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ff0722a2-e6ea-5726-9fc9-b5d25d88ff45
2026-03-25 18:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F246%252Fdf5f47b34e4f469b96935c4053d470d4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/246/df5f47b34e4f469b96935c4053d470d4/images/large/1.jpg not downloaded yet
2026-03-25 18:30:23 [ayvens.es] INFO: Found listing with ID: 1982971
2026-03-25 18:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982971%27 HTTP/1.1" 200 None
2026-03-25 18:30:23 [ayvens.es] INFO: Scrape type for 1982971: 1
2026-03-25 18:30:23 [ayvens.es] INFO: Extracting data for car ID: 1982971
2026-03-25 18:30:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76d9125d-b909-5e6e-a357-68956fa13bfe with identifier: 1982971
2026-03-25 18:30:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76d9125d-b909-5e6e-a357-68956fa13bfe with scrape type 1
2026-03-25 18:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 76d9125d-b909-5e6e-a357-68956fa13bfe
2026-03-25 18:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F451%252Fea7d4773b8e84b0aaa85c4cb85566397%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/451/ea7d4773b8e84b0aaa85c4cb85566397/images/large/1.jpg not downloaded yet
2026-03-25 18:30:23 [ayvens.es] INFO: Found listing with ID: 1982972
2026-03-25 18:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982972%27 HTTP/1.1" 200 None
2026-03-25 18:30:23 [ayvens.es] INFO: Scrape type for 1982972: 1
2026-03-25 18:30:23 [ayvens.es] INFO: Extracting data for car ID: 1982972
2026-03-25 18:30:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d435cfcb-c754-5785-8924-03c81041bd43 with identifier: 1982972
2026-03-25 18:30:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d435cfcb-c754-5785-8924-03c81041bd43 with scrape type 1
2026-03-25 18:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d435cfcb-c754-5785-8924-03c81041bd43
2026-03-25 18:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F716%252Fdd09601c0c0345aab859db20716e8938%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/716/dd09601c0c0345aab859db20716e8938/images/large/1.jpg not downloaded yet
2026-03-25 18:30:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/363/86a35ac1edda408f9344898fb6296c27/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:30:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/426/8358447160264811afb0a55b6973b773/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:30:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/363/29bb93404e304bb88875bd1fef733a2e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:30:23 [ayvens.es] INFO: Found listing with ID: 1982973
2026-03-25 18:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982973%27 HTTP/1.1" 200 None
2026-03-25 18:30:23 [ayvens.es] INFO: Scrape type for 1982973: 1
2026-03-25 18:30:23 [ayvens.es] INFO: Extracting data for car ID: 1982973
2026-03-25 18:30:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c693f85-3342-58a6-a6e9-60bf2ec0b561 with identifier: 1982973
2026-03-25 18:30:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c693f85-3342-58a6-a6e9-60bf2ec0b561 with scrape type 1
2026-03-25 18:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0c693f85-3342-58a6-a6e9-60bf2ec0b561
2026-03-25 18:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F205%252F702e497291f741388341e54840c2d64b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/205/702e497291f741388341e54840c2d64b/images/large/1.jpg not downloaded yet
2026-03-25 18:30:23 [ayvens.es] INFO: Found listing with ID: 1982974
2026-03-25 18:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982974%27 HTTP/1.1" 200 None
2026-03-25 18:30:23 [ayvens.es] INFO: Scrape type for 1982974: 1
2026-03-25 18:30:23 [ayvens.es] INFO: Extracting data for car ID: 1982974
2026-03-25 18:30:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7673439d-6ce7-507d-8627-7838229f5a22 with identifier: 1982974
2026-03-25 18:30:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7673439d-6ce7-507d-8627-7838229f5a22 with scrape type 1
2026-03-25 18:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7673439d-6ce7-507d-8627-7838229f5a22
2026-03-25 18:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F003%252F832dded08ec6400e9d368fe8fe6c97df%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/003/832dded08ec6400e9d368fe8fe6c97df/images/large/1.jpg not downloaded yet
2026-03-25 18:30:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/363/e2b38783f5c9411ab81bb510d759c032/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:30:23 [ayvens.es] INFO: Found listing with ID: 1982975
2026-03-25 18:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982975%27 HTTP/1.1" 200 None
2026-03-25 18:30:23 [ayvens.es] INFO: Scrape type for 1982975: 1
2026-03-25 18:30:23 [ayvens.es] INFO: Extracting data for car ID: 1982975
2026-03-25 18:30:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65c43900-ff05-5c27-a18a-1bf171edad43 with identifier: 1982975
2026-03-25 18:30:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65c43900-ff05-5c27-a18a-1bf171edad43 with scrape type 1
2026-03-25 18:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 65c43900-ff05-5c27-a18a-1bf171edad43
2026-03-25 18:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F494%252F6bb027a7b52541a1a2c7bc501fd2f0a7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/494/6bb027a7b52541a1a2c7bc501fd2f0a7/images/large/1.jpg not downloaded yet
2026-03-25 18:30:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/955/34d7ef73e8314a6b90889dc6fd616496/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:30:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-25 18:30:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-25 18:30:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:30:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ece9cd0>
2026-03-25 18:30:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:30:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-25 18:30:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2121
2026-03-25 18:30:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-25 18:30:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:30:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:30:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8497dc66-f8f9-5fb3-9fb3-78c77341e830/8497dc66-f8f9-5fb3-9fb3-78c77341e830_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F363%252F86a35ac1edda408f9344898fb6296c27%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/363/86a35ac1edda408f9344898fb6296c27/images/large/1.jpg saved to cache
2026-03-25 18:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8497dc66-f8f9-5fb3-9fb3-78c77341e830
2026-03-25 18:30:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8497dc66-f8f9-5fb3-9fb3-78c77341e830, skipping ID generation
2026-03-25 18:30:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8497dc66-f8f9-5fb3-9fb3-78c77341e830 with scrape type 1
2026-03-25 18:30:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8497dc66-f8f9-5fb3-9fb3-78c77341e830 sending to next pipeline
2026-03-25 18:30:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8497dc66-f8f9-5fb3-9fb3-78c77341e830, identifier: 1982231
2026-03-25 18:30:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:30:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e5bb850>
2026-03-25 18:30:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:30:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:30:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:30:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab6fd490-f485-5b8d-b29b-77d9ce9dd6fb/ab6fd490-f485-5b8d-b29b-77d9ce9dd6fb_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F426%252F8358447160264811afb0a55b6973b773%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:30:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/426/8358447160264811afb0a55b6973b773/images/large/1.jpg saved to cache
2026-03-25 18:30:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ab6fd490-f485-5b8d-b29b-77d9ce9dd6fb
2026-03-25 18:30:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ab6fd490-f485-5b8d-b29b-77d9ce9dd6fb, skipping ID generation
2026-03-25 18:30:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab6fd490-f485-5b8d-b29b-77d9ce9dd6fb with scrape type 1
2026-03-25 18:30:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ab6fd490-f485-5b8d-b29b-77d9ce9dd6fb sending to next pipeline
2026-03-25 18:30:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ab6fd490-f485-5b8d-b29b-77d9ce9dd6fb, identifier: 1982232
2026-03-25 18:30:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:30:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae90f68b50>
2026-03-25 18:30:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:30:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:30:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:30:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4d129df-6530-5be8-80d6-04fa23d0dc77/e4d129df-6530-5be8-80d6-04fa23d0dc77_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F363%252F29bb93404e304bb88875bd1fef733a2e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/363/29bb93404e304bb88875bd1fef733a2e/images/large/1.jpg saved to cache
2026-03-25 18:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e4d129df-6530-5be8-80d6-04fa23d0dc77
2026-03-25 18:30:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e4d129df-6530-5be8-80d6-04fa23d0dc77, skipping ID generation
2026-03-25 18:30:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4d129df-6530-5be8-80d6-04fa23d0dc77 with scrape type 1
2026-03-25 18:30:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e4d129df-6530-5be8-80d6-04fa23d0dc77 sending to next pipeline
2026-03-25 18:30:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e4d129df-6530-5be8-80d6-04fa23d0dc77, identifier: 1982230
2026-03-25 18:30:25 [ayvens.es] INFO: Found listing with ID: 1982976
2026-03-25 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982976%27 HTTP/1.1" 200 None
2026-03-25 18:30:25 [ayvens.es] INFO: Scrape type for 1982976: 1
2026-03-25 18:30:25 [ayvens.es] INFO: Extracting data for car ID: 1982976
2026-03-25 18:30:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 278d981f-3bdd-52a3-a851-947ca80b06fc with identifier: 1982976
2026-03-25 18:30:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 278d981f-3bdd-52a3-a851-947ca80b06fc with scrape type 1
2026-03-25 18:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 278d981f-3bdd-52a3-a851-947ca80b06fc
2026-03-25 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F137%252F2c3e2048d580465380d13eb2cfef9398%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/137/2c3e2048d580465380d13eb2cfef9398/images/large/1.jpg not downloaded yet
2026-03-25 18:30:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8497dc66-f8f9-5fb3-9fb3-78c77341e830 with identifier: 1982231
2026-03-25 18:30:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:30:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:30:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8497dc66-f8f9-5fb3-9fb3-78c77341e830 with identifier: 1982231
2026-03-25 18:30:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8497dc66-f8f9-5fb3-9fb3-78c77341e830 with identifier: 1982231 to the API
2026-03-25 18:30:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:30:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:30:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/363/86a35ac1edda408f9344898fb6296c27/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 174,
 'color': 'Plata perla',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '8497dc66-f8f9-5fb3-9fb3-78c77341e830',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41008',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'C-MAX',
 'odometer': 65360,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8497dc66-f8f9-5fb3-9fb3-78c77341e830/8497dc66-f8f9-5fb3-9fb3-78c77341e830_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 345293,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/363/86a35ac1edda408f9344898fb6296c27/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD C-MAX (O) 1.5 EcoBoost 110kW (150CV) Trend+ Auto',
 'transmission': 'manual',
 'trim': '(O) 1.5 EcoBoost 110kW (150CV) Trend+ Auto',
 'vin': None,
 'year': 2019}
2026-03-25 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982231%27 HTTP/1.1" 200 None
2026-03-25 18:30:26 [ayvens.es] INFO: Saving data for 1982231: {'created_time': 1774463426.102758, 'last_price_update_time': 1774463426.102771, 'auction_closing_time': 1774526400.0}
2026-03-25 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1982231') HTTP/1.1" 204 0
2026-03-25 18:30:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ab6fd490-f485-5b8d-b29b-77d9ce9dd6fb with identifier: 1982232
2026-03-25 18:30:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ab6fd490-f485-5b8d-b29b-77d9ce9dd6fb with identifier: 1982232
2026-03-25 18:30:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ab6fd490-f485-5b8d-b29b-77d9ce9dd6fb with identifier: 1982232 to the API
2026-03-25 18:30:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:30:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:30:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/426/8358447160264811afb0a55b6973b773/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 174,
 'color': 'Plata perla',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'ab6fd490-f485-5b8d-b29b-77d9ce9dd6fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41008',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'C-MAX',
 'odometer': 106907,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab6fd490-f485-5b8d-b29b-77d9ce9dd6fb/ab6fd490-f485-5b8d-b29b-77d9ce9dd6fb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 357884,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/426/8358447160264811afb0a55b6973b773/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD C-MAX (O) 1.5 EcoBoost 110kW (150CV) Trend+ Auto',
 'transmission': 'manual',
 'trim': '(O) 1.5 EcoBoost 110kW (150CV) Trend+ Auto',
 'vin': None,
 'year': 2019}
2026-03-25 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982232%27 HTTP/1.1" 200 None
2026-03-25 18:30:26 [ayvens.es] INFO: Saving data for 1982232: {'created_time': 1774463426.853632, 'last_price_update_time': 1774463426.853644, 'auction_closing_time': 1774526400.0}
2026-03-25 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1982232') HTTP/1.1" 204 0
2026-03-25 18:30:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e4d129df-6530-5be8-80d6-04fa23d0dc77 with identifier: 1982230
2026-03-25 18:30:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e4d129df-6530-5be8-80d6-04fa23d0dc77 with identifier: 1982230
2026-03-25 18:30:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e4d129df-6530-5be8-80d6-04fa23d0dc77 with identifier: 1982230 to the API
2026-03-25 18:30:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:30:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:30:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/363/29bb93404e304bb88875bd1fef733a2e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 174,
 'color': 'Plata perla',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'e4d129df-6530-5be8-80d6-04fa23d0dc77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41008',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'C-MAX',
 'odometer': 82745,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4d129df-6530-5be8-80d6-04fa23d0dc77/e4d129df-6530-5be8-80d6-04fa23d0dc77_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 355634,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/363/29bb93404e304bb88875bd1fef733a2e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD C-MAX (O) 1.5 EcoBoost 110kW (150CV) Trend+ Auto',
 'transmission': 'manual',
 'trim': '(O) 1.5 EcoBoost 110kW (150CV) Trend+ Auto',
 'vin': None,
 'year': 2019}
2026-03-25 18:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982230%27 HTTP/1.1" 200 None
2026-03-25 18:30:27 [ayvens.es] INFO: Saving data for 1982230: {'created_time': 1774463427.402245, 'last_price_update_time': 1774463427.402257, 'auction_closing_time': 1774526400.0}
2026-03-25 18:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1982230') HTTP/1.1" 204 0
2026-03-25 18:30:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/188/0da95ebc5ee14660a56c89e553aa0af0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:30:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/363/fcfe60e51ffd4985956e463a4ad34d8d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:30:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/585/62bb750be9d4459a86a22af9ac00276d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:30:27 [ayvens.es] INFO: Found listing with ID: 1982977
2026-03-25 18:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982977%27 HTTP/1.1" 200 None
2026-03-25 18:30:27 [ayvens.es] INFO: Scrape type for 1982977: 1
2026-03-25 18:30:27 [ayvens.es] INFO: Extracting data for car ID: 1982977
2026-03-25 18:30:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f98d349f-d3e2-52c8-bd64-2a0d9cf67c62 with identifier: 1982977
2026-03-25 18:30:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f98d349f-d3e2-52c8-bd64-2a0d9cf67c62 with scrape type 1
2026-03-25 18:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f98d349f-d3e2-52c8-bd64-2a0d9cf67c62
2026-03-25 18:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F483%252F7a48e0cacd2a4983a2f03f823ae3beb1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/483/7a48e0cacd2a4983a2f03f823ae3beb1/images/large/1.jpg not downloaded yet
2026-03-25 18:30:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/189/5e25cbcab5b0478e9b6db371800c9e44/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:30:27 [ayvens.es] INFO: Found listing with ID: 1982978
2026-03-25 18:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982978%27 HTTP/1.1" 200 None
2026-03-25 18:30:27 [ayvens.es] INFO: Scrape type for 1982978: 1
2026-03-25 18:30:27 [ayvens.es] INFO: Extracting data for car ID: 1982978
2026-03-25 18:30:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ecc2b3b5-a175-594c-b686-20367a5fa140 with identifier: 1982978
2026-03-25 18:30:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecc2b3b5-a175-594c-b686-20367a5fa140 with scrape type 1
2026-03-25 18:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ecc2b3b5-a175-594c-b686-20367a5fa140
2026-03-25 18:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F352%252F53ffa7a30a2241ccbdc0c0eead2dd599%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/352/53ffa7a30a2241ccbdc0c0eead2dd599/images/large/1.jpg not downloaded yet
2026-03-25 18:30:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:30:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ed36a50>
2026-03-25 18:30:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:30:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:30:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:30:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efea35c6-3c7a-5c99-b8b0-bec4dafef39e/efea35c6-3c7a-5c99-b8b0-bec4dafef39e_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F363%252Fe2b38783f5c9411ab81bb510d759c032%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/363/e2b38783f5c9411ab81bb510d759c032/images/large/1.jpg saved to cache
2026-03-25 18:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item efea35c6-3c7a-5c99-b8b0-bec4dafef39e
2026-03-25 18:30:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: efea35c6-3c7a-5c99-b8b0-bec4dafef39e, skipping ID generation
2026-03-25 18:30:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efea35c6-3c7a-5c99-b8b0-bec4dafef39e with scrape type 1
2026-03-25 18:30:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item efea35c6-3c7a-5c99-b8b0-bec4dafef39e sending to next pipeline
2026-03-25 18:30:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: efea35c6-3c7a-5c99-b8b0-bec4dafef39e, identifier: 1982233
2026-03-25 18:30:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:30:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae9e434650>
2026-03-25 18:30:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:30:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:30:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:30:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_602fb16d-c7d9-53f0-9435-45af71f80e80/602fb16d-c7d9-53f0-9435-45af71f80e80_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F955%252F34d7ef73e8314a6b90889dc6fd616496%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/955/34d7ef73e8314a6b90889dc6fd616496/images/large/1.jpg saved to cache
2026-03-25 18:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 602fb16d-c7d9-53f0-9435-45af71f80e80
2026-03-25 18:30:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 602fb16d-c7d9-53f0-9435-45af71f80e80, skipping ID generation
2026-03-25 18:30:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 602fb16d-c7d9-53f0-9435-45af71f80e80 with scrape type 1
2026-03-25 18:30:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 602fb16d-c7d9-53f0-9435-45af71f80e80 sending to next pipeline
2026-03-25 18:30:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 602fb16d-c7d9-53f0-9435-45af71f80e80, identifier: 1982237
2026-03-25 18:30:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/888/d2397942418b48319f29b857b5e10946/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:30:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: efea35c6-3c7a-5c99-b8b0-bec4dafef39e with identifier: 1982233
2026-03-25 18:30:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: efea35c6-3c7a-5c99-b8b0-bec4dafef39e with identifier: 1982233
2026-03-25 18:30:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: efea35c6-3c7a-5c99-b8b0-bec4dafef39e with identifier: 1982233 to the API
2026-03-25 18:30:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:30:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:30:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/363/e2b38783f5c9411ab81bb510d759c032/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 174,
 'color': 'Plata perla',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'efea35c6-3c7a-5c99-b8b0-bec4dafef39e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41008',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'C-MAX',
 'odometer': 62183,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efea35c6-3c7a-5c99-b8b0-bec4dafef39e/efea35c6-3c7a-5c99-b8b0-bec4dafef39e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 357274,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/363/e2b38783f5c9411ab81bb510d759c032/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD C-MAX (O) 1.5 EcoBoost 110kW (150CV) Trend+ Auto',
 'transmission': 'manual',
 'trim': '(O) 1.5 EcoBoost 110kW (150CV) Trend+ Auto',
 'vin': None,
 'year': 2019}
2026-03-25 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982233%27 HTTP/1.1" 200 None
2026-03-25 18:30:29 [ayvens.es] INFO: Saving data for 1982233: {'created_time': 1774463429.349543, 'last_price_update_time': 1774463429.349554, 'auction_closing_time': 1774526400.0}
2026-03-25 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1982233') HTTP/1.1" 204 0
2026-03-25 18:30:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 602fb16d-c7d9-53f0-9435-45af71f80e80 with identifier: 1982237
2026-03-25 18:30:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:30:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:30:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 602fb16d-c7d9-53f0-9435-45af71f80e80 with identifier: 1982237
2026-03-25 18:30:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 602fb16d-c7d9-53f0-9435-45af71f80e80 with identifier: 1982237 to the API
2026-03-25 18:30:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:30:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:30:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/955/34d7ef73e8314a6b90889dc6fd616496/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 190,
 'color': 'Blanco s',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '602fb16d-c7d9-53f0-9435-45af71f80e80',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41008',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT CUSTOM',
 'odometer': 84392,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_602fb16d-c7d9-53f0-9435-45af71f80e80/602fb16d-c7d9-53f0-9435-45af71f80e80_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 299714,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/955/34d7ef73e8314a6b90889dc6fd616496/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-10',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT CUSTOM Van 2.0 TDCI 96kW 300 L2 Trend',
 'transmission': 'manual',
 'trim': 'Van 2.0 TDCI 96kW 300 L2 Trend',
 'vin': None,
 'year': 2022}
2026-03-25 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982237%27 HTTP/1.1" 200 None
2026-03-25 18:30:29 [ayvens.es] INFO: Saving data for 1982237: {'created_time': 1774463429.80791, 'last_price_update_time': 1774463429.807924, 'auction_closing_time': 1774526400.0}
2026-03-25 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1982237') HTTP/1.1" 204 0
2026-03-25 18:30:29 [ayvens.es] INFO: Found listing with ID: 1982979
2026-03-25 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982979%27 HTTP/1.1" 200 None
2026-03-25 18:30:29 [ayvens.es] INFO: Scrape type for 1982979: 1
2026-03-25 18:30:29 [ayvens.es] INFO: Extracting data for car ID: 1982979
2026-03-25 18:30:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 027216d8-c48b-5ac1-a108-58b2389a8a3d with identifier: 1982979
2026-03-25 18:30:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 027216d8-c48b-5ac1-a108-58b2389a8a3d with scrape type 1
2026-03-25 18:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 027216d8-c48b-5ac1-a108-58b2389a8a3d
2026-03-25 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F580%252F4325727f023a44b3a22033d9c4f75295%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/580/4325727f023a44b3a22033d9c4f75295/images/large/1.jpg not downloaded yet
2026-03-25 18:30:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/838/c09eaa10de8f4303be385bd9f35fcc9e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:30:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/426/8476dca50da3407bb9d1135effc489e6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:30:29 [ayvens.es] INFO: Found listing with ID: 1982980
2026-03-25 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982980%27 HTTP/1.1" 200 None
2026-03-25 18:30:29 [ayvens.es] INFO: Scrape type for 1982980: 1
2026-03-25 18:30:29 [ayvens.es] INFO: Extracting data for car ID: 1982980
2026-03-25 18:30:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f53c38c-6e82-5d5d-a4dd-a79b5015dc82 with identifier: 1982980
2026-03-25 18:30:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f53c38c-6e82-5d5d-a4dd-a79b5015dc82 with scrape type 1
2026-03-25 18:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4f53c38c-6e82-5d5d-a4dd-a79b5015dc82
2026-03-25 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F708%252Fee5bace4977749769fa3f56478b7dd07%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/708/ee5bace4977749769fa3f56478b7dd07/images/large/1.jpg not downloaded yet
2026-03-25 18:30:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:30:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8d3fd590>
2026-03-25 18:30:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:30:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9329d917-7bd1-5a98-9d73-e9ca75ec630e/9329d917-7bd1-5a98-9d73-e9ca75ec630e_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F188%252F0da95ebc5ee14660a56c89e553aa0af0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/188/0da95ebc5ee14660a56c89e553aa0af0/images/large/1.jpg saved to cache
2026-03-25 18:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9329d917-7bd1-5a98-9d73-e9ca75ec630e
2026-03-25 18:30:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9329d917-7bd1-5a98-9d73-e9ca75ec630e, skipping ID generation
2026-03-25 18:30:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9329d917-7bd1-5a98-9d73-e9ca75ec630e with scrape type 1
2026-03-25 18:30:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9329d917-7bd1-5a98-9d73-e9ca75ec630e sending to next pipeline
2026-03-25 18:30:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9329d917-7bd1-5a98-9d73-e9ca75ec630e, identifier: 1982236
2026-03-25 18:30:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:30:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ea10390>
2026-03-25 18:30:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:30:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bfb164e-72d4-5b8f-be0a-0ac70edec6b7/9bfb164e-72d4-5b8f-be0a-0ac70edec6b7_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F363%252Ffcfe60e51ffd4985956e463a4ad34d8d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/363/fcfe60e51ffd4985956e463a4ad34d8d/images/large/1.jpg saved to cache
2026-03-25 18:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9bfb164e-72d4-5b8f-be0a-0ac70edec6b7
2026-03-25 18:30:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9bfb164e-72d4-5b8f-be0a-0ac70edec6b7, skipping ID generation
2026-03-25 18:30:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9bfb164e-72d4-5b8f-be0a-0ac70edec6b7 with scrape type 1
2026-03-25 18:30:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9bfb164e-72d4-5b8f-be0a-0ac70edec6b7 sending to next pipeline
2026-03-25 18:30:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9bfb164e-72d4-5b8f-be0a-0ac70edec6b7, identifier: 1982235
2026-03-25 18:30:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:30:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8d422410>
2026-03-25 18:30:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:30:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0af9fc4c-cf6c-5bb2-916c-b94c05ef2b17/0af9fc4c-cf6c-5bb2-916c-b94c05ef2b17_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F585%252F62bb750be9d4459a86a22af9ac00276d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/585/62bb750be9d4459a86a22af9ac00276d/images/large/1.jpg saved to cache
2026-03-25 18:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0af9fc4c-cf6c-5bb2-916c-b94c05ef2b17
2026-03-25 18:30:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0af9fc4c-cf6c-5bb2-916c-b94c05ef2b17, skipping ID generation
2026-03-25 18:30:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0af9fc4c-cf6c-5bb2-916c-b94c05ef2b17 with scrape type 1
2026-03-25 18:30:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0af9fc4c-cf6c-5bb2-916c-b94c05ef2b17 sending to next pipeline
2026-03-25 18:30:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0af9fc4c-cf6c-5bb2-916c-b94c05ef2b17, identifier: 1982239
2026-03-25 18:30:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:30:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ea4b8d0>
2026-03-25 18:30:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:30:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:30:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12a8ee06-0429-5b8b-8097-ef4a8fcc5612/12a8ee06-0429-5b8b-8097-ef4a8fcc5612_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F189%252F5e25cbcab5b0478e9b6db371800c9e44%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/189/5e25cbcab5b0478e9b6db371800c9e44/images/large/1.jpg saved to cache
2026-03-25 18:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 12a8ee06-0429-5b8b-8097-ef4a8fcc5612
2026-03-25 18:30:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 12a8ee06-0429-5b8b-8097-ef4a8fcc5612, skipping ID generation
2026-03-25 18:30:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12a8ee06-0429-5b8b-8097-ef4a8fcc5612 with scrape type 1
2026-03-25 18:30:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 12a8ee06-0429-5b8b-8097-ef4a8fcc5612 sending to next pipeline
2026-03-25 18:30:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 12a8ee06-0429-5b8b-8097-ef4a8fcc5612, identifier: 1982234
2026-03-25 18:30:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:30:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e577490>
2026-03-25 18:30:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:30:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:30:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:30:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06d5e93f-2798-500c-99a2-bf7c7cb0ffc7/06d5e93f-2798-500c-99a2-bf7c7cb0ffc7_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F888%252Fd2397942418b48319f29b857b5e10946%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/888/d2397942418b48319f29b857b5e10946/images/large/1.jpg saved to cache
2026-03-25 18:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 06d5e93f-2798-500c-99a2-bf7c7cb0ffc7
2026-03-25 18:30:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 06d5e93f-2798-500c-99a2-bf7c7cb0ffc7, skipping ID generation
2026-03-25 18:30:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06d5e93f-2798-500c-99a2-bf7c7cb0ffc7 with scrape type 1
2026-03-25 18:30:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 06d5e93f-2798-500c-99a2-bf7c7cb0ffc7 sending to next pipeline
2026-03-25 18:30:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 06d5e93f-2798-500c-99a2-bf7c7cb0ffc7, identifier: 1982240
2026-03-25 18:30:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9329d917-7bd1-5a98-9d73-e9ca75ec630e with identifier: 1982236
2026-03-25 18:30:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9329d917-7bd1-5a98-9d73-e9ca75ec630e with identifier: 1982236
2026-03-25 18:30:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9329d917-7bd1-5a98-9d73-e9ca75ec630e with identifier: 1982236 to the API
2026-03-25 18:30:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:30:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:30:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/188/0da95ebc5ee14660a56c89e553aa0af0/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 174,
 'color': 'Plata perla',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '9329d917-7bd1-5a98-9d73-e9ca75ec630e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41008',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'C-MAX',
 'odometer': 84414,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9329d917-7bd1-5a98-9d73-e9ca75ec630e/9329d917-7bd1-5a98-9d73-e9ca75ec630e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 327801,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/188/0da95ebc5ee14660a56c89e553aa0af0/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD C-MAX (O) 1.5 EcoBoost 110kW (150CV) Trend+ Auto',
 'transmission': 'manual',
 'trim': '(O) 1.5 EcoBoost 110kW (150CV) Trend+ Auto',
 'vin': None,
 'year': 2019}
2026-03-25 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982236%27 HTTP/1.1" 200 None
2026-03-25 18:30:32 [ayvens.es] INFO: Saving data for 1982236: {'created_time': 1774463432.361041, 'last_price_update_time': 1774463432.361053, 'auction_closing_time': 1774526400.0}
2026-03-25 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1982236') HTTP/1.1" 204 0
2026-03-25 18:30:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9bfb164e-72d4-5b8f-be0a-0ac70edec6b7 with identifier: 1982235
2026-03-25 18:30:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9bfb164e-72d4-5b8f-be0a-0ac70edec6b7 with identifier: 1982235
2026-03-25 18:30:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9bfb164e-72d4-5b8f-be0a-0ac70edec6b7 with identifier: 1982235 to the API
2026-03-25 18:30:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:30:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:30:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/363/fcfe60e51ffd4985956e463a4ad34d8d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 174,
 'color': 'Plata perla',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '9bfb164e-72d4-5b8f-be0a-0ac70edec6b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41008',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'C-MAX',
 'odometer': 108767,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bfb164e-72d4-5b8f-be0a-0ac70edec6b7/9bfb164e-72d4-5b8f-be0a-0ac70edec6b7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353583,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/363/fcfe60e51ffd4985956e463a4ad34d8d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD C-MAX (O) 1.5 EcoBoost 110kW (150CV) Trend+ Auto',
 'transmission': 'manual',
 'trim': '(O) 1.5 EcoBoost 110kW (150CV) Trend+ Auto',
 'vin': None,
 'year': 2019}
2026-03-25 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982235%27 HTTP/1.1" 200 None
2026-03-25 18:30:32 [ayvens.es] INFO: Saving data for 1982235: {'created_time': 1774463432.681683, 'last_price_update_time': 1774463432.681694, 'auction_closing_time': 1774526400.0}
2026-03-25 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1982235') HTTP/1.1" 204 0
2026-03-25 18:30:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0af9fc4c-cf6c-5bb2-916c-b94c05ef2b17 with identifier: 1982239
2026-03-25 18:30:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0af9fc4c-cf6c-5bb2-916c-b94c05ef2b17 with identifier: 1982239
2026-03-25 18:30:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0af9fc4c-cf6c-5bb2-916c-b94c05ef2b17 with identifier: 1982239 to the API
2026-03-25 18:30:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:30:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:30:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/585/62bb750be9d4459a86a22af9ac00276d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 174,
 'color': 'Plata perla',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '0af9fc4c-cf6c-5bb2-916c-b94c05ef2b17',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41008',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'C-MAX',
 'odometer': 81253,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0af9fc4c-cf6c-5bb2-916c-b94c05ef2b17/0af9fc4c-cf6c-5bb2-916c-b94c05ef2b17_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 319026,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/585/62bb750be9d4459a86a22af9ac00276d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD C-MAX (O) 1.5 EcoBoost 110kW (150CV) Trend+ Auto',
 'transmission': 'manual',
 'trim': '(O) 1.5 EcoBoost 110kW (150CV) Trend+ Auto',
 'vin': None,
 'year': 2019}
2026-03-25 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982239%27 HTTP/1.1" 200 None
2026-03-25 18:30:33 [ayvens.es] INFO: Saving data for 1982239: {'created_time': 1774463433.009641, 'last_price_update_time': 1774463433.009652, 'auction_closing_time': 1774526400.0}
2026-03-25 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1982239') HTTP/1.1" 204 0
2026-03-25 18:30:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 12a8ee06-0429-5b8b-8097-ef4a8fcc5612 with identifier: 1982234
2026-03-25 18:30:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 12a8ee06-0429-5b8b-8097-ef4a8fcc5612 with identifier: 1982234
2026-03-25 18:30:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 12a8ee06-0429-5b8b-8097-ef4a8fcc5612 with identifier: 1982234 to the API
2026-03-25 18:30:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:30:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:30:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/189/5e25cbcab5b0478e9b6db371800c9e44/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 174,
 'color': 'Plata perla',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '12a8ee06-0429-5b8b-8097-ef4a8fcc5612',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41008',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'C-MAX',
 'odometer': 89534,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12a8ee06-0429-5b8b-8097-ef4a8fcc5612/12a8ee06-0429-5b8b-8097-ef4a8fcc5612_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 363178,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/189/5e25cbcab5b0478e9b6db371800c9e44/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD C-MAX (O) 1.5 EcoBoost 110kW (150CV) Trend+ Auto',
 'transmission': 'manual',
 'trim': '(O) 1.5 EcoBoost 110kW (150CV) Trend+ Auto',
 'vin': None,
 'year': 2019}
2026-03-25 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982234%27 HTTP/1.1" 200 None
2026-03-25 18:30:33 [ayvens.es] INFO: Saving data for 1982234: {'created_time': 1774463433.35701, 'last_price_update_time': 1774463433.35702, 'auction_closing_time': 1774526400.0}
2026-03-25 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1982234') HTTP/1.1" 204 0
2026-03-25 18:30:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 06d5e93f-2798-500c-99a2-bf7c7cb0ffc7 with identifier: 1982240
2026-03-25 18:30:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:30:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 06d5e93f-2798-500c-99a2-bf7c7cb0ffc7 with identifier: 1982240
2026-03-25 18:30:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 06d5e93f-2798-500c-99a2-bf7c7cb0ffc7 with identifier: 1982240 to the API
2026-03-25 18:30:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:30:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:30:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/888/d2397942418b48319f29b857b5e10946/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 225,
 'color': 'Glaciar blanco opaca',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.3L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '06d5e93f-2798-500c-99a2-bf7c7cb0ffc7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41008',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MASTER',
 'odometer': 86578,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06d5e93f-2798-500c-99a2-bf7c7cb0ffc7/06d5e93f-2798-500c-99a2-bf7c7cb0ffc7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 299127,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/888/d2397942418b48319f29b857b5e10946/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-28',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT MASTER Fu. P L4H2 3500 RG E B dCi 107kW (145CV)',
 'transmission': 'manual',
 'trim': 'Fu. P L4H2 3500 RG E B dCi 107kW (145CV)',
 'vin': None,
 'year': 2021}
2026-03-25 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982240%27 HTTP/1.1" 200 None
2026-03-25 18:30:33 [ayvens.es] INFO: Saving data for 1982240: {'created_time': 1774463433.995714, 'last_price_update_time': 1774463433.995724, 'auction_closing_time': 1774526400.0}
2026-03-25 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1982240') HTTP/1.1" 204 0
2026-03-25 18:30:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/108/1dda4896c9a94155af6d0f9187b54ecf/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:30:34 [ayvens.es] INFO: Found listing with ID: 1982981
2026-03-25 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982981%27 HTTP/1.1" 200 None
2026-03-25 18:30:34 [ayvens.es] INFO: Scrape type for 1982981: 1
2026-03-25 18:30:34 [ayvens.es] INFO: Extracting data for car ID: 1982981
2026-03-25 18:30:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4835efab-402d-5a1e-aa4a-4f703a905655 with identifier: 1982981
2026-03-25 18:30:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4835efab-402d-5a1e-aa4a-4f703a905655 with scrape type 1
2026-03-25 18:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4835efab-402d-5a1e-aa4a-4f703a905655
2026-03-25 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F472%252F177a1d5476cf4083a08c98184d408886%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/472/177a1d5476cf4083a08c98184d408886/images/large/1.jpg not downloaded yet
2026-03-25 18:30:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/214/85e28ee4b54745e098f8ae5b0c12f814/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:30:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/451/ea7d4773b8e84b0aaa85c4cb85566397/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:30:34 [ayvens.es] INFO: Found listing with ID: 1982982
2026-03-25 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982982%27 HTTP/1.1" 200 None
2026-03-25 18:30:34 [ayvens.es] INFO: Scrape type for 1982982: 1
2026-03-25 18:30:34 [ayvens.es] INFO: Extracting data for car ID: 1982982
2026-03-25 18:30:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea0fed48-5178-525e-8054-a4c382648c01 with identifier: 1982982
2026-03-25 18:30:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea0fed48-5178-525e-8054-a4c382648c01 with scrape type 1
2026-03-25 18:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ea0fed48-5178-525e-8054-a4c382648c01
2026-03-25 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F229%252F9f32070e28dc4974aeeae6f7b01c463d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/229/9f32070e28dc4974aeeae6f7b01c463d/images/large/1.jpg not downloaded yet
2026-03-25 18:30:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:30:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ef28c10>
2026-03-25 18:30:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:30:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:30:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:30:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bd3cbfc-229d-5ccd-b1df-c8ba8f9799d9/4bd3cbfc-229d-5ccd-b1df-c8ba8f9799d9_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F838%252Fc09eaa10de8f4303be385bd9f35fcc9e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/838/c09eaa10de8f4303be385bd9f35fcc9e/images/large/1.jpg saved to cache
2026-03-25 18:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4bd3cbfc-229d-5ccd-b1df-c8ba8f9799d9
2026-03-25 18:30:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4bd3cbfc-229d-5ccd-b1df-c8ba8f9799d9, skipping ID generation
2026-03-25 18:30:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bd3cbfc-229d-5ccd-b1df-c8ba8f9799d9 with scrape type 1
2026-03-25 18:30:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4bd3cbfc-229d-5ccd-b1df-c8ba8f9799d9 sending to next pipeline
2026-03-25 18:30:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4bd3cbfc-229d-5ccd-b1df-c8ba8f9799d9, identifier: 1982238
2026-03-25 18:30:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:30:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ec54e10>
2026-03-25 18:30:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:30:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:30:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:30:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ee0cd9c-9991-55a3-9621-2688d4dd85de/1ee0cd9c-9991-55a3-9621-2688d4dd85de_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F426%252F8476dca50da3407bb9d1135effc489e6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/426/8476dca50da3407bb9d1135effc489e6/images/large/1.jpg saved to cache
2026-03-25 18:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1ee0cd9c-9991-55a3-9621-2688d4dd85de
2026-03-25 18:30:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1ee0cd9c-9991-55a3-9621-2688d4dd85de, skipping ID generation
2026-03-25 18:30:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ee0cd9c-9991-55a3-9621-2688d4dd85de with scrape type 1
2026-03-25 18:30:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1ee0cd9c-9991-55a3-9621-2688d4dd85de sending to next pipeline
2026-03-25 18:30:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1ee0cd9c-9991-55a3-9621-2688d4dd85de, identifier: 1982242
2026-03-25 18:30:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4bd3cbfc-229d-5ccd-b1df-c8ba8f9799d9 with identifier: 1982238
2026-03-25 18:30:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:30:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4bd3cbfc-229d-5ccd-b1df-c8ba8f9799d9 with identifier: 1982238
2026-03-25 18:30:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 4bd3cbfc-229d-5ccd-b1df-c8ba8f9799d9 with identifier: 1982238 to the API
2026-03-25 18:30:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:30:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:30:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/838/c09eaa10de8f4303be385bd9f35fcc9e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '4bd3cbfc-229d-5ccd-b1df-c8ba8f9799d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41008',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO',
 'odometer': 76073,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bd3cbfc-229d-5ccd-b1df-c8ba8f9799d9/4bd3cbfc-229d-5ccd-b1df-c8ba8f9799d9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 590646,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/838/c09eaa10de8f4303be385bd9f35fcc9e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT KANGOO Profesional M1-AF Blue dCi 59 kW (80 CV)',
 'transmission': 'manual',
 'trim': 'Profesional M1-AF Blue dCi 59 kW (80 CV)',
 'vin': None,
 'year': 2019}
2026-03-25 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982238%27 HTTP/1.1" 200 None
2026-03-25 18:30:34 [ayvens.es] INFO: Saving data for 1982238: {'created_time': 1774463434.839805, 'last_price_update_time': 1774463434.839817, 'auction_closing_time': 1774526400.0}
2026-03-25 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1982238') HTTP/1.1" 204 0
2026-03-25 18:30:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1ee0cd9c-9991-55a3-9621-2688d4dd85de with identifier: 1982242
2026-03-25 18:30:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1ee0cd9c-9991-55a3-9621-2688d4dd85de with identifier: 1982242
2026-03-25 18:30:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1ee0cd9c-9991-55a3-9621-2688d4dd85de with identifier: 1982242 to the API
2026-03-25 18:30:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:30:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:30:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/426/8476dca50da3407bb9d1135effc489e6/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 174,
 'color': 'Plata perla',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '1ee0cd9c-9991-55a3-9621-2688d4dd85de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41008',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'C-MAX',
 'odometer': 113852,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ee0cd9c-9991-55a3-9621-2688d4dd85de/1ee0cd9c-9991-55a3-9621-2688d4dd85de_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 337882,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/426/8476dca50da3407bb9d1135effc489e6/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD C-MAX (O) 1.5 EcoBoost 110kW (150CV) Trend+ Auto',
 'transmission': 'manual',
 'trim': '(O) 1.5 EcoBoost 110kW (150CV) Trend+ Auto',
 'vin': None,
 'year': 2019}
2026-03-25 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982242%27 HTTP/1.1" 200 None
2026-03-25 18:30:35 [ayvens.es] INFO: Saving data for 1982242: {'created_time': 1774463435.470837, 'last_price_update_time': 1774463435.470847, 'auction_closing_time': 1774526400.0}
2026-03-25 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1982242') HTTP/1.1" 204 0
2026-03-25 18:30:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/940/dfe23c0bc9514d21bfedb3b2fe301deb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:30:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/340/a15a3b8702c740ad83cfa3f376286cd5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:30:35 [ayvens.es] INFO: Found listing with ID: 1982983
2026-03-25 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982983%27 HTTP/1.1" 200 None
2026-03-25 18:30:35 [ayvens.es] INFO: Scrape type for 1982983: 1
2026-03-25 18:30:35 [ayvens.es] INFO: Extracting data for car ID: 1982983
2026-03-25 18:30:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a670f804-3bd2-5868-a231-abee0a652fe1 with identifier: 1982983
2026-03-25 18:30:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a670f804-3bd2-5868-a231-abee0a652fe1 with scrape type 1
2026-03-25 18:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a670f804-3bd2-5868-a231-abee0a652fe1
2026-03-25 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F647%252Ff68d524fd5624813bbf4401b19d14898%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/647/f68d524fd5624813bbf4401b19d14898/images/large/1.jpg not downloaded yet
2026-03-25 18:30:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:30:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ed71b50>
2026-03-25 18:30:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:30:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:30:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:30:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9f2de76-7237-533b-9143-f042179c809e/f9f2de76-7237-533b-9143-f042179c809e_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F108%252F1dda4896c9a94155af6d0f9187b54ecf%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/108/1dda4896c9a94155af6d0f9187b54ecf/images/large/1.jpg saved to cache
2026-03-25 18:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f9f2de76-7237-533b-9143-f042179c809e
2026-03-25 18:30:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f9f2de76-7237-533b-9143-f042179c809e, skipping ID generation
2026-03-25 18:30:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9f2de76-7237-533b-9143-f042179c809e with scrape type 1
2026-03-25 18:30:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f9f2de76-7237-533b-9143-f042179c809e sending to next pipeline
2026-03-25 18:30:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f9f2de76-7237-533b-9143-f042179c809e, identifier: 1982241
2026-03-25 18:30:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:30:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ec46950>
2026-03-25 18:30:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:30:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:30:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:30:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93cfce9d-f698-54ed-b9cf-49340e4de6ea/93cfce9d-f698-54ed-b9cf-49340e4de6ea_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F214%252F85e28ee4b54745e098f8ae5b0c12f814%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/214/85e28ee4b54745e098f8ae5b0c12f814/images/large/1.jpg saved to cache
2026-03-25 18:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 93cfce9d-f698-54ed-b9cf-49340e4de6ea
2026-03-25 18:30:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 93cfce9d-f698-54ed-b9cf-49340e4de6ea, skipping ID generation
2026-03-25 18:30:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93cfce9d-f698-54ed-b9cf-49340e4de6ea with scrape type 1
2026-03-25 18:30:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 93cfce9d-f698-54ed-b9cf-49340e4de6ea sending to next pipeline
2026-03-25 18:30:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 93cfce9d-f698-54ed-b9cf-49340e4de6ea, identifier: 1982245
2026-03-25 18:30:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:30:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e59d650>
2026-03-25 18:30:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:30:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:30:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:30:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76d9125d-b909-5e6e-a357-68956fa13bfe/76d9125d-b909-5e6e-a357-68956fa13bfe_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F451%252Fea7d4773b8e84b0aaa85c4cb85566397%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/451/ea7d4773b8e84b0aaa85c4cb85566397/images/large/1.jpg saved to cache
2026-03-25 18:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 76d9125d-b909-5e6e-a357-68956fa13bfe
2026-03-25 18:30:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 76d9125d-b909-5e6e-a357-68956fa13bfe, skipping ID generation
2026-03-25 18:30:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76d9125d-b909-5e6e-a357-68956fa13bfe with scrape type 1
2026-03-25 18:30:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 76d9125d-b909-5e6e-a357-68956fa13bfe sending to next pipeline
2026-03-25 18:30:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 76d9125d-b909-5e6e-a357-68956fa13bfe, identifier: 1982971
2026-03-25 18:30:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/716/dd09601c0c0345aab859db20716e8938/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:30:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/003/832dded08ec6400e9d368fe8fe6c97df/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:30:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/246/df5f47b34e4f469b96935c4053d470d4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:30:36 [ayvens.es] INFO: Found listing with ID: 1982984
2026-03-25 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982984%27 HTTP/1.1" 200 None
2026-03-25 18:30:36 [ayvens.es] INFO: Scrape type for 1982984: 1
2026-03-25 18:30:36 [ayvens.es] INFO: Extracting data for car ID: 1982984
2026-03-25 18:30:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 547d1270-cdaa-57a4-990e-466923a91f36 with identifier: 1982984
2026-03-25 18:30:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 547d1270-cdaa-57a4-990e-466923a91f36 with scrape type 1
2026-03-25 18:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 547d1270-cdaa-57a4-990e-466923a91f36
2026-03-25 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F722%252F580d0857c2764ebab1dab33bb01bb425%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/722/580d0857c2764ebab1dab33bb01bb425/images/large/1.jpg not downloaded yet
2026-03-25 18:30:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f9f2de76-7237-533b-9143-f042179c809e with identifier: 1982241
2026-03-25 18:30:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f9f2de76-7237-533b-9143-f042179c809e with identifier: 1982241
2026-03-25 18:30:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f9f2de76-7237-533b-9143-f042179c809e with identifier: 1982241 to the API
2026-03-25 18:30:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:30:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:30:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/108/1dda4896c9a94155af6d0f9187b54ecf/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 261,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f9f2de76-7237-533b-9143-f042179c809e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41008',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CRAFTER',
 'odometer': 144049,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9f2de76-7237-533b-9143-f042179c809e/f9f2de76-7237-533b-9143-f042179c809e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 573615,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/108/1dda4896c9a94155af6d0f9187b54ecf/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-25',
 'seats_number': 3,
 'seller_name': None,
 'title': 'VOLKSWAGEN CRAFTER 35 Furgon BL TA L4H3 2.0TDI 103kW(140CV)',
 'transmission': 'manual',
 'trim': '35 Furgon BL TA L4H3 2.0TDI 103kW(140CV)',
 'vin': None,
 'year': 2020}
2026-03-25 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982241%27 HTTP/1.1" 200 None
2026-03-25 18:30:36 [ayvens.es] INFO: Saving data for 1982241: {'created_time': 1774463436.851889, 'last_price_update_time': 1774463436.851903, 'auction_closing_time': 1774526400.0}
2026-03-25 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1982241') HTTP/1.1" 204 0
2026-03-25 18:30:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 93cfce9d-f698-54ed-b9cf-49340e4de6ea with identifier: 1982245
2026-03-25 18:30:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:30:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:30:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 93cfce9d-f698-54ed-b9cf-49340e4de6ea with identifier: 1982245
2026-03-25 18:30:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 93cfce9d-f698-54ed-b9cf-49340e4de6ea with identifier: 1982245 to the API
2026-03-25 18:30:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:30:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:30:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/214/85e28ee4b54745e098f8ae5b0c12f814/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'Blanco classic',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '93cfce9d-f698-54ed-b9cf-49340e4de6ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41008',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'RAV4',
 'odometer': 128916,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93cfce9d-f698-54ed-b9cf-49340e4de6ea/93cfce9d-f698-54ed-b9cf-49340e4de6ea_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 337668,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/214/85e28ee4b54745e098f8ae5b0c12f814/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA RAV4 2.5l 220H Advance',
 'transmission': 'manual',
 'trim': '2.5l 220H Advance',
 'vin': None,
 'year': 2021}
2026-03-25 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982245%27 HTTP/1.1" 200 None
2026-03-25 18:30:37 [ayvens.es] INFO: Saving data for 1982245: {'created_time': 1774463437.317476, 'last_price_update_time': 1774463437.317493, 'auction_closing_time': 1774526400.0}
2026-03-25 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1982245') HTTP/1.1" 204 0
2026-03-25 18:30:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 76d9125d-b909-5e6e-a357-68956fa13bfe with identifier: 1982971
2026-03-25 18:30:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 76d9125d-b909-5e6e-a357-68956fa13bfe with identifier: 1982971
2026-03-25 18:30:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 76d9125d-b909-5e6e-a357-68956fa13bfe with identifier: 1982971 to the API
2026-03-25 18:30:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:30:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:30:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/451/ea7d4773b8e84b0aaa85c4cb85566397/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '76d9125d-b909-5e6e-a357-68956fa13bfe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'MONDEO',
 'odometer': 76318,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76d9125d-b909-5e6e-a357-68956fa13bfe/76d9125d-b909-5e6e-a357-68956fa13bfe_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 369363,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/451/ea7d4773b8e84b0aaa85c4cb85566397/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD MONDEO 2.0 TDCi 110kW (150CV) Trend',
 'transmission': 'manual',
 'trim': '2.0 TDCi 110kW (150CV) Trend',
 'vin': None,
 'year': 2019}
2026-03-25 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982971%27 HTTP/1.1" 200 None
2026-03-25 18:30:37 [ayvens.es] INFO: Saving data for 1982971: {'created_time': 1774463437.620563, 'last_price_update_time': 1774463437.620575, 'auction_closing_time': 1774526400.0}
2026-03-25 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1982971') HTTP/1.1" 204 0
2026-03-25 18:30:37 [ayvens.es] INFO: Found listing with ID: 1982985
2026-03-25 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982985%27 HTTP/1.1" 200 None
2026-03-25 18:30:37 [ayvens.es] INFO: Scrape type for 1982985: 1
2026-03-25 18:30:37 [ayvens.es] INFO: Extracting data for car ID: 1982985
2026-03-25 18:30:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e92a3fd8-35e7-5ed2-a98d-fa7b729fc351 with identifier: 1982985
2026-03-25 18:30:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e92a3fd8-35e7-5ed2-a98d-fa7b729fc351 with scrape type 1
2026-03-25 18:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e92a3fd8-35e7-5ed2-a98d-fa7b729fc351
2026-03-25 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F046%252F61ea20db2f3a4bb2ae8c5eeae4554441%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/046/61ea20db2f3a4bb2ae8c5eeae4554441/images/large/1.jpg not downloaded yet
2026-03-25 18:30:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/205/702e497291f741388341e54840c2d64b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:30:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/494/6bb027a7b52541a1a2c7bc501fd2f0a7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:30:37 [ayvens.es] INFO: Found listing with ID: 1982986
2026-03-25 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982986%27 HTTP/1.1" 200 None
2026-03-25 18:30:37 [ayvens.es] INFO: Scrape type for 1982986: 1
2026-03-25 18:30:37 [ayvens.es] INFO: Extracting data for car ID: 1982986
2026-03-25 18:30:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad30404f-3c24-56eb-b65d-33190c8df623 with identifier: 1982986
2026-03-25 18:30:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad30404f-3c24-56eb-b65d-33190c8df623 with scrape type 1
2026-03-25 18:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ad30404f-3c24-56eb-b65d-33190c8df623
2026-03-25 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F563%252Fad6aee6d5539444a8f5e366bc8ef1f2d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/563/ad6aee6d5539444a8f5e366bc8ef1f2d/images/large/1.jpg not downloaded yet
2026-03-25 18:30:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:30:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ea81090>
2026-03-25 18:30:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:30:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:30:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:30:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72a9d55b-2742-5e4c-9e62-7f5d7eac3b92/72a9d55b-2742-5e4c-9e62-7f5d7eac3b92_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F940%252Fdfe23c0bc9514d21bfedb3b2fe301deb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/940/dfe23c0bc9514d21bfedb3b2fe301deb/images/large/1.jpg saved to cache
2026-03-25 18:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 72a9d55b-2742-5e4c-9e62-7f5d7eac3b92
2026-03-25 18:30:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 72a9d55b-2742-5e4c-9e62-7f5d7eac3b92, skipping ID generation
2026-03-25 18:30:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72a9d55b-2742-5e4c-9e62-7f5d7eac3b92 with scrape type 1
2026-03-25 18:30:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 72a9d55b-2742-5e4c-9e62-7f5d7eac3b92 sending to next pipeline
2026-03-25 18:30:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 72a9d55b-2742-5e4c-9e62-7f5d7eac3b92, identifier: 1982244
2026-03-25 18:30:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:30:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e58ce10>
2026-03-25 18:30:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:30:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:30:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4536f54a-5d41-52ff-a600-b80df3ab56a6/4536f54a-5d41-52ff-a600-b80df3ab56a6_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F340%252Fa15a3b8702c740ad83cfa3f376286cd5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/340/a15a3b8702c740ad83cfa3f376286cd5/images/large/1.jpg saved to cache
2026-03-25 18:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4536f54a-5d41-52ff-a600-b80df3ab56a6
2026-03-25 18:30:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4536f54a-5d41-52ff-a600-b80df3ab56a6, skipping ID generation
2026-03-25 18:30:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4536f54a-5d41-52ff-a600-b80df3ab56a6 with scrape type 1
2026-03-25 18:30:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4536f54a-5d41-52ff-a600-b80df3ab56a6 sending to next pipeline
2026-03-25 18:30:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4536f54a-5d41-52ff-a600-b80df3ab56a6, identifier: 1982243
2026-03-25 18:30:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:30:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8eda03d0>
2026-03-25 18:30:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:30:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d435cfcb-c754-5785-8924-03c81041bd43/d435cfcb-c754-5785-8924-03c81041bd43_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F716%252Fdd09601c0c0345aab859db20716e8938%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/716/dd09601c0c0345aab859db20716e8938/images/large/1.jpg saved to cache
2026-03-25 18:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d435cfcb-c754-5785-8924-03c81041bd43
2026-03-25 18:30:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d435cfcb-c754-5785-8924-03c81041bd43, skipping ID generation
2026-03-25 18:30:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d435cfcb-c754-5785-8924-03c81041bd43 with scrape type 1
2026-03-25 18:30:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d435cfcb-c754-5785-8924-03c81041bd43 sending to next pipeline
2026-03-25 18:30:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d435cfcb-c754-5785-8924-03c81041bd43, identifier: 1982972
2026-03-25 18:30:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:30:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae90a31f90>
2026-03-25 18:30:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:30:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7673439d-6ce7-507d-8627-7838229f5a22/7673439d-6ce7-507d-8627-7838229f5a22_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F003%252F832dded08ec6400e9d368fe8fe6c97df%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/003/832dded08ec6400e9d368fe8fe6c97df/images/large/1.jpg saved to cache
2026-03-25 18:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7673439d-6ce7-507d-8627-7838229f5a22
2026-03-25 18:30:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7673439d-6ce7-507d-8627-7838229f5a22, skipping ID generation
2026-03-25 18:30:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7673439d-6ce7-507d-8627-7838229f5a22 with scrape type 1
2026-03-25 18:30:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7673439d-6ce7-507d-8627-7838229f5a22 sending to next pipeline
2026-03-25 18:30:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7673439d-6ce7-507d-8627-7838229f5a22, identifier: 1982974
2026-03-25 18:30:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:30:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ec50590>
2026-03-25 18:30:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:30:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:30:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff0722a2-e6ea-5726-9fc9-b5d25d88ff45/ff0722a2-e6ea-5726-9fc9-b5d25d88ff45_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F246%252Fdf5f47b34e4f469b96935c4053d470d4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/246/df5f47b34e4f469b96935c4053d470d4/images/large/1.jpg saved to cache
2026-03-25 18:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ff0722a2-e6ea-5726-9fc9-b5d25d88ff45
2026-03-25 18:30:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ff0722a2-e6ea-5726-9fc9-b5d25d88ff45, skipping ID generation
2026-03-25 18:30:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff0722a2-e6ea-5726-9fc9-b5d25d88ff45 with scrape type 1
2026-03-25 18:30:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ff0722a2-e6ea-5726-9fc9-b5d25d88ff45 sending to next pipeline
2026-03-25 18:30:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ff0722a2-e6ea-5726-9fc9-b5d25d88ff45, identifier: 1982970
2026-03-25 18:30:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 72a9d55b-2742-5e4c-9e62-7f5d7eac3b92 with identifier: 1982244
2026-03-25 18:30:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:30:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 72a9d55b-2742-5e4c-9e62-7f5d7eac3b92 with identifier: 1982244
2026-03-25 18:30:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 72a9d55b-2742-5e4c-9e62-7f5d7eac3b92 with identifier: 1982244 to the API
2026-03-25 18:30:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:30:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:30:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/940/dfe23c0bc9514d21bfedb3b2fe301deb/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'Clear white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '72a9d55b-2742-5e4c-9e62-7f5d7eac3b92',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41008',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'NIRO',
 'odometer': 76193,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72a9d55b-2742-5e4c-9e62-7f5d7eac3b92/72a9d55b-2742-5e4c-9e62-7f5d7eac3b92_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 539630,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/940/dfe23c0bc9514d21bfedb3b2fe301deb/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA NIRO 1.6 GDi HEV 104kW (141CV) Drive',
 'transmission': 'manual',
 'trim': '1.6 GDi HEV 104kW (141CV) Drive',
 'vin': None,
 'year': 2021}
2026-03-25 18:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982244%27 HTTP/1.1" 200 None
2026-03-25 18:30:39 [ayvens.es] INFO: Saving data for 1982244: {'created_time': 1774463439.23068, 'last_price_update_time': 1774463439.23069, 'auction_closing_time': 1774526400.0}
2026-03-25 18:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1982244') HTTP/1.1" 204 0
2026-03-25 18:30:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4536f54a-5d41-52ff-a600-b80df3ab56a6 with identifier: 1982243
2026-03-25 18:30:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4536f54a-5d41-52ff-a600-b80df3ab56a6 with identifier: 1982243
2026-03-25 18:30:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 4536f54a-5d41-52ff-a600-b80df3ab56a6 with identifier: 1982243 to the API
2026-03-25 18:30:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:30:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:30:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/340/a15a3b8702c740ad83cfa3f376286cd5/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 236,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.3L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '4536f54a-5d41-52ff-a600-b80df3ab56a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41008',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MASTER',
 'odometer': 69123,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4536f54a-5d41-52ff-a600-b80df3ab56a6/4536f54a-5d41-52ff-a600-b80df3ab56a6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 526935,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/340/a15a3b8702c740ad83cfa3f376286cd5/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-14',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT MASTER Furgon T L3H2 3500 Bl dCi 100 kW(135CV)',
 'transmission': 'manual',
 'trim': 'Furgon T L3H2 3500 Bl dCi 100 kW(135CV)',
 'vin': None,
 'year': 2021}
2026-03-25 18:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982243%27 HTTP/1.1" 200 None
2026-03-25 18:30:39 [ayvens.es] INFO: Saving data for 1982243: {'created_time': 1774463439.643912, 'last_price_update_time': 1774463439.643925, 'auction_closing_time': 1774526400.0}
2026-03-25 18:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1982243') HTTP/1.1" 204 0
2026-03-25 18:30:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d435cfcb-c754-5785-8924-03c81041bd43 with identifier: 1982972
2026-03-25 18:30:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d435cfcb-c754-5785-8924-03c81041bd43 with identifier: 1982972
2026-03-25 18:30:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d435cfcb-c754-5785-8924-03c81041bd43 with identifier: 1982972 to the API
2026-03-25 18:30:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:30:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:30:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/716/dd09601c0c0345aab859db20716e8938/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd435cfcb-c754-5785-8924-03c81041bd43',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 99747,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d435cfcb-c754-5785-8924-03c81041bd43/d435cfcb-c754-5785-8924-03c81041bd43_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 451715,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/716/dd09601c0c0345aab859db20716e8938/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI dCi 85 kW (115 CV) E6D N-CONNECTA',
 'transmission': 'manual',
 'trim': 'dCi 85 kW (115 CV) E6D N-CONNECTA',
 'vin': None,
 'year': 2021}
2026-03-25 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982972%27 HTTP/1.1" 200 None
2026-03-25 18:30:40 [ayvens.es] INFO: Saving data for 1982972: {'created_time': 1774463440.14895, 'last_price_update_time': 1774463440.14896, 'auction_closing_time': 1774526400.0}
2026-03-25 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1982972') HTTP/1.1" 204 0
2026-03-25 18:30:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7673439d-6ce7-507d-8627-7838229f5a22 with identifier: 1982974
2026-03-25 18:30:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7673439d-6ce7-507d-8627-7838229f5a22 with identifier: 1982974
2026-03-25 18:30:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7673439d-6ce7-507d-8627-7838229f5a22 with identifier: 1982974 to the API
2026-03-25 18:30:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:30:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:30:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/003/832dded08ec6400e9d368fe8fe6c97df/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '7673439d-6ce7-507d-8627-7838229f5a22',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 58262,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7673439d-6ce7-507d-8627-7838229f5a22/7673439d-6ce7-507d-8627-7838229f5a22_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 334762,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/003/832dded08ec6400e9d368fe8fe6c97df/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 Active Puretech 100 S&S BVM6',
 'transmission': 'manual',
 'trim': 'Active Puretech 100 S&S BVM6',
 'vin': None,
 'year': 2020}
2026-03-25 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982974%27 HTTP/1.1" 200 None
2026-03-25 18:30:40 [ayvens.es] INFO: Saving data for 1982974: {'created_time': 1774463440.485174, 'last_price_update_time': 1774463440.485184, 'auction_closing_time': 1774526400.0}
2026-03-25 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1982974') HTTP/1.1" 204 0
2026-03-25 18:30:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ff0722a2-e6ea-5726-9fc9-b5d25d88ff45 with identifier: 1982970
2026-03-25 18:30:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ff0722a2-e6ea-5726-9fc9-b5d25d88ff45 with identifier: 1982970
2026-03-25 18:30:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ff0722a2-e6ea-5726-9fc9-b5d25d88ff45 with identifier: 1982970 to the API
2026-03-25 18:30:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:30:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:30:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/246/df5f47b34e4f469b96935c4053d470d4/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 185,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'ff0722a2-e6ea-5726-9fc9-b5d25d88ff45',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'PORSCHE',
 'model': 'MACAN',
 'odometer': 89237,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff0722a2-e6ea-5726-9fc9-b5d25d88ff45/ff0722a2-e6ea-5726-9fc9-b5d25d88ff45_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 351071,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/246/df5f47b34e4f469b96935c4053d470d4/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PORSCHE MACAN Macan',
 'transmission': 'manual',
 'trim': 'Macan',
 'vin': None,
 'year': 2019}
2026-03-25 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982970%27 HTTP/1.1" 200 None
2026-03-25 18:30:40 [ayvens.es] INFO: Saving data for 1982970: {'created_time': 1774463440.831245, 'last_price_update_time': 1774463440.831261, 'auction_closing_time': 1774526400.0}
2026-03-25 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1982970') HTTP/1.1" 204 0
2026-03-25 18:30:40 [ayvens.es] INFO: Found listing with ID: 1982987
2026-03-25 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982987%27 HTTP/1.1" 200 None
2026-03-25 18:30:40 [ayvens.es] INFO: Scrape type for 1982987: 1
2026-03-25 18:30:40 [ayvens.es] INFO: Extracting data for car ID: 1982987
2026-03-25 18:30:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b09b1976-4b6d-5052-b9ee-d362432fec5d with identifier: 1982987
2026-03-25 18:30:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b09b1976-4b6d-5052-b9ee-d362432fec5d with scrape type 1
2026-03-25 18:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b09b1976-4b6d-5052-b9ee-d362432fec5d
2026-03-25 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F933%252F08c0cccef3424ad7be466f2a4b3a9a03%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/933/08c0cccef3424ad7be466f2a4b3a9a03/images/large/1.jpg not downloaded yet
2026-03-25 18:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/137/2c3e2048d580465380d13eb2cfef9398/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/352/53ffa7a30a2241ccbdc0c0eead2dd599/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/483/7a48e0cacd2a4983a2f03f823ae3beb1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:30:40 [ayvens.es] INFO: Found listing with ID: 1982988
2026-03-25 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982988%27 HTTP/1.1" 200 None
2026-03-25 18:30:40 [ayvens.es] INFO: Scrape type for 1982988: 1
2026-03-25 18:30:40 [ayvens.es] INFO: Extracting data for car ID: 1982988
2026-03-25 18:30:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4c9da13-b96d-5069-8d58-59715cc73163 with identifier: 1982988
2026-03-25 18:30:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4c9da13-b96d-5069-8d58-59715cc73163 with scrape type 1
2026-03-25 18:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e4c9da13-b96d-5069-8d58-59715cc73163
2026-03-25 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F859%252F818ce67f7b9d470d97692e0ab733ef3c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/859/818ce67f7b9d470d97692e0ab733ef3c/images/large/1.jpg not downloaded yet
2026-03-25 18:30:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:30:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8eaa9350>
2026-03-25 18:30:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:30:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:30:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c693f85-3342-58a6-a6e9-60bf2ec0b561/0c693f85-3342-58a6-a6e9-60bf2ec0b561_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F205%252F702e497291f741388341e54840c2d64b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/205/702e497291f741388341e54840c2d64b/images/large/1.jpg saved to cache
2026-03-25 18:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0c693f85-3342-58a6-a6e9-60bf2ec0b561
2026-03-25 18:30:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0c693f85-3342-58a6-a6e9-60bf2ec0b561, skipping ID generation
2026-03-25 18:30:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c693f85-3342-58a6-a6e9-60bf2ec0b561 with scrape type 1
2026-03-25 18:30:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0c693f85-3342-58a6-a6e9-60bf2ec0b561 sending to next pipeline
2026-03-25 18:30:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0c693f85-3342-58a6-a6e9-60bf2ec0b561, identifier: 1982973
2026-03-25 18:30:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:30:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8eea1b90>
2026-03-25 18:30:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:30:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:30:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65c43900-ff05-5c27-a18a-1bf171edad43/65c43900-ff05-5c27-a18a-1bf171edad43_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F494%252F6bb027a7b52541a1a2c7bc501fd2f0a7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/494/6bb027a7b52541a1a2c7bc501fd2f0a7/images/large/1.jpg saved to cache
2026-03-25 18:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 65c43900-ff05-5c27-a18a-1bf171edad43
2026-03-25 18:30:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 65c43900-ff05-5c27-a18a-1bf171edad43, skipping ID generation
2026-03-25 18:30:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65c43900-ff05-5c27-a18a-1bf171edad43 with scrape type 1
2026-03-25 18:30:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 65c43900-ff05-5c27-a18a-1bf171edad43 sending to next pipeline
2026-03-25 18:30:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 65c43900-ff05-5c27-a18a-1bf171edad43, identifier: 1982975
2026-03-25 18:30:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/472/177a1d5476cf4083a08c98184d408886/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:30:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/580/4325727f023a44b3a22033d9c4f75295/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:30:41 [ayvens.es] INFO: Found listing with ID: 1982989
2026-03-25 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982989%27 HTTP/1.1" 200 None
2026-03-25 18:30:41 [ayvens.es] INFO: Scrape type for 1982989: 1
2026-03-25 18:30:41 [ayvens.es] INFO: Extracting data for car ID: 1982989
2026-03-25 18:30:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39586f6e-f767-5847-81a7-5d4afdc2f65c with identifier: 1982989
2026-03-25 18:30:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39586f6e-f767-5847-81a7-5d4afdc2f65c with scrape type 1
2026-03-25 18:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 39586f6e-f767-5847-81a7-5d4afdc2f65c
2026-03-25 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F537%252F0cd0333953ac4827b97fc8ee52dcd103%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/537/0cd0333953ac4827b97fc8ee52dcd103/images/large/1.jpg not downloaded yet
2026-03-25 18:30:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0c693f85-3342-58a6-a6e9-60bf2ec0b561 with identifier: 1982973
2026-03-25 18:30:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0c693f85-3342-58a6-a6e9-60bf2ec0b561 with identifier: 1982973
2026-03-25 18:30:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0c693f85-3342-58a6-a6e9-60bf2ec0b561 with identifier: 1982973 to the API
2026-03-25 18:30:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:30:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:30:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/205/702e497291f741388341e54840c2d64b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '0c693f85-3342-58a6-a6e9-60bf2ec0b561',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'RIFTER',
 'odometer': 95500,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c693f85-3342-58a6-a6e9-60bf2ec0b561/0c693f85-3342-58a6-a6e9-60bf2ec0b561_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336323,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/205/702e497291f741388341e54840c2d64b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT RIFTER Active Pack Standard BlueHDi 73kW',
 'transmission': 'manual',
 'trim': 'Active Pack Standard BlueHDi 73kW',
 'vin': None,
 'year': 2021}
2026-03-25 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982973%27 HTTP/1.1" 200 None
2026-03-25 18:30:41 [ayvens.es] INFO: Saving data for 1982973: {'created_time': 1774463441.935805, 'last_price_update_time': 1774463441.935815, 'auction_closing_time': 1774526400.0}
2026-03-25 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1982973') HTTP/1.1" 204 0
2026-03-25 18:30:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 65c43900-ff05-5c27-a18a-1bf171edad43 with identifier: 1982975
2026-03-25 18:30:42 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:30:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 65c43900-ff05-5c27-a18a-1bf171edad43 with identifier: 1982975
2026-03-25 18:30:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 65c43900-ff05-5c27-a18a-1bf171edad43 with identifier: 1982975 to the API
2026-03-25 18:30:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:30:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:30:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/494/6bb027a7b52541a1a2c7bc501fd2f0a7/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'color': 'Cassa',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '65c43900-ff05-5c27-a18a-1bf171edad43',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'SPORTAGE',
 'odometer': 45643,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65c43900-ff05-5c27-a18a-1bf171edad43/65c43900-ff05-5c27-a18a-1bf171edad43_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 346897,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/494/6bb027a7b52541a1a2c7bc501fd2f0a7/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA SPORTAGE 1.6 T-GDi MHEV 110kW (150CV) Drive 4x2',
 'transmission': 'manual',
 'trim': '1.6 T-GDi MHEV 110kW (150CV) Drive 4x2',
 'vin': None,
 'year': 2023}
2026-03-25 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982975%27 HTTP/1.1" 200 None
2026-03-25 18:30:42 [ayvens.es] INFO: Saving data for 1982975: {'created_time': 1774463442.482774, 'last_price_update_time': 1774463442.482786, 'auction_closing_time': 1774526400.0}
2026-03-25 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1982975') HTTP/1.1" 204 0
2026-03-25 18:30:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/647/f68d524fd5624813bbf4401b19d14898/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:30:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/229/9f32070e28dc4974aeeae6f7b01c463d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:30:42 [ayvens.es] INFO: Found listing with ID: 1982990
2026-03-25 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982990%27 HTTP/1.1" 200 None
2026-03-25 18:30:42 [ayvens.es] INFO: Scrape type for 1982990: 1
2026-03-25 18:30:42 [ayvens.es] INFO: Extracting data for car ID: 1982990
2026-03-25 18:30:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63fdba5a-7a61-5ad8-84e1-140d804ccb9c with identifier: 1982990
2026-03-25 18:30:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63fdba5a-7a61-5ad8-84e1-140d804ccb9c with scrape type 1
2026-03-25 18:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 63fdba5a-7a61-5ad8-84e1-140d804ccb9c
2026-03-25 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F025%252F5e780ae7ce734efbac271abe2d24a25f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/025/5e780ae7ce734efbac271abe2d24a25f/images/large/1.jpg not downloaded yet
2026-03-25 18:30:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:30:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ececc50>
2026-03-25 18:30:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:30:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:30:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:30:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_278d981f-3bdd-52a3-a851-947ca80b06fc/278d981f-3bdd-52a3-a851-947ca80b06fc_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F137%252F2c3e2048d580465380d13eb2cfef9398%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/137/2c3e2048d580465380d13eb2cfef9398/images/large/1.jpg saved to cache
2026-03-25 18:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 278d981f-3bdd-52a3-a851-947ca80b06fc
2026-03-25 18:30:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 278d981f-3bdd-52a3-a851-947ca80b06fc, skipping ID generation
2026-03-25 18:30:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 278d981f-3bdd-52a3-a851-947ca80b06fc with scrape type 1
2026-03-25 18:30:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 278d981f-3bdd-52a3-a851-947ca80b06fc sending to next pipeline
2026-03-25 18:30:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 278d981f-3bdd-52a3-a851-947ca80b06fc, identifier: 1982976
2026-03-25 18:30:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:30:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8d445390>
2026-03-25 18:30:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:30:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:30:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:30:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecc2b3b5-a175-594c-b686-20367a5fa140/ecc2b3b5-a175-594c-b686-20367a5fa140_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F352%252F53ffa7a30a2241ccbdc0c0eead2dd599%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/352/53ffa7a30a2241ccbdc0c0eead2dd599/images/large/1.jpg saved to cache
2026-03-25 18:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ecc2b3b5-a175-594c-b686-20367a5fa140
2026-03-25 18:30:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ecc2b3b5-a175-594c-b686-20367a5fa140, skipping ID generation
2026-03-25 18:30:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecc2b3b5-a175-594c-b686-20367a5fa140 with scrape type 1
2026-03-25 18:30:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ecc2b3b5-a175-594c-b686-20367a5fa140 sending to next pipeline
2026-03-25 18:30:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ecc2b3b5-a175-594c-b686-20367a5fa140, identifier: 1982978
2026-03-25 18:30:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:30:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ef2a010>
2026-03-25 18:30:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:30:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:30:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:30:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f98d349f-d3e2-52c8-bd64-2a0d9cf67c62/f98d349f-d3e2-52c8-bd64-2a0d9cf67c62_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F483%252F7a48e0cacd2a4983a2f03f823ae3beb1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/483/7a48e0cacd2a4983a2f03f823ae3beb1/images/large/1.jpg saved to cache
2026-03-25 18:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f98d349f-d3e2-52c8-bd64-2a0d9cf67c62
2026-03-25 18:30:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f98d349f-d3e2-52c8-bd64-2a0d9cf67c62, skipping ID generation
2026-03-25 18:30:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f98d349f-d3e2-52c8-bd64-2a0d9cf67c62 with scrape type 1
2026-03-25 18:30:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f98d349f-d3e2-52c8-bd64-2a0d9cf67c62 sending to next pipeline
2026-03-25 18:30:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f98d349f-d3e2-52c8-bd64-2a0d9cf67c62, identifier: 1982977
2026-03-25 18:30:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:30:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ed17250>
2026-03-25 18:30:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:30:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:30:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:30:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4835efab-402d-5a1e-aa4a-4f703a905655/4835efab-402d-5a1e-aa4a-4f703a905655_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F472%252F177a1d5476cf4083a08c98184d408886%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/472/177a1d5476cf4083a08c98184d408886/images/large/1.jpg saved to cache
2026-03-25 18:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4835efab-402d-5a1e-aa4a-4f703a905655
2026-03-25 18:30:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4835efab-402d-5a1e-aa4a-4f703a905655, skipping ID generation
2026-03-25 18:30:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4835efab-402d-5a1e-aa4a-4f703a905655 with scrape type 1
2026-03-25 18:30:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4835efab-402d-5a1e-aa4a-4f703a905655 sending to next pipeline
2026-03-25 18:30:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4835efab-402d-5a1e-aa4a-4f703a905655, identifier: 1982981
2026-03-25 18:30:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:30:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ea31d50>
2026-03-25 18:30:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:30:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:30:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:30:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_027216d8-c48b-5ac1-a108-58b2389a8a3d/027216d8-c48b-5ac1-a108-58b2389a8a3d_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F580%252F4325727f023a44b3a22033d9c4f75295%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/580/4325727f023a44b3a22033d9c4f75295/images/large/1.jpg saved to cache
2026-03-25 18:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 027216d8-c48b-5ac1-a108-58b2389a8a3d
2026-03-25 18:30:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 027216d8-c48b-5ac1-a108-58b2389a8a3d, skipping ID generation
2026-03-25 18:30:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 027216d8-c48b-5ac1-a108-58b2389a8a3d with scrape type 1
2026-03-25 18:30:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 027216d8-c48b-5ac1-a108-58b2389a8a3d sending to next pipeline
2026-03-25 18:30:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 027216d8-c48b-5ac1-a108-58b2389a8a3d, identifier: 1982979
2026-03-25 18:30:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/708/ee5bace4977749769fa3f56478b7dd07/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:30:43 [ayvens.es] INFO: Found listing with ID: 1982991
2026-03-25 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982991%27 HTTP/1.1" 200 None
2026-03-25 18:30:43 [ayvens.es] INFO: Scrape type for 1982991: 1
2026-03-25 18:30:43 [ayvens.es] INFO: Extracting data for car ID: 1982991
2026-03-25 18:30:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2369b4db-70cd-5be8-95dd-d21e6a3e046d with identifier: 1982991
2026-03-25 18:30:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2369b4db-70cd-5be8-95dd-d21e6a3e046d with scrape type 1
2026-03-25 18:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2369b4db-70cd-5be8-95dd-d21e6a3e046d
2026-03-25 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F682%252Fb1b26f8ef87f469f9e50b385885adcfe%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/682/b1b26f8ef87f469f9e50b385885adcfe/images/large/1.jpg not downloaded yet
2026-03-25 18:30:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 278d981f-3bdd-52a3-a851-947ca80b06fc with identifier: 1982976
2026-03-25 18:30:43 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:30:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 278d981f-3bdd-52a3-a851-947ca80b06fc with identifier: 1982976
2026-03-25 18:30:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 278d981f-3bdd-52a3-a851-947ca80b06fc with identifier: 1982976 to the API
2026-03-25 18:30:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:30:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:30:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/137/2c3e2048d580465380d13eb2cfef9398/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'Penta',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '278d981f-3bdd-52a3-a851-947ca80b06fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'SPORTAGE',
 'odometer': 163247,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_278d981f-3bdd-52a3-a851-947ca80b06fc/278d981f-3bdd-52a3-a851-947ca80b06fc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 523413,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/137/2c3e2048d580465380d13eb2cfef9398/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA SPORTAGE 1.6 CRDi MHEV 100kW (136CV) Drive 4x2',
 'transmission': 'manual',
 'trim': '1.6 CRDi MHEV 100kW (136CV) Drive 4x2',
 'vin': None,
 'year': 2022}
2026-03-25 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982976%27 HTTP/1.1" 200 None
2026-03-25 18:30:43 [ayvens.es] INFO: Saving data for 1982976: {'created_time': 1774463443.809166, 'last_price_update_time': 1774463443.809178, 'auction_closing_time': 1774526400.0}
2026-03-25 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1982976') HTTP/1.1" 204 0
2026-03-25 18:30:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ecc2b3b5-a175-594c-b686-20367a5fa140 with identifier: 1982978
2026-03-25 18:30:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ecc2b3b5-a175-594c-b686-20367a5fa140 with identifier: 1982978
2026-03-25 18:30:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ecc2b3b5-a175-594c-b686-20367a5fa140 with identifier: 1982978 to the API
2026-03-25 18:30:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:30:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:30:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/352/53ffa7a30a2241ccbdc0c0eead2dd599/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 146,
 'color': 'Cassa',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ecc2b3b5-a175-594c-b686-20367a5fa140',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'SPORTAGE',
 'odometer': 75236,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecc2b3b5-a175-594c-b686-20367a5fa140/ecc2b3b5-a175-594c-b686-20367a5fa140_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 333480,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/352/53ffa7a30a2241ccbdc0c0eead2dd599/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA SPORTAGE 1.6 MHEV Black Edition 100kW (136CV) 4x2',
 'transmission': 'manual',
 'trim': '1.6 MHEV Black Edition 100kW (136CV) 4x2',
 'vin': None,
 'year': 2021}
2026-03-25 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982978%27 HTTP/1.1" 200 None
2026-03-25 18:30:44 [ayvens.es] INFO: Saving data for 1982978: {'created_time': 1774463444.135406, 'last_price_update_time': 1774463444.135418, 'auction_closing_time': 1774526400.0}
2026-03-25 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1982978') HTTP/1.1" 204 0
2026-03-25 18:30:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f98d349f-d3e2-52c8-bd64-2a0d9cf67c62 with identifier: 1982977
2026-03-25 18:30:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f98d349f-d3e2-52c8-bd64-2a0d9cf67c62 with identifier: 1982977
2026-03-25 18:30:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f98d349f-d3e2-52c8-bd64-2a0d9cf67c62 with identifier: 1982977 to the API
2026-03-25 18:30:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:30:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:30:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/483/7a48e0cacd2a4983a2f03f823ae3beb1/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.7L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f98d349f-d3e2-52c8-bd64-2a0d9cf67c62',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'SPORTAGE',
 'odometer': 60093,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f98d349f-d3e2-52c8-bd64-2a0d9cf67c62/f98d349f-d3e2-52c8-bd64-2a0d9cf67c62_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354306,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/483/7a48e0cacd2a4983a2f03f823ae3beb1/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA SPORTAGE 1.7 CRDi VGT 85kW Business 4x2 Eco-Dynam',
 'transmission': 'manual',
 'trim': '1.7 CRDi VGT 85kW Business 4x2 Eco-Dynam',
 'vin': None,
 'year': 2018}
2026-03-25 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982977%27 HTTP/1.1" 200 None
2026-03-25 18:30:44 [ayvens.es] INFO: Saving data for 1982977: {'created_time': 1774463444.65752, 'last_price_update_time': 1774463444.65753, 'auction_closing_time': 1774526400.0}
2026-03-25 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1982977') HTTP/1.1" 204 0
2026-03-25 18:30:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4835efab-402d-5a1e-aa4a-4f703a905655 with identifier: 1982981
2026-03-25 18:30:44 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:30:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4835efab-402d-5a1e-aa4a-4f703a905655 with identifier: 1982981
2026-03-25 18:30:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 4835efab-402d-5a1e-aa4a-4f703a905655 with identifier: 1982981 to the API
2026-03-25 18:30:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:30:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:30:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/472/177a1d5476cf4083a08c98184d408886/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'color': 'Azul',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '4835efab-402d-5a1e-aa4a-4f703a905655',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 159589,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4835efab-402d-5a1e-aa4a-4f703a905655/4835efab-402d-5a1e-aa4a-4f703a905655_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 371268,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/472/177a1d5476cf4083a08c98184d408886/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.5 BlueHDi 96kW S&S GT EAT8',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi 96kW S&S GT EAT8',
 'vin': None,
 'year': 2021}
2026-03-25 18:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982981%27 HTTP/1.1" 200 None
2026-03-25 18:30:45 [ayvens.es] INFO: Saving data for 1982981: {'created_time': 1774463445.042946, 'last_price_update_time': 1774463445.04296, 'auction_closing_time': 1774526400.0}
2026-03-25 18:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1982981') HTTP/1.1" 204 0
2026-03-25 18:30:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 027216d8-c48b-5ac1-a108-58b2389a8a3d with identifier: 1982979
2026-03-25 18:30:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 027216d8-c48b-5ac1-a108-58b2389a8a3d with identifier: 1982979
2026-03-25 18:30:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 027216d8-c48b-5ac1-a108-58b2389a8a3d with identifier: 1982979 to the API
2026-03-25 18:30:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:30:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:30:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/580/4325727f023a44b3a22033d9c4f75295/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '027216d8-c48b-5ac1-a108-58b2389a8a3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'CORSA',
 'odometer': 100817,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_027216d8-c48b-5ac1-a108-58b2389a8a3d/027216d8-c48b-5ac1-a108-58b2389a8a3d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 322955,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/580/4325727f023a44b3a22033d9c4f75295/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL CORSA 1.5D DT 74kW (100CV) Edition',
 'transmission': 'manual',
 'trim': '1.5D DT 74kW (100CV) Edition',
 'vin': None,
 'year': 2022}
2026-03-25 18:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982979%27 HTTP/1.1" 200 None
2026-03-25 18:30:45 [ayvens.es] INFO: Saving data for 1982979: {'created_time': 1774463445.366197, 'last_price_update_time': 1774463445.366208, 'auction_closing_time': 1774526400.0}
2026-03-25 18:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1982979') HTTP/1.1" 204 0
2026-03-25 18:30:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/722/580d0857c2764ebab1dab33bb01bb425/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:30:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/046/61ea20db2f3a4bb2ae8c5eeae4554441/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:30:45 [ayvens.es] INFO: Found listing with ID: 1982992
2026-03-25 18:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982992%27 HTTP/1.1" 200 None
2026-03-25 18:30:45 [ayvens.es] INFO: Scrape type for 1982992: 1
2026-03-25 18:30:45 [ayvens.es] INFO: Extracting data for car ID: 1982992
2026-03-25 18:30:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6626d391-afbf-5617-ba82-bb4888a8e7d7 with identifier: 1982992
2026-03-25 18:30:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6626d391-afbf-5617-ba82-bb4888a8e7d7 with scrape type 1
2026-03-25 18:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6626d391-afbf-5617-ba82-bb4888a8e7d7
2026-03-25 18:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F352%252F5dff84294dc4492fb90de2bb2869f92a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/352/5dff84294dc4492fb90de2bb2869f92a/images/large/1.jpg not downloaded yet
2026-03-25 18:30:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:30:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e57fa10>
2026-03-25 18:30:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:30:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a670f804-3bd2-5868-a231-abee0a652fe1/a670f804-3bd2-5868-a231-abee0a652fe1_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F647%252Ff68d524fd5624813bbf4401b19d14898%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/647/f68d524fd5624813bbf4401b19d14898/images/large/1.jpg saved to cache
2026-03-25 18:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a670f804-3bd2-5868-a231-abee0a652fe1
2026-03-25 18:30:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a670f804-3bd2-5868-a231-abee0a652fe1, skipping ID generation
2026-03-25 18:30:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a670f804-3bd2-5868-a231-abee0a652fe1 with scrape type 1
2026-03-25 18:30:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a670f804-3bd2-5868-a231-abee0a652fe1 sending to next pipeline
2026-03-25 18:30:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a670f804-3bd2-5868-a231-abee0a652fe1, identifier: 1982983
2026-03-25 18:30:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:30:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e57c490>
2026-03-25 18:30:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:30:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea0fed48-5178-525e-8054-a4c382648c01/ea0fed48-5178-525e-8054-a4c382648c01_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F229%252F9f32070e28dc4974aeeae6f7b01c463d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/229/9f32070e28dc4974aeeae6f7b01c463d/images/large/1.jpg saved to cache
2026-03-25 18:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ea0fed48-5178-525e-8054-a4c382648c01
2026-03-25 18:30:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ea0fed48-5178-525e-8054-a4c382648c01, skipping ID generation
2026-03-25 18:30:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea0fed48-5178-525e-8054-a4c382648c01 with scrape type 1
2026-03-25 18:30:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ea0fed48-5178-525e-8054-a4c382648c01 sending to next pipeline
2026-03-25 18:30:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ea0fed48-5178-525e-8054-a4c382648c01, identifier: 1982982
2026-03-25 18:30:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:30:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ed70a50>
2026-03-25 18:30:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:30:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:30:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f53c38c-6e82-5d5d-a4dd-a79b5015dc82/4f53c38c-6e82-5d5d-a4dd-a79b5015dc82_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F708%252Fee5bace4977749769fa3f56478b7dd07%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/708/ee5bace4977749769fa3f56478b7dd07/images/large/1.jpg saved to cache
2026-03-25 18:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4f53c38c-6e82-5d5d-a4dd-a79b5015dc82
2026-03-25 18:30:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4f53c38c-6e82-5d5d-a4dd-a79b5015dc82, skipping ID generation
2026-03-25 18:30:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f53c38c-6e82-5d5d-a4dd-a79b5015dc82 with scrape type 1
2026-03-25 18:30:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4f53c38c-6e82-5d5d-a4dd-a79b5015dc82 sending to next pipeline
2026-03-25 18:30:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4f53c38c-6e82-5d5d-a4dd-a79b5015dc82, identifier: 1982980
2026-03-25 18:30:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/563/ad6aee6d5539444a8f5e366bc8ef1f2d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:30:46 [ayvens.es] INFO: Found listing with ID: 1982993
2026-03-25 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982993%27 HTTP/1.1" 200 None
2026-03-25 18:30:46 [ayvens.es] INFO: Scrape type for 1982993: 1
2026-03-25 18:30:46 [ayvens.es] INFO: Extracting data for car ID: 1982993
2026-03-25 18:30:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb23bcd2-7819-5c23-81e4-0c08e5b86704 with identifier: 1982993
2026-03-25 18:30:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb23bcd2-7819-5c23-81e4-0c08e5b86704 with scrape type 1
2026-03-25 18:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item eb23bcd2-7819-5c23-81e4-0c08e5b86704
2026-03-25 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F729%252F91339848793549eb8e8cb18ba70030d3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/729/91339848793549eb8e8cb18ba70030d3/images/large/1.jpg not downloaded yet
2026-03-25 18:30:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a670f804-3bd2-5868-a231-abee0a652fe1 with identifier: 1982983
2026-03-25 18:30:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a670f804-3bd2-5868-a231-abee0a652fe1 with identifier: 1982983
2026-03-25 18:30:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a670f804-3bd2-5868-a231-abee0a652fe1 with identifier: 1982983 to the API
2026-03-25 18:30:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:30:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:30:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/647/f68d524fd5624813bbf4401b19d14898/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a670f804-3bd2-5868-a231-abee0a652fe1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'CORSA',
 'odometer': 129075,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a670f804-3bd2-5868-a231-abee0a652fe1/a670f804-3bd2-5868-a231-abee0a652fe1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 335349,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/647/f68d524fd5624813bbf4401b19d14898/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL CORSA 1.5D DT 74kW (100CV) Edition',
 'transmission': 'manual',
 'trim': '1.5D DT 74kW (100CV) Edition',
 'vin': None,
 'year': 2021}
2026-03-25 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982983%27 HTTP/1.1" 200 None
2026-03-25 18:30:46 [ayvens.es] INFO: Saving data for 1982983: {'created_time': 1774463446.372553, 'last_price_update_time': 1774463446.372568, 'auction_closing_time': 1774526400.0}
2026-03-25 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1982983') HTTP/1.1" 204 0
2026-03-25 18:30:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ea0fed48-5178-525e-8054-a4c382648c01 with identifier: 1982982
2026-03-25 18:30:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ea0fed48-5178-525e-8054-a4c382648c01 with identifier: 1982982
2026-03-25 18:30:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ea0fed48-5178-525e-8054-a4c382648c01 with identifier: 1982982 to the API
2026-03-25 18:30:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:30:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:30:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/229/9f32070e28dc4974aeeae6f7b01c463d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 86,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ea0fed48-5178-525e-8054-a4c382648c01',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C3',
 'odometer': 98560,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea0fed48-5178-525e-8054-a4c382648c01/ea0fed48-5178-525e-8054-a4c382648c01_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328294,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/229/9f32070e28dc4974aeeae6f7b01c463d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C3 BlueHDi 73KW (100CV) S&S FEEL',
 'transmission': 'manual',
 'trim': 'BlueHDi 73KW (100CV) S&S FEEL',
 'vin': None,
 'year': 2020}
2026-03-25 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982982%27 HTTP/1.1" 200 None
2026-03-25 18:30:46 [ayvens.es] INFO: Saving data for 1982982: {'created_time': 1774463446.716334, 'last_price_update_time': 1774463446.716344, 'auction_closing_time': 1774526400.0}
2026-03-25 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1982982') HTTP/1.1" 204 0
2026-03-25 18:30:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4f53c38c-6e82-5d5d-a4dd-a79b5015dc82 with identifier: 1982980
2026-03-25 18:30:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:30:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4f53c38c-6e82-5d5d-a4dd-a79b5015dc82 with identifier: 1982980
2026-03-25 18:30:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 4f53c38c-6e82-5d5d-a4dd-a79b5015dc82 with identifier: 1982980 to the API
2026-03-25 18:30:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:30:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:30:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/708/ee5bace4977749769fa3f56478b7dd07/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 40,
 'color': 'Phytonicblau',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '4f53c38c-6e82-5d5d-a4dd-a79b5015dc82',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 122083,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f53c38c-6e82-5d5d-a4dd-a79b5015dc82/4f53c38c-6e82-5d5d-a4dd-a79b5015dc82_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 548780,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/708/ee5bace4977749769fa3f56478b7dd07/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 xDrive25e',
 'transmission': 'manual',
 'trim': 'xDrive25e',
 'vin': None,
 'year': 2021}
2026-03-25 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982980%27 HTTP/1.1" 200 None
2026-03-25 18:30:47 [ayvens.es] INFO: Saving data for 1982980: {'created_time': 1774463447.094257, 'last_price_update_time': 1774463447.094268, 'auction_closing_time': 1774526400.0}
2026-03-25 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1982980') HTTP/1.1" 204 0
2026-03-25 18:30:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/859/818ce67f7b9d470d97692e0ab733ef3c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:30:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/933/08c0cccef3424ad7be466f2a4b3a9a03/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:30:47 [ayvens.es] INFO: Found listing with ID: 1982994
2026-03-25 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982994%27 HTTP/1.1" 200 None
2026-03-25 18:30:47 [ayvens.es] INFO: Scrape type for 1982994: 1
2026-03-25 18:30:47 [ayvens.es] INFO: Extracting data for car ID: 1982994
2026-03-25 18:30:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8aca777c-5ddd-5076-8a1a-8bd036e55969 with identifier: 1982994
2026-03-25 18:30:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8aca777c-5ddd-5076-8a1a-8bd036e55969 with scrape type 1
2026-03-25 18:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8aca777c-5ddd-5076-8a1a-8bd036e55969
2026-03-25 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F724%252F5ebffec740fe4fd3889e3a10cc67ac58%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/724/5ebffec740fe4fd3889e3a10cc67ac58/images/large/1.jpg not downloaded yet
2026-03-25 18:30:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:30:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ee59910>
2026-03-25 18:30:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:30:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_547d1270-cdaa-57a4-990e-466923a91f36/547d1270-cdaa-57a4-990e-466923a91f36_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F722%252F580d0857c2764ebab1dab33bb01bb425%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/722/580d0857c2764ebab1dab33bb01bb425/images/large/1.jpg saved to cache
2026-03-25 18:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 547d1270-cdaa-57a4-990e-466923a91f36
2026-03-25 18:30:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 547d1270-cdaa-57a4-990e-466923a91f36, skipping ID generation
2026-03-25 18:30:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 547d1270-cdaa-57a4-990e-466923a91f36 with scrape type 1
2026-03-25 18:30:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 547d1270-cdaa-57a4-990e-466923a91f36 sending to next pipeline
2026-03-25 18:30:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 547d1270-cdaa-57a4-990e-466923a91f36, identifier: 1982984
2026-03-25 18:30:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:30:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ee58d90>
2026-03-25 18:30:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:30:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e92a3fd8-35e7-5ed2-a98d-fa7b729fc351/e92a3fd8-35e7-5ed2-a98d-fa7b729fc351_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F046%252F61ea20db2f3a4bb2ae8c5eeae4554441%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/046/61ea20db2f3a4bb2ae8c5eeae4554441/images/large/1.jpg saved to cache
2026-03-25 18:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e92a3fd8-35e7-5ed2-a98d-fa7b729fc351
2026-03-25 18:30:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e92a3fd8-35e7-5ed2-a98d-fa7b729fc351, skipping ID generation
2026-03-25 18:30:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e92a3fd8-35e7-5ed2-a98d-fa7b729fc351 with scrape type 1
2026-03-25 18:30:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e92a3fd8-35e7-5ed2-a98d-fa7b729fc351 sending to next pipeline
2026-03-25 18:30:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e92a3fd8-35e7-5ed2-a98d-fa7b729fc351, identifier: 1982985
2026-03-25 18:30:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:30:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ea4a890>
2026-03-25 18:30:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:30:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad30404f-3c24-56eb-b65d-33190c8df623/ad30404f-3c24-56eb-b65d-33190c8df623_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F563%252Fad6aee6d5539444a8f5e366bc8ef1f2d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/563/ad6aee6d5539444a8f5e366bc8ef1f2d/images/large/1.jpg saved to cache
2026-03-25 18:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ad30404f-3c24-56eb-b65d-33190c8df623
2026-03-25 18:30:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ad30404f-3c24-56eb-b65d-33190c8df623, skipping ID generation
2026-03-25 18:30:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad30404f-3c24-56eb-b65d-33190c8df623 with scrape type 1
2026-03-25 18:30:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ad30404f-3c24-56eb-b65d-33190c8df623 sending to next pipeline
2026-03-25 18:30:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ad30404f-3c24-56eb-b65d-33190c8df623, identifier: 1982986
2026-03-25 18:30:47 [ayvens.es] INFO: Found listing with ID: 1982995
2026-03-25 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982995%27 HTTP/1.1" 200 None
2026-03-25 18:30:47 [ayvens.es] INFO: Scrape type for 1982995: 1
2026-03-25 18:30:47 [ayvens.es] INFO: Extracting data for car ID: 1982995
2026-03-25 18:30:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2abceb7-fb7b-5813-be3b-1e2ac5e14bb6 with identifier: 1982995
2026-03-25 18:30:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2abceb7-fb7b-5813-be3b-1e2ac5e14bb6 with scrape type 1
2026-03-25 18:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f2abceb7-fb7b-5813-be3b-1e2ac5e14bb6
2026-03-25 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F950%252F5a8b8ca056904f94a55db0a264499c05%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/950/5a8b8ca056904f94a55db0a264499c05/images/large/1.jpg not downloaded yet
2026-03-25 18:30:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 547d1270-cdaa-57a4-990e-466923a91f36 with identifier: 1982984
2026-03-25 18:30:47 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:30:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 547d1270-cdaa-57a4-990e-466923a91f36 with identifier: 1982984
2026-03-25 18:30:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 547d1270-cdaa-57a4-990e-466923a91f36 with identifier: 1982984 to the API
2026-03-25 18:30:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:30:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:30:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/722/580d0857c2764ebab1dab33bb01bb425/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 170,
 'color': 'Phytonic',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '547d1270-cdaa-57a4-990e-466923a91f36',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X4',
 'odometer': 53142,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_547d1270-cdaa-57a4-990e-466923a91f36/547d1270-cdaa-57a4-990e-466923a91f36_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353008,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/722/580d0857c2764ebab1dab33bb01bb425/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X4 xDrive20i xLine',
 'transmission': 'manual',
 'trim': 'xDrive20i xLine',
 'vin': None,
 'year': 2022}
2026-03-25 18:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982984%27 HTTP/1.1" 200 None
2026-03-25 18:30:48 [ayvens.es] INFO: Saving data for 1982984: {'created_time': 1774463448.256836, 'last_price_update_time': 1774463448.256846, 'auction_closing_time': 1774526400.0}
2026-03-25 18:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1982984') HTTP/1.1" 204 0
2026-03-25 18:30:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e92a3fd8-35e7-5ed2-a98d-fa7b729fc351 with identifier: 1982985
2026-03-25 18:30:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e92a3fd8-35e7-5ed2-a98d-fa7b729fc351 with identifier: 1982985
2026-03-25 18:30:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e92a3fd8-35e7-5ed2-a98d-fa7b729fc351 with identifier: 1982985 to the API
2026-03-25 18:30:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:30:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:30:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/046/61ea20db2f3a4bb2ae8c5eeae4554441/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e92a3fd8-35e7-5ed2-a98d-fa7b729fc351',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q2',
 'odometer': 149237,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e92a3fd8-35e7-5ed2-a98d-fa7b729fc351/e92a3fd8-35e7-5ed2-a98d-fa7b729fc351_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 352161,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/046/61ea20db2f3a4bb2ae8c5eeae4554441/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q2 Advanced 30 TDI 85kW (116CV) S tronic',
 'transmission': 'manual',
 'trim': 'Advanced 30 TDI 85kW (116CV) S tronic',
 'vin': None,
 'year': 2019}
2026-03-25 18:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982985%27 HTTP/1.1" 200 None
2026-03-25 18:30:48 [ayvens.es] INFO: Saving data for 1982985: {'created_time': 1774463448.616872, 'last_price_update_time': 1774463448.616882, 'auction_closing_time': 1774526400.0}
2026-03-25 18:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1982985') HTTP/1.1" 204 0
2026-03-25 18:30:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ad30404f-3c24-56eb-b65d-33190c8df623 with identifier: 1982986
2026-03-25 18:30:48 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:30:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ad30404f-3c24-56eb-b65d-33190c8df623 with identifier: 1982986
2026-03-25 18:30:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ad30404f-3c24-56eb-b65d-33190c8df623 with identifier: 1982986 to the API
2026-03-25 18:30:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:30:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:30:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/563/ad6aee6d5539444a8f5e366bc8ef1f2d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Clear',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'ad30404f-3c24-56eb-b65d-33190c8df623',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'STONIC',
 'odometer': 77444,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad30404f-3c24-56eb-b65d-33190c8df623/ad30404f-3c24-56eb-b65d-33190c8df623_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 519961,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/563/ad6aee6d5539444a8f5e366bc8ef1f2d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA STONIC 1.0 T-GDi 88kW (120CV) MHEV iMT Drive',
 'transmission': 'manual',
 'trim': '1.0 T-GDi 88kW (120CV) MHEV iMT Drive',
 'vin': None,
 'year': 2021}
2026-03-25 18:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982986%27 HTTP/1.1" 200 None
2026-03-25 18:30:48 [ayvens.es] INFO: Saving data for 1982986: {'created_time': 1774463448.939182, 'last_price_update_time': 1774463448.939191, 'auction_closing_time': 1774526400.0}
2026-03-25 18:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1982986') HTTP/1.1" 204 0
2026-03-25 18:30:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/537/0cd0333953ac4827b97fc8ee52dcd103/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:30:48 [ayvens.es] INFO: Found listing with ID: 1982996
2026-03-25 18:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982996%27 HTTP/1.1" 200 None
2026-03-25 18:30:48 [ayvens.es] INFO: Scrape type for 1982996: 1
2026-03-25 18:30:48 [ayvens.es] INFO: Extracting data for car ID: 1982996
2026-03-25 18:30:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3be65617-9b56-5b13-a237-960d66618f08 with identifier: 1982996
2026-03-25 18:30:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3be65617-9b56-5b13-a237-960d66618f08 with scrape type 1
2026-03-25 18:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3be65617-9b56-5b13-a237-960d66618f08
2026-03-25 18:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F144%252Fed5320ce38c240de89f69a4ae4027941%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/144/ed5320ce38c240de89f69a4ae4027941/images/large/1.jpg not downloaded yet
2026-03-25 18:30:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:30:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ee78bd0>
2026-03-25 18:30:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:30:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4c9da13-b96d-5069-8d58-59715cc73163/e4c9da13-b96d-5069-8d58-59715cc73163_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F859%252F818ce67f7b9d470d97692e0ab733ef3c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/859/818ce67f7b9d470d97692e0ab733ef3c/images/large/1.jpg saved to cache
2026-03-25 18:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e4c9da13-b96d-5069-8d58-59715cc73163
2026-03-25 18:30:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e4c9da13-b96d-5069-8d58-59715cc73163, skipping ID generation
2026-03-25 18:30:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4c9da13-b96d-5069-8d58-59715cc73163 with scrape type 1
2026-03-25 18:30:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e4c9da13-b96d-5069-8d58-59715cc73163 sending to next pipeline
2026-03-25 18:30:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e4c9da13-b96d-5069-8d58-59715cc73163, identifier: 1982988
2026-03-25 18:30:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:30:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ee8ca50>
2026-03-25 18:30:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:30:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b09b1976-4b6d-5052-b9ee-d362432fec5d/b09b1976-4b6d-5052-b9ee-d362432fec5d_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F933%252F08c0cccef3424ad7be466f2a4b3a9a03%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/933/08c0cccef3424ad7be466f2a4b3a9a03/images/large/1.jpg saved to cache
2026-03-25 18:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b09b1976-4b6d-5052-b9ee-d362432fec5d
2026-03-25 18:30:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b09b1976-4b6d-5052-b9ee-d362432fec5d, skipping ID generation
2026-03-25 18:30:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b09b1976-4b6d-5052-b9ee-d362432fec5d with scrape type 1
2026-03-25 18:30:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b09b1976-4b6d-5052-b9ee-d362432fec5d sending to next pipeline
2026-03-25 18:30:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b09b1976-4b6d-5052-b9ee-d362432fec5d, identifier: 1982987
2026-03-25 18:30:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/025/5e780ae7ce734efbac271abe2d24a25f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:30:49 [ayvens.es] INFO: Found listing with ID: 1982997
2026-03-25 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982997%27 HTTP/1.1" 200 None
2026-03-25 18:30:49 [ayvens.es] INFO: Scrape type for 1982997: 1
2026-03-25 18:30:49 [ayvens.es] INFO: Extracting data for car ID: 1982997
2026-03-25 18:30:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18689087-3471-5b79-a623-8ad6e541a9bf with identifier: 1982997
2026-03-25 18:30:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18689087-3471-5b79-a623-8ad6e541a9bf with scrape type 1
2026-03-25 18:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 18689087-3471-5b79-a623-8ad6e541a9bf
2026-03-25 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F688%252F03e22a221f83464587936cf8a886e6c3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/688/03e22a221f83464587936cf8a886e6c3/images/large/1.jpg not downloaded yet
2026-03-25 18:30:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e4c9da13-b96d-5069-8d58-59715cc73163 with identifier: 1982988
2026-03-25 18:30:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e4c9da13-b96d-5069-8d58-59715cc73163 with identifier: 1982988
2026-03-25 18:30:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e4c9da13-b96d-5069-8d58-59715cc73163 with identifier: 1982988 to the API
2026-03-25 18:30:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:30:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:30:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/859/818ce67f7b9d470d97692e0ab733ef3c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'e4c9da13-b96d-5069-8d58-59715cc73163',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C4 SPACETOURER',
 'odometer': 137009,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4c9da13-b96d-5069-8d58-59715cc73163/e4c9da13-b96d-5069-8d58-59715cc73163_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353709,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/859/818ce67f7b9d470d97692e0ab733ef3c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C4 SPACETOURER PureTech 96KW (130CV) S&S EAT8 Live',
 'transmission': 'manual',
 'trim': 'PureTech 96KW (130CV) S&S EAT8 Live',
 'vin': None,
 'year': 2020}
2026-03-25 18:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982988%27 HTTP/1.1" 200 None
2026-03-25 18:30:50 [ayvens.es] INFO: Saving data for 1982988: {'created_time': 1774463450.089164, 'last_price_update_time': 1774463450.089176, 'auction_closing_time': 1774526400.0}
2026-03-25 18:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1982988') HTTP/1.1" 204 0
2026-03-25 18:30:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b09b1976-4b6d-5052-b9ee-d362432fec5d with identifier: 1982987
2026-03-25 18:30:50 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:30:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b09b1976-4b6d-5052-b9ee-d362432fec5d with identifier: 1982987
2026-03-25 18:30:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b09b1976-4b6d-5052-b9ee-d362432fec5d with identifier: 1982987 to the API
2026-03-25 18:30:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:30:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:30:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/933/08c0cccef3424ad7be466f2a4b3a9a03/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b09b1976-4b6d-5052-b9ee-d362432fec5d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'CUPRA',
 'model': 'FORMENTOR',
 'odometer': 119941,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b09b1976-4b6d-5052-b9ee-d362432fec5d/b09b1976-4b6d-5052-b9ee-d362432fec5d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 380765,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/933/08c0cccef3424ad7be466f2a4b3a9a03/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CUPRA FORMENTOR 2.0 TDI 110kW (150 CV)',
 'transmission': 'manual',
 'trim': '2.0 TDI 110kW (150 CV)',
 'vin': None,
 'year': 2021}
2026-03-25 18:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982987%27 HTTP/1.1" 200 None
2026-03-25 18:30:50 [ayvens.es] INFO: Saving data for 1982987: {'created_time': 1774463450.545762, 'last_price_update_time': 1774463450.545771, 'auction_closing_time': 1774526400.0}
2026-03-25 18:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1982987') HTTP/1.1" 204 0
2026-03-25 18:30:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/352/5dff84294dc4492fb90de2bb2869f92a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:30:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/682/b1b26f8ef87f469f9e50b385885adcfe/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:30:50 [ayvens.es] INFO: Found listing with ID: 1982998
2026-03-25 18:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982998%27 HTTP/1.1" 200 None
2026-03-25 18:30:50 [ayvens.es] INFO: Scrape type for 1982998: 1
2026-03-25 18:30:50 [ayvens.es] INFO: Extracting data for car ID: 1982998
2026-03-25 18:30:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7522c106-0d87-5384-a203-eb5826a1f258 with identifier: 1982998
2026-03-25 18:30:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7522c106-0d87-5384-a203-eb5826a1f258 with scrape type 1
2026-03-25 18:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7522c106-0d87-5384-a203-eb5826a1f258
2026-03-25 18:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F425%252Fadbb935ba0ca4092acb9b0215301f24b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/425/adbb935ba0ca4092acb9b0215301f24b/images/large/1.jpg not downloaded yet
2026-03-25 18:30:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:30:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ecb4190>
2026-03-25 18:30:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:30:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39586f6e-f767-5847-81a7-5d4afdc2f65c/39586f6e-f767-5847-81a7-5d4afdc2f65c_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F537%252F0cd0333953ac4827b97fc8ee52dcd103%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/537/0cd0333953ac4827b97fc8ee52dcd103/images/large/1.jpg saved to cache
2026-03-25 18:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 39586f6e-f767-5847-81a7-5d4afdc2f65c
2026-03-25 18:30:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 39586f6e-f767-5847-81a7-5d4afdc2f65c, skipping ID generation
2026-03-25 18:30:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39586f6e-f767-5847-81a7-5d4afdc2f65c with scrape type 1
2026-03-25 18:30:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 39586f6e-f767-5847-81a7-5d4afdc2f65c sending to next pipeline
2026-03-25 18:30:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 39586f6e-f767-5847-81a7-5d4afdc2f65c, identifier: 1982989
2026-03-25 18:30:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:30:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ea5a890>
2026-03-25 18:30:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:30:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:30:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63fdba5a-7a61-5ad8-84e1-140d804ccb9c/63fdba5a-7a61-5ad8-84e1-140d804ccb9c_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F025%252F5e780ae7ce734efbac271abe2d24a25f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/025/5e780ae7ce734efbac271abe2d24a25f/images/large/1.jpg saved to cache
2026-03-25 18:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 63fdba5a-7a61-5ad8-84e1-140d804ccb9c
2026-03-25 18:30:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 63fdba5a-7a61-5ad8-84e1-140d804ccb9c, skipping ID generation
2026-03-25 18:30:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63fdba5a-7a61-5ad8-84e1-140d804ccb9c with scrape type 1
2026-03-25 18:30:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 63fdba5a-7a61-5ad8-84e1-140d804ccb9c sending to next pipeline
2026-03-25 18:30:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 63fdba5a-7a61-5ad8-84e1-140d804ccb9c, identifier: 1982990
2026-03-25 18:30:50 [ayvens.es] INFO: Found listing with ID: 1982999
2026-03-25 18:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982999%27 HTTP/1.1" 200 None
2026-03-25 18:30:50 [ayvens.es] INFO: Scrape type for 1982999: 1
2026-03-25 18:30:50 [ayvens.es] INFO: Extracting data for car ID: 1982999
2026-03-25 18:30:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a9eed14-4b96-5856-b561-01e62d6d17fc with identifier: 1982999
2026-03-25 18:30:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a9eed14-4b96-5856-b561-01e62d6d17fc with scrape type 1
2026-03-25 18:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1a9eed14-4b96-5856-b561-01e62d6d17fc
2026-03-25 18:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F684%252F2a39d0affe194076bd4e74ab777074da%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/684/2a39d0affe194076bd4e74ab777074da/images/large/1.jpg not downloaded yet
2026-03-25 18:30:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 39586f6e-f767-5847-81a7-5d4afdc2f65c with identifier: 1982989
2026-03-25 18:30:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 39586f6e-f767-5847-81a7-5d4afdc2f65c with identifier: 1982989
2026-03-25 18:30:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 39586f6e-f767-5847-81a7-5d4afdc2f65c with identifier: 1982989 to the API
2026-03-25 18:30:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:30:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:30:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/537/0cd0333953ac4827b97fc8ee52dcd103/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '39586f6e-f767-5847-81a7-5d4afdc2f65c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 199811,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39586f6e-f767-5847-81a7-5d4afdc2f65c/39586f6e-f767-5847-81a7-5d4afdc2f65c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 327091,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/537/0cd0333953ac4827b97fc8ee52dcd103/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-11',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS Profesional dCi 55 kW (75 CV)',
 'transmission': 'manual',
 'trim': 'Profesional dCi 55 kW (75 CV)',
 'vin': None,
 'year': 2019}
2026-03-25 18:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982989%27 HTTP/1.1" 200 None
2026-03-25 18:30:51 [ayvens.es] INFO: Saving data for 1982989: {'created_time': 1774463451.316772, 'last_price_update_time': 1774463451.316782, 'auction_closing_time': 1774526400.0}
2026-03-25 18:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1982989') HTTP/1.1" 204 0
2026-03-25 18:30:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 63fdba5a-7a61-5ad8-84e1-140d804ccb9c with identifier: 1982990
2026-03-25 18:30:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 63fdba5a-7a61-5ad8-84e1-140d804ccb9c with identifier: 1982990
2026-03-25 18:30:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 63fdba5a-7a61-5ad8-84e1-140d804ccb9c with identifier: 1982990 to the API
2026-03-25 18:30:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:30:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:30:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/025/5e780ae7ce734efbac271abe2d24a25f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 191,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.3L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '63fdba5a-7a61-5ad8-84e1-140d804ccb9c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MASTER',
 'odometer': 231307,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63fdba5a-7a61-5ad8-84e1-140d804ccb9c/63fdba5a-7a61-5ad8-84e1-140d804ccb9c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 511421,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/025/5e780ae7ce734efbac271abe2d24a25f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-11',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT MASTER Furgon T L2H2 3500 Blue dCi 99W (135CV)',
 'transmission': 'manual',
 'trim': 'Furgon T L2H2 3500 Blue dCi 99W (135CV)',
 'vin': None,
 'year': 2019}
2026-03-25 18:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982990%27 HTTP/1.1" 200 None
2026-03-25 18:30:51 [ayvens.es] INFO: Saving data for 1982990: {'created_time': 1774463451.733009, 'last_price_update_time': 1774463451.733019, 'auction_closing_time': 1774526400.0}
2026-03-25 18:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1982990') HTTP/1.1" 204 0
2026-03-25 18:30:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/724/5ebffec740fe4fd3889e3a10cc67ac58/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:30:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/729/91339848793549eb8e8cb18ba70030d3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:30:51 [ayvens.es] INFO: Found listing with ID: 1983000
2026-03-25 18:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983000%27 HTTP/1.1" 200 None
2026-03-25 18:30:51 [ayvens.es] INFO: Scrape type for 1983000: 1
2026-03-25 18:30:51 [ayvens.es] INFO: Extracting data for car ID: 1983000
2026-03-25 18:30:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1188f57-0619-58d5-9017-46141169bc48 with identifier: 1983000
2026-03-25 18:30:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1188f57-0619-58d5-9017-46141169bc48 with scrape type 1
2026-03-25 18:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d1188f57-0619-58d5-9017-46141169bc48
2026-03-25 18:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F532%252F031c845c550d4f1fad028786a22d3b0d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/532/031c845c550d4f1fad028786a22d3b0d/images/large/1.jpg not downloaded yet
2026-03-25 18:30:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:30:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae9cf65990>
2026-03-25 18:30:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:30:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:30:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:30:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6626d391-afbf-5617-ba82-bb4888a8e7d7/6626d391-afbf-5617-ba82-bb4888a8e7d7_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F352%252F5dff84294dc4492fb90de2bb2869f92a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/352/5dff84294dc4492fb90de2bb2869f92a/images/large/1.jpg saved to cache
2026-03-25 18:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6626d391-afbf-5617-ba82-bb4888a8e7d7
2026-03-25 18:30:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6626d391-afbf-5617-ba82-bb4888a8e7d7, skipping ID generation
2026-03-25 18:30:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6626d391-afbf-5617-ba82-bb4888a8e7d7 with scrape type 1
2026-03-25 18:30:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6626d391-afbf-5617-ba82-bb4888a8e7d7 sending to next pipeline
2026-03-25 18:30:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6626d391-afbf-5617-ba82-bb4888a8e7d7, identifier: 1982992
2026-03-25 18:30:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:30:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ea0bf50>
2026-03-25 18:30:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:30:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:30:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:30:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2369b4db-70cd-5be8-95dd-d21e6a3e046d/2369b4db-70cd-5be8-95dd-d21e6a3e046d_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F682%252Fb1b26f8ef87f469f9e50b385885adcfe%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/682/b1b26f8ef87f469f9e50b385885adcfe/images/large/1.jpg saved to cache
2026-03-25 18:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2369b4db-70cd-5be8-95dd-d21e6a3e046d
2026-03-25 18:30:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2369b4db-70cd-5be8-95dd-d21e6a3e046d, skipping ID generation
2026-03-25 18:30:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2369b4db-70cd-5be8-95dd-d21e6a3e046d with scrape type 1
2026-03-25 18:30:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2369b4db-70cd-5be8-95dd-d21e6a3e046d sending to next pipeline
2026-03-25 18:30:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2369b4db-70cd-5be8-95dd-d21e6a3e046d, identifier: 1982991
2026-03-25 18:30:52 [ayvens.es] INFO: Found listing with ID: 1983001
2026-03-25 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983001%27 HTTP/1.1" 200 None
2026-03-25 18:30:52 [ayvens.es] INFO: Scrape type for 1983001: 1
2026-03-25 18:30:52 [ayvens.es] INFO: Extracting data for car ID: 1983001
2026-03-25 18:30:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff25eaed-a37a-57f5-b715-663021df30f2 with identifier: 1983001
2026-03-25 18:30:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff25eaed-a37a-57f5-b715-663021df30f2 with scrape type 1
2026-03-25 18:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ff25eaed-a37a-57f5-b715-663021df30f2
2026-03-25 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F090%252Fe7f3935e7fa34b219f64299a25822471%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/090/e7f3935e7fa34b219f64299a25822471/images/large/1.jpg not downloaded yet
2026-03-25 18:30:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6626d391-afbf-5617-ba82-bb4888a8e7d7 with identifier: 1982992
2026-03-25 18:30:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6626d391-afbf-5617-ba82-bb4888a8e7d7 with identifier: 1982992
2026-03-25 18:30:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 6626d391-afbf-5617-ba82-bb4888a8e7d7 with identifier: 1982992 to the API
2026-03-25 18:30:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:30:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:30:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/352/5dff84294dc4492fb90de2bb2869f92a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '6626d391-afbf-5617-ba82-bb4888a8e7d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'KUGA',
 'odometer': 183456,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6626d391-afbf-5617-ba82-bb4888a8e7d7/6626d391-afbf-5617-ba82-bb4888a8e7d7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 383679,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/352/5dff84294dc4492fb90de2bb2869f92a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD KUGA (O) 2.0 TDCi 110kW 4x2 A-S-S Titanium',
 'transmission': 'manual',
 'trim': '(O) 2.0 TDCi 110kW 4x2 A-S-S Titanium',
 'vin': None,
 'year': 2018}
2026-03-25 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982992%27 HTTP/1.1" 200 None
2026-03-25 18:30:52 [ayvens.es] INFO: Saving data for 1982992: {'created_time': 1774463452.417592, 'last_price_update_time': 1774463452.417602, 'auction_closing_time': 1774526400.0}
2026-03-25 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1982992') HTTP/1.1" 204 0
2026-03-25 18:30:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2369b4db-70cd-5be8-95dd-d21e6a3e046d with identifier: 1982991
2026-03-25 18:30:52 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:30:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2369b4db-70cd-5be8-95dd-d21e6a3e046d with identifier: 1982991
2026-03-25 18:30:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 2369b4db-70cd-5be8-95dd-d21e6a3e046d with identifier: 1982991 to the API
2026-03-25 18:30:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:30:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:30:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/682/b1b26f8ef87f469f9e50b385885adcfe/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 220,
 'color': 'Serie',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '3.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '2369b4db-70cd-5be8-95dd-d21e6a3e046d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER SPORT',
 'odometer': 113373,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2369b4db-70cd-5be8-95dd-d21e6a3e046d/2369b4db-70cd-5be8-95dd-d21e6a3e046d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 375665,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/682/b1b26f8ef87f469f9e50b385885adcfe/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER RANGE ROVER SPORT 3.0D I6 183kW MHEV S AWD Auto.',
 'transmission': 'manual',
 'trim': '3.0D I6 183kW MHEV S AWD Auto.',
 'vin': None,
 'year': 2021}
2026-03-25 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982991%27 HTTP/1.1" 200 None
2026-03-25 18:30:52 [ayvens.es] INFO: Saving data for 1982991: {'created_time': 1774463452.864793, 'last_price_update_time': 1774463452.864804, 'auction_closing_time': 1774526400.0}
2026-03-25 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1982991') HTTP/1.1" 204 0
2026-03-25 18:30:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/950/5a8b8ca056904f94a55db0a264499c05/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:30:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/144/ed5320ce38c240de89f69a4ae4027941/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:30:52 [ayvens.es] INFO: Found listing with ID: 1983002
2026-03-25 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983002%27 HTTP/1.1" 200 None
2026-03-25 18:30:52 [ayvens.es] INFO: Scrape type for 1983002: 1
2026-03-25 18:30:52 [ayvens.es] INFO: Extracting data for car ID: 1983002
2026-03-25 18:30:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f16b1bb-af9b-5e6c-8972-74253a05d42d with identifier: 1983002
2026-03-25 18:30:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f16b1bb-af9b-5e6c-8972-74253a05d42d with scrape type 1
2026-03-25 18:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3f16b1bb-af9b-5e6c-8972-74253a05d42d
2026-03-25 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F499%252F8e68d98a4e554856b8daaa6f9e1aaaba%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/499/8e68d98a4e554856b8daaa6f9e1aaaba/images/large/1.jpg not downloaded yet
2026-03-25 18:30:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:30:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae90f5b790>
2026-03-25 18:30:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:30:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:30:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:30:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8aca777c-5ddd-5076-8a1a-8bd036e55969/8aca777c-5ddd-5076-8a1a-8bd036e55969_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F724%252F5ebffec740fe4fd3889e3a10cc67ac58%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/724/5ebffec740fe4fd3889e3a10cc67ac58/images/large/1.jpg saved to cache
2026-03-25 18:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8aca777c-5ddd-5076-8a1a-8bd036e55969
2026-03-25 18:30:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8aca777c-5ddd-5076-8a1a-8bd036e55969, skipping ID generation
2026-03-25 18:30:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8aca777c-5ddd-5076-8a1a-8bd036e55969 with scrape type 1
2026-03-25 18:30:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8aca777c-5ddd-5076-8a1a-8bd036e55969 sending to next pipeline
2026-03-25 18:30:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8aca777c-5ddd-5076-8a1a-8bd036e55969, identifier: 1982994
2026-03-25 18:30:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:30:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ea07050>
2026-03-25 18:30:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:30:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:30:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:30:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb23bcd2-7819-5c23-81e4-0c08e5b86704/eb23bcd2-7819-5c23-81e4-0c08e5b86704_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F729%252F91339848793549eb8e8cb18ba70030d3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/729/91339848793549eb8e8cb18ba70030d3/images/large/1.jpg saved to cache
2026-03-25 18:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eb23bcd2-7819-5c23-81e4-0c08e5b86704
2026-03-25 18:30:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eb23bcd2-7819-5c23-81e4-0c08e5b86704, skipping ID generation
2026-03-25 18:30:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb23bcd2-7819-5c23-81e4-0c08e5b86704 with scrape type 1
2026-03-25 18:30:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eb23bcd2-7819-5c23-81e4-0c08e5b86704 sending to next pipeline
2026-03-25 18:30:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: eb23bcd2-7819-5c23-81e4-0c08e5b86704, identifier: 1982993
2026-03-25 18:30:53 [ayvens.es] INFO: Found listing with ID: 1983003
2026-03-25 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983003%27 HTTP/1.1" 200 None
2026-03-25 18:30:53 [ayvens.es] INFO: Scrape type for 1983003: 1
2026-03-25 18:30:53 [ayvens.es] INFO: Extracting data for car ID: 1983003
2026-03-25 18:30:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c94ed23-867f-5979-b419-2dee175f6b3e with identifier: 1983003
2026-03-25 18:30:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c94ed23-867f-5979-b419-2dee175f6b3e with scrape type 1
2026-03-25 18:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6c94ed23-867f-5979-b419-2dee175f6b3e
2026-03-25 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F534%252F4faf44a9a4a34f1cb52a918bb3b10ad8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/534/4faf44a9a4a34f1cb52a918bb3b10ad8/images/large/1.jpg not downloaded yet
2026-03-25 18:30:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8aca777c-5ddd-5076-8a1a-8bd036e55969 with identifier: 1982994
2026-03-25 18:30:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8aca777c-5ddd-5076-8a1a-8bd036e55969 with identifier: 1982994
2026-03-25 18:30:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8aca777c-5ddd-5076-8a1a-8bd036e55969 with identifier: 1982994 to the API
2026-03-25 18:30:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:30:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:30:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/724/5ebffec740fe4fd3889e3a10cc67ac58/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '8aca777c-5ddd-5076-8a1a-8bd036e55969',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'BERLINGO',
 'odometer': 274568,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8aca777c-5ddd-5076-8a1a-8bd036e55969/8aca777c-5ddd-5076-8a1a-8bd036e55969_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325782,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/724/5ebffec740fe4fd3889e3a10cc67ac58/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-30',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROËN BERLINGO BlueHDi 55KW (75CV)',
 'transmission': 'manual',
 'trim': 'BlueHDi 55KW (75CV)',
 'vin': None,
 'year': 2018}
2026-03-25 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982994%27 HTTP/1.1" 200 None
2026-03-25 18:30:53 [ayvens.es] INFO: Saving data for 1982994: {'created_time': 1774463453.650608, 'last_price_update_time': 1774463453.65062, 'auction_closing_time': 1774526400.0}
2026-03-25 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1982994') HTTP/1.1" 204 0
2026-03-25 18:30:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: eb23bcd2-7819-5c23-81e4-0c08e5b86704 with identifier: 1982993
2026-03-25 18:30:53 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:30:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: eb23bcd2-7819-5c23-81e4-0c08e5b86704 with identifier: 1982993
2026-03-25 18:30:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: eb23bcd2-7819-5c23-81e4-0c08e5b86704 with identifier: 1982993 to the API
2026-03-25 18:30:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:30:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:30:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/729/91339848793549eb8e8cb18ba70030d3/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'color': 'Plata',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'eb23bcd2-7819-5c23-81e4-0c08e5b86704',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 196879,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb23bcd2-7819-5c23-81e4-0c08e5b86704/eb23bcd2-7819-5c23-81e4-0c08e5b86704_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 345316,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/729/91339848793549eb8e8cb18ba70030d3/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI DIG-T 103kW N-Connecta (sin rueda repu)',
 'transmission': 'manual',
 'trim': 'DIG-T 103kW N-Connecta (sin rueda repu)',
 'vin': None,
 'year': 2021}
2026-03-25 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982993%27 HTTP/1.1" 200 None
2026-03-25 18:30:54 [ayvens.es] INFO: Saving data for 1982993: {'created_time': 1774463454.01247, 'last_price_update_time': 1774463454.012481, 'auction_closing_time': 1774526400.0}
2026-03-25 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1982993') HTTP/1.1" 204 0
2026-03-25 18:30:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/688/03e22a221f83464587936cf8a886e6c3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:30:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/425/adbb935ba0ca4092acb9b0215301f24b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:30:54 [ayvens.es] INFO: Found listing with ID: 1983004
2026-03-25 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983004%27 HTTP/1.1" 200 None
2026-03-25 18:30:54 [ayvens.es] INFO: Scrape type for 1983004: 1
2026-03-25 18:30:54 [ayvens.es] INFO: Extracting data for car ID: 1983004
2026-03-25 18:30:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c6db5af-5c0a-502d-8031-bb61a8b679e1 with identifier: 1983004
2026-03-25 18:30:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c6db5af-5c0a-502d-8031-bb61a8b679e1 with scrape type 1
2026-03-25 18:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7c6db5af-5c0a-502d-8031-bb61a8b679e1
2026-03-25 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F993%252F671fed7e457c471ba762655dd3c591c5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/993/671fed7e457c471ba762655dd3c591c5/images/large/1.jpg not downloaded yet
2026-03-25 18:30:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:30:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ea831d0>
2026-03-25 18:30:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:30:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2abceb7-fb7b-5813-be3b-1e2ac5e14bb6/f2abceb7-fb7b-5813-be3b-1e2ac5e14bb6_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F950%252F5a8b8ca056904f94a55db0a264499c05%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/950/5a8b8ca056904f94a55db0a264499c05/images/large/1.jpg saved to cache
2026-03-25 18:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f2abceb7-fb7b-5813-be3b-1e2ac5e14bb6
2026-03-25 18:30:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f2abceb7-fb7b-5813-be3b-1e2ac5e14bb6, skipping ID generation
2026-03-25 18:30:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2abceb7-fb7b-5813-be3b-1e2ac5e14bb6 with scrape type 1
2026-03-25 18:30:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f2abceb7-fb7b-5813-be3b-1e2ac5e14bb6 sending to next pipeline
2026-03-25 18:30:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f2abceb7-fb7b-5813-be3b-1e2ac5e14bb6, identifier: 1982995
2026-03-25 18:30:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:30:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ea81bd0>
2026-03-25 18:30:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:30:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:30:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3be65617-9b56-5b13-a237-960d66618f08/3be65617-9b56-5b13-a237-960d66618f08_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F144%252Fed5320ce38c240de89f69a4ae4027941%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/144/ed5320ce38c240de89f69a4ae4027941/images/large/1.jpg saved to cache
2026-03-25 18:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3be65617-9b56-5b13-a237-960d66618f08
2026-03-25 18:30:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3be65617-9b56-5b13-a237-960d66618f08, skipping ID generation
2026-03-25 18:30:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3be65617-9b56-5b13-a237-960d66618f08 with scrape type 1
2026-03-25 18:30:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3be65617-9b56-5b13-a237-960d66618f08 sending to next pipeline
2026-03-25 18:30:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3be65617-9b56-5b13-a237-960d66618f08, identifier: 1982996
2026-03-25 18:30:54 [ayvens.es] INFO: Found listing with ID: 1983005
2026-03-25 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983005%27 HTTP/1.1" 200 None
2026-03-25 18:30:54 [ayvens.es] INFO: Scrape type for 1983005: 1
2026-03-25 18:30:54 [ayvens.es] INFO: Extracting data for car ID: 1983005
2026-03-25 18:30:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 087f706b-6654-50f7-8838-005250d7907c with identifier: 1983005
2026-03-25 18:30:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 087f706b-6654-50f7-8838-005250d7907c with scrape type 1
2026-03-25 18:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 087f706b-6654-50f7-8838-005250d7907c
2026-03-25 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F649%252Fd2e8916fc3bb4edf894be280d1b4d3c1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/649/d2e8916fc3bb4edf894be280d1b4d3c1/images/large/1.jpg not downloaded yet
2026-03-25 18:30:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f2abceb7-fb7b-5813-be3b-1e2ac5e14bb6 with identifier: 1982995
2026-03-25 18:30:54 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:30:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f2abceb7-fb7b-5813-be3b-1e2ac5e14bb6 with identifier: 1982995
2026-03-25 18:30:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f2abceb7-fb7b-5813-be3b-1e2ac5e14bb6 with identifier: 1982995 to the API
2026-03-25 18:30:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:30:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:30:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/950/5a8b8ca056904f94a55db0a264499c05/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'color': 'Deluxe',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f2abceb7-fb7b-5813-be3b-1e2ac5e14bb6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'SPORTAGE',
 'odometer': 90752,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2abceb7-fb7b-5813-be3b-1e2ac5e14bb6/f2abceb7-fb7b-5813-be3b-1e2ac5e14bb6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 341088,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/950/5a8b8ca056904f94a55db0a264499c05/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA SPORTAGE 1.6 CRDi 85kW (115CV) Concept 4x2',
 'transmission': 'manual',
 'trim': '1.6 CRDi 85kW (115CV) Concept 4x2',
 'vin': None,
 'year': 2023}
2026-03-25 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982995%27 HTTP/1.1" 200 None
2026-03-25 18:30:54 [ayvens.es] INFO: Saving data for 1982995: {'created_time': 1774463454.787392, 'last_price_update_time': 1774463454.787409, 'auction_closing_time': 1774526400.0}
2026-03-25 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1982995') HTTP/1.1" 204 0
2026-03-25 18:30:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3be65617-9b56-5b13-a237-960d66618f08 with identifier: 1982996
2026-03-25 18:30:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3be65617-9b56-5b13-a237-960d66618f08 with identifier: 1982996
2026-03-25 18:30:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3be65617-9b56-5b13-a237-960d66618f08 with identifier: 1982996 to the API
2026-03-25 18:30:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:30:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:30:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/144/ed5320ce38c240de89f69a4ae4027941/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '3be65617-9b56-5b13-a237-960d66618f08',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'COMBO',
 'odometer': 64199,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3be65617-9b56-5b13-a237-960d66618f08/3be65617-9b56-5b13-a237-960d66618f08_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 346961,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/144/ed5320ce38c240de89f69a4ae4027941/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL COMBO (O) 1.5 TD 75kW (100CV) S/S Edition Plus',
 'transmission': 'manual',
 'trim': '(O) 1.5 TD 75kW (100CV) S/S Edition Plus',
 'vin': None,
 'year': 2022}
2026-03-25 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982996%27 HTTP/1.1" 200 None
2026-03-25 18:30:55 [ayvens.es] INFO: Saving data for 1982996: {'created_time': 1774463455.148705, 'last_price_update_time': 1774463455.148715, 'auction_closing_time': 1774526400.0}
2026-03-25 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1982996') HTTP/1.1" 204 0
2026-03-25 18:30:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/684/2a39d0affe194076bd4e74ab777074da/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:30:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/532/031c845c550d4f1fad028786a22d3b0d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:30:55 [ayvens.es] INFO: Found listing with ID: 1983006
2026-03-25 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983006%27 HTTP/1.1" 200 None
2026-03-25 18:30:55 [ayvens.es] INFO: Scrape type for 1983006: 1
2026-03-25 18:30:55 [ayvens.es] INFO: Extracting data for car ID: 1983006
2026-03-25 18:30:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff585bc6-f345-53a5-b8fe-90866a77408f with identifier: 1983006
2026-03-25 18:30:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff585bc6-f345-53a5-b8fe-90866a77408f with scrape type 1
2026-03-25 18:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ff585bc6-f345-53a5-b8fe-90866a77408f
2026-03-25 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F353%252F8f00399fbf1b4ae496f14f9f78a887ed%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/353/8f00399fbf1b4ae496f14f9f78a887ed/images/large/1.jpg not downloaded yet
2026-03-25 18:30:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:30:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ea59350>
2026-03-25 18:30:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:30:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:30:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:30:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18689087-3471-5b79-a623-8ad6e541a9bf/18689087-3471-5b79-a623-8ad6e541a9bf_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F688%252F03e22a221f83464587936cf8a886e6c3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/688/03e22a221f83464587936cf8a886e6c3/images/large/1.jpg saved to cache
2026-03-25 18:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 18689087-3471-5b79-a623-8ad6e541a9bf
2026-03-25 18:30:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 18689087-3471-5b79-a623-8ad6e541a9bf, skipping ID generation
2026-03-25 18:30:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18689087-3471-5b79-a623-8ad6e541a9bf with scrape type 1
2026-03-25 18:30:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 18689087-3471-5b79-a623-8ad6e541a9bf sending to next pipeline
2026-03-25 18:30:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 18689087-3471-5b79-a623-8ad6e541a9bf, identifier: 1982997
2026-03-25 18:30:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:30:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ecf6290>
2026-03-25 18:30:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:30:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:30:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:30:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7522c106-0d87-5384-a203-eb5826a1f258/7522c106-0d87-5384-a203-eb5826a1f258_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F425%252Fadbb935ba0ca4092acb9b0215301f24b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/425/adbb935ba0ca4092acb9b0215301f24b/images/large/1.jpg saved to cache
2026-03-25 18:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7522c106-0d87-5384-a203-eb5826a1f258
2026-03-25 18:30:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7522c106-0d87-5384-a203-eb5826a1f258, skipping ID generation
2026-03-25 18:30:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7522c106-0d87-5384-a203-eb5826a1f258 with scrape type 1
2026-03-25 18:30:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7522c106-0d87-5384-a203-eb5826a1f258 sending to next pipeline
2026-03-25 18:30:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7522c106-0d87-5384-a203-eb5826a1f258, identifier: 1982998
2026-03-25 18:30:55 [ayvens.es] INFO: Found listing with ID: 1983007
2026-03-25 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983007%27 HTTP/1.1" 200 None
2026-03-25 18:30:55 [ayvens.es] INFO: Scrape type for 1983007: 1
2026-03-25 18:30:55 [ayvens.es] INFO: Extracting data for car ID: 1983007
2026-03-25 18:30:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6355beca-0070-53b0-9807-1002e2a4b157 with identifier: 1983007
2026-03-25 18:30:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6355beca-0070-53b0-9807-1002e2a4b157 with scrape type 1
2026-03-25 18:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6355beca-0070-53b0-9807-1002e2a4b157
2026-03-25 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F127%252F6e9f799383f54f28b4937e9e4eead5b6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/127/6e9f799383f54f28b4937e9e4eead5b6/images/large/1.jpg not downloaded yet
2026-03-25 18:30:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 18689087-3471-5b79-a623-8ad6e541a9bf with identifier: 1982997
2026-03-25 18:30:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 18689087-3471-5b79-a623-8ad6e541a9bf with identifier: 1982997
2026-03-25 18:30:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 18689087-3471-5b79-a623-8ad6e541a9bf with identifier: 1982997 to the API
2026-03-25 18:30:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:30:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:30:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/688/03e22a221f83464587936cf8a886e6c3/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '18689087-3471-5b79-a623-8ad6e541a9bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 174260,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18689087-3471-5b79-a623-8ad6e541a9bf/18689087-3471-5b79-a623-8ad6e541a9bf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 317674,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/688/03e22a221f83464587936cf8a886e6c3/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-29',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS Profesional Blue dCi 70kW (95CV)',
 'transmission': 'manual',
 'trim': 'Profesional Blue dCi 70kW (95CV)',
 'vin': None,
 'year': 2021}
2026-03-25 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982997%27 HTTP/1.1" 200 None
2026-03-25 18:30:55 [ayvens.es] INFO: Saving data for 1982997: {'created_time': 1774463455.939117, 'last_price_update_time': 1774463455.939166, 'auction_closing_time': 1774526400.0}
2026-03-25 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1982997') HTTP/1.1" 204 0
2026-03-25 18:30:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7522c106-0d87-5384-a203-eb5826a1f258 with identifier: 1982998
2026-03-25 18:30:55 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:30:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7522c106-0d87-5384-a203-eb5826a1f258 with identifier: 1982998
2026-03-25 18:30:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7522c106-0d87-5384-a203-eb5826a1f258 with identifier: 1982998 to the API
2026-03-25 18:30:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:30:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:30:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/425/adbb935ba0ca4092acb9b0215301f24b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 146,
 'color': 'Mineral',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '7522c106-0d87-5384-a203-eb5826a1f258',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 122642,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7522c106-0d87-5384-a203-eb5826a1f258/7522c106-0d87-5384-a203-eb5826a1f258_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347442,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/425/adbb935ba0ca4092acb9b0215301f24b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-14',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS (O) Profesional Blue dCi 59 kW (80CV)',
 'transmission': 'manual',
 'trim': '(O) Profesional Blue dCi 59 kW (80CV)',
 'vin': None,
 'year': 2021}
2026-03-25 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982998%27 HTTP/1.1" 200 None
2026-03-25 18:30:56 [ayvens.es] INFO: Saving data for 1982998: {'created_time': 1774463456.353023, 'last_price_update_time': 1774463456.353036, 'auction_closing_time': 1774526400.0}
2026-03-25 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1982998') HTTP/1.1" 204 0
2026-03-25 18:30:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/499/8e68d98a4e554856b8daaa6f9e1aaaba/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:30:56 [ayvens.es] INFO: Found listing with ID: 1983008
2026-03-25 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983008%27 HTTP/1.1" 200 None
2026-03-25 18:30:56 [ayvens.es] INFO: Scrape type for 1983008: 1
2026-03-25 18:30:56 [ayvens.es] INFO: Extracting data for car ID: 1983008
2026-03-25 18:30:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41352a9d-ca52-5ccf-9dbe-a7de1eb6713f with identifier: 1983008
2026-03-25 18:30:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41352a9d-ca52-5ccf-9dbe-a7de1eb6713f with scrape type 1
2026-03-25 18:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 41352a9d-ca52-5ccf-9dbe-a7de1eb6713f
2026-03-25 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F293%252F4e75adafe1d44b62b64d98f7026b45cb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/293/4e75adafe1d44b62b64d98f7026b45cb/images/large/1.jpg not downloaded yet
2026-03-25 18:30:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:30:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ecb75d0>
2026-03-25 18:30:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:30:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:30:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:30:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a9eed14-4b96-5856-b561-01e62d6d17fc/1a9eed14-4b96-5856-b561-01e62d6d17fc_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F684%252F2a39d0affe194076bd4e74ab777074da%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/684/2a39d0affe194076bd4e74ab777074da/images/large/1.jpg saved to cache
2026-03-25 18:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1a9eed14-4b96-5856-b561-01e62d6d17fc
2026-03-25 18:30:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1a9eed14-4b96-5856-b561-01e62d6d17fc, skipping ID generation
2026-03-25 18:30:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a9eed14-4b96-5856-b561-01e62d6d17fc with scrape type 1
2026-03-25 18:30:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1a9eed14-4b96-5856-b561-01e62d6d17fc sending to next pipeline
2026-03-25 18:30:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1a9eed14-4b96-5856-b561-01e62d6d17fc, identifier: 1982999
2026-03-25 18:30:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:30:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ee5ab50>
2026-03-25 18:30:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:30:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:30:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:30:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1188f57-0619-58d5-9017-46141169bc48/d1188f57-0619-58d5-9017-46141169bc48_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F532%252F031c845c550d4f1fad028786a22d3b0d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/532/031c845c550d4f1fad028786a22d3b0d/images/large/1.jpg saved to cache
2026-03-25 18:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d1188f57-0619-58d5-9017-46141169bc48
2026-03-25 18:30:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d1188f57-0619-58d5-9017-46141169bc48, skipping ID generation
2026-03-25 18:30:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1188f57-0619-58d5-9017-46141169bc48 with scrape type 1
2026-03-25 18:30:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d1188f57-0619-58d5-9017-46141169bc48 sending to next pipeline
2026-03-25 18:30:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d1188f57-0619-58d5-9017-46141169bc48, identifier: 1983000
2026-03-25 18:30:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/090/e7f3935e7fa34b219f64299a25822471/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:30:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1a9eed14-4b96-5856-b561-01e62d6d17fc with identifier: 1982999
2026-03-25 18:30:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1a9eed14-4b96-5856-b561-01e62d6d17fc with identifier: 1982999
2026-03-25 18:30:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1a9eed14-4b96-5856-b561-01e62d6d17fc with identifier: 1982999 to the API
2026-03-25 18:30:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:30:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:30:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/684/2a39d0affe194076bd4e74ab777074da/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 201,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.3L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '1a9eed14-4b96-5856-b561-01e62d6d17fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'NV400',
 'odometer': 93559,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a9eed14-4b96-5856-b561-01e62d6d17fc/1a9eed14-4b96-5856-b561-01e62d6d17fc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 298957,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/684/2a39d0affe194076bd4e74ab777074da/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-14',
 'seats_number': 3,
 'seller_name': None,
 'title': 'NISSAN NV400 L2H2 3,5T 2.3dCi 99kW FWD Optima',
 'transmission': 'manual',
 'trim': 'L2H2 3,5T 2.3dCi 99kW FWD Optima',
 'vin': None,
 'year': 2020}
2026-03-25 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271982999%27 HTTP/1.1" 200 None
2026-03-25 18:30:57 [ayvens.es] INFO: Saving data for 1982999: {'created_time': 1774463457.159679, 'last_price_update_time': 1774463457.15969, 'auction_closing_time': 1774526400.0}
2026-03-25 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1982999') HTTP/1.1" 204 0
2026-03-25 18:30:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d1188f57-0619-58d5-9017-46141169bc48 with identifier: 1983000
2026-03-25 18:30:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d1188f57-0619-58d5-9017-46141169bc48 with identifier: 1983000
2026-03-25 18:30:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d1188f57-0619-58d5-9017-46141169bc48 with identifier: 1983000 to the API
2026-03-25 18:30:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:30:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:30:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/532/031c845c550d4f1fad028786a22d3b0d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd1188f57-0619-58d5-9017-46141169bc48',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'COMBO',
 'odometer': 109460,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1188f57-0619-58d5-9017-46141169bc48/d1188f57-0619-58d5-9017-46141169bc48_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329440,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/532/031c845c550d4f1fad028786a22d3b0d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL COMBO 1.5 TD 75kW (100CV) S/S Expression L',
 'transmission': 'manual',
 'trim': '1.5 TD 75kW (100CV) S/S Expression L',
 'vin': None,
 'year': 2020}
2026-03-25 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983000%27 HTTP/1.1" 200 None
2026-03-25 18:30:57 [ayvens.es] INFO: Saving data for 1983000: {'created_time': 1774463457.469877, 'last_price_update_time': 1774463457.469887, 'auction_closing_time': 1774526400.0}
2026-03-25 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983000') HTTP/1.1" 204 0
2026-03-25 18:30:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/534/4faf44a9a4a34f1cb52a918bb3b10ad8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:30:57 [ayvens.es] INFO: Found listing with ID: 1983009
2026-03-25 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983009%27 HTTP/1.1" 200 None
2026-03-25 18:30:57 [ayvens.es] INFO: Scrape type for 1983009: 1
2026-03-25 18:30:57 [ayvens.es] INFO: Extracting data for car ID: 1983009
2026-03-25 18:30:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ebe944e-ee11-59b1-b378-5f07ba95215c with identifier: 1983009
2026-03-25 18:30:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ebe944e-ee11-59b1-b378-5f07ba95215c with scrape type 1
2026-03-25 18:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4ebe944e-ee11-59b1-b378-5f07ba95215c
2026-03-25 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F051%252F571458cba11c48f4b1fc4802208a392a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/051/571458cba11c48f4b1fc4802208a392a/images/large/1.jpg not downloaded yet
2026-03-25 18:30:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:30:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8eca4cd0>
2026-03-25 18:30:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:30:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:30:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:30:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f16b1bb-af9b-5e6c-8972-74253a05d42d/3f16b1bb-af9b-5e6c-8972-74253a05d42d_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F499%252F8e68d98a4e554856b8daaa6f9e1aaaba%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/499/8e68d98a4e554856b8daaa6f9e1aaaba/images/large/1.jpg saved to cache
2026-03-25 18:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3f16b1bb-af9b-5e6c-8972-74253a05d42d
2026-03-25 18:30:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3f16b1bb-af9b-5e6c-8972-74253a05d42d, skipping ID generation
2026-03-25 18:30:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f16b1bb-af9b-5e6c-8972-74253a05d42d with scrape type 1
2026-03-25 18:30:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3f16b1bb-af9b-5e6c-8972-74253a05d42d sending to next pipeline
2026-03-25 18:30:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3f16b1bb-af9b-5e6c-8972-74253a05d42d, identifier: 1983002
2026-03-25 18:30:57 [ayvens.es] INFO: Found listing with ID: 1983010
2026-03-25 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983010%27 HTTP/1.1" 200 None
2026-03-25 18:30:57 [ayvens.es] INFO: Scrape type for 1983010: 1
2026-03-25 18:30:57 [ayvens.es] INFO: Extracting data for car ID: 1983010
2026-03-25 18:30:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 415e744b-0e9c-5edd-b725-93d756b102d4 with identifier: 1983010
2026-03-25 18:30:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 415e744b-0e9c-5edd-b725-93d756b102d4 with scrape type 1
2026-03-25 18:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 415e744b-0e9c-5edd-b725-93d756b102d4
2026-03-25 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F155%252Fa824f6335c26443b86ee38180a4ccfc1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/155/a824f6335c26443b86ee38180a4ccfc1/images/large/1.jpg not downloaded yet
2026-03-25 18:30:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3f16b1bb-af9b-5e6c-8972-74253a05d42d with identifier: 1983002
2026-03-25 18:30:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:30:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3f16b1bb-af9b-5e6c-8972-74253a05d42d with identifier: 1983002
2026-03-25 18:30:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3f16b1bb-af9b-5e6c-8972-74253a05d42d with identifier: 1983002 to the API
2026-03-25 18:30:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:30:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:30:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/499/8e68d98a4e554856b8daaa6f9e1aaaba/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '3f16b1bb-af9b-5e6c-8972-74253a05d42d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'RAPID',
 'odometer': 168025,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f16b1bb-af9b-5e6c-8972-74253a05d42d/3f16b1bb-af9b-5e6c-8972-74253a05d42d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 369629,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/499/8e68d98a4e554856b8daaa6f9e1aaaba/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA RAPID 1.6 TDI CR 85KW (115cv) Style Spaceback',
 'transmission': 'manual',
 'trim': '1.6 TDI CR 85KW (115cv) Style Spaceback',
 'vin': None,
 'year': 2019}
2026-03-25 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983002%27 HTTP/1.1" 200 None
2026-03-25 18:30:58 [ayvens.es] INFO: Saving data for 1983002: {'created_time': 1774463458.009886, 'last_price_update_time': 1774463458.009898, 'auction_closing_time': 1774526400.0}
2026-03-25 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983002') HTTP/1.1" 204 0
2026-03-25 18:30:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:30:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e58dad0>
2026-03-25 18:30:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:30:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:30:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:30:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff25eaed-a37a-57f5-b715-663021df30f2/ff25eaed-a37a-57f5-b715-663021df30f2_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F090%252Fe7f3935e7fa34b219f64299a25822471%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/090/e7f3935e7fa34b219f64299a25822471/images/large/1.jpg saved to cache
2026-03-25 18:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ff25eaed-a37a-57f5-b715-663021df30f2
2026-03-25 18:30:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ff25eaed-a37a-57f5-b715-663021df30f2, skipping ID generation
2026-03-25 18:30:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff25eaed-a37a-57f5-b715-663021df30f2 with scrape type 1
2026-03-25 18:30:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ff25eaed-a37a-57f5-b715-663021df30f2 sending to next pipeline
2026-03-25 18:30:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ff25eaed-a37a-57f5-b715-663021df30f2, identifier: 1983001
2026-03-25 18:30:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/993/671fed7e457c471ba762655dd3c591c5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:30:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/353/8f00399fbf1b4ae496f14f9f78a887ed/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:30:58 [ayvens.es] INFO: Found listing with ID: 1983011
2026-03-25 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983011%27 HTTP/1.1" 200 None
2026-03-25 18:30:58 [ayvens.es] INFO: Scrape type for 1983011: 1
2026-03-25 18:30:58 [ayvens.es] INFO: Extracting data for car ID: 1983011
2026-03-25 18:30:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e0c8721-9d4b-51f4-ab4d-6f9d2b98ddc9 with identifier: 1983011
2026-03-25 18:30:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e0c8721-9d4b-51f4-ab4d-6f9d2b98ddc9 with scrape type 1
2026-03-25 18:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4e0c8721-9d4b-51f4-ab4d-6f9d2b98ddc9
2026-03-25 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F552%252Ff281129bd9154f6a950f4eb980f28ec7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/552/f281129bd9154f6a950f4eb980f28ec7/images/large/1.jpg not downloaded yet
2026-03-25 18:30:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ff25eaed-a37a-57f5-b715-663021df30f2 with identifier: 1983001
2026-03-25 18:30:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ff25eaed-a37a-57f5-b715-663021df30f2 with identifier: 1983001
2026-03-25 18:30:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ff25eaed-a37a-57f5-b715-663021df30f2 with identifier: 1983001 to the API
2026-03-25 18:30:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:30:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:30:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/090/e7f3935e7fa34b219f64299a25822471/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ff25eaed-a37a-57f5-b715-663021df30f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'EXPERT',
 'odometer': 137153,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff25eaed-a37a-57f5-b715-663021df30f2/ff25eaed-a37a-57f5-b715-663021df30f2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 448696,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/090/e7f3935e7fa34b219f64299a25822471/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-11',
 'seats_number': 2,
 'seller_name': None,
 'title': 'PEUGEOT EXPERT (O) Furgon Pro 2.0 BlueHDi 90KW (120CV)',
 'transmission': 'manual',
 'trim': '(O) Furgon Pro 2.0 BlueHDi 90KW (120CV)',
 'vin': None,
 'year': 2019}
2026-03-25 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983001%27 HTTP/1.1" 200 None
2026-03-25 18:30:58 [ayvens.es] INFO: Saving data for 1983001: {'created_time': 1774463458.589271, 'last_price_update_time': 1774463458.589281, 'auction_closing_time': 1774526400.0}
2026-03-25 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983001') HTTP/1.1" 204 0
2026-03-25 18:30:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/649/d2e8916fc3bb4edf894be280d1b4d3c1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:30:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:30:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ee8d550>
2026-03-25 18:30:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:30:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:30:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:30:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c94ed23-867f-5979-b419-2dee175f6b3e/6c94ed23-867f-5979-b419-2dee175f6b3e_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F534%252F4faf44a9a4a34f1cb52a918bb3b10ad8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/534/4faf44a9a4a34f1cb52a918bb3b10ad8/images/large/1.jpg saved to cache
2026-03-25 18:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6c94ed23-867f-5979-b419-2dee175f6b3e
2026-03-25 18:30:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6c94ed23-867f-5979-b419-2dee175f6b3e, skipping ID generation
2026-03-25 18:30:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c94ed23-867f-5979-b419-2dee175f6b3e with scrape type 1
2026-03-25 18:30:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6c94ed23-867f-5979-b419-2dee175f6b3e sending to next pipeline
2026-03-25 18:30:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6c94ed23-867f-5979-b419-2dee175f6b3e, identifier: 1983003
2026-03-25 18:30:58 [ayvens.es] INFO: Found listing with ID: 1983012
2026-03-25 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983012%27 HTTP/1.1" 200 None
2026-03-25 18:30:58 [ayvens.es] INFO: Scrape type for 1983012: 1
2026-03-25 18:30:58 [ayvens.es] INFO: Extracting data for car ID: 1983012
2026-03-25 18:30:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35b759db-ba34-5ffc-988f-7d84538f70e6 with identifier: 1983012
2026-03-25 18:30:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35b759db-ba34-5ffc-988f-7d84538f70e6 with scrape type 1
2026-03-25 18:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 35b759db-ba34-5ffc-988f-7d84538f70e6
2026-03-25 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F100%252F80047bb7d7b3465093c6746368a995c9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/100/80047bb7d7b3465093c6746368a995c9/images/large/1.jpg not downloaded yet
2026-03-25 18:30:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6c94ed23-867f-5979-b419-2dee175f6b3e with identifier: 1983003
2026-03-25 18:30:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6c94ed23-867f-5979-b419-2dee175f6b3e with identifier: 1983003
2026-03-25 18:30:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 6c94ed23-867f-5979-b419-2dee175f6b3e with identifier: 1983003 to the API
2026-03-25 18:30:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:30:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:30:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/534/4faf44a9a4a34f1cb52a918bb3b10ad8/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Blanco s',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '6c94ed23-867f-5979-b419-2dee175f6b3e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT COURIER',
 'odometer': 76376,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c94ed23-867f-5979-b419-2dee175f6b3e/6c94ed23-867f-5979-b419-2dee175f6b3e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258953,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/534/4faf44a9a4a34f1cb52a918bb3b10ad8/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-18',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FORD TRANSIT COURIER Van 1.5 TDCi 56kW Trend',
 'transmission': 'manual',
 'trim': 'Van 1.5 TDCi 56kW Trend',
 'vin': None,
 'year': 2021}
2026-03-25 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983003%27 HTTP/1.1" 200 None
2026-03-25 18:30:59 [ayvens.es] INFO: Saving data for 1983003: {'created_time': 1774463459.086542, 'last_price_update_time': 1774463459.086554, 'auction_closing_time': 1774526400.0}
2026-03-25 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983003') HTTP/1.1" 204 0
2026-03-25 18:30:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:30:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ee8dd50>
2026-03-25 18:30:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:30:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:30:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:30:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c6db5af-5c0a-502d-8031-bb61a8b679e1/7c6db5af-5c0a-502d-8031-bb61a8b679e1_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F993%252F671fed7e457c471ba762655dd3c591c5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/993/671fed7e457c471ba762655dd3c591c5/images/large/1.jpg saved to cache
2026-03-25 18:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7c6db5af-5c0a-502d-8031-bb61a8b679e1
2026-03-25 18:30:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7c6db5af-5c0a-502d-8031-bb61a8b679e1, skipping ID generation
2026-03-25 18:30:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c6db5af-5c0a-502d-8031-bb61a8b679e1 with scrape type 1
2026-03-25 18:30:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7c6db5af-5c0a-502d-8031-bb61a8b679e1 sending to next pipeline
2026-03-25 18:30:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7c6db5af-5c0a-502d-8031-bb61a8b679e1, identifier: 1983004
2026-03-25 18:30:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:30:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8eab49d0>
2026-03-25 18:30:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:30:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:30:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:30:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff585bc6-f345-53a5-b8fe-90866a77408f/ff585bc6-f345-53a5-b8fe-90866a77408f_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F353%252F8f00399fbf1b4ae496f14f9f78a887ed%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/353/8f00399fbf1b4ae496f14f9f78a887ed/images/large/1.jpg saved to cache
2026-03-25 18:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ff585bc6-f345-53a5-b8fe-90866a77408f
2026-03-25 18:30:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ff585bc6-f345-53a5-b8fe-90866a77408f, skipping ID generation
2026-03-25 18:30:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff585bc6-f345-53a5-b8fe-90866a77408f with scrape type 1
2026-03-25 18:30:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ff585bc6-f345-53a5-b8fe-90866a77408f sending to next pipeline
2026-03-25 18:30:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ff585bc6-f345-53a5-b8fe-90866a77408f, identifier: 1983006
2026-03-25 18:30:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/127/6e9f799383f54f28b4937e9e4eead5b6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:30:59 [ayvens.es] INFO: Found listing with ID: 1983013
2026-03-25 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983013%27 HTTP/1.1" 200 None
2026-03-25 18:30:59 [ayvens.es] INFO: Scrape type for 1983013: 1
2026-03-25 18:30:59 [ayvens.es] INFO: Extracting data for car ID: 1983013
2026-03-25 18:30:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6788bec7-9f39-5e08-bbd8-ce53575c5383 with identifier: 1983013
2026-03-25 18:30:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6788bec7-9f39-5e08-bbd8-ce53575c5383 with scrape type 1
2026-03-25 18:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6788bec7-9f39-5e08-bbd8-ce53575c5383
2026-03-25 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F757%252F263d2bccaeb64038b2c6e7f6023d7e65%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/757/263d2bccaeb64038b2c6e7f6023d7e65/images/large/1.jpg not downloaded yet
2026-03-25 18:30:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7c6db5af-5c0a-502d-8031-bb61a8b679e1 with identifier: 1983004
2026-03-25 18:30:59 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:30:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7c6db5af-5c0a-502d-8031-bb61a8b679e1 with identifier: 1983004
2026-03-25 18:30:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7c6db5af-5c0a-502d-8031-bb61a8b679e1 with identifier: 1983004 to the API
2026-03-25 18:30:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:30:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:30:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/993/671fed7e457c471ba762655dd3c591c5/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'color': 'Blanco candy s',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '7c6db5af-5c0a-502d-8031-bb61a8b679e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CADDY',
 'odometer': 171546,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c6db5af-5c0a-502d-8031-bb61a8b679e1/7c6db5af-5c0a-502d-8031-bb61a8b679e1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 513348,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/993/671fed7e457c471ba762655dd3c591c5/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-25',
 'seats_number': 2,
 'seller_name': None,
 'title': 'VOLKSWAGEN CADDY Profesional Maxi Furgon 2.0 TDI 75kW BMT',
 'transmission': 'manual',
 'trim': 'Profesional Maxi Furgon 2.0 TDI 75kW BMT',
 'vin': None,
 'year': 2020}
2026-03-25 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983004%27 HTTP/1.1" 200 None
2026-03-25 18:30:59 [ayvens.es] INFO: Saving data for 1983004: {'created_time': 1774463459.929948, 'last_price_update_time': 1774463459.929962, 'auction_closing_time': 1774526400.0}
2026-03-25 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983004') HTTP/1.1" 204 0
2026-03-25 18:30:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ff585bc6-f345-53a5-b8fe-90866a77408f with identifier: 1983006
2026-03-25 18:30:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ff585bc6-f345-53a5-b8fe-90866a77408f with identifier: 1983006
2026-03-25 18:31:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ff585bc6-f345-53a5-b8fe-90866a77408f with identifier: 1983006 to the API
2026-03-25 18:31:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/353/8f00399fbf1b4ae496f14f9f78a887ed/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 184,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ff585bc6-f345-53a5-b8fe-90866a77408f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CRAFTER',
 'odometer': 156119,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff585bc6-f345-53a5-b8fe-90866a77408f/ff585bc6-f345-53a5-b8fe-90866a77408f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 323498,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/353/8f00399fbf1b4ae496f14f9f78a887ed/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-16',
 'seats_number': 3,
 'seller_name': None,
 'title': 'VOLKSWAGEN CRAFTER 35 Chasis CS BL 2.0 TDI 103kW (140CV)',
 'transmission': 'manual',
 'trim': '35 Chasis CS BL 2.0 TDI 103kW (140CV)',
 'vin': None,
 'year': 2018}
2026-03-25 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983006%27 HTTP/1.1" 200 None
2026-03-25 18:31:00 [ayvens.es] INFO: Saving data for 1983006: {'created_time': 1774463460.28447, 'last_price_update_time': 1774463460.284482, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983006') HTTP/1.1" 204 0
2026-03-25 18:31:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ec45d10>
2026-03-25 18:31:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_087f706b-6654-50f7-8838-005250d7907c/087f706b-6654-50f7-8838-005250d7907c_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F649%252Fd2e8916fc3bb4edf894be280d1b4d3c1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/649/d2e8916fc3bb4edf894be280d1b4d3c1/images/large/1.jpg saved to cache
2026-03-25 18:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 087f706b-6654-50f7-8838-005250d7907c
2026-03-25 18:31:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 087f706b-6654-50f7-8838-005250d7907c, skipping ID generation
2026-03-25 18:31:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 087f706b-6654-50f7-8838-005250d7907c with scrape type 1
2026-03-25 18:31:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 087f706b-6654-50f7-8838-005250d7907c sending to next pipeline
2026-03-25 18:31:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 087f706b-6654-50f7-8838-005250d7907c, identifier: 1983005
2026-03-25 18:31:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 087f706b-6654-50f7-8838-005250d7907c with identifier: 1983005
2026-03-25 18:31:00 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:31:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 087f706b-6654-50f7-8838-005250d7907c with identifier: 1983005
2026-03-25 18:31:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 087f706b-6654-50f7-8838-005250d7907c with identifier: 1983005 to the API
2026-03-25 18:31:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/649/d2e8916fc3bb4edf894be280d1b4d3c1/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'Gris monta',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '087f706b-6654-50f7-8838-005250d7907c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS',
 'odometer': 183516,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_087f706b-6654-50f7-8838-005250d7907c/087f706b-6654-50f7-8838-005250d7907c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347371,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/649/d2e8916fc3bb4edf894be280d1b4d3c1/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS A 180 d',
 'transmission': 'manual',
 'trim': 'A 180 d',
 'vin': None,
 'year': 2019}
2026-03-25 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983005%27 HTTP/1.1" 200 None
2026-03-25 18:31:00 [ayvens.es] INFO: Saving data for 1983005: {'created_time': 1774463460.748698, 'last_price_update_time': 1774463460.748711, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983005') HTTP/1.1" 204 0
2026-03-25 18:31:00 [ayvens.es] INFO: Found listing with ID: 1983014
2026-03-25 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983014%27 HTTP/1.1" 200 None
2026-03-25 18:31:00 [ayvens.es] INFO: Scrape type for 1983014: 1
2026-03-25 18:31:00 [ayvens.es] INFO: Extracting data for car ID: 1983014
2026-03-25 18:31:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ee87a62-3325-533f-88bf-2b43994a0974 with identifier: 1983014
2026-03-25 18:31:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ee87a62-3325-533f-88bf-2b43994a0974 with scrape type 1
2026-03-25 18:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7ee87a62-3325-533f-88bf-2b43994a0974
2026-03-25 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F511%252F993737e083784a7790fd8a1fa11df596%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/511/993737e083784a7790fd8a1fa11df596/images/large/1.jpg not downloaded yet
2026-03-25 18:31:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/051/571458cba11c48f4b1fc4802208a392a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ea6dcd0>
2026-03-25 18:31:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6355beca-0070-53b0-9807-1002e2a4b157/6355beca-0070-53b0-9807-1002e2a4b157_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F127%252F6e9f799383f54f28b4937e9e4eead5b6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/127/6e9f799383f54f28b4937e9e4eead5b6/images/large/1.jpg saved to cache
2026-03-25 18:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6355beca-0070-53b0-9807-1002e2a4b157
2026-03-25 18:31:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6355beca-0070-53b0-9807-1002e2a4b157, skipping ID generation
2026-03-25 18:31:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6355beca-0070-53b0-9807-1002e2a4b157 with scrape type 1
2026-03-25 18:31:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6355beca-0070-53b0-9807-1002e2a4b157 sending to next pipeline
2026-03-25 18:31:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6355beca-0070-53b0-9807-1002e2a4b157, identifier: 1983007
2026-03-25 18:31:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/293/4e75adafe1d44b62b64d98f7026b45cb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:00 [ayvens.es] INFO: Found listing with ID: 1983015
2026-03-25 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983015%27 HTTP/1.1" 200 None
2026-03-25 18:31:01 [ayvens.es] INFO: Scrape type for 1983015: 1
2026-03-25 18:31:01 [ayvens.es] INFO: Extracting data for car ID: 1983015
2026-03-25 18:31:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a363f2b-bb22-52e8-a028-fb5fc1a4fdab with identifier: 1983015
2026-03-25 18:31:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a363f2b-bb22-52e8-a028-fb5fc1a4fdab with scrape type 1
2026-03-25 18:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2a363f2b-bb22-52e8-a028-fb5fc1a4fdab
2026-03-25 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F258%252F1e388d51322e48ff8193984bd11a7a19%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/258/1e388d51322e48ff8193984bd11a7a19/images/large/1.jpg not downloaded yet
2026-03-25 18:31:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6355beca-0070-53b0-9807-1002e2a4b157 with identifier: 1983007
2026-03-25 18:31:01 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:31:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6355beca-0070-53b0-9807-1002e2a4b157 with identifier: 1983007
2026-03-25 18:31:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 6355beca-0070-53b0-9807-1002e2a4b157 with identifier: 1983007 to the API
2026-03-25 18:31:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/127/6e9f799383f54f28b4937e9e4eead5b6/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Blanco banquise',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '6355beca-0070-53b0-9807-1002e2a4b157',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '308',
 'odometer': 133654,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6355beca-0070-53b0-9807-1002e2a4b157/6355beca-0070-53b0-9807-1002e2a4b157_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340483,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/127/6e9f799383f54f28b4937e9e4eead5b6/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 308 SW Style BlueHDi 130 S&S',
 'transmission': 'manual',
 'trim': 'SW Style BlueHDi 130 S&S',
 'vin': None,
 'year': 2021}
2026-03-25 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983007%27 HTTP/1.1" 200 None
2026-03-25 18:31:01 [ayvens.es] INFO: Saving data for 1983007: {'created_time': 1774463461.306559, 'last_price_update_time': 1774463461.306571, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983007') HTTP/1.1" 204 0
2026-03-25 18:31:01 [ayvens.es] INFO: Found listing with ID: 1983016
2026-03-25 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983016%27 HTTP/1.1" 200 None
2026-03-25 18:31:01 [ayvens.es] INFO: Scrape type for 1983016: 1
2026-03-25 18:31:01 [ayvens.es] INFO: Extracting data for car ID: 1983016
2026-03-25 18:31:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13d6dad1-92cd-588c-9303-058cd344242d with identifier: 1983016
2026-03-25 18:31:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13d6dad1-92cd-588c-9303-058cd344242d with scrape type 1
2026-03-25 18:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 13d6dad1-92cd-588c-9303-058cd344242d
2026-03-25 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F511%252F4b28b351479146fea92c11a1b1a206d0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/511/4b28b351479146fea92c11a1b1a206d0/images/large/1.jpg not downloaded yet
2026-03-25 18:31:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/552/f281129bd9154f6a950f4eb980f28ec7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ed35250>
2026-03-25 18:31:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ebe944e-ee11-59b1-b378-5f07ba95215c/4ebe944e-ee11-59b1-b378-5f07ba95215c_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F051%252F571458cba11c48f4b1fc4802208a392a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/051/571458cba11c48f4b1fc4802208a392a/images/large/1.jpg saved to cache
2026-03-25 18:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4ebe944e-ee11-59b1-b378-5f07ba95215c
2026-03-25 18:31:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4ebe944e-ee11-59b1-b378-5f07ba95215c, skipping ID generation
2026-03-25 18:31:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ebe944e-ee11-59b1-b378-5f07ba95215c with scrape type 1
2026-03-25 18:31:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4ebe944e-ee11-59b1-b378-5f07ba95215c sending to next pipeline
2026-03-25 18:31:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4ebe944e-ee11-59b1-b378-5f07ba95215c, identifier: 1983009
2026-03-25 18:31:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ecf5150>
2026-03-25 18:31:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41352a9d-ca52-5ccf-9dbe-a7de1eb6713f/41352a9d-ca52-5ccf-9dbe-a7de1eb6713f_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F293%252F4e75adafe1d44b62b64d98f7026b45cb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/293/4e75adafe1d44b62b64d98f7026b45cb/images/large/1.jpg saved to cache
2026-03-25 18:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 41352a9d-ca52-5ccf-9dbe-a7de1eb6713f
2026-03-25 18:31:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 41352a9d-ca52-5ccf-9dbe-a7de1eb6713f, skipping ID generation
2026-03-25 18:31:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41352a9d-ca52-5ccf-9dbe-a7de1eb6713f with scrape type 1
2026-03-25 18:31:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 41352a9d-ca52-5ccf-9dbe-a7de1eb6713f sending to next pipeline
2026-03-25 18:31:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 41352a9d-ca52-5ccf-9dbe-a7de1eb6713f, identifier: 1983008
2026-03-25 18:31:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/155/a824f6335c26443b86ee38180a4ccfc1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:01 [ayvens.es] INFO: Found listing with ID: 1983017
2026-03-25 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983017%27 HTTP/1.1" 200 None
2026-03-25 18:31:01 [ayvens.es] INFO: Scrape type for 1983017: 1
2026-03-25 18:31:01 [ayvens.es] INFO: Extracting data for car ID: 1983017
2026-03-25 18:31:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d5b7422-53f8-5a18-8074-b88e9a465f74 with identifier: 1983017
2026-03-25 18:31:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d5b7422-53f8-5a18-8074-b88e9a465f74 with scrape type 1
2026-03-25 18:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9d5b7422-53f8-5a18-8074-b88e9a465f74
2026-03-25 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F870%252F84951d68a2344a1183a293fc3e6cea02%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/870/84951d68a2344a1183a293fc3e6cea02/images/large/1.jpg not downloaded yet
2026-03-25 18:31:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4ebe944e-ee11-59b1-b378-5f07ba95215c with identifier: 1983009
2026-03-25 18:31:01 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:31:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4ebe944e-ee11-59b1-b378-5f07ba95215c with identifier: 1983009
2026-03-25 18:31:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 4ebe944e-ee11-59b1-b378-5f07ba95215c with identifier: 1983009 to the API
2026-03-25 18:31:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/051/571458cba11c48f4b1fc4802208a392a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Gris magnetic',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '4ebe944e-ee11-59b1-b378-5f07ba95215c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'KUGA',
 'odometer': 80487,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ebe944e-ee11-59b1-b378-5f07ba95215c/4ebe944e-ee11-59b1-b378-5f07ba95215c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330864,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/051/571458cba11c48f4b1fc4802208a392a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD KUGA (O) ST-Line 1.5 EcoBlue 88kW (120CV)',
 'transmission': 'manual',
 'trim': '(O) ST-Line 1.5 EcoBlue 88kW (120CV)',
 'vin': None,
 'year': 2022}
2026-03-25 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983009%27 HTTP/1.1" 200 None
2026-03-25 18:31:02 [ayvens.es] INFO: Saving data for 1983009: {'created_time': 1774463462.048272, 'last_price_update_time': 1774463462.048285, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983009') HTTP/1.1" 204 0
2026-03-25 18:31:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 41352a9d-ca52-5ccf-9dbe-a7de1eb6713f with identifier: 1983008
2026-03-25 18:31:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 41352a9d-ca52-5ccf-9dbe-a7de1eb6713f with identifier: 1983008
2026-03-25 18:31:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 41352a9d-ca52-5ccf-9dbe-a7de1eb6713f with identifier: 1983008 to the API
2026-03-25 18:31:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/293/4e75adafe1d44b62b64d98f7026b45cb/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 91,
 'color': 'Blanco banquise',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '41352a9d-ca52-5ccf-9dbe-a7de1eb6713f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '308',
 'odometer': 169579,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41352a9d-ca52-5ccf-9dbe-a7de1eb6713f/41352a9d-ca52-5ccf-9dbe-a7de1eb6713f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 500646,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/293/4e75adafe1d44b62b64d98f7026b45cb/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 308 5P Allure Pack BlueHDi 100 S&S',
 'transmission': 'manual',
 'trim': '5P Allure Pack BlueHDi 100 S&S',
 'vin': None,
 'year': 2021}
2026-03-25 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983008%27 HTTP/1.1" 200 None
2026-03-25 18:31:02 [ayvens.es] INFO: Saving data for 1983008: {'created_time': 1774463462.429695, 'last_price_update_time': 1774463462.429705, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983008') HTTP/1.1" 204 0
2026-03-25 18:31:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/100/80047bb7d7b3465093c6746368a995c9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/757/263d2bccaeb64038b2c6e7f6023d7e65/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:02 [ayvens.es] INFO: Found listing with ID: 1983018
2026-03-25 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983018%27 HTTP/1.1" 200 None
2026-03-25 18:31:02 [ayvens.es] INFO: Scrape type for 1983018: 1
2026-03-25 18:31:02 [ayvens.es] INFO: Extracting data for car ID: 1983018
2026-03-25 18:31:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b9e4813-7fb3-5c4a-9ac7-b8287a8f06f8 with identifier: 1983018
2026-03-25 18:31:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b9e4813-7fb3-5c4a-9ac7-b8287a8f06f8 with scrape type 1
2026-03-25 18:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8b9e4813-7fb3-5c4a-9ac7-b8287a8f06f8
2026-03-25 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F263%252F80ce41a6cb8c4021a29d84c0cd13cc32%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/263/80ce41a6cb8c4021a29d84c0cd13cc32/images/large/1.jpg not downloaded yet
2026-03-25 18:31:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ef2a150>
2026-03-25 18:31:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e0c8721-9d4b-51f4-ab4d-6f9d2b98ddc9/4e0c8721-9d4b-51f4-ab4d-6f9d2b98ddc9_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F552%252Ff281129bd9154f6a950f4eb980f28ec7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/552/f281129bd9154f6a950f4eb980f28ec7/images/large/1.jpg saved to cache
2026-03-25 18:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4e0c8721-9d4b-51f4-ab4d-6f9d2b98ddc9
2026-03-25 18:31:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4e0c8721-9d4b-51f4-ab4d-6f9d2b98ddc9, skipping ID generation
2026-03-25 18:31:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e0c8721-9d4b-51f4-ab4d-6f9d2b98ddc9 with scrape type 1
2026-03-25 18:31:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4e0c8721-9d4b-51f4-ab4d-6f9d2b98ddc9 sending to next pipeline
2026-03-25 18:31:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4e0c8721-9d4b-51f4-ab4d-6f9d2b98ddc9, identifier: 1983011
2026-03-25 18:31:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ee8f090>
2026-03-25 18:31:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_415e744b-0e9c-5edd-b725-93d756b102d4/415e744b-0e9c-5edd-b725-93d756b102d4_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F155%252Fa824f6335c26443b86ee38180a4ccfc1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/155/a824f6335c26443b86ee38180a4ccfc1/images/large/1.jpg saved to cache
2026-03-25 18:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 415e744b-0e9c-5edd-b725-93d756b102d4
2026-03-25 18:31:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 415e744b-0e9c-5edd-b725-93d756b102d4, skipping ID generation
2026-03-25 18:31:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 415e744b-0e9c-5edd-b725-93d756b102d4 with scrape type 1
2026-03-25 18:31:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 415e744b-0e9c-5edd-b725-93d756b102d4 sending to next pipeline
2026-03-25 18:31:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 415e744b-0e9c-5edd-b725-93d756b102d4, identifier: 1983010
2026-03-25 18:31:02 [ayvens.es] INFO: Found listing with ID: 1983019
2026-03-25 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983019%27 HTTP/1.1" 200 None
2026-03-25 18:31:02 [ayvens.es] INFO: Scrape type for 1983019: 1
2026-03-25 18:31:02 [ayvens.es] INFO: Extracting data for car ID: 1983019
2026-03-25 18:31:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89f7b66b-6394-5e3e-9d58-0a2cbe3366bf with identifier: 1983019
2026-03-25 18:31:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89f7b66b-6394-5e3e-9d58-0a2cbe3366bf with scrape type 1
2026-03-25 18:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 89f7b66b-6394-5e3e-9d58-0a2cbe3366bf
2026-03-25 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F384%252Fe3bf109989c84e029dbac2c435c29df7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/384/e3bf109989c84e029dbac2c435c29df7/images/large/1.jpg not downloaded yet
2026-03-25 18:31:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4e0c8721-9d4b-51f4-ab4d-6f9d2b98ddc9 with identifier: 1983011
2026-03-25 18:31:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4e0c8721-9d4b-51f4-ab4d-6f9d2b98ddc9 with identifier: 1983011
2026-03-25 18:31:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 4e0c8721-9d4b-51f4-ab4d-6f9d2b98ddc9 with identifier: 1983011 to the API
2026-03-25 18:31:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/552/f281129bd9154f6a950f4eb980f28ec7/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '4e0c8721-9d4b-51f4-ab4d-6f9d2b98ddc9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT COURIER',
 'odometer': 147655,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e0c8721-9d4b-51f4-ab4d-6f9d2b98ddc9/4e0c8721-9d4b-51f4-ab4d-6f9d2b98ddc9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 334420,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/552/f281129bd9154f6a950f4eb980f28ec7/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-14',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FORD TRANSIT COURIER Van 1.5 TDCi 56kW Ambiente',
 'transmission': 'manual',
 'trim': 'Van 1.5 TDCi 56kW Ambiente',
 'vin': None,
 'year': 2020}
2026-03-25 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983011%27 HTTP/1.1" 200 None
2026-03-25 18:31:03 [ayvens.es] INFO: Saving data for 1983011: {'created_time': 1774463463.200627, 'last_price_update_time': 1774463463.200637, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983011') HTTP/1.1" 204 0
2026-03-25 18:31:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 415e744b-0e9c-5edd-b725-93d756b102d4 with identifier: 1983010
2026-03-25 18:31:03 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:31:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 415e744b-0e9c-5edd-b725-93d756b102d4 with identifier: 1983010
2026-03-25 18:31:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 415e744b-0e9c-5edd-b725-93d756b102d4 with identifier: 1983010 to the API
2026-03-25 18:31:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/155/a824f6335c26443b86ee38180a4ccfc1/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'color': 'Blanco solido',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '415e744b-0e9c-5edd-b725-93d756b102d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'COMBO',
 'odometer': 117416,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_415e744b-0e9c-5edd-b725-93d756b102d4/415e744b-0e9c-5edd-b725-93d756b102d4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 513086,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/155/a824f6335c26443b86ee38180a4ccfc1/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-29',
 'seats_number': 2,
 'seller_name': None,
 'title': 'OPEL COMBO Cargo L 650kg Diesel 1.5 100HP S&S MT E6',
 'transmission': 'manual',
 'trim': 'Cargo L 650kg Diesel 1.5 100HP S&S MT E6',
 'vin': None,
 'year': 2022}
2026-03-25 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983010%27 HTTP/1.1" 200 None
2026-03-25 18:31:03 [ayvens.es] INFO: Saving data for 1983010: {'created_time': 1774463463.51119, 'last_price_update_time': 1774463463.511202, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983010') HTTP/1.1" 204 0
2026-03-25 18:31:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/511/993737e083784a7790fd8a1fa11df596/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:03 [ayvens.es] INFO: Found listing with ID: 1983020
2026-03-25 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983020%27 HTTP/1.1" 200 None
2026-03-25 18:31:03 [ayvens.es] INFO: Scrape type for 1983020: 1
2026-03-25 18:31:03 [ayvens.es] INFO: Extracting data for car ID: 1983020
2026-03-25 18:31:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3bd1702-793f-5ae1-9a37-31b8179042e9 with identifier: 1983020
2026-03-25 18:31:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3bd1702-793f-5ae1-9a37-31b8179042e9 with scrape type 1
2026-03-25 18:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a3bd1702-793f-5ae1-9a37-31b8179042e9
2026-03-25 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F553%252F88de3876432048369d61041488d42253%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/553/88de3876432048369d61041488d42253/images/large/1.jpg not downloaded yet
2026-03-25 18:31:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e58ec10>
2026-03-25 18:31:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35b759db-ba34-5ffc-988f-7d84538f70e6/35b759db-ba34-5ffc-988f-7d84538f70e6_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F100%252F80047bb7d7b3465093c6746368a995c9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/100/80047bb7d7b3465093c6746368a995c9/images/large/1.jpg saved to cache
2026-03-25 18:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 35b759db-ba34-5ffc-988f-7d84538f70e6
2026-03-25 18:31:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 35b759db-ba34-5ffc-988f-7d84538f70e6, skipping ID generation
2026-03-25 18:31:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35b759db-ba34-5ffc-988f-7d84538f70e6 with scrape type 1
2026-03-25 18:31:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 35b759db-ba34-5ffc-988f-7d84538f70e6 sending to next pipeline
2026-03-25 18:31:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 35b759db-ba34-5ffc-988f-7d84538f70e6, identifier: 1983012
2026-03-25 18:31:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ec69410>
2026-03-25 18:31:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6788bec7-9f39-5e08-bbd8-ce53575c5383/6788bec7-9f39-5e08-bbd8-ce53575c5383_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F757%252F263d2bccaeb64038b2c6e7f6023d7e65%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/757/263d2bccaeb64038b2c6e7f6023d7e65/images/large/1.jpg saved to cache
2026-03-25 18:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6788bec7-9f39-5e08-bbd8-ce53575c5383
2026-03-25 18:31:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6788bec7-9f39-5e08-bbd8-ce53575c5383, skipping ID generation
2026-03-25 18:31:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6788bec7-9f39-5e08-bbd8-ce53575c5383 with scrape type 1
2026-03-25 18:31:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6788bec7-9f39-5e08-bbd8-ce53575c5383 sending to next pipeline
2026-03-25 18:31:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6788bec7-9f39-5e08-bbd8-ce53575c5383, identifier: 1983013
2026-03-25 18:31:03 [ayvens.es] INFO: Found listing with ID: 1983021
2026-03-25 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983021%27 HTTP/1.1" 200 None
2026-03-25 18:31:03 [ayvens.es] INFO: Scrape type for 1983021: 1
2026-03-25 18:31:03 [ayvens.es] INFO: Extracting data for car ID: 1983021
2026-03-25 18:31:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4585ad7a-d4f1-5560-b87a-23f3eeb7f6e1 with identifier: 1983021
2026-03-25 18:31:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4585ad7a-d4f1-5560-b87a-23f3eeb7f6e1 with scrape type 1
2026-03-25 18:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4585ad7a-d4f1-5560-b87a-23f3eeb7f6e1
2026-03-25 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F055%252Fe32d5e06f29b474f9dc5aba20f705d86%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/055/e32d5e06f29b474f9dc5aba20f705d86/images/large/1.jpg not downloaded yet
2026-03-25 18:31:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 35b759db-ba34-5ffc-988f-7d84538f70e6 with identifier: 1983012
2026-03-25 18:31:03 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:31:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 35b759db-ba34-5ffc-988f-7d84538f70e6 with identifier: 1983012
2026-03-25 18:31:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 35b759db-ba34-5ffc-988f-7d84538f70e6 with identifier: 1983012 to the API
2026-03-25 18:31:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/100/80047bb7d7b3465093c6746368a995c9/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'Pintura metalizada',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '35b759db-ba34-5ffc-988f-7d84538f70e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508',
 'odometer': 147023,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35b759db-ba34-5ffc-988f-7d84538f70e6/35b759db-ba34-5ffc-988f-7d84538f70e6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 367699,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/100/80047bb7d7b3465093c6746368a995c9/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 5P Allure BlueHDi 120kW (160) S&S EAT8',
 'transmission': 'manual',
 'trim': '5P Allure BlueHDi 120kW (160) S&S EAT8',
 'vin': None,
 'year': 2020}
2026-03-25 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983012%27 HTTP/1.1" 200 None
2026-03-25 18:31:04 [ayvens.es] INFO: Saving data for 1983012: {'created_time': 1774463464.23391, 'last_price_update_time': 1774463464.233921, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983012') HTTP/1.1" 204 0
2026-03-25 18:31:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6788bec7-9f39-5e08-bbd8-ce53575c5383 with identifier: 1983013
2026-03-25 18:31:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6788bec7-9f39-5e08-bbd8-ce53575c5383 with identifier: 1983013
2026-03-25 18:31:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 6788bec7-9f39-5e08-bbd8-ce53575c5383 with identifier: 1983013 to the API
2026-03-25 18:31:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/757/263d2bccaeb64038b2c6e7f6023d7e65/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 185,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.4L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '6788bec7-9f39-5e08-bbd8-ce53575c5383',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'HILUX',
 'odometer': 211016,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6788bec7-9f39-5e08-bbd8-ce53575c5383/6788bec7-9f39-5e08-bbd8-ce53575c5383_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 318417,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/757/263d2bccaeb64038b2c6e7f6023d7e65/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA HILUX 2.4 D-4D Cabina Doble GX',
 'transmission': 'manual',
 'trim': '2.4 D-4D Cabina Doble GX',
 'vin': None,
 'year': 2019}
2026-03-25 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983013%27 HTTP/1.1" 200 None
2026-03-25 18:31:04 [ayvens.es] INFO: Saving data for 1983013: {'created_time': 1774463464.55692, 'last_price_update_time': 1774463464.556929, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983013') HTTP/1.1" 204 0
2026-03-25 18:31:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/511/4b28b351479146fea92c11a1b1a206d0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/258/1e388d51322e48ff8193984bd11a7a19/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:04 [ayvens.es] INFO: Found listing with ID: 1983022
2026-03-25 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983022%27 HTTP/1.1" 200 None
2026-03-25 18:31:04 [ayvens.es] INFO: Scrape type for 1983022: 1
2026-03-25 18:31:04 [ayvens.es] INFO: Extracting data for car ID: 1983022
2026-03-25 18:31:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f21de25e-534c-5196-bcc8-4b32393f9a6d with identifier: 1983022
2026-03-25 18:31:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f21de25e-534c-5196-bcc8-4b32393f9a6d with scrape type 1
2026-03-25 18:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f21de25e-534c-5196-bcc8-4b32393f9a6d
2026-03-25 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F762%252F82011c27152341a8b3f466be3004c1c0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/762/82011c27152341a8b3f466be3004c1c0/images/large/1.jpg not downloaded yet
2026-03-25 18:31:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae90a38490>
2026-03-25 18:31:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ee87a62-3325-533f-88bf-2b43994a0974/7ee87a62-3325-533f-88bf-2b43994a0974_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F511%252F993737e083784a7790fd8a1fa11df596%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/511/993737e083784a7790fd8a1fa11df596/images/large/1.jpg saved to cache
2026-03-25 18:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7ee87a62-3325-533f-88bf-2b43994a0974
2026-03-25 18:31:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7ee87a62-3325-533f-88bf-2b43994a0974, skipping ID generation
2026-03-25 18:31:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ee87a62-3325-533f-88bf-2b43994a0974 with scrape type 1
2026-03-25 18:31:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7ee87a62-3325-533f-88bf-2b43994a0974 sending to next pipeline
2026-03-25 18:31:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7ee87a62-3325-533f-88bf-2b43994a0974, identifier: 1983014
2026-03-25 18:31:04 [ayvens.es] INFO: Found listing with ID: 1983023
2026-03-25 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983023%27 HTTP/1.1" 200 None
2026-03-25 18:31:04 [ayvens.es] INFO: Scrape type for 1983023: 1
2026-03-25 18:31:04 [ayvens.es] INFO: Extracting data for car ID: 1983023
2026-03-25 18:31:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 166a5e97-246b-522a-a1db-292245ac733d with identifier: 1983023
2026-03-25 18:31:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 166a5e97-246b-522a-a1db-292245ac733d with scrape type 1
2026-03-25 18:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 166a5e97-246b-522a-a1db-292245ac733d
2026-03-25 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F689%252F12ee2d779bb64e8995a456000059c896%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/689/12ee2d779bb64e8995a456000059c896/images/large/1.jpg not downloaded yet
2026-03-25 18:31:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7ee87a62-3325-533f-88bf-2b43994a0974 with identifier: 1983014
2026-03-25 18:31:04 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:31:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7ee87a62-3325-533f-88bf-2b43994a0974 with identifier: 1983014
2026-03-25 18:31:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7ee87a62-3325-533f-88bf-2b43994a0974 with identifier: 1983014 to the API
2026-03-25 18:31:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/511/993737e083784a7790fd8a1fa11df596/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Urban green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '7ee87a62-3325-533f-88bf-2b43994a0974',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'STONIC',
 'odometer': 58521,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ee87a62-3325-533f-88bf-2b43994a0974/7ee87a62-3325-533f-88bf-2b43994a0974_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 364470,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/511/993737e083784a7790fd8a1fa11df596/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA STONIC 1.0 T-GDi 88kW (120CV) MHEV iMT Drive',
 'transmission': 'manual',
 'trim': '1.0 T-GDi 88kW (120CV) MHEV iMT Drive',
 'vin': None,
 'year': 2023}
2026-03-25 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983014%27 HTTP/1.1" 200 None
2026-03-25 18:31:05 [ayvens.es] INFO: Saving data for 1983014: {'created_time': 1774463465.125912, 'last_price_update_time': 1774463465.125924, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983014') HTTP/1.1" 204 0
2026-03-25 18:31:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/870/84951d68a2344a1183a293fc3e6cea02/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:05 [ayvens.es] INFO: Found listing with ID: 1983024
2026-03-25 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983024%27 HTTP/1.1" 200 None
2026-03-25 18:31:05 [ayvens.es] INFO: Scrape type for 1983024: 1
2026-03-25 18:31:05 [ayvens.es] INFO: Extracting data for car ID: 1983024
2026-03-25 18:31:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bedc4409-132b-59db-8b66-f636eac0847b with identifier: 1983024
2026-03-25 18:31:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bedc4409-132b-59db-8b66-f636eac0847b with scrape type 1
2026-03-25 18:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item bedc4409-132b-59db-8b66-f636eac0847b
2026-03-25 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F047%252F6ba1ad3469874257bd45f40b5637aafc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/047/6ba1ad3469874257bd45f40b5637aafc/images/large/1.jpg not downloaded yet
2026-03-25 18:31:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ecb4ed0>
2026-03-25 18:31:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13d6dad1-92cd-588c-9303-058cd344242d/13d6dad1-92cd-588c-9303-058cd344242d_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F511%252F4b28b351479146fea92c11a1b1a206d0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/511/4b28b351479146fea92c11a1b1a206d0/images/large/1.jpg saved to cache
2026-03-25 18:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 13d6dad1-92cd-588c-9303-058cd344242d
2026-03-25 18:31:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 13d6dad1-92cd-588c-9303-058cd344242d, skipping ID generation
2026-03-25 18:31:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13d6dad1-92cd-588c-9303-058cd344242d with scrape type 1
2026-03-25 18:31:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 13d6dad1-92cd-588c-9303-058cd344242d sending to next pipeline
2026-03-25 18:31:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 13d6dad1-92cd-588c-9303-058cd344242d, identifier: 1983016
2026-03-25 18:31:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae909033d0>
2026-03-25 18:31:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a363f2b-bb22-52e8-a028-fb5fc1a4fdab/2a363f2b-bb22-52e8-a028-fb5fc1a4fdab_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F258%252F1e388d51322e48ff8193984bd11a7a19%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/258/1e388d51322e48ff8193984bd11a7a19/images/large/1.jpg saved to cache
2026-03-25 18:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2a363f2b-bb22-52e8-a028-fb5fc1a4fdab
2026-03-25 18:31:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2a363f2b-bb22-52e8-a028-fb5fc1a4fdab, skipping ID generation
2026-03-25 18:31:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a363f2b-bb22-52e8-a028-fb5fc1a4fdab with scrape type 1
2026-03-25 18:31:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2a363f2b-bb22-52e8-a028-fb5fc1a4fdab sending to next pipeline
2026-03-25 18:31:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2a363f2b-bb22-52e8-a028-fb5fc1a4fdab, identifier: 1983015
2026-03-25 18:31:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/263/80ce41a6cb8c4021a29d84c0cd13cc32/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:05 [ayvens.es] INFO: Found listing with ID: 1983025
2026-03-25 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983025%27 HTTP/1.1" 200 None
2026-03-25 18:31:05 [ayvens.es] INFO: Scrape type for 1983025: 1
2026-03-25 18:31:05 [ayvens.es] INFO: Extracting data for car ID: 1983025
2026-03-25 18:31:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: baa5cbc6-aecc-59c9-889f-bb32cf432775 with identifier: 1983025
2026-03-25 18:31:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item baa5cbc6-aecc-59c9-889f-bb32cf432775 with scrape type 1
2026-03-25 18:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item baa5cbc6-aecc-59c9-889f-bb32cf432775
2026-03-25 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F336%252Fa17f658f858d45d097778be0cf9b7211%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/336/a17f658f858d45d097778be0cf9b7211/images/large/1.jpg not downloaded yet
2026-03-25 18:31:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 13d6dad1-92cd-588c-9303-058cd344242d with identifier: 1983016
2026-03-25 18:31:05 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:31:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 13d6dad1-92cd-588c-9303-058cd344242d with identifier: 1983016
2026-03-25 18:31:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 13d6dad1-92cd-588c-9303-058cd344242d with identifier: 1983016 to the API
2026-03-25 18:31:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/511/4b28b351479146fea92c11a1b1a206d0/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'Azul energy',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '13d6dad1-92cd-588c-9303-058cd344242d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'OCTAVIA',
 'odometer': 198003,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13d6dad1-92cd-588c-9303-058cd344242d/13d6dad1-92cd-588c-9303-058cd344242d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344279,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/511/4b28b351479146fea92c11a1b1a206d0/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA OCTAVIA 1.5 TSI 110kW (150 CV) Manual Style',
 'transmission': 'manual',
 'trim': '1.5 TSI 110kW (150 CV) Manual Style',
 'vin': None,
 'year': 2022}
2026-03-25 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983016%27 HTTP/1.1" 200 None
2026-03-25 18:31:06 [ayvens.es] INFO: Saving data for 1983016: {'created_time': 1774463466.023391, 'last_price_update_time': 1774463466.023403, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983016') HTTP/1.1" 204 0
2026-03-25 18:31:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2a363f2b-bb22-52e8-a028-fb5fc1a4fdab with identifier: 1983015
2026-03-25 18:31:06 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:31:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2a363f2b-bb22-52e8-a028-fb5fc1a4fdab with identifier: 1983015
2026-03-25 18:31:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 2a363f2b-bb22-52e8-a028-fb5fc1a4fdab with identifier: 1983015 to the API
2026-03-25 18:31:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/258/1e388d51322e48ff8193984bd11a7a19/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Plata r',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '2a363f2b-bb22-52e8-a028-fb5fc1a4fdab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT',
 'odometer': 113409,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a363f2b-bb22-52e8-a028-fb5fc1a4fdab/2a363f2b-bb22-52e8-a028-fb5fc1a4fdab_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 350252,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/258/1e388d51322e48ff8193984bd11a7a19/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT 2.0 TDI 110kW (150CV)',
 'transmission': 'manual',
 'trim': '2.0 TDI 110kW (150CV)',
 'vin': None,
 'year': 2021}
2026-03-25 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983015%27 HTTP/1.1" 200 None
2026-03-25 18:31:06 [ayvens.es] INFO: Saving data for 1983015: {'created_time': 1774463466.332493, 'last_price_update_time': 1774463466.332509, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983015') HTTP/1.1" 204 0
2026-03-25 18:31:06 [scrapy.extensions.logstats] INFO: Crawled 4 pages (at 4 pages/min), scraped 63 items (at 63 items/min)
2026-03-25 18:31:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 174MiB
2026-03-25 18:31:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/384/e3bf109989c84e029dbac2c435c29df7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:06 [ayvens.es] INFO: Found listing with ID: 1983026
2026-03-25 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983026%27 HTTP/1.1" 200 None
2026-03-25 18:31:06 [ayvens.es] INFO: Scrape type for 1983026: 1
2026-03-25 18:31:06 [ayvens.es] INFO: Extracting data for car ID: 1983026
2026-03-25 18:31:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c7136f0-dd04-5fab-a963-c5d85fde33e1 with identifier: 1983026
2026-03-25 18:31:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c7136f0-dd04-5fab-a963-c5d85fde33e1 with scrape type 1
2026-03-25 18:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7c7136f0-dd04-5fab-a963-c5d85fde33e1
2026-03-25 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F361%252Fa84d1b0f88a54e138d308a65e3c7b538%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/361/a84d1b0f88a54e138d308a65e3c7b538/images/large/1.jpg not downloaded yet
2026-03-25 18:31:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ee59750>
2026-03-25 18:31:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d5b7422-53f8-5a18-8074-b88e9a465f74/9d5b7422-53f8-5a18-8074-b88e9a465f74_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F870%252F84951d68a2344a1183a293fc3e6cea02%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/870/84951d68a2344a1183a293fc3e6cea02/images/large/1.jpg saved to cache
2026-03-25 18:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9d5b7422-53f8-5a18-8074-b88e9a465f74
2026-03-25 18:31:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9d5b7422-53f8-5a18-8074-b88e9a465f74, skipping ID generation
2026-03-25 18:31:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d5b7422-53f8-5a18-8074-b88e9a465f74 with scrape type 1
2026-03-25 18:31:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9d5b7422-53f8-5a18-8074-b88e9a465f74 sending to next pipeline
2026-03-25 18:31:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9d5b7422-53f8-5a18-8074-b88e9a465f74, identifier: 1983017
2026-03-25 18:31:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9d5b7422-53f8-5a18-8074-b88e9a465f74 with identifier: 1983017
2026-03-25 18:31:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9d5b7422-53f8-5a18-8074-b88e9a465f74 with identifier: 1983017
2026-03-25 18:31:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9d5b7422-53f8-5a18-8074-b88e9a465f74 with identifier: 1983017 to the API
2026-03-25 18:31:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/870/84951d68a2344a1183a293fc3e6cea02/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '9d5b7422-53f8-5a18-8074-b88e9a465f74',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '208',
 'odometer': 61617,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d5b7422-53f8-5a18-8074-b88e9a465f74/9d5b7422-53f8-5a18-8074-b88e9a465f74_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325092,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/870/84951d68a2344a1183a293fc3e6cea02/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 208 BlueHDi 73kW (100CV) Active',
 'transmission': 'manual',
 'trim': 'BlueHDi 73kW (100CV) Active',
 'vin': None,
 'year': 2022}
2026-03-25 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983017%27 HTTP/1.1" 200 None
2026-03-25 18:31:06 [ayvens.es] INFO: Saving data for 1983017: {'created_time': 1774463466.857046, 'last_price_update_time': 1774463466.85706, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983017') HTTP/1.1" 204 0
2026-03-25 18:31:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ecdfb10>
2026-03-25 18:31:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b9e4813-7fb3-5c4a-9ac7-b8287a8f06f8/8b9e4813-7fb3-5c4a-9ac7-b8287a8f06f8_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F263%252F80ce41a6cb8c4021a29d84c0cd13cc32%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/263/80ce41a6cb8c4021a29d84c0cd13cc32/images/large/1.jpg saved to cache
2026-03-25 18:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8b9e4813-7fb3-5c4a-9ac7-b8287a8f06f8
2026-03-25 18:31:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8b9e4813-7fb3-5c4a-9ac7-b8287a8f06f8, skipping ID generation
2026-03-25 18:31:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b9e4813-7fb3-5c4a-9ac7-b8287a8f06f8 with scrape type 1
2026-03-25 18:31:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8b9e4813-7fb3-5c4a-9ac7-b8287a8f06f8 sending to next pipeline
2026-03-25 18:31:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8b9e4813-7fb3-5c4a-9ac7-b8287a8f06f8, identifier: 1983018
2026-03-25 18:31:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/553/88de3876432048369d61041488d42253/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:07 [ayvens.es] INFO: Found listing with ID: 1983027
2026-03-25 18:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983027%27 HTTP/1.1" 200 None
2026-03-25 18:31:07 [ayvens.es] INFO: Scrape type for 1983027: 1
2026-03-25 18:31:07 [ayvens.es] INFO: Extracting data for car ID: 1983027
2026-03-25 18:31:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55e462e9-ac7c-579d-9af0-31bdd352d810 with identifier: 1983027
2026-03-25 18:31:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55e462e9-ac7c-579d-9af0-31bdd352d810 with scrape type 1
2026-03-25 18:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 55e462e9-ac7c-579d-9af0-31bdd352d810
2026-03-25 18:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F729%252F66acbe8162834f35ac6a2f314859f070%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/729/66acbe8162834f35ac6a2f314859f070/images/large/1.jpg not downloaded yet
2026-03-25 18:31:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8b9e4813-7fb3-5c4a-9ac7-b8287a8f06f8 with identifier: 1983018
2026-03-25 18:31:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8b9e4813-7fb3-5c4a-9ac7-b8287a8f06f8 with identifier: 1983018
2026-03-25 18:31:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8b9e4813-7fb3-5c4a-9ac7-b8287a8f06f8 with identifier: 1983018 to the API
2026-03-25 18:31:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/263/80ce41a6cb8c4021a29d84c0cd13cc32/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '8b9e4813-7fb3-5c4a-9ac7-b8287a8f06f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KAROQ',
 'odometer': 100168,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b9e4813-7fb3-5c4a-9ac7-b8287a8f06f8/8b9e4813-7fb3-5c4a-9ac7-b8287a8f06f8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 521582,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/263/80ce41a6cb8c4021a29d84c0cd13cc32/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA KAROQ 2.0 TDI 110kW (150CV) DSG 4X4 Ambition',
 'transmission': 'manual',
 'trim': '2.0 TDI 110kW (150CV) DSG 4X4 Ambition',
 'vin': None,
 'year': 2022}
2026-03-25 18:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983018%27 HTTP/1.1" 200 None
2026-03-25 18:31:07 [ayvens.es] INFO: Saving data for 1983018: {'created_time': 1774463467.513744, 'last_price_update_time': 1774463467.513755, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983018') HTTP/1.1" 204 0
2026-03-25 18:31:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e5daa90>
2026-03-25 18:31:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89f7b66b-6394-5e3e-9d58-0a2cbe3366bf/89f7b66b-6394-5e3e-9d58-0a2cbe3366bf_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F384%252Fe3bf109989c84e029dbac2c435c29df7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/384/e3bf109989c84e029dbac2c435c29df7/images/large/1.jpg saved to cache
2026-03-25 18:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 89f7b66b-6394-5e3e-9d58-0a2cbe3366bf
2026-03-25 18:31:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 89f7b66b-6394-5e3e-9d58-0a2cbe3366bf, skipping ID generation
2026-03-25 18:31:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89f7b66b-6394-5e3e-9d58-0a2cbe3366bf with scrape type 1
2026-03-25 18:31:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 89f7b66b-6394-5e3e-9d58-0a2cbe3366bf sending to next pipeline
2026-03-25 18:31:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 89f7b66b-6394-5e3e-9d58-0a2cbe3366bf, identifier: 1983019
2026-03-25 18:31:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/762/82011c27152341a8b3f466be3004c1c0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:07 [ayvens.es] INFO: Found listing with ID: 1983028
2026-03-25 18:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983028%27 HTTP/1.1" 200 None
2026-03-25 18:31:07 [ayvens.es] INFO: Scrape type for 1983028: 1
2026-03-25 18:31:07 [ayvens.es] INFO: Extracting data for car ID: 1983028
2026-03-25 18:31:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44b8fef0-a4ac-52f3-8854-e4c10ae3154d with identifier: 1983028
2026-03-25 18:31:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44b8fef0-a4ac-52f3-8854-e4c10ae3154d with scrape type 1
2026-03-25 18:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 44b8fef0-a4ac-52f3-8854-e4c10ae3154d
2026-03-25 18:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F069%252F0ac504b585df4d2fb7d85fd3eb5f2f63%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/069/0ac504b585df4d2fb7d85fd3eb5f2f63/images/large/1.jpg not downloaded yet
2026-03-25 18:31:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 89f7b66b-6394-5e3e-9d58-0a2cbe3366bf with identifier: 1983019
2026-03-25 18:31:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 89f7b66b-6394-5e3e-9d58-0a2cbe3366bf with identifier: 1983019
2026-03-25 18:31:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 89f7b66b-6394-5e3e-9d58-0a2cbe3366bf with identifier: 1983019 to the API
2026-03-25 18:31:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/384/e3bf109989c84e029dbac2c435c29df7/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '89f7b66b-6394-5e3e-9d58-0a2cbe3366bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KAROQ',
 'odometer': 169301,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89f7b66b-6394-5e3e-9d58-0a2cbe3366bf/89f7b66b-6394-5e3e-9d58-0a2cbe3366bf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340923,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/384/e3bf109989c84e029dbac2c435c29df7/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA KAROQ 2.0 TDI 110kW (150CV) DSG 4X4 Ambition',
 'transmission': 'manual',
 'trim': '2.0 TDI 110kW (150CV) DSG 4X4 Ambition',
 'vin': None,
 'year': 2021}
2026-03-25 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983019%27 HTTP/1.1" 200 None
2026-03-25 18:31:08 [ayvens.es] INFO: Saving data for 1983019: {'created_time': 1774463468.057205, 'last_price_update_time': 1774463468.057216, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983019') HTTP/1.1" 204 0
2026-03-25 18:31:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ed14a50>
2026-03-25 18:31:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3bd1702-793f-5ae1-9a37-31b8179042e9/a3bd1702-793f-5ae1-9a37-31b8179042e9_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F553%252F88de3876432048369d61041488d42253%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/553/88de3876432048369d61041488d42253/images/large/1.jpg saved to cache
2026-03-25 18:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a3bd1702-793f-5ae1-9a37-31b8179042e9
2026-03-25 18:31:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a3bd1702-793f-5ae1-9a37-31b8179042e9, skipping ID generation
2026-03-25 18:31:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3bd1702-793f-5ae1-9a37-31b8179042e9 with scrape type 1
2026-03-25 18:31:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a3bd1702-793f-5ae1-9a37-31b8179042e9 sending to next pipeline
2026-03-25 18:31:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a3bd1702-793f-5ae1-9a37-31b8179042e9, identifier: 1983020
2026-03-25 18:31:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/055/e32d5e06f29b474f9dc5aba20f705d86/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:08 [ayvens.es] INFO: Found listing with ID: 1983029
2026-03-25 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983029%27 HTTP/1.1" 200 None
2026-03-25 18:31:08 [ayvens.es] INFO: Scrape type for 1983029: 1
2026-03-25 18:31:08 [ayvens.es] INFO: Extracting data for car ID: 1983029
2026-03-25 18:31:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4485b1e-e68e-5365-8433-540e524880cd with identifier: 1983029
2026-03-25 18:31:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4485b1e-e68e-5365-8433-540e524880cd with scrape type 1
2026-03-25 18:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e4485b1e-e68e-5365-8433-540e524880cd
2026-03-25 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F079%252F03edf635062944efb4eabd71cf9514b2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/079/03edf635062944efb4eabd71cf9514b2/images/large/1.jpg not downloaded yet
2026-03-25 18:31:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a3bd1702-793f-5ae1-9a37-31b8179042e9 with identifier: 1983020
2026-03-25 18:31:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a3bd1702-793f-5ae1-9a37-31b8179042e9 with identifier: 1983020
2026-03-25 18:31:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a3bd1702-793f-5ae1-9a37-31b8179042e9 with identifier: 1983020 to the API
2026-03-25 18:31:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/553/88de3876432048369d61041488d42253/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'color': 'Blanco s',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.2L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a3bd1702-793f-5ae1-9a37-31b8179042e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'FIORINO',
 'odometer': 103721,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3bd1702-793f-5ae1-9a37-31b8179042e9/a3bd1702-793f-5ae1-9a37-31b8179042e9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 501795,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/553/88de3876432048369d61041488d42253/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-26',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FIAT FIORINO Cargo SX N1 1.3 MJet 59 kW (80 CV)',
 'transmission': 'manual',
 'trim': 'Cargo SX N1 1.3 MJet 59 kW (80 CV)',
 'vin': None,
 'year': 2020}
2026-03-25 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983020%27 HTTP/1.1" 200 None
2026-03-25 18:31:08 [ayvens.es] INFO: Saving data for 1983020: {'created_time': 1774463468.5419, 'last_price_update_time': 1774463468.541912, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983020') HTTP/1.1" 204 0
2026-03-25 18:31:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ec6b990>
2026-03-25 18:31:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f21de25e-534c-5196-bcc8-4b32393f9a6d/f21de25e-534c-5196-bcc8-4b32393f9a6d_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F762%252F82011c27152341a8b3f466be3004c1c0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/762/82011c27152341a8b3f466be3004c1c0/images/large/1.jpg saved to cache
2026-03-25 18:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f21de25e-534c-5196-bcc8-4b32393f9a6d
2026-03-25 18:31:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f21de25e-534c-5196-bcc8-4b32393f9a6d, skipping ID generation
2026-03-25 18:31:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f21de25e-534c-5196-bcc8-4b32393f9a6d with scrape type 1
2026-03-25 18:31:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f21de25e-534c-5196-bcc8-4b32393f9a6d sending to next pipeline
2026-03-25 18:31:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f21de25e-534c-5196-bcc8-4b32393f9a6d, identifier: 1983022
2026-03-25 18:31:08 [ayvens.es] INFO: Found listing with ID: 1983030
2026-03-25 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983030%27 HTTP/1.1" 200 None
2026-03-25 18:31:08 [ayvens.es] INFO: Scrape type for 1983030: 1
2026-03-25 18:31:08 [ayvens.es] INFO: Extracting data for car ID: 1983030
2026-03-25 18:31:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c41c077b-f9cd-5042-a330-0c83ce69b7bc with identifier: 1983030
2026-03-25 18:31:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c41c077b-f9cd-5042-a330-0c83ce69b7bc with scrape type 1
2026-03-25 18:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c41c077b-f9cd-5042-a330-0c83ce69b7bc
2026-03-25 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F160%252Fd7ba1f9740e045fcbc2cd98aa8976626%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/160/d7ba1f9740e045fcbc2cd98aa8976626/images/large/1.jpg not downloaded yet
2026-03-25 18:31:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f21de25e-534c-5196-bcc8-4b32393f9a6d with identifier: 1983022
2026-03-25 18:31:08 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:31:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f21de25e-534c-5196-bcc8-4b32393f9a6d with identifier: 1983022
2026-03-25 18:31:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f21de25e-534c-5196-bcc8-4b32393f9a6d with identifier: 1983022 to the API
2026-03-25 18:31:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/762/82011c27152341a8b3f466be3004c1c0/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'Stellar blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f21de25e-534c-5196-bcc8-4b32393f9a6d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'TUCSON',
 'odometer': 210637,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f21de25e-534c-5196-bcc8-4b32393f9a6d/f21de25e-534c-5196-bcc8-4b32393f9a6d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 369583,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/762/82011c27152341a8b3f466be3004c1c0/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI TUCSON 1.6 CRDI 85kW (116CV) 48V SLE 4X2',
 'transmission': 'manual',
 'trim': '1.6 CRDI 85kW (116CV) 48V SLE 4X2',
 'vin': None,
 'year': 2019}
2026-03-25 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983022%27 HTTP/1.1" 200 None
2026-03-25 18:31:09 [ayvens.es] INFO: Saving data for 1983022: {'created_time': 1774463469.246012, 'last_price_update_time': 1774463469.246029, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983022') HTTP/1.1" 204 0
2026-03-25 18:31:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/047/6ba1ad3469874257bd45f40b5637aafc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/689/12ee2d779bb64e8995a456000059c896/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/336/a17f658f858d45d097778be0cf9b7211/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae90745ed0>
2026-03-25 18:31:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4585ad7a-d4f1-5560-b87a-23f3eeb7f6e1/4585ad7a-d4f1-5560-b87a-23f3eeb7f6e1_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F055%252Fe32d5e06f29b474f9dc5aba20f705d86%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/055/e32d5e06f29b474f9dc5aba20f705d86/images/large/1.jpg saved to cache
2026-03-25 18:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4585ad7a-d4f1-5560-b87a-23f3eeb7f6e1
2026-03-25 18:31:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4585ad7a-d4f1-5560-b87a-23f3eeb7f6e1, skipping ID generation
2026-03-25 18:31:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4585ad7a-d4f1-5560-b87a-23f3eeb7f6e1 with scrape type 1
2026-03-25 18:31:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4585ad7a-d4f1-5560-b87a-23f3eeb7f6e1 sending to next pipeline
2026-03-25 18:31:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4585ad7a-d4f1-5560-b87a-23f3eeb7f6e1, identifier: 1983021
2026-03-25 18:31:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/361/a84d1b0f88a54e138d308a65e3c7b538/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:09 [ayvens.es] INFO: Found listing with ID: 1983031
2026-03-25 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983031%27 HTTP/1.1" 200 None
2026-03-25 18:31:09 [ayvens.es] INFO: Scrape type for 1983031: 1
2026-03-25 18:31:09 [ayvens.es] INFO: Extracting data for car ID: 1983031
2026-03-25 18:31:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f593bdc6-9fe6-5e2e-a9a7-ceb60fc0402d with identifier: 1983031
2026-03-25 18:31:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f593bdc6-9fe6-5e2e-a9a7-ceb60fc0402d with scrape type 1
2026-03-25 18:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f593bdc6-9fe6-5e2e-a9a7-ceb60fc0402d
2026-03-25 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F151%252F24421f9fb76f4ced8c08f25447b30387%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/151/24421f9fb76f4ced8c08f25447b30387/images/large/1.jpg not downloaded yet
2026-03-25 18:31:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4585ad7a-d4f1-5560-b87a-23f3eeb7f6e1 with identifier: 1983021
2026-03-25 18:31:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4585ad7a-d4f1-5560-b87a-23f3eeb7f6e1 with identifier: 1983021
2026-03-25 18:31:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 4585ad7a-d4f1-5560-b87a-23f3eeb7f6e1 with identifier: 1983021 to the API
2026-03-25 18:31:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/055/e32d5e06f29b474f9dc5aba20f705d86/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '4585ad7a-d4f1-5560-b87a-23f3eeb7f6e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KADJAR',
 'odometer': 101173,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4585ad7a-d4f1-5560-b87a-23f3eeb7f6e1/4585ad7a-d4f1-5560-b87a-23f3eeb7f6e1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 493774,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/055/e32d5e06f29b474f9dc5aba20f705d86/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT KADJAR Intens Blue dCi 85kW (115CV) - 18',
 'transmission': 'manual',
 'trim': 'Intens Blue dCi 85kW (115CV) - 18',
 'vin': None,
 'year': 2019}
2026-03-25 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983021%27 HTTP/1.1" 200 None
2026-03-25 18:31:09 [ayvens.es] INFO: Saving data for 1983021: {'created_time': 1774463469.770125, 'last_price_update_time': 1774463469.770135, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983021') HTTP/1.1" 204 0
2026-03-25 18:31:09 [ayvens.es] INFO: Found listing with ID: 1983032
2026-03-25 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983032%27 HTTP/1.1" 200 None
2026-03-25 18:31:09 [ayvens.es] INFO: Scrape type for 1983032: 1
2026-03-25 18:31:09 [ayvens.es] INFO: Extracting data for car ID: 1983032
2026-03-25 18:31:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee31360e-9acd-5c2c-875f-126934f2db22 with identifier: 1983032
2026-03-25 18:31:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee31360e-9acd-5c2c-875f-126934f2db22 with scrape type 1
2026-03-25 18:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ee31360e-9acd-5c2c-875f-126934f2db22
2026-03-25 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F369%252F81bc92a867fa4076a57dc81f7211e9eb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/369/81bc92a867fa4076a57dc81f7211e9eb/images/large/1.jpg not downloaded yet
2026-03-25 18:31:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae90747c90>
2026-03-25 18:31:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bedc4409-132b-59db-8b66-f636eac0847b/bedc4409-132b-59db-8b66-f636eac0847b_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F047%252F6ba1ad3469874257bd45f40b5637aafc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/047/6ba1ad3469874257bd45f40b5637aafc/images/large/1.jpg saved to cache
2026-03-25 18:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bedc4409-132b-59db-8b66-f636eac0847b
2026-03-25 18:31:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bedc4409-132b-59db-8b66-f636eac0847b, skipping ID generation
2026-03-25 18:31:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bedc4409-132b-59db-8b66-f636eac0847b with scrape type 1
2026-03-25 18:31:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bedc4409-132b-59db-8b66-f636eac0847b sending to next pipeline
2026-03-25 18:31:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: bedc4409-132b-59db-8b66-f636eac0847b, identifier: 1983024
2026-03-25 18:31:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ec68210>
2026-03-25 18:31:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_166a5e97-246b-522a-a1db-292245ac733d/166a5e97-246b-522a-a1db-292245ac733d_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F689%252F12ee2d779bb64e8995a456000059c896%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/689/12ee2d779bb64e8995a456000059c896/images/large/1.jpg saved to cache
2026-03-25 18:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 166a5e97-246b-522a-a1db-292245ac733d
2026-03-25 18:31:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 166a5e97-246b-522a-a1db-292245ac733d, skipping ID generation
2026-03-25 18:31:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 166a5e97-246b-522a-a1db-292245ac733d with scrape type 1
2026-03-25 18:31:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 166a5e97-246b-522a-a1db-292245ac733d sending to next pipeline
2026-03-25 18:31:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 166a5e97-246b-522a-a1db-292245ac733d, identifier: 1983023
2026-03-25 18:31:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8eab41d0>
2026-03-25 18:31:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baa5cbc6-aecc-59c9-889f-bb32cf432775/baa5cbc6-aecc-59c9-889f-bb32cf432775_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F336%252Fa17f658f858d45d097778be0cf9b7211%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/336/a17f658f858d45d097778be0cf9b7211/images/large/1.jpg saved to cache
2026-03-25 18:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item baa5cbc6-aecc-59c9-889f-bb32cf432775
2026-03-25 18:31:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: baa5cbc6-aecc-59c9-889f-bb32cf432775, skipping ID generation
2026-03-25 18:31:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item baa5cbc6-aecc-59c9-889f-bb32cf432775 with scrape type 1
2026-03-25 18:31:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item baa5cbc6-aecc-59c9-889f-bb32cf432775 sending to next pipeline
2026-03-25 18:31:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: baa5cbc6-aecc-59c9-889f-bb32cf432775, identifier: 1983025
2026-03-25 18:31:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8eebf150>
2026-03-25 18:31:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c7136f0-dd04-5fab-a963-c5d85fde33e1/7c7136f0-dd04-5fab-a963-c5d85fde33e1_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F361%252Fa84d1b0f88a54e138d308a65e3c7b538%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/361/a84d1b0f88a54e138d308a65e3c7b538/images/large/1.jpg saved to cache
2026-03-25 18:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7c7136f0-dd04-5fab-a963-c5d85fde33e1
2026-03-25 18:31:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7c7136f0-dd04-5fab-a963-c5d85fde33e1, skipping ID generation
2026-03-25 18:31:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c7136f0-dd04-5fab-a963-c5d85fde33e1 with scrape type 1
2026-03-25 18:31:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7c7136f0-dd04-5fab-a963-c5d85fde33e1 sending to next pipeline
2026-03-25 18:31:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7c7136f0-dd04-5fab-a963-c5d85fde33e1, identifier: 1983026
2026-03-25 18:31:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/729/66acbe8162834f35ac6a2f314859f070/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:10 [ayvens.es] INFO: Found listing with ID: 1983033
2026-03-25 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983033%27 HTTP/1.1" 200 None
2026-03-25 18:31:10 [ayvens.es] INFO: Scrape type for 1983033: 1
2026-03-25 18:31:10 [ayvens.es] INFO: Extracting data for car ID: 1983033
2026-03-25 18:31:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 482ca8c0-a7e5-52f9-9152-6e52b826e11e with identifier: 1983033
2026-03-25 18:31:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 482ca8c0-a7e5-52f9-9152-6e52b826e11e with scrape type 1
2026-03-25 18:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 482ca8c0-a7e5-52f9-9152-6e52b826e11e
2026-03-25 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F664%252F99e7b368d7fd441fb5deeafa48b1b064%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/664/99e7b368d7fd441fb5deeafa48b1b064/images/large/1.jpg not downloaded yet
2026-03-25 18:31:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: bedc4409-132b-59db-8b66-f636eac0847b with identifier: 1983024
2026-03-25 18:31:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:31:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: bedc4409-132b-59db-8b66-f636eac0847b with identifier: 1983024
2026-03-25 18:31:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: bedc4409-132b-59db-8b66-f636eac0847b with identifier: 1983024 to the API
2026-03-25 18:31:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/047/6ba1ad3469874257bd45f40b5637aafc/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'color': 'Pintura',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'bedc4409-132b-59db-8b66-f636eac0847b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS 4',
 'odometer': 20451,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bedc4409-132b-59db-8b66-f636eac0847b/bedc4409-132b-59db-8b66-f636eac0847b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 513221,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/047/6ba1ad3469874257bd45f40b5637aafc/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-11-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS 4 BlueHDi 96kW auto. Etoile Alcantara@',
 'transmission': 'manual',
 'trim': 'BlueHDi 96kW auto. Etoile Alcantara@',
 'vin': None,
 'year': 2024}
2026-03-25 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983024%27 HTTP/1.1" 200 None
2026-03-25 18:31:10 [ayvens.es] INFO: Saving data for 1983024: {'created_time': 1774463470.880473, 'last_price_update_time': 1774463470.880483, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983024') HTTP/1.1" 204 0
2026-03-25 18:31:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 166a5e97-246b-522a-a1db-292245ac733d with identifier: 1983023
2026-03-25 18:31:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:31:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 166a5e97-246b-522a-a1db-292245ac733d with identifier: 1983023
2026-03-25 18:31:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 166a5e97-246b-522a-a1db-292245ac733d with identifier: 1983023 to the API
2026-03-25 18:31:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/689/12ee2d779bb64e8995a456000059c896/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 164,
 'color': 'Cassa white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '166a5e97-246b-522a-a1db-292245ac733d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'SPORTAGE',
 'odometer': 105683,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_166a5e97-246b-522a-a1db-292245ac733d/166a5e97-246b-522a-a1db-292245ac733d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 486963,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/689/12ee2d779bb64e8995a456000059c896/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA SPORTAGE 1.6 MHEV Business 100kW (136CV) 4x4',
 'transmission': 'manual',
 'trim': '1.6 MHEV Business 100kW (136CV) 4x4',
 'vin': None,
 'year': 2021}
2026-03-25 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983023%27 HTTP/1.1" 200 None
2026-03-25 18:31:11 [ayvens.es] INFO: Saving data for 1983023: {'created_time': 1774463471.177411, 'last_price_update_time': 1774463471.177421, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983023') HTTP/1.1" 204 0
2026-03-25 18:31:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: baa5cbc6-aecc-59c9-889f-bb32cf432775 with identifier: 1983025
2026-03-25 18:31:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: baa5cbc6-aecc-59c9-889f-bb32cf432775 with identifier: 1983025
2026-03-25 18:31:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: baa5cbc6-aecc-59c9-889f-bb32cf432775 with identifier: 1983025 to the API
2026-03-25 18:31:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/336/a17f658f858d45d097778be0cf9b7211/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'baa5cbc6-aecc-59c9-889f-bb32cf432775',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KAROQ',
 'odometer': 175582,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_baa5cbc6-aecc-59c9-889f-bb32cf432775/baa5cbc6-aecc-59c9-889f-bb32cf432775_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342367,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/336/a17f658f858d45d097778be0cf9b7211/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA KAROQ 2.0 TDI 110kW (150CV) DSG 4X4 Ambition',
 'transmission': 'manual',
 'trim': '2.0 TDI 110kW (150CV) DSG 4X4 Ambition',
 'vin': None,
 'year': 2021}
2026-03-25 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983025%27 HTTP/1.1" 200 None
2026-03-25 18:31:11 [ayvens.es] INFO: Saving data for 1983025: {'created_time': 1774463471.469004, 'last_price_update_time': 1774463471.469014, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983025') HTTP/1.1" 204 0
2026-03-25 18:31:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7c7136f0-dd04-5fab-a963-c5d85fde33e1 with identifier: 1983026
2026-03-25 18:31:11 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:31:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7c7136f0-dd04-5fab-a963-c5d85fde33e1 with identifier: 1983026
2026-03-25 18:31:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7c7136f0-dd04-5fab-a963-c5d85fde33e1 with identifier: 1983026 to the API
2026-03-25 18:31:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/361/a84d1b0f88a54e138d308a65e3c7b538/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '7c7136f0-dd04-5fab-a963-c5d85fde33e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ARONA',
 'odometer': 161149,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c7136f0-dd04-5fab-a963-c5d85fde33e1/7c7136f0-dd04-5fab-a963-c5d85fde33e1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 323970,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/361/a84d1b0f88a54e138d308a65e3c7b538/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ARONA 1.6 TDI 70kW (95CV) Style Go Eco',
 'transmission': 'manual',
 'trim': '1.6 TDI 70kW (95CV) Style Go Eco',
 'vin': None,
 'year': 2021}
2026-03-25 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983026%27 HTTP/1.1" 200 None
2026-03-25 18:31:11 [ayvens.es] INFO: Saving data for 1983026: {'created_time': 1774463471.782711, 'last_price_update_time': 1774463471.782721, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983026') HTTP/1.1" 204 0
2026-03-25 18:31:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/069/0ac504b585df4d2fb7d85fd3eb5f2f63/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:11 [ayvens.es] INFO: Found listing with ID: 1983034
2026-03-25 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983034%27 HTTP/1.1" 200 None
2026-03-25 18:31:11 [ayvens.es] INFO: Scrape type for 1983034: 1
2026-03-25 18:31:11 [ayvens.es] INFO: Extracting data for car ID: 1983034
2026-03-25 18:31:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 831176cb-f6df-5c74-adc7-9b2e80b63645 with identifier: 1983034
2026-03-25 18:31:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 831176cb-f6df-5c74-adc7-9b2e80b63645 with scrape type 1
2026-03-25 18:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 831176cb-f6df-5c74-adc7-9b2e80b63645
2026-03-25 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F154%252F7c5e15de11fb46bab023e4be02d70769%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/154/7c5e15de11fb46bab023e4be02d70769/images/large/1.jpg not downloaded yet
2026-03-25 18:31:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/079/03edf635062944efb4eabd71cf9514b2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ea5ac50>
2026-03-25 18:31:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55e462e9-ac7c-579d-9af0-31bdd352d810/55e462e9-ac7c-579d-9af0-31bdd352d810_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F729%252F66acbe8162834f35ac6a2f314859f070%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/729/66acbe8162834f35ac6a2f314859f070/images/large/1.jpg saved to cache
2026-03-25 18:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 55e462e9-ac7c-579d-9af0-31bdd352d810
2026-03-25 18:31:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 55e462e9-ac7c-579d-9af0-31bdd352d810, skipping ID generation
2026-03-25 18:31:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55e462e9-ac7c-579d-9af0-31bdd352d810 with scrape type 1
2026-03-25 18:31:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 55e462e9-ac7c-579d-9af0-31bdd352d810 sending to next pipeline
2026-03-25 18:31:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 55e462e9-ac7c-579d-9af0-31bdd352d810, identifier: 1983027
2026-03-25 18:31:12 [ayvens.es] INFO: Found listing with ID: 1983035
2026-03-25 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983035%27 HTTP/1.1" 200 None
2026-03-25 18:31:12 [ayvens.es] INFO: Scrape type for 1983035: 1
2026-03-25 18:31:12 [ayvens.es] INFO: Extracting data for car ID: 1983035
2026-03-25 18:31:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d2ef966-b23f-5cf2-b8e3-afe1ff211175 with identifier: 1983035
2026-03-25 18:31:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d2ef966-b23f-5cf2-b8e3-afe1ff211175 with scrape type 1
2026-03-25 18:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4d2ef966-b23f-5cf2-b8e3-afe1ff211175
2026-03-25 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F968%252F1b4884a077564567bf1bf8104b14394a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/968/1b4884a077564567bf1bf8104b14394a/images/large/1.jpg not downloaded yet
2026-03-25 18:31:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 55e462e9-ac7c-579d-9af0-31bdd352d810 with identifier: 1983027
2026-03-25 18:31:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 55e462e9-ac7c-579d-9af0-31bdd352d810 with identifier: 1983027
2026-03-25 18:31:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 55e462e9-ac7c-579d-9af0-31bdd352d810 with identifier: 1983027 to the API
2026-03-25 18:31:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/729/66acbe8162834f35ac6a2f314859f070/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '55e462e9-ac7c-579d-9af0-31bdd352d810',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MEGANE',
 'odometer': 118088,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55e462e9-ac7c-579d-9af0-31bdd352d810/55e462e9-ac7c-579d-9af0-31bdd352d810_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 339246,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/729/66acbe8162834f35ac6a2f314859f070/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT MEGANE Equilibre Blue dCi 85 kW (115CV)',
 'transmission': 'manual',
 'trim': 'Equilibre Blue dCi 85 kW (115CV)',
 'vin': None,
 'year': 2022}
2026-03-25 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983027%27 HTTP/1.1" 200 None
2026-03-25 18:31:12 [ayvens.es] INFO: Saving data for 1983027: {'created_time': 1774463472.375668, 'last_price_update_time': 1774463472.375678, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983027') HTTP/1.1" 204 0
2026-03-25 18:31:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ed0f990>
2026-03-25 18:31:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44b8fef0-a4ac-52f3-8854-e4c10ae3154d/44b8fef0-a4ac-52f3-8854-e4c10ae3154d_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F069%252F0ac504b585df4d2fb7d85fd3eb5f2f63%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/069/0ac504b585df4d2fb7d85fd3eb5f2f63/images/large/1.jpg saved to cache
2026-03-25 18:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 44b8fef0-a4ac-52f3-8854-e4c10ae3154d
2026-03-25 18:31:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 44b8fef0-a4ac-52f3-8854-e4c10ae3154d, skipping ID generation
2026-03-25 18:31:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44b8fef0-a4ac-52f3-8854-e4c10ae3154d with scrape type 1
2026-03-25 18:31:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 44b8fef0-a4ac-52f3-8854-e4c10ae3154d sending to next pipeline
2026-03-25 18:31:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 44b8fef0-a4ac-52f3-8854-e4c10ae3154d, identifier: 1983028
2026-03-25 18:31:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/160/d7ba1f9740e045fcbc2cd98aa8976626/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:12 [ayvens.es] INFO: Found listing with ID: 1983036
2026-03-25 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983036%27 HTTP/1.1" 200 None
2026-03-25 18:31:12 [ayvens.es] INFO: Scrape type for 1983036: 1
2026-03-25 18:31:12 [ayvens.es] INFO: Extracting data for car ID: 1983036
2026-03-25 18:31:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec15d7f7-194b-59d9-a048-d639fd8a98c3 with identifier: 1983036
2026-03-25 18:31:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec15d7f7-194b-59d9-a048-d639fd8a98c3 with scrape type 1
2026-03-25 18:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ec15d7f7-194b-59d9-a048-d639fd8a98c3
2026-03-25 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F770%252F8956683e0622497992f5d5977f01b589%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/770/8956683e0622497992f5d5977f01b589/images/large/1.jpg not downloaded yet
2026-03-25 18:31:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 44b8fef0-a4ac-52f3-8854-e4c10ae3154d with identifier: 1983028
2026-03-25 18:31:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 44b8fef0-a4ac-52f3-8854-e4c10ae3154d with identifier: 1983028
2026-03-25 18:31:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 44b8fef0-a4ac-52f3-8854-e4c10ae3154d with identifier: 1983028 to the API
2026-03-25 18:31:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/069/0ac504b585df4d2fb7d85fd3eb5f2f63/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 101,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '44b8fef0-a4ac-52f3-8854-e4c10ae3154d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MEGANE',
 'odometer': 115226,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44b8fef0-a4ac-52f3-8854-e4c10ae3154d/44b8fef0-a4ac-52f3-8854-e4c10ae3154d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 346191,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/069/0ac504b585df4d2fb7d85fd3eb5f2f63/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT MEGANE Business Blue dCi 81 kW (115CV)',
 'transmission': 'manual',
 'trim': 'Business Blue dCi 81 kW (115CV)',
 'vin': None,
 'year': 2020}
2026-03-25 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983028%27 HTTP/1.1" 200 None
2026-03-25 18:31:12 [ayvens.es] INFO: Saving data for 1983028: {'created_time': 1774463472.996276, 'last_price_update_time': 1774463472.996287, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983028') HTTP/1.1" 204 0
2026-03-25 18:31:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/151/24421f9fb76f4ced8c08f25447b30387/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8f252f90>
2026-03-25 18:31:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4485b1e-e68e-5365-8433-540e524880cd/e4485b1e-e68e-5365-8433-540e524880cd_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F079%252F03edf635062944efb4eabd71cf9514b2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/079/03edf635062944efb4eabd71cf9514b2/images/large/1.jpg saved to cache
2026-03-25 18:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e4485b1e-e68e-5365-8433-540e524880cd
2026-03-25 18:31:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e4485b1e-e68e-5365-8433-540e524880cd, skipping ID generation
2026-03-25 18:31:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4485b1e-e68e-5365-8433-540e524880cd with scrape type 1
2026-03-25 18:31:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e4485b1e-e68e-5365-8433-540e524880cd sending to next pipeline
2026-03-25 18:31:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e4485b1e-e68e-5365-8433-540e524880cd, identifier: 1983029
2026-03-25 18:31:13 [ayvens.es] INFO: Found listing with ID: 1983037
2026-03-25 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983037%27 HTTP/1.1" 200 None
2026-03-25 18:31:13 [ayvens.es] INFO: Scrape type for 1983037: 1
2026-03-25 18:31:13 [ayvens.es] INFO: Extracting data for car ID: 1983037
2026-03-25 18:31:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09041162-b53d-536e-874f-7bbf0e146734 with identifier: 1983037
2026-03-25 18:31:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09041162-b53d-536e-874f-7bbf0e146734 with scrape type 1
2026-03-25 18:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 09041162-b53d-536e-874f-7bbf0e146734
2026-03-25 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F431%252F50f833a924f649d5822f3d7f10e13e88%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/431/50f833a924f649d5822f3d7f10e13e88/images/large/1.jpg not downloaded yet
2026-03-25 18:31:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e4485b1e-e68e-5365-8433-540e524880cd with identifier: 1983029
2026-03-25 18:31:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e4485b1e-e68e-5365-8433-540e524880cd with identifier: 1983029
2026-03-25 18:31:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e4485b1e-e68e-5365-8433-540e524880cd with identifier: 1983029 to the API
2026-03-25 18:31:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/079/03edf635062944efb4eabd71cf9514b2/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e4485b1e-e68e-5365-8433-540e524880cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KAROQ',
 'odometer': 81164,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4485b1e-e68e-5365-8433-540e524880cd/e4485b1e-e68e-5365-8433-540e524880cd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 335442,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/079/03edf635062944efb4eabd71cf9514b2/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA KAROQ 2.0 TDI 110kW (150CV) DSG 4X4 Ambition',
 'transmission': 'manual',
 'trim': '2.0 TDI 110kW (150CV) DSG 4X4 Ambition',
 'vin': None,
 'year': 2022}
2026-03-25 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983029%27 HTTP/1.1" 200 None
2026-03-25 18:31:13 [ayvens.es] INFO: Saving data for 1983029: {'created_time': 1774463473.515335, 'last_price_update_time': 1774463473.515345, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983029') HTTP/1.1" 204 0
2026-03-25 18:31:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/369/81bc92a867fa4076a57dc81f7211e9eb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ed72110>
2026-03-25 18:31:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c41c077b-f9cd-5042-a330-0c83ce69b7bc/c41c077b-f9cd-5042-a330-0c83ce69b7bc_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F160%252Fd7ba1f9740e045fcbc2cd98aa8976626%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/160/d7ba1f9740e045fcbc2cd98aa8976626/images/large/1.jpg saved to cache
2026-03-25 18:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c41c077b-f9cd-5042-a330-0c83ce69b7bc
2026-03-25 18:31:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c41c077b-f9cd-5042-a330-0c83ce69b7bc, skipping ID generation
2026-03-25 18:31:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c41c077b-f9cd-5042-a330-0c83ce69b7bc with scrape type 1
2026-03-25 18:31:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c41c077b-f9cd-5042-a330-0c83ce69b7bc sending to next pipeline
2026-03-25 18:31:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c41c077b-f9cd-5042-a330-0c83ce69b7bc, identifier: 1983030
2026-03-25 18:31:13 [ayvens.es] INFO: Found listing with ID: 1983038
2026-03-25 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983038%27 HTTP/1.1" 200 None
2026-03-25 18:31:13 [ayvens.es] INFO: Scrape type for 1983038: 1
2026-03-25 18:31:13 [ayvens.es] INFO: Extracting data for car ID: 1983038
2026-03-25 18:31:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebf729b0-a3d8-5daf-8036-b009321305a7 with identifier: 1983038
2026-03-25 18:31:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebf729b0-a3d8-5daf-8036-b009321305a7 with scrape type 1
2026-03-25 18:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ebf729b0-a3d8-5daf-8036-b009321305a7
2026-03-25 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F901%252Ff85498c59576473e9ea32807263b39af%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/901/f85498c59576473e9ea32807263b39af/images/large/1.jpg not downloaded yet
2026-03-25 18:31:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c41c077b-f9cd-5042-a330-0c83ce69b7bc with identifier: 1983030
2026-03-25 18:31:13 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:31:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c41c077b-f9cd-5042-a330-0c83ce69b7bc with identifier: 1983030
2026-03-25 18:31:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c41c077b-f9cd-5042-a330-0c83ce69b7bc with identifier: 1983030 to the API
2026-03-25 18:31:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/160/d7ba1f9740e045fcbc2cd98aa8976626/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 86,
 'color': 'Gris diamante',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'c41c077b-f9cd-5042-a330-0c83ce69b7bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'C-HR',
 'odometer': 122844,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c41c077b-f9cd-5042-a330-0c83ce69b7bc/c41c077b-f9cd-5042-a330-0c83ce69b7bc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328386,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/160/d7ba1f9740e045fcbc2cd98aa8976626/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA C-HR 1.8 125H Advance',
 'transmission': 'manual',
 'trim': '1.8 125H Advance',
 'vin': None,
 'year': 2019}
2026-03-25 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983030%27 HTTP/1.1" 200 None
2026-03-25 18:31:14 [ayvens.es] INFO: Saving data for 1983030: {'created_time': 1774463474.01746, 'last_price_update_time': 1774463474.01747, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983030') HTTP/1.1" 204 0
2026-03-25 18:31:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ec44210>
2026-03-25 18:31:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f593bdc6-9fe6-5e2e-a9a7-ceb60fc0402d/f593bdc6-9fe6-5e2e-a9a7-ceb60fc0402d_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F151%252F24421f9fb76f4ced8c08f25447b30387%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/151/24421f9fb76f4ced8c08f25447b30387/images/large/1.jpg saved to cache
2026-03-25 18:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f593bdc6-9fe6-5e2e-a9a7-ceb60fc0402d
2026-03-25 18:31:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f593bdc6-9fe6-5e2e-a9a7-ceb60fc0402d, skipping ID generation
2026-03-25 18:31:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f593bdc6-9fe6-5e2e-a9a7-ceb60fc0402d with scrape type 1
2026-03-25 18:31:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f593bdc6-9fe6-5e2e-a9a7-ceb60fc0402d sending to next pipeline
2026-03-25 18:31:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f593bdc6-9fe6-5e2e-a9a7-ceb60fc0402d, identifier: 1983031
2026-03-25 18:31:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/664/99e7b368d7fd441fb5deeafa48b1b064/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:14 [ayvens.es] INFO: Found listing with ID: 1983039
2026-03-25 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983039%27 HTTP/1.1" 200 None
2026-03-25 18:31:14 [ayvens.es] INFO: Scrape type for 1983039: 1
2026-03-25 18:31:14 [ayvens.es] INFO: Extracting data for car ID: 1983039
2026-03-25 18:31:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9977394-be95-5207-9528-751fd26ee37b with identifier: 1983039
2026-03-25 18:31:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9977394-be95-5207-9528-751fd26ee37b with scrape type 1
2026-03-25 18:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b9977394-be95-5207-9528-751fd26ee37b
2026-03-25 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F838%252F0f41e2dc90014e308a44365221629f3e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/838/0f41e2dc90014e308a44365221629f3e/images/large/1.jpg not downloaded yet
2026-03-25 18:31:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f593bdc6-9fe6-5e2e-a9a7-ceb60fc0402d with identifier: 1983031
2026-03-25 18:31:14 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:31:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f593bdc6-9fe6-5e2e-a9a7-ceb60fc0402d with identifier: 1983031
2026-03-25 18:31:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f593bdc6-9fe6-5e2e-a9a7-ceb60fc0402d with identifier: 1983031 to the API
2026-03-25 18:31:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/151/24421f9fb76f4ced8c08f25447b30387/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 202,
 'color': 'Fuji white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'f593bdc6-9fe6-5e2e-a9a7-ceb60fc0402d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER EVOQUE',
 'odometer': 61822,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f593bdc6-9fe6-5e2e-a9a7-ceb60fc0402d/f593bdc6-9fe6-5e2e-a9a7-ceb60fc0402d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 343676,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/151/24421f9fb76f4ced8c08f25447b30387/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER RANGE ROVER EVOQUE 2.0 P250 R-Dynamic S AUTO 4WD MHEV',
 'transmission': 'manual',
 'trim': '2.0 P250 R-Dynamic S AUTO 4WD MHEV',
 'vin': None,
 'year': 2021}
2026-03-25 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983031%27 HTTP/1.1" 200 None
2026-03-25 18:31:14 [ayvens.es] INFO: Saving data for 1983031: {'created_time': 1774463474.633068, 'last_price_update_time': 1774463474.633078, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983031') HTTP/1.1" 204 0
2026-03-25 18:31:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae90fdc790>
2026-03-25 18:31:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee31360e-9acd-5c2c-875f-126934f2db22/ee31360e-9acd-5c2c-875f-126934f2db22_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F369%252F81bc92a867fa4076a57dc81f7211e9eb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/369/81bc92a867fa4076a57dc81f7211e9eb/images/large/1.jpg saved to cache
2026-03-25 18:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ee31360e-9acd-5c2c-875f-126934f2db22
2026-03-25 18:31:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ee31360e-9acd-5c2c-875f-126934f2db22, skipping ID generation
2026-03-25 18:31:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee31360e-9acd-5c2c-875f-126934f2db22 with scrape type 1
2026-03-25 18:31:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ee31360e-9acd-5c2c-875f-126934f2db22 sending to next pipeline
2026-03-25 18:31:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ee31360e-9acd-5c2c-875f-126934f2db22, identifier: 1983032
2026-03-25 18:31:14 [ayvens.es] INFO: Found listing with ID: 1983040
2026-03-25 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983040%27 HTTP/1.1" 200 None
2026-03-25 18:31:14 [ayvens.es] INFO: Scrape type for 1983040: 1
2026-03-25 18:31:14 [ayvens.es] INFO: Extracting data for car ID: 1983040
2026-03-25 18:31:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ccb74a31-9d47-55fa-9f7b-094b1dddc0b3 with identifier: 1983040
2026-03-25 18:31:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccb74a31-9d47-55fa-9f7b-094b1dddc0b3 with scrape type 1
2026-03-25 18:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ccb74a31-9d47-55fa-9f7b-094b1dddc0b3
2026-03-25 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F759%252F2dd902fdafa34d3b9e51773d13398f8e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/759/2dd902fdafa34d3b9e51773d13398f8e/images/large/1.jpg not downloaded yet
2026-03-25 18:31:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ee31360e-9acd-5c2c-875f-126934f2db22 with identifier: 1983032
2026-03-25 18:31:14 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:31:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ee31360e-9acd-5c2c-875f-126934f2db22 with identifier: 1983032
2026-03-25 18:31:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ee31360e-9acd-5c2c-875f-126934f2db22 with identifier: 1983032 to the API
2026-03-25 18:31:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/369/81bc92a867fa4076a57dc81f7211e9eb/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'Blanco candy solido',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'ee31360e-9acd-5c2c-875f-126934f2db22',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KAMIQ',
 'odometer': 71792,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee31360e-9acd-5c2c-875f-126934f2db22/ee31360e-9acd-5c2c-875f-126934f2db22_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328693,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/369/81bc92a867fa4076a57dc81f7211e9eb/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA KAMIQ 1.0 TSI 81kW (110CV) DSG Emotion',
 'transmission': 'manual',
 'trim': '1.0 TSI 81kW (110CV) DSG Emotion',
 'vin': None,
 'year': 2022}
2026-03-25 18:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983032%27 HTTP/1.1" 200 None
2026-03-25 18:31:15 [ayvens.es] INFO: Saving data for 1983032: {'created_time': 1774463475.142555, 'last_price_update_time': 1774463475.142566, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983032') HTTP/1.1" 204 0
2026-03-25 18:31:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae9105a710>
2026-03-25 18:31:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_482ca8c0-a7e5-52f9-9152-6e52b826e11e/482ca8c0-a7e5-52f9-9152-6e52b826e11e_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F664%252F99e7b368d7fd441fb5deeafa48b1b064%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/664/99e7b368d7fd441fb5deeafa48b1b064/images/large/1.jpg saved to cache
2026-03-25 18:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 482ca8c0-a7e5-52f9-9152-6e52b826e11e
2026-03-25 18:31:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 482ca8c0-a7e5-52f9-9152-6e52b826e11e, skipping ID generation
2026-03-25 18:31:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 482ca8c0-a7e5-52f9-9152-6e52b826e11e with scrape type 1
2026-03-25 18:31:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 482ca8c0-a7e5-52f9-9152-6e52b826e11e sending to next pipeline
2026-03-25 18:31:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 482ca8c0-a7e5-52f9-9152-6e52b826e11e, identifier: 1983033
2026-03-25 18:31:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/154/7c5e15de11fb46bab023e4be02d70769/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/968/1b4884a077564567bf1bf8104b14394a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:15 [ayvens.es] INFO: Found listing with ID: 1983041
2026-03-25 18:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983041%27 HTTP/1.1" 200 None
2026-03-25 18:31:15 [ayvens.es] INFO: Scrape type for 1983041: 1
2026-03-25 18:31:15 [ayvens.es] INFO: Extracting data for car ID: 1983041
2026-03-25 18:31:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9fba89a-6e89-532c-9e73-e1dd8b5b9d98 with identifier: 1983041
2026-03-25 18:31:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9fba89a-6e89-532c-9e73-e1dd8b5b9d98 with scrape type 1
2026-03-25 18:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c9fba89a-6e89-532c-9e73-e1dd8b5b9d98
2026-03-25 18:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F667%252Fb734e289d8d94e87b294580ff5d7b439%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/667/b734e289d8d94e87b294580ff5d7b439/images/large/1.jpg not downloaded yet
2026-03-25 18:31:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 482ca8c0-a7e5-52f9-9152-6e52b826e11e with identifier: 1983033
2026-03-25 18:31:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 482ca8c0-a7e5-52f9-9152-6e52b826e11e with identifier: 1983033
2026-03-25 18:31:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 482ca8c0-a7e5-52f9-9152-6e52b826e11e with identifier: 1983033 to the API
2026-03-25 18:31:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/664/99e7b368d7fd441fb5deeafa48b1b064/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 164,
 'color': 'Cassa white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '482ca8c0-a7e5-52f9-9152-6e52b826e11e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'SPORTAGE',
 'odometer': 61075,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_482ca8c0-a7e5-52f9-9152-6e52b826e11e/482ca8c0-a7e5-52f9-9152-6e52b826e11e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 357810,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/664/99e7b368d7fd441fb5deeafa48b1b064/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA SPORTAGE 1.6 MHEV Business 100kW (136CV) 4x4',
 'transmission': 'manual',
 'trim': '1.6 MHEV Business 100kW (136CV) 4x4',
 'vin': None,
 'year': 2021}
2026-03-25 18:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983033%27 HTTP/1.1" 200 None
2026-03-25 18:31:15 [ayvens.es] INFO: Saving data for 1983033: {'created_time': 1774463475.622168, 'last_price_update_time': 1774463475.622177, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983033') HTTP/1.1" 204 0
2026-03-25 18:31:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/770/8956683e0622497992f5d5977f01b589/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:15 [ayvens.es] INFO: Found listing with ID: 1983042
2026-03-25 18:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983042%27 HTTP/1.1" 200 None
2026-03-25 18:31:15 [ayvens.es] INFO: Scrape type for 1983042: 1
2026-03-25 18:31:15 [ayvens.es] INFO: Extracting data for car ID: 1983042
2026-03-25 18:31:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7c2623d-6fec-5142-ab55-ac25cd5476f7 with identifier: 1983042
2026-03-25 18:31:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7c2623d-6fec-5142-ab55-ac25cd5476f7 with scrape type 1
2026-03-25 18:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a7c2623d-6fec-5142-ab55-ac25cd5476f7
2026-03-25 18:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F534%252Fab7fe1ab12af45fd91b72fe6ddf56356%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/534/ab7fe1ab12af45fd91b72fe6ddf56356/images/large/1.jpg not downloaded yet
2026-03-25 18:31:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ed37850>
2026-03-25 18:31:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_831176cb-f6df-5c74-adc7-9b2e80b63645/831176cb-f6df-5c74-adc7-9b2e80b63645_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F154%252F7c5e15de11fb46bab023e4be02d70769%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/154/7c5e15de11fb46bab023e4be02d70769/images/large/1.jpg saved to cache
2026-03-25 18:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 831176cb-f6df-5c74-adc7-9b2e80b63645
2026-03-25 18:31:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 831176cb-f6df-5c74-adc7-9b2e80b63645, skipping ID generation
2026-03-25 18:31:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 831176cb-f6df-5c74-adc7-9b2e80b63645 with scrape type 1
2026-03-25 18:31:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 831176cb-f6df-5c74-adc7-9b2e80b63645 sending to next pipeline
2026-03-25 18:31:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 831176cb-f6df-5c74-adc7-9b2e80b63645, identifier: 1983034
2026-03-25 18:31:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8edaded0>
2026-03-25 18:31:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d2ef966-b23f-5cf2-b8e3-afe1ff211175/4d2ef966-b23f-5cf2-b8e3-afe1ff211175_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F968%252F1b4884a077564567bf1bf8104b14394a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/968/1b4884a077564567bf1bf8104b14394a/images/large/1.jpg saved to cache
2026-03-25 18:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4d2ef966-b23f-5cf2-b8e3-afe1ff211175
2026-03-25 18:31:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4d2ef966-b23f-5cf2-b8e3-afe1ff211175, skipping ID generation
2026-03-25 18:31:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d2ef966-b23f-5cf2-b8e3-afe1ff211175 with scrape type 1
2026-03-25 18:31:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4d2ef966-b23f-5cf2-b8e3-afe1ff211175 sending to next pipeline
2026-03-25 18:31:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4d2ef966-b23f-5cf2-b8e3-afe1ff211175, identifier: 1983035
2026-03-25 18:31:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/431/50f833a924f649d5822f3d7f10e13e88/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:15 [ayvens.es] INFO: Found listing with ID: 1983043
2026-03-25 18:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983043%27 HTTP/1.1" 200 None
2026-03-25 18:31:16 [ayvens.es] INFO: Scrape type for 1983043: 1
2026-03-25 18:31:16 [ayvens.es] INFO: Extracting data for car ID: 1983043
2026-03-25 18:31:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b65d312-2f08-5025-bdcf-4823f8687ad2 with identifier: 1983043
2026-03-25 18:31:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b65d312-2f08-5025-bdcf-4823f8687ad2 with scrape type 1
2026-03-25 18:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6b65d312-2f08-5025-bdcf-4823f8687ad2
2026-03-25 18:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F237%252F73ef6cca06e54e918f83bbf9af0ee084%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/237/73ef6cca06e54e918f83bbf9af0ee084/images/large/1.jpg not downloaded yet
2026-03-25 18:31:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 831176cb-f6df-5c74-adc7-9b2e80b63645 with identifier: 1983034
2026-03-25 18:31:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 831176cb-f6df-5c74-adc7-9b2e80b63645 with identifier: 1983034
2026-03-25 18:31:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 831176cb-f6df-5c74-adc7-9b2e80b63645 with identifier: 1983034 to the API
2026-03-25 18:31:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/154/7c5e15de11fb46bab023e4be02d70769/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'Plata',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '831176cb-f6df-5c74-adc7-9b2e80b63645',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 67908,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_831176cb-f6df-5c74-adc7-9b2e80b63645/831176cb-f6df-5c74-adc7-9b2e80b63645_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 525852,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/154/7c5e15de11fb46bab023e4be02d70769/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON 1.0 EcoTSI 85kW St&Sp Style Visio Ed Nav',
 'transmission': 'manual',
 'trim': '1.0 EcoTSI 85kW St&Sp Style Visio Ed Nav',
 'vin': None,
 'year': 2019}
2026-03-25 18:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983034%27 HTTP/1.1" 200 None
2026-03-25 18:31:16 [ayvens.es] INFO: Saving data for 1983034: {'created_time': 1774463476.526253, 'last_price_update_time': 1774463476.526281, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983034') HTTP/1.1" 204 0
2026-03-25 18:31:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4d2ef966-b23f-5cf2-b8e3-afe1ff211175 with identifier: 1983035
2026-03-25 18:31:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4d2ef966-b23f-5cf2-b8e3-afe1ff211175 with identifier: 1983035
2026-03-25 18:31:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 4d2ef966-b23f-5cf2-b8e3-afe1ff211175 with identifier: 1983035 to the API
2026-03-25 18:31:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/968/1b4884a077564567bf1bf8104b14394a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '4d2ef966-b23f-5cf2-b8e3-afe1ff211175',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'MICRA',
 'odometer': 61685,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d2ef966-b23f-5cf2-b8e3-afe1ff211175/4d2ef966-b23f-5cf2-b8e3-afe1ff211175_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344435,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/968/1b4884a077564567bf1bf8104b14394a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN MICRA IG-T 68 kW (92 CV) E6D-F Acenta Sprint',
 'transmission': 'manual',
 'trim': 'IG-T 68 kW (92 CV) E6D-F Acenta Sprint',
 'vin': None,
 'year': 2022}
2026-03-25 18:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983035%27 HTTP/1.1" 200 None
2026-03-25 18:31:16 [ayvens.es] INFO: Saving data for 1983035: {'created_time': 1774463476.894047, 'last_price_update_time': 1774463476.894059, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983035') HTTP/1.1" 204 0
2026-03-25 18:31:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/901/f85498c59576473e9ea32807263b39af/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:16 [ayvens.es] INFO: Found listing with ID: 1983044
2026-03-25 18:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983044%27 HTTP/1.1" 200 None
2026-03-25 18:31:16 [ayvens.es] INFO: Scrape type for 1983044: 1
2026-03-25 18:31:16 [ayvens.es] INFO: Extracting data for car ID: 1983044
2026-03-25 18:31:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebc01e3f-ae56-5480-94f5-4a3648b2fac3 with identifier: 1983044
2026-03-25 18:31:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebc01e3f-ae56-5480-94f5-4a3648b2fac3 with scrape type 1
2026-03-25 18:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ebc01e3f-ae56-5480-94f5-4a3648b2fac3
2026-03-25 18:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F660%252F89c4a116878e456cb5da638f799499e0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/660/89c4a116878e456cb5da638f799499e0/images/large/1.jpg not downloaded yet
2026-03-25 18:31:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8f0c8210>
2026-03-25 18:31:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec15d7f7-194b-59d9-a048-d639fd8a98c3/ec15d7f7-194b-59d9-a048-d639fd8a98c3_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F770%252F8956683e0622497992f5d5977f01b589%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/770/8956683e0622497992f5d5977f01b589/images/large/1.jpg saved to cache
2026-03-25 18:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ec15d7f7-194b-59d9-a048-d639fd8a98c3
2026-03-25 18:31:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ec15d7f7-194b-59d9-a048-d639fd8a98c3, skipping ID generation
2026-03-25 18:31:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec15d7f7-194b-59d9-a048-d639fd8a98c3 with scrape type 1
2026-03-25 18:31:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ec15d7f7-194b-59d9-a048-d639fd8a98c3 sending to next pipeline
2026-03-25 18:31:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ec15d7f7-194b-59d9-a048-d639fd8a98c3, identifier: 1983036
2026-03-25 18:31:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ea83710>
2026-03-25 18:31:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09041162-b53d-536e-874f-7bbf0e146734/09041162-b53d-536e-874f-7bbf0e146734_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F431%252F50f833a924f649d5822f3d7f10e13e88%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/431/50f833a924f649d5822f3d7f10e13e88/images/large/1.jpg saved to cache
2026-03-25 18:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 09041162-b53d-536e-874f-7bbf0e146734
2026-03-25 18:31:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 09041162-b53d-536e-874f-7bbf0e146734, skipping ID generation
2026-03-25 18:31:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09041162-b53d-536e-874f-7bbf0e146734 with scrape type 1
2026-03-25 18:31:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 09041162-b53d-536e-874f-7bbf0e146734 sending to next pipeline
2026-03-25 18:31:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 09041162-b53d-536e-874f-7bbf0e146734, identifier: 1983037
2026-03-25 18:31:17 [ayvens.es] INFO: Found listing with ID: 1983045
2026-03-25 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983045%27 HTTP/1.1" 200 None
2026-03-25 18:31:17 [ayvens.es] INFO: Scrape type for 1983045: 1
2026-03-25 18:31:17 [ayvens.es] INFO: Extracting data for car ID: 1983045
2026-03-25 18:31:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b658712-88f0-58c6-bbf6-2b9e5aded71b with identifier: 1983045
2026-03-25 18:31:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b658712-88f0-58c6-bbf6-2b9e5aded71b with scrape type 1
2026-03-25 18:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9b658712-88f0-58c6-bbf6-2b9e5aded71b
2026-03-25 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F458%252F506cf6042d6a4170a9054b9dc85d11c8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/458/506cf6042d6a4170a9054b9dc85d11c8/images/large/1.jpg not downloaded yet
2026-03-25 18:31:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ec15d7f7-194b-59d9-a048-d639fd8a98c3 with identifier: 1983036
2026-03-25 18:31:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ec15d7f7-194b-59d9-a048-d639fd8a98c3 with identifier: 1983036
2026-03-25 18:31:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ec15d7f7-194b-59d9-a048-d639fd8a98c3 with identifier: 1983036 to the API
2026-03-25 18:31:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/770/8956683e0622497992f5d5977f01b589/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'ec15d7f7-194b-59d9-a048-d639fd8a98c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 50127,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec15d7f7-194b-59d9-a048-d639fd8a98c3/ec15d7f7-194b-59d9-a048-d639fd8a98c3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 362218,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/770/8956683e0622497992f5d5977f01b589/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 GT Puretech 130 S&S EAT8',
 'transmission': 'manual',
 'trim': 'GT Puretech 130 S&S EAT8',
 'vin': None,
 'year': 2021}
2026-03-25 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983036%27 HTTP/1.1" 200 None
2026-03-25 18:31:17 [ayvens.es] INFO: Saving data for 1983036: {'created_time': 1774463477.745922, 'last_price_update_time': 1774463477.745932, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983036') HTTP/1.1" 204 0
2026-03-25 18:31:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 09041162-b53d-536e-874f-7bbf0e146734 with identifier: 1983037
2026-03-25 18:31:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 09041162-b53d-536e-874f-7bbf0e146734 with identifier: 1983037
2026-03-25 18:31:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 09041162-b53d-536e-874f-7bbf0e146734 with identifier: 1983037 to the API
2026-03-25 18:31:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/431/50f833a924f649d5822f3d7f10e13e88/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'color': 'Azul',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '09041162-b53d-536e-874f-7bbf0e146734',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3',
 'odometer': 44620,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09041162-b53d-536e-874f-7bbf0e146734/09041162-b53d-536e-874f-7bbf0e146734_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 387473,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/431/50f833a924f649d5822f3d7f10e13e88/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 Sportback Advanced 30 TDI 85kW (116CV)',
 'transmission': 'manual',
 'trim': 'Sportback Advanced 30 TDI 85kW (116CV)',
 'vin': None,
 'year': 2023}
2026-03-25 18:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983037%27 HTTP/1.1" 200 None
2026-03-25 18:31:18 [ayvens.es] INFO: Saving data for 1983037: {'created_time': 1774463478.090098, 'last_price_update_time': 1774463478.090108, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983037') HTTP/1.1" 204 0
2026-03-25 18:31:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/838/0f41e2dc90014e308a44365221629f3e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:18 [ayvens.es] INFO: Found listing with ID: 1983046
2026-03-25 18:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983046%27 HTTP/1.1" 200 None
2026-03-25 18:31:18 [ayvens.es] INFO: Scrape type for 1983046: 1
2026-03-25 18:31:18 [ayvens.es] INFO: Extracting data for car ID: 1983046
2026-03-25 18:31:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bfb7ec4a-5f2f-5aee-a597-ff231b78f876 with identifier: 1983046
2026-03-25 18:31:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfb7ec4a-5f2f-5aee-a597-ff231b78f876 with scrape type 1
2026-03-25 18:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item bfb7ec4a-5f2f-5aee-a597-ff231b78f876
2026-03-25 18:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F254%252Ff4fb7f457b5b43f8986d091ffa53f6d7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/254/f4fb7f457b5b43f8986d091ffa53f6d7/images/large/1.jpg not downloaded yet
2026-03-25 18:31:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae909033d0>
2026-03-25 18:31:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebf729b0-a3d8-5daf-8036-b009321305a7/ebf729b0-a3d8-5daf-8036-b009321305a7_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F901%252Ff85498c59576473e9ea32807263b39af%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/901/f85498c59576473e9ea32807263b39af/images/large/1.jpg saved to cache
2026-03-25 18:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ebf729b0-a3d8-5daf-8036-b009321305a7
2026-03-25 18:31:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ebf729b0-a3d8-5daf-8036-b009321305a7, skipping ID generation
2026-03-25 18:31:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebf729b0-a3d8-5daf-8036-b009321305a7 with scrape type 1
2026-03-25 18:31:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ebf729b0-a3d8-5daf-8036-b009321305a7 sending to next pipeline
2026-03-25 18:31:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ebf729b0-a3d8-5daf-8036-b009321305a7, identifier: 1983038
2026-03-25 18:31:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/759/2dd902fdafa34d3b9e51773d13398f8e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:18 [ayvens.es] INFO: Found listing with ID: 1983047
2026-03-25 18:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983047%27 HTTP/1.1" 200 None
2026-03-25 18:31:18 [ayvens.es] INFO: Scrape type for 1983047: 1
2026-03-25 18:31:18 [ayvens.es] INFO: Extracting data for car ID: 1983047
2026-03-25 18:31:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e478dba5-d652-5997-861c-77205a8641e0 with identifier: 1983047
2026-03-25 18:31:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e478dba5-d652-5997-861c-77205a8641e0 with scrape type 1
2026-03-25 18:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e478dba5-d652-5997-861c-77205a8641e0
2026-03-25 18:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F703%252F308777cddd664cb88a1721dfa31c5b2f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/703/308777cddd664cb88a1721dfa31c5b2f/images/large/1.jpg not downloaded yet
2026-03-25 18:31:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ebf729b0-a3d8-5daf-8036-b009321305a7 with identifier: 1983038
2026-03-25 18:31:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ebf729b0-a3d8-5daf-8036-b009321305a7 with identifier: 1983038
2026-03-25 18:31:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ebf729b0-a3d8-5daf-8036-b009321305a7 with identifier: 1983038 to the API
2026-03-25 18:31:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/901/f85498c59576473e9ea32807263b39af/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'color': 'Azul',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ebf729b0-a3d8-5daf-8036-b009321305a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS 7 CROSSBACK',
 'odometer': 125828,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebf729b0-a3d8-5daf-8036-b009321305a7/ebf729b0-a3d8-5daf-8036-b009321305a7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 352772,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/901/f85498c59576473e9ea32807263b39af/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS 7 CROSSBACK BlueHDi DE 96kW (130CV) AT Bastille +',
 'transmission': 'manual',
 'trim': 'BlueHDi DE 96kW (130CV) AT Bastille +',
 'vin': None,
 'year': 2021}
2026-03-25 18:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983038%27 HTTP/1.1" 200 None
2026-03-25 18:31:18 [ayvens.es] INFO: Saving data for 1983038: {'created_time': 1774463478.728525, 'last_price_update_time': 1774463478.728534, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983038') HTTP/1.1" 204 0
2026-03-25 18:31:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/534/ab7fe1ab12af45fd91b72fe6ddf56356/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:18 [ayvens.es] INFO: Found listing with ID: 1983048
2026-03-25 18:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983048%27 HTTP/1.1" 200 None
2026-03-25 18:31:18 [ayvens.es] INFO: Scrape type for 1983048: 1
2026-03-25 18:31:18 [ayvens.es] INFO: Extracting data for car ID: 1983048
2026-03-25 18:31:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01e4dd71-2022-5d81-8791-82d1b9b7568e with identifier: 1983048
2026-03-25 18:31:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01e4dd71-2022-5d81-8791-82d1b9b7568e with scrape type 1
2026-03-25 18:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 01e4dd71-2022-5d81-8791-82d1b9b7568e
2026-03-25 18:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F324%252Fbfb8364d44b3435787740f07455ef5b1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/324/bfb8364d44b3435787740f07455ef5b1/images/large/1.jpg not downloaded yet
2026-03-25 18:31:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8f01a790>
2026-03-25 18:31:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9977394-be95-5207-9528-751fd26ee37b/b9977394-be95-5207-9528-751fd26ee37b_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F838%252F0f41e2dc90014e308a44365221629f3e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/838/0f41e2dc90014e308a44365221629f3e/images/large/1.jpg saved to cache
2026-03-25 18:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b9977394-be95-5207-9528-751fd26ee37b
2026-03-25 18:31:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b9977394-be95-5207-9528-751fd26ee37b, skipping ID generation
2026-03-25 18:31:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9977394-be95-5207-9528-751fd26ee37b with scrape type 1
2026-03-25 18:31:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b9977394-be95-5207-9528-751fd26ee37b sending to next pipeline
2026-03-25 18:31:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b9977394-be95-5207-9528-751fd26ee37b, identifier: 1983039
2026-03-25 18:31:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ed294d0>
2026-03-25 18:31:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccb74a31-9d47-55fa-9f7b-094b1dddc0b3/ccb74a31-9d47-55fa-9f7b-094b1dddc0b3_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F759%252F2dd902fdafa34d3b9e51773d13398f8e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/759/2dd902fdafa34d3b9e51773d13398f8e/images/large/1.jpg saved to cache
2026-03-25 18:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ccb74a31-9d47-55fa-9f7b-094b1dddc0b3
2026-03-25 18:31:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ccb74a31-9d47-55fa-9f7b-094b1dddc0b3, skipping ID generation
2026-03-25 18:31:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccb74a31-9d47-55fa-9f7b-094b1dddc0b3 with scrape type 1
2026-03-25 18:31:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ccb74a31-9d47-55fa-9f7b-094b1dddc0b3 sending to next pipeline
2026-03-25 18:31:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ccb74a31-9d47-55fa-9f7b-094b1dddc0b3, identifier: 1983040
2026-03-25 18:31:19 [ayvens.es] INFO: Found listing with ID: 1983049
2026-03-25 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983049%27 HTTP/1.1" 200 None
2026-03-25 18:31:19 [ayvens.es] INFO: Scrape type for 1983049: 1
2026-03-25 18:31:19 [ayvens.es] INFO: Extracting data for car ID: 1983049
2026-03-25 18:31:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66135bd0-b6ba-50fe-aa29-4bbaa4371053 with identifier: 1983049
2026-03-25 18:31:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66135bd0-b6ba-50fe-aa29-4bbaa4371053 with scrape type 1
2026-03-25 18:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 66135bd0-b6ba-50fe-aa29-4bbaa4371053
2026-03-25 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F619%252Fc461612b65a84e3d92e41d94906e4946%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/619/c461612b65a84e3d92e41d94906e4946/images/large/1.jpg not downloaded yet
2026-03-25 18:31:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b9977394-be95-5207-9528-751fd26ee37b with identifier: 1983039
2026-03-25 18:31:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b9977394-be95-5207-9528-751fd26ee37b with identifier: 1983039
2026-03-25 18:31:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b9977394-be95-5207-9528-751fd26ee37b with identifier: 1983039 to the API
2026-03-25 18:31:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/838/0f41e2dc90014e308a44365221629f3e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'color': 'Plata',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'b9977394-be95-5207-9528-751fd26ee37b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'MONDEO',
 'odometer': 130978,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9977394-be95-5207-9528-751fd26ee37b/b9977394-be95-5207-9528-751fd26ee37b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 576615,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/838/0f41e2dc90014e308a44365221629f3e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD MONDEO 2.0 Hibrido 138kW Trend HEV Auto SB',
 'transmission': 'manual',
 'trim': '2.0 Hibrido 138kW Trend HEV Auto SB',
 'vin': None,
 'year': 2020}
2026-03-25 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983039%27 HTTP/1.1" 200 None
2026-03-25 18:31:19 [ayvens.es] INFO: Saving data for 1983039: {'created_time': 1774463479.679209, 'last_price_update_time': 1774463479.67922, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983039') HTTP/1.1" 204 0
2026-03-25 18:31:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ccb74a31-9d47-55fa-9f7b-094b1dddc0b3 with identifier: 1983040
2026-03-25 18:31:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:31:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ccb74a31-9d47-55fa-9f7b-094b1dddc0b3 with identifier: 1983040
2026-03-25 18:31:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ccb74a31-9d47-55fa-9f7b-094b1dddc0b3 with identifier: 1983040 to the API
2026-03-25 18:31:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/759/2dd902fdafa34d3b9e51773d13398f8e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'gas',
 'id': 'ccb74a31-9d47-55fa-9f7b-094b1dddc0b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'DACIA',
 'model': 'DOKKER',
 'odometer': 171159,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccb74a31-9d47-55fa-9f7b-094b1dddc0b3/ccb74a31-9d47-55fa-9f7b-094b1dddc0b3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 481099,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/759/2dd902fdafa34d3b9e51773d13398f8e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-15',
 'seats_number': 2,
 'seller_name': None,
 'title': 'DACIA DOKKER Van Essential 1.6 80kW (110CV) GLP',
 'transmission': 'manual',
 'trim': 'Van Essential 1.6 80kW (110CV) GLP',
 'vin': None,
 'year': 2020}
2026-03-25 18:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983040%27 HTTP/1.1" 200 None
2026-03-25 18:31:20 [ayvens.es] INFO: Saving data for 1983040: {'created_time': 1774463480.035113, 'last_price_update_time': 1774463480.035123, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983040') HTTP/1.1" 204 0
2026-03-25 18:31:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/237/73ef6cca06e54e918f83bbf9af0ee084/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8edafad0>
2026-03-25 18:31:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7c2623d-6fec-5142-ab55-ac25cd5476f7/a7c2623d-6fec-5142-ab55-ac25cd5476f7_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F534%252Fab7fe1ab12af45fd91b72fe6ddf56356%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/534/ab7fe1ab12af45fd91b72fe6ddf56356/images/large/1.jpg saved to cache
2026-03-25 18:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a7c2623d-6fec-5142-ab55-ac25cd5476f7
2026-03-25 18:31:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a7c2623d-6fec-5142-ab55-ac25cd5476f7, skipping ID generation
2026-03-25 18:31:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7c2623d-6fec-5142-ab55-ac25cd5476f7 with scrape type 1
2026-03-25 18:31:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a7c2623d-6fec-5142-ab55-ac25cd5476f7 sending to next pipeline
2026-03-25 18:31:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a7c2623d-6fec-5142-ab55-ac25cd5476f7, identifier: 1983042
2026-03-25 18:31:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/660/89c4a116878e456cb5da638f799499e0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:20 [ayvens.es] INFO: Found listing with ID: 1983050
2026-03-25 18:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983050%27 HTTP/1.1" 200 None
2026-03-25 18:31:20 [ayvens.es] INFO: Scrape type for 1983050: 1
2026-03-25 18:31:20 [ayvens.es] INFO: Extracting data for car ID: 1983050
2026-03-25 18:31:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce6b48af-f15e-598b-a6c5-a2b9de32f1ce with identifier: 1983050
2026-03-25 18:31:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce6b48af-f15e-598b-a6c5-a2b9de32f1ce with scrape type 1
2026-03-25 18:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ce6b48af-f15e-598b-a6c5-a2b9de32f1ce
2026-03-25 18:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F757%252Fe7f978ea77b747df9331f40e9a6feae0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/757/e7f978ea77b747df9331f40e9a6feae0/images/large/1.jpg not downloaded yet
2026-03-25 18:31:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a7c2623d-6fec-5142-ab55-ac25cd5476f7 with identifier: 1983042
2026-03-25 18:31:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a7c2623d-6fec-5142-ab55-ac25cd5476f7 with identifier: 1983042
2026-03-25 18:31:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a7c2623d-6fec-5142-ab55-ac25cd5476f7 with identifier: 1983042 to the API
2026-03-25 18:31:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/534/ab7fe1ab12af45fd91b72fe6ddf56356/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a7c2623d-6fec-5142-ab55-ac25cd5476f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'KUGA',
 'odometer': 163804,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7c2623d-6fec-5142-ab55-ac25cd5476f7/a7c2623d-6fec-5142-ab55-ac25cd5476f7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347692,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/534/ab7fe1ab12af45fd91b72fe6ddf56356/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD KUGA ST-LIne Limited Edit 2.0 TDCi 110kW 4x2',
 'transmission': 'manual',
 'trim': 'ST-LIne Limited Edit 2.0 TDCi 110kW 4x2',
 'vin': None,
 'year': 2019}
2026-03-25 18:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983042%27 HTTP/1.1" 200 None
2026-03-25 18:31:20 [ayvens.es] INFO: Saving data for 1983042: {'created_time': 1774463480.592297, 'last_price_update_time': 1774463480.59231, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983042') HTTP/1.1" 204 0
2026-03-25 18:31:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/667/b734e289d8d94e87b294580ff5d7b439/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:20 [ayvens.es] INFO: Found listing with ID: 1983051
2026-03-25 18:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983051%27 HTTP/1.1" 200 None
2026-03-25 18:31:20 [ayvens.es] INFO: Scrape type for 1983051: 1
2026-03-25 18:31:20 [ayvens.es] INFO: Extracting data for car ID: 1983051
2026-03-25 18:31:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8a8c1a6-4242-5339-a017-3852d6948c25 with identifier: 1983051
2026-03-25 18:31:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8a8c1a6-4242-5339-a017-3852d6948c25 with scrape type 1
2026-03-25 18:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e8a8c1a6-4242-5339-a017-3852d6948c25
2026-03-25 18:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F917%252F75480fe1970040e59555a778c1bcdffa%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/917/75480fe1970040e59555a778c1bcdffa/images/large/1.jpg not downloaded yet
2026-03-25 18:31:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/254/f4fb7f457b5b43f8986d091ffa53f6d7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e58ec10>
2026-03-25 18:31:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b65d312-2f08-5025-bdcf-4823f8687ad2/6b65d312-2f08-5025-bdcf-4823f8687ad2_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F237%252F73ef6cca06e54e918f83bbf9af0ee084%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/237/73ef6cca06e54e918f83bbf9af0ee084/images/large/1.jpg saved to cache
2026-03-25 18:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6b65d312-2f08-5025-bdcf-4823f8687ad2
2026-03-25 18:31:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6b65d312-2f08-5025-bdcf-4823f8687ad2, skipping ID generation
2026-03-25 18:31:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b65d312-2f08-5025-bdcf-4823f8687ad2 with scrape type 1
2026-03-25 18:31:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6b65d312-2f08-5025-bdcf-4823f8687ad2 sending to next pipeline
2026-03-25 18:31:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6b65d312-2f08-5025-bdcf-4823f8687ad2, identifier: 1983043
2026-03-25 18:31:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8f407350>
2026-03-25 18:31:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebc01e3f-ae56-5480-94f5-4a3648b2fac3/ebc01e3f-ae56-5480-94f5-4a3648b2fac3_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F660%252F89c4a116878e456cb5da638f799499e0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/660/89c4a116878e456cb5da638f799499e0/images/large/1.jpg saved to cache
2026-03-25 18:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ebc01e3f-ae56-5480-94f5-4a3648b2fac3
2026-03-25 18:31:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ebc01e3f-ae56-5480-94f5-4a3648b2fac3, skipping ID generation
2026-03-25 18:31:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebc01e3f-ae56-5480-94f5-4a3648b2fac3 with scrape type 1
2026-03-25 18:31:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ebc01e3f-ae56-5480-94f5-4a3648b2fac3 sending to next pipeline
2026-03-25 18:31:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ebc01e3f-ae56-5480-94f5-4a3648b2fac3, identifier: 1983044
2026-03-25 18:31:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/458/506cf6042d6a4170a9054b9dc85d11c8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:20 [ayvens.es] INFO: Found listing with ID: 1983052
2026-03-25 18:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983052%27 HTTP/1.1" 200 None
2026-03-25 18:31:20 [ayvens.es] INFO: Scrape type for 1983052: 1
2026-03-25 18:31:20 [ayvens.es] INFO: Extracting data for car ID: 1983052
2026-03-25 18:31:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19b17ef6-81bf-5681-adbf-2b0da70da089 with identifier: 1983052
2026-03-25 18:31:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19b17ef6-81bf-5681-adbf-2b0da70da089 with scrape type 1
2026-03-25 18:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 19b17ef6-81bf-5681-adbf-2b0da70da089
2026-03-25 18:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F858%252F00fdd92e89184527892a24ee2c89f08a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/858/00fdd92e89184527892a24ee2c89f08a/images/large/1.jpg not downloaded yet
2026-03-25 18:31:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6b65d312-2f08-5025-bdcf-4823f8687ad2 with identifier: 1983043
2026-03-25 18:31:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6b65d312-2f08-5025-bdcf-4823f8687ad2 with identifier: 1983043
2026-03-25 18:31:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 6b65d312-2f08-5025-bdcf-4823f8687ad2 with identifier: 1983043 to the API
2026-03-25 18:31:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/237/73ef6cca06e54e918f83bbf9af0ee084/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 95,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '6b65d312-2f08-5025-bdcf-4823f8687ad2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C4',
 'odometer': 141241,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b65d312-2f08-5025-bdcf-4823f8687ad2/6b65d312-2f08-5025-bdcf-4823f8687ad2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 314347,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/237/73ef6cca06e54e918f83bbf9af0ee084/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C4 C4 BlueHDi 73KW (100CV) Tonic',
 'transmission': 'manual',
 'trim': 'C4 BlueHDi 73KW (100CV) Tonic',
 'vin': None,
 'year': 2018}
2026-03-25 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983043%27 HTTP/1.1" 200 None
2026-03-25 18:31:21 [ayvens.es] INFO: Saving data for 1983043: {'created_time': 1774463481.30932, 'last_price_update_time': 1774463481.30933, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983043') HTTP/1.1" 204 0
2026-03-25 18:31:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ebc01e3f-ae56-5480-94f5-4a3648b2fac3 with identifier: 1983044
2026-03-25 18:31:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ebc01e3f-ae56-5480-94f5-4a3648b2fac3 with identifier: 1983044
2026-03-25 18:31:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ebc01e3f-ae56-5480-94f5-4a3648b2fac3 with identifier: 1983044 to the API
2026-03-25 18:31:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/660/89c4a116878e456cb5da638f799499e0/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ebc01e3f-ae56-5480-94f5-4a3648b2fac3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO',
 'odometer': 187063,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebc01e3f-ae56-5480-94f5-4a3648b2fac3/ebc01e3f-ae56-5480-94f5-4a3648b2fac3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340152,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/660/89c4a116878e456cb5da638f799499e0/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT KANGOO Profesional M1-AF Blue dCi 70 kW (95 CV)',
 'transmission': 'manual',
 'trim': 'Profesional M1-AF Blue dCi 70 kW (95 CV)',
 'vin': None,
 'year': 2020}
2026-03-25 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983044%27 HTTP/1.1" 200 None
2026-03-25 18:31:21 [ayvens.es] INFO: Saving data for 1983044: {'created_time': 1774463481.646952, 'last_price_update_time': 1774463481.646963, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983044') HTTP/1.1" 204 0
2026-03-25 18:31:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/703/308777cddd664cb88a1721dfa31c5b2f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:21 [ayvens.es] INFO: Found listing with ID: 1983053
2026-03-25 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983053%27 HTTP/1.1" 200 None
2026-03-25 18:31:21 [ayvens.es] INFO: Scrape type for 1983053: 1
2026-03-25 18:31:21 [ayvens.es] INFO: Extracting data for car ID: 1983053
2026-03-25 18:31:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c9a3172-adc5-5702-939d-7f4d50e9ba36 with identifier: 1983053
2026-03-25 18:31:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c9a3172-adc5-5702-939d-7f4d50e9ba36 with scrape type 1
2026-03-25 18:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2c9a3172-adc5-5702-939d-7f4d50e9ba36
2026-03-25 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F158%252F2ed4c92ee4ca435d805a7fdd3f393974%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/158/2ed4c92ee4ca435d805a7fdd3f393974/images/large/1.jpg not downloaded yet
2026-03-25 18:31:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/324/bfb8364d44b3435787740f07455ef5b1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ec5a190>
2026-03-25 18:31:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9fba89a-6e89-532c-9e73-e1dd8b5b9d98/c9fba89a-6e89-532c-9e73-e1dd8b5b9d98_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F667%252Fb734e289d8d94e87b294580ff5d7b439%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/667/b734e289d8d94e87b294580ff5d7b439/images/large/1.jpg saved to cache
2026-03-25 18:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c9fba89a-6e89-532c-9e73-e1dd8b5b9d98
2026-03-25 18:31:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c9fba89a-6e89-532c-9e73-e1dd8b5b9d98, skipping ID generation
2026-03-25 18:31:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9fba89a-6e89-532c-9e73-e1dd8b5b9d98 with scrape type 1
2026-03-25 18:31:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c9fba89a-6e89-532c-9e73-e1dd8b5b9d98 sending to next pipeline
2026-03-25 18:31:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c9fba89a-6e89-532c-9e73-e1dd8b5b9d98, identifier: 1983041
2026-03-25 18:31:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8eda2b50>
2026-03-25 18:31:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfb7ec4a-5f2f-5aee-a597-ff231b78f876/bfb7ec4a-5f2f-5aee-a597-ff231b78f876_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F254%252Ff4fb7f457b5b43f8986d091ffa53f6d7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/254/f4fb7f457b5b43f8986d091ffa53f6d7/images/large/1.jpg saved to cache
2026-03-25 18:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bfb7ec4a-5f2f-5aee-a597-ff231b78f876
2026-03-25 18:31:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bfb7ec4a-5f2f-5aee-a597-ff231b78f876, skipping ID generation
2026-03-25 18:31:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfb7ec4a-5f2f-5aee-a597-ff231b78f876 with scrape type 1
2026-03-25 18:31:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bfb7ec4a-5f2f-5aee-a597-ff231b78f876 sending to next pipeline
2026-03-25 18:31:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: bfb7ec4a-5f2f-5aee-a597-ff231b78f876, identifier: 1983046
2026-03-25 18:31:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ec47190>
2026-03-25 18:31:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b658712-88f0-58c6-bbf6-2b9e5aded71b/9b658712-88f0-58c6-bbf6-2b9e5aded71b_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F458%252F506cf6042d6a4170a9054b9dc85d11c8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/458/506cf6042d6a4170a9054b9dc85d11c8/images/large/1.jpg saved to cache
2026-03-25 18:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9b658712-88f0-58c6-bbf6-2b9e5aded71b
2026-03-25 18:31:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9b658712-88f0-58c6-bbf6-2b9e5aded71b, skipping ID generation
2026-03-25 18:31:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b658712-88f0-58c6-bbf6-2b9e5aded71b with scrape type 1
2026-03-25 18:31:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9b658712-88f0-58c6-bbf6-2b9e5aded71b sending to next pipeline
2026-03-25 18:31:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9b658712-88f0-58c6-bbf6-2b9e5aded71b, identifier: 1983045
2026-03-25 18:31:22 [ayvens.es] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 100
2026-03-25 18:31:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c9fba89a-6e89-532c-9e73-e1dd8b5b9d98 with identifier: 1983041
2026-03-25 18:31:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:31:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c9fba89a-6e89-532c-9e73-e1dd8b5b9d98 with identifier: 1983041
2026-03-25 18:31:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c9fba89a-6e89-532c-9e73-e1dd8b5b9d98 with identifier: 1983041 to the API
2026-03-25 18:31:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/667/b734e289d8d94e87b294580ff5d7b439/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'color': 'Narvik',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c9fba89a-6e89-532c-9e73-e1dd8b5b9d98',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER EVOQUE',
 'odometer': 95867,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9fba89a-6e89-532c-9e73-e1dd8b5b9d98/c9fba89a-6e89-532c-9e73-e1dd8b5b9d98_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 657375,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/667/b734e289d8d94e87b294580ff5d7b439/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER RANGE ROVER EVOQUE 2.0 D150 S AUTO 4WD MHEV',
 'transmission': 'manual',
 'trim': '2.0 D150 S AUTO 4WD MHEV',
 'vin': None,
 'year': 2020}
2026-03-25 18:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983041%27 HTTP/1.1" 200 None
2026-03-25 18:31:22 [ayvens.es] INFO: Saving data for 1983041: {'created_time': 1774463482.602325, 'last_price_update_time': 1774463482.602336, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983041') HTTP/1.1" 204 0
2026-03-25 18:31:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: bfb7ec4a-5f2f-5aee-a597-ff231b78f876 with identifier: 1983046
2026-03-25 18:31:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:31:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: bfb7ec4a-5f2f-5aee-a597-ff231b78f876 with identifier: 1983046
2026-03-25 18:31:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: bfb7ec4a-5f2f-5aee-a597-ff231b78f876 with identifier: 1983046 to the API
2026-03-25 18:31:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/254/f4fb7f457b5b43f8986d091ffa53f6d7/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Sapporo',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'bfb7ec4a-5f2f-5aee-a597-ff231b78f876',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 64542,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfb7ec4a-5f2f-5aee-a597-ff231b78f876/bfb7ec4a-5f2f-5aee-a597-ff231b78f876_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 337595,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/254/f4fb7f457b5b43f8986d091ffa53f6d7/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI DIG-T 103kW (140CV) mHEV 4x2 Acenta',
 'transmission': 'manual',
 'trim': 'DIG-T 103kW (140CV) mHEV 4x2 Acenta',
 'vin': None,
 'year': 2022}
2026-03-25 18:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983046%27 HTTP/1.1" 200 None
2026-03-25 18:31:22 [ayvens.es] INFO: Saving data for 1983046: {'created_time': 1774463482.970342, 'last_price_update_time': 1774463482.970352, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983046') HTTP/1.1" 204 0
2026-03-25 18:31:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9b658712-88f0-58c6-bbf6-2b9e5aded71b with identifier: 1983045
2026-03-25 18:31:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9b658712-88f0-58c6-bbf6-2b9e5aded71b with identifier: 1983045
2026-03-25 18:31:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9b658712-88f0-58c6-bbf6-2b9e5aded71b with identifier: 1983045 to the API
2026-03-25 18:31:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/458/506cf6042d6a4170a9054b9dc85d11c8/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '9b658712-88f0-58c6-bbf6-2b9e5aded71b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLC-CLASS',
 'odometer': 98874,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b658712-88f0-58c6-bbf6-2b9e5aded71b/9b658712-88f0-58c6-bbf6-2b9e5aded71b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 369098,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/458/506cf6042d6a4170a9054b9dc85d11c8/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLC-CLASS GLC 200 d 4MATIC',
 'transmission': 'manual',
 'trim': 'GLC 200 d 4MATIC',
 'vin': None,
 'year': 2020}
2026-03-25 18:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983045%27 HTTP/1.1" 200 None
2026-03-25 18:31:23 [ayvens.es] INFO: Saving data for 1983045: {'created_time': 1774463483.292712, 'last_price_update_time': 1774463483.292722, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983045') HTTP/1.1" 204 0
2026-03-25 18:31:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/619/c461612b65a84e3d92e41d94906e4946/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 18:31:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/757/e7f978ea77b747df9331f40e9a6feae0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ec60750>
2026-03-25 18:31:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e478dba5-d652-5997-861c-77205a8641e0/e478dba5-d652-5997-861c-77205a8641e0_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F703%252F308777cddd664cb88a1721dfa31c5b2f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/703/308777cddd664cb88a1721dfa31c5b2f/images/large/1.jpg saved to cache
2026-03-25 18:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e478dba5-d652-5997-861c-77205a8641e0
2026-03-25 18:31:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e478dba5-d652-5997-861c-77205a8641e0, skipping ID generation
2026-03-25 18:31:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e478dba5-d652-5997-861c-77205a8641e0 with scrape type 1
2026-03-25 18:31:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e478dba5-d652-5997-861c-77205a8641e0 sending to next pipeline
2026-03-25 18:31:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e478dba5-d652-5997-861c-77205a8641e0, identifier: 1983047
2026-03-25 18:31:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8d423a90>
2026-03-25 18:31:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01e4dd71-2022-5d81-8791-82d1b9b7568e/01e4dd71-2022-5d81-8791-82d1b9b7568e_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F324%252Fbfb8364d44b3435787740f07455ef5b1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/324/bfb8364d44b3435787740f07455ef5b1/images/large/1.jpg saved to cache
2026-03-25 18:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 01e4dd71-2022-5d81-8791-82d1b9b7568e
2026-03-25 18:31:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 01e4dd71-2022-5d81-8791-82d1b9b7568e, skipping ID generation
2026-03-25 18:31:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01e4dd71-2022-5d81-8791-82d1b9b7568e with scrape type 1
2026-03-25 18:31:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 01e4dd71-2022-5d81-8791-82d1b9b7568e sending to next pipeline
2026-03-25 18:31:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 01e4dd71-2022-5d81-8791-82d1b9b7568e, identifier: 1983048
2026-03-25 18:31:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e478dba5-d652-5997-861c-77205a8641e0 with identifier: 1983047
2026-03-25 18:31:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e478dba5-d652-5997-861c-77205a8641e0 with identifier: 1983047
2026-03-25 18:31:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e478dba5-d652-5997-861c-77205a8641e0 with identifier: 1983047 to the API
2026-03-25 18:31:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/703/308777cddd664cb88a1721dfa31c5b2f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'e478dba5-d652-5997-861c-77205a8641e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ARONA',
 'odometer': 64983,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e478dba5-d652-5997-861c-77205a8641e0/e478dba5-d652-5997-861c-77205a8641e0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 339866,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/703/308777cddd664cb88a1721dfa31c5b2f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ARONA 1.0 TSI 85kW (115CV) Style Go Eco',
 'transmission': 'manual',
 'trim': '1.0 TSI 85kW (115CV) Style Go Eco',
 'vin': None,
 'year': 2020}
2026-03-25 18:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983047%27 HTTP/1.1" 200 None
2026-03-25 18:31:23 [ayvens.es] INFO: Saving data for 1983047: {'created_time': 1774463483.904061, 'last_price_update_time': 1774463483.904071, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983047') HTTP/1.1" 204 0
2026-03-25 18:31:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 01e4dd71-2022-5d81-8791-82d1b9b7568e with identifier: 1983048
2026-03-25 18:31:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 01e4dd71-2022-5d81-8791-82d1b9b7568e with identifier: 1983048
2026-03-25 18:31:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 01e4dd71-2022-5d81-8791-82d1b9b7568e with identifier: 1983048 to the API
2026-03-25 18:31:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/324/bfb8364d44b3435787740f07455ef5b1/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '01e4dd71-2022-5d81-8791-82d1b9b7568e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008',
 'odometer': 57222,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01e4dd71-2022-5d81-8791-82d1b9b7568e/01e4dd71-2022-5d81-8791-82d1b9b7568e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 338803,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/324/bfb8364d44b3435787740f07455ef5b1/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-22',
 'seats_number': 7,
 'seller_name': None,
 'title': 'PEUGEOT 5008 1.5 BlueHDi 96kW (130CV) S&S Allure',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi 96kW (130CV) S&S Allure',
 'vin': None,
 'year': 2021}
2026-03-25 18:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983048%27 HTTP/1.1" 200 None
2026-03-25 18:31:24 [ayvens.es] INFO: Saving data for 1983048: {'created_time': 1774463484.270471, 'last_price_update_time': 1774463484.270488, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983048') HTTP/1.1" 204 0
2026-03-25 18:31:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/917/75480fe1970040e59555a778c1bcdffa/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/858/00fdd92e89184527892a24ee2c89f08a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8eaa24d0>
2026-03-25 18:31:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66135bd0-b6ba-50fe-aa29-4bbaa4371053/66135bd0-b6ba-50fe-aa29-4bbaa4371053_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F619%252Fc461612b65a84e3d92e41d94906e4946%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/619/c461612b65a84e3d92e41d94906e4946/images/large/1.jpg saved to cache
2026-03-25 18:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 66135bd0-b6ba-50fe-aa29-4bbaa4371053
2026-03-25 18:31:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 66135bd0-b6ba-50fe-aa29-4bbaa4371053, skipping ID generation
2026-03-25 18:31:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66135bd0-b6ba-50fe-aa29-4bbaa4371053 with scrape type 1
2026-03-25 18:31:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 66135bd0-b6ba-50fe-aa29-4bbaa4371053 sending to next pipeline
2026-03-25 18:31:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 66135bd0-b6ba-50fe-aa29-4bbaa4371053, identifier: 1983049
2026-03-25 18:31:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8f019f90>
2026-03-25 18:31:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce6b48af-f15e-598b-a6c5-a2b9de32f1ce/ce6b48af-f15e-598b-a6c5-a2b9de32f1ce_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F757%252Fe7f978ea77b747df9331f40e9a6feae0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/757/e7f978ea77b747df9331f40e9a6feae0/images/large/1.jpg saved to cache
2026-03-25 18:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ce6b48af-f15e-598b-a6c5-a2b9de32f1ce
2026-03-25 18:31:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ce6b48af-f15e-598b-a6c5-a2b9de32f1ce, skipping ID generation
2026-03-25 18:31:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce6b48af-f15e-598b-a6c5-a2b9de32f1ce with scrape type 1
2026-03-25 18:31:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ce6b48af-f15e-598b-a6c5-a2b9de32f1ce sending to next pipeline
2026-03-25 18:31:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ce6b48af-f15e-598b-a6c5-a2b9de32f1ce, identifier: 1983050
2026-03-25 18:31:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 66135bd0-b6ba-50fe-aa29-4bbaa4371053 with identifier: 1983049
2026-03-25 18:31:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 66135bd0-b6ba-50fe-aa29-4bbaa4371053 with identifier: 1983049
2026-03-25 18:31:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 66135bd0-b6ba-50fe-aa29-4bbaa4371053 with identifier: 1983049 to the API
2026-03-25 18:31:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/619/c461612b65a84e3d92e41d94906e4946/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 188,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '66135bd0-b6ba-50fe-aa29-4bbaa4371053',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'TRAFIC',
 'odometer': 45403,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66135bd0-b6ba-50fe-aa29-4bbaa4371053/66135bd0-b6ba-50fe-aa29-4bbaa4371053_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 321913,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/619/c461612b65a84e3d92e41d94906e4946/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-06-21',
 'seats_number': 9,
 'seller_name': None,
 'title': 'RENAULT TRAFIC (O) Authentic Energy Blue dCi 81 kW (110CV)',
 'transmission': 'manual',
 'trim': '(O) Authentic Energy Blue dCi 81 kW (110CV)',
 'vin': None,
 'year': 2024}
2026-03-25 18:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983049%27 HTTP/1.1" 200 None
2026-03-25 18:31:24 [ayvens.es] INFO: Saving data for 1983049: {'created_time': 1774463484.906515, 'last_price_update_time': 1774463484.906527, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983049') HTTP/1.1" 204 0
2026-03-25 18:31:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ce6b48af-f15e-598b-a6c5-a2b9de32f1ce with identifier: 1983050
2026-03-25 18:31:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ce6b48af-f15e-598b-a6c5-a2b9de32f1ce with identifier: 1983050
2026-03-25 18:31:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ce6b48af-f15e-598b-a6c5-a2b9de32f1ce with identifier: 1983050 to the API
2026-03-25 18:31:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/757/e7f978ea77b747df9331f40e9a6feae0/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ce6b48af-f15e-598b-a6c5-a2b9de32f1ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'KUGA',
 'odometer': 54070,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce6b48af-f15e-598b-a6c5-a2b9de32f1ce/ce6b48af-f15e-598b-a6c5-a2b9de32f1ce_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353394,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/757/e7f978ea77b747df9331f40e9a6feae0/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD KUGA (O) ST-Line 1.5 EcoBlue 88kW (120CV)',
 'transmission': 'manual',
 'trim': '(O) ST-Line 1.5 EcoBlue 88kW (120CV)',
 'vin': None,
 'year': 2022}
2026-03-25 18:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983050%27 HTTP/1.1" 200 None
2026-03-25 18:31:25 [ayvens.es] INFO: Saving data for 1983050: {'created_time': 1774463485.278445, 'last_price_update_time': 1774463485.278455, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983050') HTTP/1.1" 204 0
2026-03-25 18:31:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/158/2ed4c92ee4ca435d805a7fdd3f393974/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ec50dd0>
2026-03-25 18:31:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8a8c1a6-4242-5339-a017-3852d6948c25/e8a8c1a6-4242-5339-a017-3852d6948c25_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F917%252F75480fe1970040e59555a778c1bcdffa%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/917/75480fe1970040e59555a778c1bcdffa/images/large/1.jpg saved to cache
2026-03-25 18:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e8a8c1a6-4242-5339-a017-3852d6948c25
2026-03-25 18:31:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e8a8c1a6-4242-5339-a017-3852d6948c25, skipping ID generation
2026-03-25 18:31:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8a8c1a6-4242-5339-a017-3852d6948c25 with scrape type 1
2026-03-25 18:31:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e8a8c1a6-4242-5339-a017-3852d6948c25 sending to next pipeline
2026-03-25 18:31:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e8a8c1a6-4242-5339-a017-3852d6948c25, identifier: 1983051
2026-03-25 18:31:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ed16c50>
2026-03-25 18:31:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19b17ef6-81bf-5681-adbf-2b0da70da089/19b17ef6-81bf-5681-adbf-2b0da70da089_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F858%252F00fdd92e89184527892a24ee2c89f08a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/858/00fdd92e89184527892a24ee2c89f08a/images/large/1.jpg saved to cache
2026-03-25 18:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 19b17ef6-81bf-5681-adbf-2b0da70da089
2026-03-25 18:31:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 19b17ef6-81bf-5681-adbf-2b0da70da089, skipping ID generation
2026-03-25 18:31:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19b17ef6-81bf-5681-adbf-2b0da70da089 with scrape type 1
2026-03-25 18:31:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 19b17ef6-81bf-5681-adbf-2b0da70da089 sending to next pipeline
2026-03-25 18:31:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 19b17ef6-81bf-5681-adbf-2b0da70da089, identifier: 1983052
2026-03-25 18:31:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e8a8c1a6-4242-5339-a017-3852d6948c25 with identifier: 1983051
2026-03-25 18:31:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:31:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e8a8c1a6-4242-5339-a017-3852d6948c25 with identifier: 1983051
2026-03-25 18:31:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e8a8c1a6-4242-5339-a017-3852d6948c25 with identifier: 1983051 to the API
2026-03-25 18:31:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/917/75480fe1970040e59555a778c1bcdffa/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 214,
 'color': 'Bluefire',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'e8a8c1a6-4242-5339-a017-3852d6948c25',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'JAGUAR',
 'model': 'F-PACE',
 'odometer': 57104,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8a8c1a6-4242-5339-a017-3852d6948c25/e8a8c1a6-4242-5339-a017-3852d6948c25_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 355104,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/917/75480fe1970040e59555a778c1bcdffa/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'JAGUAR F-PACE 2.0 I4 250PS AWD Auto R-Dynamic S',
 'transmission': 'manual',
 'trim': '2.0 I4 250PS AWD Auto R-Dynamic S',
 'vin': None,
 'year': 2022}
2026-03-25 18:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983051%27 HTTP/1.1" 200 None
2026-03-25 18:31:25 [ayvens.es] INFO: Saving data for 1983051: {'created_time': 1774463485.923656, 'last_price_update_time': 1774463485.923667, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983051') HTTP/1.1" 204 0
2026-03-25 18:31:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 19b17ef6-81bf-5681-adbf-2b0da70da089 with identifier: 1983052
2026-03-25 18:31:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 19b17ef6-81bf-5681-adbf-2b0da70da089 with identifier: 1983052
2026-03-25 18:31:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 19b17ef6-81bf-5681-adbf-2b0da70da089 with identifier: 1983052 to the API
2026-03-25 18:31:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/858/00fdd92e89184527892a24ee2c89f08a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '19b17ef6-81bf-5681-adbf-2b0da70da089',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'BERLINGO',
 'odometer': 151912,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19b17ef6-81bf-5681-adbf-2b0da70da089/19b17ef6-81bf-5681-adbf-2b0da70da089_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 314128,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/858/00fdd92e89184527892a24ee2c89f08a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-18',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROËN BERLINGO Talla M BlueHDi 100 CONTROL',
 'transmission': 'manual',
 'trim': 'Talla M BlueHDi 100 CONTROL',
 'vin': None,
 'year': 2021}
2026-03-25 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983052%27 HTTP/1.1" 200 None
2026-03-25 18:31:26 [ayvens.es] INFO: Saving data for 1983052: {'created_time': 1774463486.292892, 'last_price_update_time': 1774463486.292909, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983052') HTTP/1.1" 204 0
2026-03-25 18:31:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ee78310>
2026-03-25 18:31:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c9a3172-adc5-5702-939d-7f4d50e9ba36/2c9a3172-adc5-5702-939d-7f4d50e9ba36_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F158%252F2ed4c92ee4ca435d805a7fdd3f393974%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/158/2ed4c92ee4ca435d805a7fdd3f393974/images/large/1.jpg saved to cache
2026-03-25 18:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2c9a3172-adc5-5702-939d-7f4d50e9ba36
2026-03-25 18:31:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2c9a3172-adc5-5702-939d-7f4d50e9ba36, skipping ID generation
2026-03-25 18:31:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c9a3172-adc5-5702-939d-7f4d50e9ba36 with scrape type 1
2026-03-25 18:31:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2c9a3172-adc5-5702-939d-7f4d50e9ba36 sending to next pipeline
2026-03-25 18:31:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2c9a3172-adc5-5702-939d-7f4d50e9ba36, identifier: 1983053
2026-03-25 18:31:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2c9a3172-adc5-5702-939d-7f4d50e9ba36 with identifier: 1983053
2026-03-25 18:31:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2c9a3172-adc5-5702-939d-7f4d50e9ba36 with identifier: 1983053
2026-03-25 18:31:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 2c9a3172-adc5-5702-939d-7f4d50e9ba36 with identifier: 1983053 to the API
2026-03-25 18:31:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/158/2ed4c92ee4ca435d805a7fdd3f393974/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '2c9a3172-adc5-5702-939d-7f4d50e9ba36',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'BERLINGO',
 'odometer': 110054,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c9a3172-adc5-5702-939d-7f4d50e9ba36/2c9a3172-adc5-5702-939d-7f4d50e9ba36_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324009,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/158/2ed4c92ee4ca435d805a7fdd3f393974/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-17',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROËN BERLINGO Talla M BlueHDi 100 CONTROL',
 'transmission': 'manual',
 'trim': 'Talla M BlueHDi 100 CONTROL',
 'vin': None,
 'year': 2021}
2026-03-25 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983053%27 HTTP/1.1" 200 None
2026-03-25 18:31:26 [ayvens.es] INFO: Saving data for 1983053: {'created_time': 1774463486.780258, 'last_price_update_time': 1774463486.780268, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983053') HTTP/1.1" 204 0
2026-03-25 18:31:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-25 18:31:27 [ayvens.es] INFO: Found listing with ID: 1983054
2026-03-25 18:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983054%27 HTTP/1.1" 200 None
2026-03-25 18:31:27 [ayvens.es] INFO: Scrape type for 1983054: 1
2026-03-25 18:31:27 [ayvens.es] INFO: Extracting data for car ID: 1983054
2026-03-25 18:31:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06ccf973-2e79-58b6-84ec-b9ea9dc32431 with identifier: 1983054
2026-03-25 18:31:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06ccf973-2e79-58b6-84ec-b9ea9dc32431 with scrape type 1
2026-03-25 18:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 06ccf973-2e79-58b6-84ec-b9ea9dc32431
2026-03-25 18:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F734%252F21cfa0bd2bcf47e4aea89c3f35db0588%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/734/21cfa0bd2bcf47e4aea89c3f35db0588/images/large/1.jpg not downloaded yet
2026-03-25 18:31:27 [ayvens.es] INFO: Found listing with ID: 1983055
2026-03-25 18:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983055%27 HTTP/1.1" 200 None
2026-03-25 18:31:27 [ayvens.es] INFO: Scrape type for 1983055: 1
2026-03-25 18:31:27 [ayvens.es] INFO: Extracting data for car ID: 1983055
2026-03-25 18:31:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 851861c7-c208-5e49-930f-a0266e34ab47 with identifier: 1983055
2026-03-25 18:31:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 851861c7-c208-5e49-930f-a0266e34ab47 with scrape type 1
2026-03-25 18:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 851861c7-c208-5e49-930f-a0266e34ab47
2026-03-25 18:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F395%252F6b1d7e6bb0c144adac8c788aaf2f309d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/395/6b1d7e6bb0c144adac8c788aaf2f309d/images/large/1.jpg not downloaded yet
2026-03-25 18:31:27 [ayvens.es] INFO: Found listing with ID: 1983056
2026-03-25 18:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983056%27 HTTP/1.1" 200 None
2026-03-25 18:31:27 [ayvens.es] INFO: Scrape type for 1983056: 1
2026-03-25 18:31:27 [ayvens.es] INFO: Extracting data for car ID: 1983056
2026-03-25 18:31:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4e498b7-165e-5542-a716-06820ccdf92a with identifier: 1983056
2026-03-25 18:31:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4e498b7-165e-5542-a716-06820ccdf92a with scrape type 1
2026-03-25 18:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b4e498b7-165e-5542-a716-06820ccdf92a
2026-03-25 18:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F784%252Fc2d9d89635bf4595a78e23048bdd740d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/784/c2d9d89635bf4595a78e23048bdd740d/images/large/1.jpg not downloaded yet
2026-03-25 18:31:27 [ayvens.es] INFO: Found listing with ID: 1983057
2026-03-25 18:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983057%27 HTTP/1.1" 200 None
2026-03-25 18:31:27 [ayvens.es] INFO: Scrape type for 1983057: 1
2026-03-25 18:31:27 [ayvens.es] INFO: Extracting data for car ID: 1983057
2026-03-25 18:31:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4aa6efd9-a037-574a-b074-bc31bb34910c with identifier: 1983057
2026-03-25 18:31:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4aa6efd9-a037-574a-b074-bc31bb34910c with scrape type 1
2026-03-25 18:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4aa6efd9-a037-574a-b074-bc31bb34910c
2026-03-25 18:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F949%252F48a7a0bec4124c2fa4496fd6c7fa6ec7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/949/48a7a0bec4124c2fa4496fd6c7fa6ec7/images/large/1.jpg not downloaded yet
2026-03-25 18:31:27 [ayvens.es] INFO: Found listing with ID: 1983058
2026-03-25 18:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983058%27 HTTP/1.1" 200 None
2026-03-25 18:31:27 [ayvens.es] INFO: Scrape type for 1983058: 1
2026-03-25 18:31:27 [ayvens.es] INFO: Extracting data for car ID: 1983058
2026-03-25 18:31:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb01de8d-44fd-5982-9055-8312e267d0c4 with identifier: 1983058
2026-03-25 18:31:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb01de8d-44fd-5982-9055-8312e267d0c4 with scrape type 1
2026-03-25 18:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item cb01de8d-44fd-5982-9055-8312e267d0c4
2026-03-25 18:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F478%252Fed9c9f4240a9463fadd27274764fc362%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/478/ed9c9f4240a9463fadd27274764fc362/images/large/1.jpg not downloaded yet
2026-03-25 18:31:27 [ayvens.es] INFO: Found listing with ID: 1983059
2026-03-25 18:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983059%27 HTTP/1.1" 200 None
2026-03-25 18:31:27 [ayvens.es] INFO: Scrape type for 1983059: 1
2026-03-25 18:31:27 [ayvens.es] INFO: Extracting data for car ID: 1983059
2026-03-25 18:31:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0cbe8183-4ca8-5dee-8685-9317eeaaf573 with identifier: 1983059
2026-03-25 18:31:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cbe8183-4ca8-5dee-8685-9317eeaaf573 with scrape type 1
2026-03-25 18:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0cbe8183-4ca8-5dee-8685-9317eeaaf573
2026-03-25 18:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F378%252Fda02d3c39bc6458d9c9064fafccd39d9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/378/da02d3c39bc6458d9c9064fafccd39d9/images/large/1.jpg not downloaded yet
2026-03-25 18:31:28 [ayvens.es] INFO: Found listing with ID: 1983060
2026-03-25 18:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983060%27 HTTP/1.1" 200 None
2026-03-25 18:31:28 [ayvens.es] INFO: Scrape type for 1983060: 1
2026-03-25 18:31:28 [ayvens.es] INFO: Extracting data for car ID: 1983060
2026-03-25 18:31:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f42b8a6-f092-5e85-82f9-20b5f25ca30a with identifier: 1983060
2026-03-25 18:31:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f42b8a6-f092-5e85-82f9-20b5f25ca30a with scrape type 1
2026-03-25 18:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5f42b8a6-f092-5e85-82f9-20b5f25ca30a
2026-03-25 18:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F888%252Fd309c38fc9e840fc88a8132a8d071171%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/888/d309c38fc9e840fc88a8132a8d071171/images/large/1.jpg not downloaded yet
2026-03-25 18:31:28 [ayvens.es] INFO: Found listing with ID: 1983061
2026-03-25 18:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983061%27 HTTP/1.1" 200 None
2026-03-25 18:31:28 [ayvens.es] INFO: Scrape type for 1983061: 1
2026-03-25 18:31:28 [ayvens.es] INFO: Extracting data for car ID: 1983061
2026-03-25 18:31:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48b2eb63-919f-562f-9f2c-5509dea6465b with identifier: 1983061
2026-03-25 18:31:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48b2eb63-919f-562f-9f2c-5509dea6465b with scrape type 1
2026-03-25 18:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 48b2eb63-919f-562f-9f2c-5509dea6465b
2026-03-25 18:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F892%252Fdc2366631e9b45d89f252aae1fcb4b18%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/892/dc2366631e9b45d89f252aae1fcb4b18/images/large/1.jpg not downloaded yet
2026-03-25 18:31:28 [ayvens.es] INFO: Found listing with ID: 1983062
2026-03-25 18:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983062%27 HTTP/1.1" 200 None
2026-03-25 18:31:28 [ayvens.es] INFO: Scrape type for 1983062: 1
2026-03-25 18:31:28 [ayvens.es] INFO: Extracting data for car ID: 1983062
2026-03-25 18:31:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0bd45df-da94-5501-a30f-c2e10a76ffaa with identifier: 1983062
2026-03-25 18:31:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0bd45df-da94-5501-a30f-c2e10a76ffaa with scrape type 1
2026-03-25 18:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b0bd45df-da94-5501-a30f-c2e10a76ffaa
2026-03-25 18:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F148%252F12ea2752864d46d8bd87e5593c835554%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/148/12ea2752864d46d8bd87e5593c835554/images/large/1.jpg not downloaded yet
2026-03-25 18:31:28 [ayvens.es] INFO: Found listing with ID: 1983063
2026-03-25 18:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983063%27 HTTP/1.1" 200 None
2026-03-25 18:31:28 [ayvens.es] INFO: Scrape type for 1983063: 1
2026-03-25 18:31:28 [ayvens.es] INFO: Extracting data for car ID: 1983063
2026-03-25 18:31:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6bc765b2-e171-5054-859d-dd84de090eaf with identifier: 1983063
2026-03-25 18:31:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bc765b2-e171-5054-859d-dd84de090eaf with scrape type 1
2026-03-25 18:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6bc765b2-e171-5054-859d-dd84de090eaf
2026-03-25 18:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F230%252F6557cf4e47f94c74ac21faef035fcb9b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/230/6557cf4e47f94c74ac21faef035fcb9b/images/large/1.jpg not downloaded yet
2026-03-25 18:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/949/48a7a0bec4124c2fa4496fd6c7fa6ec7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/395/6b1d7e6bb0c144adac8c788aaf2f309d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:28 [ayvens.es] INFO: Found listing with ID: 1983064
2026-03-25 18:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983064%27 HTTP/1.1" 200 None
2026-03-25 18:31:28 [ayvens.es] INFO: Scrape type for 1983064: 1
2026-03-25 18:31:28 [ayvens.es] INFO: Extracting data for car ID: 1983064
2026-03-25 18:31:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6ded1f4-ada9-5e3e-aae5-a3c05280cf57 with identifier: 1983064
2026-03-25 18:31:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6ded1f4-ada9-5e3e-aae5-a3c05280cf57 with scrape type 1
2026-03-25 18:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c6ded1f4-ada9-5e3e-aae5-a3c05280cf57
2026-03-25 18:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F624%252F7fbcbbba53d74dc19f7de29d30431d0f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/624/7fbcbbba53d74dc19f7de29d30431d0f/images/large/1.jpg not downloaded yet
2026-03-25 18:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/478/ed9c9f4240a9463fadd27274764fc362/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:28 [ayvens.es] INFO: Found listing with ID: 1983065
2026-03-25 18:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983065%27 HTTP/1.1" 200 None
2026-03-25 18:31:28 [ayvens.es] INFO: Scrape type for 1983065: 1
2026-03-25 18:31:28 [ayvens.es] INFO: Extracting data for car ID: 1983065
2026-03-25 18:31:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c17494ce-12f1-5207-b434-f8e96664c82c with identifier: 1983065
2026-03-25 18:31:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c17494ce-12f1-5207-b434-f8e96664c82c with scrape type 1
2026-03-25 18:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c17494ce-12f1-5207-b434-f8e96664c82c
2026-03-25 18:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F811%252Fde2cec4714e8464b825e76874452704b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/811/de2cec4714e8464b825e76874452704b/images/large/1.jpg not downloaded yet
2026-03-25 18:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/784/c2d9d89635bf4595a78e23048bdd740d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/734/21cfa0bd2bcf47e4aea89c3f35db0588/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:28 [ayvens.es] INFO: Found listing with ID: 1983066
2026-03-25 18:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983066%27 HTTP/1.1" 200 None
2026-03-25 18:31:28 [ayvens.es] INFO: Scrape type for 1983066: 1
2026-03-25 18:31:28 [ayvens.es] INFO: Extracting data for car ID: 1983066
2026-03-25 18:31:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c97f34d-179a-5839-a0fd-79517894a3c8 with identifier: 1983066
2026-03-25 18:31:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c97f34d-179a-5839-a0fd-79517894a3c8 with scrape type 1
2026-03-25 18:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2c97f34d-179a-5839-a0fd-79517894a3c8
2026-03-25 18:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F001%252F8eec4e81561b4e68a01e2b2ab754dd34%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/001/8eec4e81561b4e68a01e2b2ab754dd34/images/large/1.jpg not downloaded yet
2026-03-25 18:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/378/da02d3c39bc6458d9c9064fafccd39d9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ed73b90>
2026-03-25 18:31:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4aa6efd9-a037-574a-b074-bc31bb34910c/4aa6efd9-a037-574a-b074-bc31bb34910c_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F949%252F48a7a0bec4124c2fa4496fd6c7fa6ec7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/949/48a7a0bec4124c2fa4496fd6c7fa6ec7/images/large/1.jpg saved to cache
2026-03-25 18:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4aa6efd9-a037-574a-b074-bc31bb34910c
2026-03-25 18:31:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4aa6efd9-a037-574a-b074-bc31bb34910c, skipping ID generation
2026-03-25 18:31:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4aa6efd9-a037-574a-b074-bc31bb34910c with scrape type 1
2026-03-25 18:31:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4aa6efd9-a037-574a-b074-bc31bb34910c sending to next pipeline
2026-03-25 18:31:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4aa6efd9-a037-574a-b074-bc31bb34910c, identifier: 1983057
2026-03-25 18:31:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae90b0e7d0>
2026-03-25 18:31:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_851861c7-c208-5e49-930f-a0266e34ab47/851861c7-c208-5e49-930f-a0266e34ab47_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F395%252F6b1d7e6bb0c144adac8c788aaf2f309d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/395/6b1d7e6bb0c144adac8c788aaf2f309d/images/large/1.jpg saved to cache
2026-03-25 18:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 851861c7-c208-5e49-930f-a0266e34ab47
2026-03-25 18:31:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 851861c7-c208-5e49-930f-a0266e34ab47, skipping ID generation
2026-03-25 18:31:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 851861c7-c208-5e49-930f-a0266e34ab47 with scrape type 1
2026-03-25 18:31:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 851861c7-c208-5e49-930f-a0266e34ab47 sending to next pipeline
2026-03-25 18:31:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 851861c7-c208-5e49-930f-a0266e34ab47, identifier: 1983055
2026-03-25 18:31:28 [ayvens.es] INFO: Found listing with ID: 1983067
2026-03-25 18:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983067%27 HTTP/1.1" 200 None
2026-03-25 18:31:28 [ayvens.es] INFO: Scrape type for 1983067: 1
2026-03-25 18:31:28 [ayvens.es] INFO: Extracting data for car ID: 1983067
2026-03-25 18:31:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ca1f7b2-56ea-5681-9ee0-d0bc93c45442 with identifier: 1983067
2026-03-25 18:31:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ca1f7b2-56ea-5681-9ee0-d0bc93c45442 with scrape type 1
2026-03-25 18:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9ca1f7b2-56ea-5681-9ee0-d0bc93c45442
2026-03-25 18:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F722%252Fea237c23ee494a1c81e6a4605bb1756b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/722/ea237c23ee494a1c81e6a4605bb1756b/images/large/1.jpg not downloaded yet
2026-03-25 18:31:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4aa6efd9-a037-574a-b074-bc31bb34910c with identifier: 1983057
2026-03-25 18:31:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4aa6efd9-a037-574a-b074-bc31bb34910c with identifier: 1983057
2026-03-25 18:31:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 4aa6efd9-a037-574a-b074-bc31bb34910c with identifier: 1983057 to the API
2026-03-25 18:31:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/949/48a7a0bec4124c2fa4496fd6c7fa6ec7/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 190,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '3.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '4aa6efd9-a037-574a-b074-bc31bb34910c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLE',
 'odometer': 123124,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4aa6efd9-a037-574a-b074-bc31bb34910c/4aa6efd9-a037-574a-b074-bc31bb34910c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 410484,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/949/48a7a0bec4124c2fa4496fd6c7fa6ec7/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLE GLE 450 4MATIC',
 'transmission': 'manual',
 'trim': 'GLE 450 4MATIC',
 'vin': None,
 'year': 2020}
2026-03-25 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983057%27 HTTP/1.1" 200 None
2026-03-25 18:31:29 [ayvens.es] INFO: Saving data for 1983057: {'created_time': 1774463489.234323, 'last_price_update_time': 1774463489.234333, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983057') HTTP/1.1" 204 0
2026-03-25 18:31:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 851861c7-c208-5e49-930f-a0266e34ab47 with identifier: 1983055
2026-03-25 18:31:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 851861c7-c208-5e49-930f-a0266e34ab47 with identifier: 1983055
2026-03-25 18:31:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 851861c7-c208-5e49-930f-a0266e34ab47 with identifier: 1983055 to the API
2026-03-25 18:31:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/395/6b1d7e6bb0c144adac8c788aaf2f309d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '0.9L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '851861c7-c208-5e49-930f-a0266e34ab47',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 122314,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_851861c7-c208-5e49-930f-a0266e34ab47/851861c7-c208-5e49-930f-a0266e34ab47_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 314089,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/395/6b1d7e6bb0c144adac8c788aaf2f309d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO (E) Business Energy TCe 55kW (75CV) -18',
 'transmission': 'manual',
 'trim': '(E) Business Energy TCe 55kW (75CV) -18',
 'vin': None,
 'year': 2018}
2026-03-25 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983055%27 HTTP/1.1" 200 None
2026-03-25 18:31:29 [ayvens.es] INFO: Saving data for 1983055: {'created_time': 1774463489.697016, 'last_price_update_time': 1774463489.697027, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983055') HTTP/1.1" 204 0
2026-03-25 18:31:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8eab5b10>
2026-03-25 18:31:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb01de8d-44fd-5982-9055-8312e267d0c4/cb01de8d-44fd-5982-9055-8312e267d0c4_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F478%252Fed9c9f4240a9463fadd27274764fc362%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/478/ed9c9f4240a9463fadd27274764fc362/images/large/1.jpg saved to cache
2026-03-25 18:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cb01de8d-44fd-5982-9055-8312e267d0c4
2026-03-25 18:31:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cb01de8d-44fd-5982-9055-8312e267d0c4, skipping ID generation
2026-03-25 18:31:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb01de8d-44fd-5982-9055-8312e267d0c4 with scrape type 1
2026-03-25 18:31:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cb01de8d-44fd-5982-9055-8312e267d0c4 sending to next pipeline
2026-03-25 18:31:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: cb01de8d-44fd-5982-9055-8312e267d0c4, identifier: 1983058
2026-03-25 18:31:29 [ayvens.es] INFO: Found listing with ID: 1983068
2026-03-25 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983068%27 HTTP/1.1" 200 None
2026-03-25 18:31:29 [ayvens.es] INFO: Scrape type for 1983068: 1
2026-03-25 18:31:29 [ayvens.es] INFO: Extracting data for car ID: 1983068
2026-03-25 18:31:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9d8328e-59f9-5e2a-ae69-fe71b28f3e5d with identifier: 1983068
2026-03-25 18:31:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9d8328e-59f9-5e2a-ae69-fe71b28f3e5d with scrape type 1
2026-03-25 18:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e9d8328e-59f9-5e2a-ae69-fe71b28f3e5d
2026-03-25 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F308%252F5b446a065ec2486e9ba8c48e9f8aec45%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/308/5b446a065ec2486e9ba8c48e9f8aec45/images/large/1.jpg not downloaded yet
2026-03-25 18:31:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: cb01de8d-44fd-5982-9055-8312e267d0c4 with identifier: 1983058
2026-03-25 18:31:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: cb01de8d-44fd-5982-9055-8312e267d0c4 with identifier: 1983058
2026-03-25 18:31:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: cb01de8d-44fd-5982-9055-8312e267d0c4 with identifier: 1983058 to the API
2026-03-25 18:31:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/478/ed9c9f4240a9463fadd27274764fc362/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.7L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'cb01de8d-44fd-5982-9055-8312e267d0c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 252065,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb01de8d-44fd-5982-9055-8312e267d0c4/cb01de8d-44fd-5982-9055-8312e267d0c4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 322448,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/478/ed9c9f4240a9463fadd27274764fc362/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI dCi 150CV (110kW) 4WD ACENTA',
 'transmission': 'manual',
 'trim': 'dCi 150CV (110kW) 4WD ACENTA',
 'vin': None,
 'year': 2020}
2026-03-25 18:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983058%27 HTTP/1.1" 200 None
2026-03-25 18:31:30 [ayvens.es] INFO: Saving data for 1983058: {'created_time': 1774463490.25415, 'last_price_update_time': 1774463490.254161, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983058') HTTP/1.1" 204 0
2026-03-25 18:31:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/888/d309c38fc9e840fc88a8132a8d071171/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e589e90>
2026-03-25 18:31:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4e498b7-165e-5542-a716-06820ccdf92a/b4e498b7-165e-5542-a716-06820ccdf92a_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F784%252Fc2d9d89635bf4595a78e23048bdd740d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/784/c2d9d89635bf4595a78e23048bdd740d/images/large/1.jpg saved to cache
2026-03-25 18:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b4e498b7-165e-5542-a716-06820ccdf92a
2026-03-25 18:31:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b4e498b7-165e-5542-a716-06820ccdf92a, skipping ID generation
2026-03-25 18:31:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4e498b7-165e-5542-a716-06820ccdf92a with scrape type 1
2026-03-25 18:31:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b4e498b7-165e-5542-a716-06820ccdf92a sending to next pipeline
2026-03-25 18:31:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b4e498b7-165e-5542-a716-06820ccdf92a, identifier: 1983056
2026-03-25 18:31:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ec59350>
2026-03-25 18:31:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06ccf973-2e79-58b6-84ec-b9ea9dc32431/06ccf973-2e79-58b6-84ec-b9ea9dc32431_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F734%252F21cfa0bd2bcf47e4aea89c3f35db0588%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/734/21cfa0bd2bcf47e4aea89c3f35db0588/images/large/1.jpg saved to cache
2026-03-25 18:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 06ccf973-2e79-58b6-84ec-b9ea9dc32431
2026-03-25 18:31:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 06ccf973-2e79-58b6-84ec-b9ea9dc32431, skipping ID generation
2026-03-25 18:31:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06ccf973-2e79-58b6-84ec-b9ea9dc32431 with scrape type 1
2026-03-25 18:31:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 06ccf973-2e79-58b6-84ec-b9ea9dc32431 sending to next pipeline
2026-03-25 18:31:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 06ccf973-2e79-58b6-84ec-b9ea9dc32431, identifier: 1983054
2026-03-25 18:31:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ea89d90>
2026-03-25 18:31:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cbe8183-4ca8-5dee-8685-9317eeaaf573/0cbe8183-4ca8-5dee-8685-9317eeaaf573_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F378%252Fda02d3c39bc6458d9c9064fafccd39d9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/378/da02d3c39bc6458d9c9064fafccd39d9/images/large/1.jpg saved to cache
2026-03-25 18:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0cbe8183-4ca8-5dee-8685-9317eeaaf573
2026-03-25 18:31:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0cbe8183-4ca8-5dee-8685-9317eeaaf573, skipping ID generation
2026-03-25 18:31:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cbe8183-4ca8-5dee-8685-9317eeaaf573 with scrape type 1
2026-03-25 18:31:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0cbe8183-4ca8-5dee-8685-9317eeaaf573 sending to next pipeline
2026-03-25 18:31:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0cbe8183-4ca8-5dee-8685-9317eeaaf573, identifier: 1983059
2026-03-25 18:31:30 [ayvens.es] INFO: Found listing with ID: 1983069
2026-03-25 18:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983069%27 HTTP/1.1" 200 None
2026-03-25 18:31:30 [ayvens.es] INFO: Scrape type for 1983069: 1
2026-03-25 18:31:30 [ayvens.es] INFO: Extracting data for car ID: 1983069
2026-03-25 18:31:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e612fc6c-a8b0-57e1-a1f0-0da5a3a0811f with identifier: 1983069
2026-03-25 18:31:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e612fc6c-a8b0-57e1-a1f0-0da5a3a0811f with scrape type 1
2026-03-25 18:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e612fc6c-a8b0-57e1-a1f0-0da5a3a0811f
2026-03-25 18:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F277%252F8342c3df4cf94e028bfdbee7706cec85%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/277/8342c3df4cf94e028bfdbee7706cec85/images/large/1.jpg not downloaded yet
2026-03-25 18:31:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b4e498b7-165e-5542-a716-06820ccdf92a with identifier: 1983056
2026-03-25 18:31:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b4e498b7-165e-5542-a716-06820ccdf92a with identifier: 1983056
2026-03-25 18:31:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b4e498b7-165e-5542-a716-06820ccdf92a with identifier: 1983056 to the API
2026-03-25 18:31:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/784/c2d9d89635bf4595a78e23048bdd740d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 94,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b4e498b7-165e-5542-a716-06820ccdf92a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 126014,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4e498b7-165e-5542-a716-06820ccdf92a/b4e498b7-165e-5542-a716-06820ccdf92a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 650669,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/784/c2d9d89635bf4595a78e23048bdd740d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO (O) Business Blue dCi 63 kW (85CV)',
 'transmission': 'manual',
 'trim': '(O) Business Blue dCi 63 kW (85CV)',
 'vin': None,
 'year': 2021}
2026-03-25 18:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983056%27 HTTP/1.1" 200 None
2026-03-25 18:31:31 [ayvens.es] INFO: Saving data for 1983056: {'created_time': 1774463491.227597, 'last_price_update_time': 1774463491.227607, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983056') HTTP/1.1" 204 0
2026-03-25 18:31:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 06ccf973-2e79-58b6-84ec-b9ea9dc32431 with identifier: 1983054
2026-03-25 18:31:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 06ccf973-2e79-58b6-84ec-b9ea9dc32431 with identifier: 1983054
2026-03-25 18:31:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 06ccf973-2e79-58b6-84ec-b9ea9dc32431 with identifier: 1983054 to the API
2026-03-25 18:31:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/734/21cfa0bd2bcf47e4aea89c3f35db0588/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 179,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '06ccf973-2e79-58b6-84ec-b9ea9dc32431',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT',
 'odometer': 168699,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06ccf973-2e79-58b6-84ec-b9ea9dc32431/06ccf973-2e79-58b6-84ec-b9ea9dc32431_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 566497,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/734/21cfa0bd2bcf47e4aea89c3f35db0588/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-17',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 350 96kW L3H2 Van Trend FWD',
 'transmission': 'manual',
 'trim': '350 96kW L3H2 Van Trend FWD',
 'vin': None,
 'year': 2021}
2026-03-25 18:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983054%27 HTTP/1.1" 200 None
2026-03-25 18:31:31 [ayvens.es] INFO: Saving data for 1983054: {'created_time': 1774463491.640105, 'last_price_update_time': 1774463491.640117, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983054') HTTP/1.1" 204 0
2026-03-25 18:31:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0cbe8183-4ca8-5dee-8685-9317eeaaf573 with identifier: 1983059
2026-03-25 18:31:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0cbe8183-4ca8-5dee-8685-9317eeaaf573 with identifier: 1983059
2026-03-25 18:31:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0cbe8183-4ca8-5dee-8685-9317eeaaf573 with identifier: 1983059 to the API
2026-03-25 18:31:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/378/da02d3c39bc6458d9c9064fafccd39d9/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '0cbe8183-4ca8-5dee-8685-9317eeaaf573',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 148879,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cbe8183-4ca8-5dee-8685-9317eeaaf573/0cbe8183-4ca8-5dee-8685-9317eeaaf573_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325500,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/378/da02d3c39bc6458d9c9064fafccd39d9/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 Allure BlueHDI 130 S&S EAT8',
 'transmission': 'manual',
 'trim': 'Allure BlueHDI 130 S&S EAT8',
 'vin': None,
 'year': 2022}
2026-03-25 18:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983059%27 HTTP/1.1" 200 None
2026-03-25 18:31:31 [ayvens.es] INFO: Saving data for 1983059: {'created_time': 1774463491.971349, 'last_price_update_time': 1774463491.971359, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983059') HTTP/1.1" 204 0
2026-03-25 18:31:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/892/dc2366631e9b45d89f252aae1fcb4b18/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/148/12ea2752864d46d8bd87e5593c835554/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/624/7fbcbbba53d74dc19f7de29d30431d0f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/230/6557cf4e47f94c74ac21faef035fcb9b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:31 [ayvens.es] INFO: Found listing with ID: 1983070
2026-03-25 18:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983070%27 HTTP/1.1" 200 None
2026-03-25 18:31:32 [ayvens.es] INFO: Scrape type for 1983070: 1
2026-03-25 18:31:32 [ayvens.es] INFO: Extracting data for car ID: 1983070
2026-03-25 18:31:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 797c61a0-3302-51ce-b650-3065a2d624f3 with identifier: 1983070
2026-03-25 18:31:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 797c61a0-3302-51ce-b650-3065a2d624f3 with scrape type 1
2026-03-25 18:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 797c61a0-3302-51ce-b650-3065a2d624f3
2026-03-25 18:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F822%252F0395759565ef40f5ad775dab29a2357e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/822/0395759565ef40f5ad775dab29a2357e/images/large/1.jpg not downloaded yet
2026-03-25 18:31:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ec5ac10>
2026-03-25 18:31:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f42b8a6-f092-5e85-82f9-20b5f25ca30a/5f42b8a6-f092-5e85-82f9-20b5f25ca30a_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F888%252Fd309c38fc9e840fc88a8132a8d071171%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/888/d309c38fc9e840fc88a8132a8d071171/images/large/1.jpg saved to cache
2026-03-25 18:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5f42b8a6-f092-5e85-82f9-20b5f25ca30a
2026-03-25 18:31:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5f42b8a6-f092-5e85-82f9-20b5f25ca30a, skipping ID generation
2026-03-25 18:31:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f42b8a6-f092-5e85-82f9-20b5f25ca30a with scrape type 1
2026-03-25 18:31:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5f42b8a6-f092-5e85-82f9-20b5f25ca30a sending to next pipeline
2026-03-25 18:31:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5f42b8a6-f092-5e85-82f9-20b5f25ca30a, identifier: 1983060
2026-03-25 18:31:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5f42b8a6-f092-5e85-82f9-20b5f25ca30a with identifier: 1983060
2026-03-25 18:31:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5f42b8a6-f092-5e85-82f9-20b5f25ca30a with identifier: 1983060
2026-03-25 18:31:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5f42b8a6-f092-5e85-82f9-20b5f25ca30a with identifier: 1983060 to the API
2026-03-25 18:31:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/888/d309c38fc9e840fc88a8132a8d071171/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '5f42b8a6-f092-5e85-82f9-20b5f25ca30a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 70462,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f42b8a6-f092-5e85-82f9-20b5f25ca30a/5f42b8a6-f092-5e85-82f9-20b5f25ca30a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 376879,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/888/d309c38fc9e840fc88a8132a8d071171/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.5 BlueHDi 96kW (130CV) S&S Active Pack',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi 96kW (130CV) S&S Active Pack',
 'vin': None,
 'year': 2021}
2026-03-25 18:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983060%27 HTTP/1.1" 200 None
2026-03-25 18:31:32 [ayvens.es] INFO: Saving data for 1983060: {'created_time': 1774463492.501036, 'last_price_update_time': 1774463492.501046, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983060') HTTP/1.1" 204 0
2026-03-25 18:31:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/811/de2cec4714e8464b825e76874452704b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/001/8eec4e81561b4e68a01e2b2ab754dd34/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:32 [ayvens.es] INFO: Found listing with ID: 1983071
2026-03-25 18:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983071%27 HTTP/1.1" 200 None
2026-03-25 18:31:32 [ayvens.es] INFO: Scrape type for 1983071: 1
2026-03-25 18:31:32 [ayvens.es] INFO: Extracting data for car ID: 1983071
2026-03-25 18:31:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4a37647-1fcc-503e-8e3e-51d31c78fc8b with identifier: 1983071
2026-03-25 18:31:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4a37647-1fcc-503e-8e3e-51d31c78fc8b with scrape type 1
2026-03-25 18:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f4a37647-1fcc-503e-8e3e-51d31c78fc8b
2026-03-25 18:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F430%252Fad3c0b7990614fd9b2c35cbcf5f0a402%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/430/ad3c0b7990614fd9b2c35cbcf5f0a402/images/large/1.jpg not downloaded yet
2026-03-25 18:31:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ec69f90>
2026-03-25 18:31:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48b2eb63-919f-562f-9f2c-5509dea6465b/48b2eb63-919f-562f-9f2c-5509dea6465b_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F892%252Fdc2366631e9b45d89f252aae1fcb4b18%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/892/dc2366631e9b45d89f252aae1fcb4b18/images/large/1.jpg saved to cache
2026-03-25 18:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 48b2eb63-919f-562f-9f2c-5509dea6465b
2026-03-25 18:31:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 48b2eb63-919f-562f-9f2c-5509dea6465b, skipping ID generation
2026-03-25 18:31:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48b2eb63-919f-562f-9f2c-5509dea6465b with scrape type 1
2026-03-25 18:31:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 48b2eb63-919f-562f-9f2c-5509dea6465b sending to next pipeline
2026-03-25 18:31:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 48b2eb63-919f-562f-9f2c-5509dea6465b, identifier: 1983061
2026-03-25 18:31:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8f405990>
2026-03-25 18:31:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0bd45df-da94-5501-a30f-c2e10a76ffaa/b0bd45df-da94-5501-a30f-c2e10a76ffaa_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F148%252F12ea2752864d46d8bd87e5593c835554%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/148/12ea2752864d46d8bd87e5593c835554/images/large/1.jpg saved to cache
2026-03-25 18:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b0bd45df-da94-5501-a30f-c2e10a76ffaa
2026-03-25 18:31:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b0bd45df-da94-5501-a30f-c2e10a76ffaa, skipping ID generation
2026-03-25 18:31:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0bd45df-da94-5501-a30f-c2e10a76ffaa with scrape type 1
2026-03-25 18:31:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b0bd45df-da94-5501-a30f-c2e10a76ffaa sending to next pipeline
2026-03-25 18:31:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b0bd45df-da94-5501-a30f-c2e10a76ffaa, identifier: 1983062
2026-03-25 18:31:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8d40e710>
2026-03-25 18:31:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6ded1f4-ada9-5e3e-aae5-a3c05280cf57/c6ded1f4-ada9-5e3e-aae5-a3c05280cf57_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F624%252F7fbcbbba53d74dc19f7de29d30431d0f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/624/7fbcbbba53d74dc19f7de29d30431d0f/images/large/1.jpg saved to cache
2026-03-25 18:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c6ded1f4-ada9-5e3e-aae5-a3c05280cf57
2026-03-25 18:31:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c6ded1f4-ada9-5e3e-aae5-a3c05280cf57, skipping ID generation
2026-03-25 18:31:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6ded1f4-ada9-5e3e-aae5-a3c05280cf57 with scrape type 1
2026-03-25 18:31:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c6ded1f4-ada9-5e3e-aae5-a3c05280cf57 sending to next pipeline
2026-03-25 18:31:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c6ded1f4-ada9-5e3e-aae5-a3c05280cf57, identifier: 1983064
2026-03-25 18:31:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8eaa1410>
2026-03-25 18:31:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bc765b2-e171-5054-859d-dd84de090eaf/6bc765b2-e171-5054-859d-dd84de090eaf_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F230%252F6557cf4e47f94c74ac21faef035fcb9b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/230/6557cf4e47f94c74ac21faef035fcb9b/images/large/1.jpg saved to cache
2026-03-25 18:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6bc765b2-e171-5054-859d-dd84de090eaf
2026-03-25 18:31:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6bc765b2-e171-5054-859d-dd84de090eaf, skipping ID generation
2026-03-25 18:31:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bc765b2-e171-5054-859d-dd84de090eaf with scrape type 1
2026-03-25 18:31:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6bc765b2-e171-5054-859d-dd84de090eaf sending to next pipeline
2026-03-25 18:31:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6bc765b2-e171-5054-859d-dd84de090eaf, identifier: 1983063
2026-03-25 18:31:33 [ayvens.es] INFO: Found listing with ID: 1983072
2026-03-25 18:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983072%27 HTTP/1.1" 200 None
2026-03-25 18:31:33 [ayvens.es] INFO: Scrape type for 1983072: 1
2026-03-25 18:31:33 [ayvens.es] INFO: Extracting data for car ID: 1983072
2026-03-25 18:31:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9d2cb7d-1f84-5fe9-94fb-ba51f1b726f2 with identifier: 1983072
2026-03-25 18:31:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9d2cb7d-1f84-5fe9-94fb-ba51f1b726f2 with scrape type 1
2026-03-25 18:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f9d2cb7d-1f84-5fe9-94fb-ba51f1b726f2
2026-03-25 18:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F821%252F89f8203e5de7418a9100d0b6608b8def%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/821/89f8203e5de7418a9100d0b6608b8def/images/large/1.jpg not downloaded yet
2026-03-25 18:31:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 48b2eb63-919f-562f-9f2c-5509dea6465b with identifier: 1983061
2026-03-25 18:31:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:31:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 48b2eb63-919f-562f-9f2c-5509dea6465b with identifier: 1983061
2026-03-25 18:31:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 48b2eb63-919f-562f-9f2c-5509dea6465b with identifier: 1983061 to the API
2026-03-25 18:31:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/892/dc2366631e9b45d89f252aae1fcb4b18/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'color': 'Schwarz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '48b2eb63-919f-562f-9f2c-5509dea6465b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 81611,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48b2eb63-919f-562f-9f2c-5509dea6465b/48b2eb63-919f-562f-9f2c-5509dea6465b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 381101,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/892/dc2366631e9b45d89f252aae1fcb4b18/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 sDrive18dA Corporate',
 'transmission': 'manual',
 'trim': 'sDrive18dA Corporate',
 'vin': None,
 'year': 2021}
2026-03-25 18:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983061%27 HTTP/1.1" 200 None
2026-03-25 18:31:33 [ayvens.es] INFO: Saving data for 1983061: {'created_time': 1774463493.630953, 'last_price_update_time': 1774463493.630964, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983061') HTTP/1.1" 204 0
2026-03-25 18:31:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b0bd45df-da94-5501-a30f-c2e10a76ffaa with identifier: 1983062
2026-03-25 18:31:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b0bd45df-da94-5501-a30f-c2e10a76ffaa with identifier: 1983062
2026-03-25 18:31:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b0bd45df-da94-5501-a30f-c2e10a76ffaa with identifier: 1983062 to the API
2026-03-25 18:31:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/148/12ea2752864d46d8bd87e5593c835554/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b0bd45df-da94-5501-a30f-c2e10a76ffaa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS 7',
 'odometer': 39212,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0bd45df-da94-5501-a30f-c2e10a76ffaa/b0bd45df-da94-5501-a30f-c2e10a76ffaa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 367679,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/148/12ea2752864d46d8bd87e5593c835554/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-07-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS 7 BlueHDi 130 Automatico PERFORMANCE LINE',
 'transmission': 'manual',
 'trim': 'BlueHDi 130 Automatico PERFORMANCE LINE',
 'vin': None,
 'year': 2024}
2026-03-25 18:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983062%27 HTTP/1.1" 200 None
2026-03-25 18:31:33 [ayvens.es] INFO: Saving data for 1983062: {'created_time': 1774463493.952429, 'last_price_update_time': 1774463493.952441, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983062') HTTP/1.1" 204 0
2026-03-25 18:31:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c6ded1f4-ada9-5e3e-aae5-a3c05280cf57 with identifier: 1983064
2026-03-25 18:31:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c6ded1f4-ada9-5e3e-aae5-a3c05280cf57 with identifier: 1983064
2026-03-25 18:31:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c6ded1f4-ada9-5e3e-aae5-a3c05280cf57 with identifier: 1983064 to the API
2026-03-25 18:31:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/624/7fbcbbba53d74dc19f7de29d30431d0f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'Azul',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'c6ded1f4-ada9-5e3e-aae5-a3c05280cf57',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 19091,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6ded1f4-ada9-5e3e-aae5-a3c05280cf57/c6ded1f4-ada9-5e3e-aae5-a3c05280cf57_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 364643,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/624/7fbcbbba53d74dc19f7de29d30431d0f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-10-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.2 100KW GT eDCS6',
 'transmission': 'manual',
 'trim': '1.2 100KW GT eDCS6',
 'vin': None,
 'year': 2024}
2026-03-25 18:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983064%27 HTTP/1.1" 200 None
2026-03-25 18:31:34 [ayvens.es] INFO: Saving data for 1983064: {'created_time': 1774463494.284941, 'last_price_update_time': 1774463494.28495, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983064') HTTP/1.1" 204 0
2026-03-25 18:31:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6bc765b2-e171-5054-859d-dd84de090eaf with identifier: 1983063
2026-03-25 18:31:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6bc765b2-e171-5054-859d-dd84de090eaf with identifier: 1983063
2026-03-25 18:31:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 6bc765b2-e171-5054-859d-dd84de090eaf with identifier: 1983063 to the API
2026-03-25 18:31:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/230/6557cf4e47f94c74ac21faef035fcb9b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 94,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '6bc765b2-e171-5054-859d-dd84de090eaf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 66144,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bc765b2-e171-5054-859d-dd84de090eaf/6bc765b2-e171-5054-859d-dd84de090eaf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354014,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/230/6557cf4e47f94c74ac21faef035fcb9b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO Zen Blue dCi 63 kW (85CV)',
 'transmission': 'manual',
 'trim': 'Zen Blue dCi 63 kW (85CV)',
 'vin': None,
 'year': 2020}
2026-03-25 18:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983063%27 HTTP/1.1" 200 None
2026-03-25 18:31:34 [ayvens.es] INFO: Saving data for 1983063: {'created_time': 1774463494.628161, 'last_price_update_time': 1774463494.628171, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983063') HTTP/1.1" 204 0
2026-03-25 18:31:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ed71cd0>
2026-03-25 18:31:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c17494ce-12f1-5207-b434-f8e96664c82c/c17494ce-12f1-5207-b434-f8e96664c82c_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F811%252Fde2cec4714e8464b825e76874452704b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/811/de2cec4714e8464b825e76874452704b/images/large/1.jpg saved to cache
2026-03-25 18:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c17494ce-12f1-5207-b434-f8e96664c82c
2026-03-25 18:31:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c17494ce-12f1-5207-b434-f8e96664c82c, skipping ID generation
2026-03-25 18:31:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c17494ce-12f1-5207-b434-f8e96664c82c with scrape type 1
2026-03-25 18:31:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c17494ce-12f1-5207-b434-f8e96664c82c sending to next pipeline
2026-03-25 18:31:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c17494ce-12f1-5207-b434-f8e96664c82c, identifier: 1983065
2026-03-25 18:31:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e56b990>
2026-03-25 18:31:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c97f34d-179a-5839-a0fd-79517894a3c8/2c97f34d-179a-5839-a0fd-79517894a3c8_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F001%252F8eec4e81561b4e68a01e2b2ab754dd34%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/001/8eec4e81561b4e68a01e2b2ab754dd34/images/large/1.jpg saved to cache
2026-03-25 18:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2c97f34d-179a-5839-a0fd-79517894a3c8
2026-03-25 18:31:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2c97f34d-179a-5839-a0fd-79517894a3c8, skipping ID generation
2026-03-25 18:31:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c97f34d-179a-5839-a0fd-79517894a3c8 with scrape type 1
2026-03-25 18:31:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2c97f34d-179a-5839-a0fd-79517894a3c8 sending to next pipeline
2026-03-25 18:31:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2c97f34d-179a-5839-a0fd-79517894a3c8, identifier: 1983066
2026-03-25 18:31:34 [ayvens.es] INFO: Found listing with ID: 1983073
2026-03-25 18:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983073%27 HTTP/1.1" 200 None
2026-03-25 18:31:35 [ayvens.es] INFO: Scrape type for 1983073: 1
2026-03-25 18:31:35 [ayvens.es] INFO: Extracting data for car ID: 1983073
2026-03-25 18:31:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1167005e-506a-5cf2-8240-6107998eabcc with identifier: 1983073
2026-03-25 18:31:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1167005e-506a-5cf2-8240-6107998eabcc with scrape type 1
2026-03-25 18:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1167005e-506a-5cf2-8240-6107998eabcc
2026-03-25 18:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F918%252F0198574aa11048f793b2fceb11587ef4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/918/0198574aa11048f793b2fceb11587ef4/images/large/1.jpg not downloaded yet
2026-03-25 18:31:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c17494ce-12f1-5207-b434-f8e96664c82c with identifier: 1983065
2026-03-25 18:31:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:31:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c17494ce-12f1-5207-b434-f8e96664c82c with identifier: 1983065
2026-03-25 18:31:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c17494ce-12f1-5207-b434-f8e96664c82c with identifier: 1983065 to the API
2026-03-25 18:31:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/811/de2cec4714e8464b825e76874452704b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'Rojo',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c17494ce-12f1-5207-b434-f8e96664c82c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 146965,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c17494ce-12f1-5207-b434-f8e96664c82c/c17494ce-12f1-5207-b434-f8e96664c82c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 383523,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/811/de2cec4714e8464b825e76874452704b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO Intens Blue dCi 74kW (100CV)',
 'transmission': 'manual',
 'trim': 'Intens Blue dCi 74kW (100CV)',
 'vin': None,
 'year': 2022}
2026-03-25 18:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983065%27 HTTP/1.1" 200 None
2026-03-25 18:31:35 [ayvens.es] INFO: Saving data for 1983065: {'created_time': 1774463495.388606, 'last_price_update_time': 1774463495.388616, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983065') HTTP/1.1" 204 0
2026-03-25 18:31:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2c97f34d-179a-5839-a0fd-79517894a3c8 with identifier: 1983066
2026-03-25 18:31:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2c97f34d-179a-5839-a0fd-79517894a3c8 with identifier: 1983066
2026-03-25 18:31:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 2c97f34d-179a-5839-a0fd-79517894a3c8 with identifier: 1983066 to the API
2026-03-25 18:31:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/001/8eec4e81561b4e68a01e2b2ab754dd34/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 186,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.3L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '2c97f34d-179a-5839-a0fd-79517894a3c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'DUCATO',
 'odometer': 170009,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c97f34d-179a-5839-a0fd-79517894a3c8/2c97f34d-179a-5839-a0fd-79517894a3c8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 311044,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/001/8eec4e81561b4e68a01e2b2ab754dd34/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-30',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FIAT DUCATO 35 L3H3 2.3 Multijet (103 kW)',
 'transmission': 'manual',
 'trim': '35 L3H3 2.3 Multijet (103 kW)',
 'vin': None,
 'year': 2021}
2026-03-25 18:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983066%27 HTTP/1.1" 200 None
2026-03-25 18:31:35 [ayvens.es] INFO: Saving data for 1983066: {'created_time': 1774463495.712251, 'last_price_update_time': 1774463495.712261, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983066') HTTP/1.1" 204 0
2026-03-25 18:31:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/722/ea237c23ee494a1c81e6a4605bb1756b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:35 [ayvens.es] INFO: Found listing with ID: 1983074
2026-03-25 18:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983074%27 HTTP/1.1" 200 None
2026-03-25 18:31:35 [ayvens.es] INFO: Scrape type for 1983074: 1
2026-03-25 18:31:35 [ayvens.es] INFO: Extracting data for car ID: 1983074
2026-03-25 18:31:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d530f2ce-2363-5c67-ad28-0b35550b7292 with identifier: 1983074
2026-03-25 18:31:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d530f2ce-2363-5c67-ad28-0b35550b7292 with scrape type 1
2026-03-25 18:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d530f2ce-2363-5c67-ad28-0b35550b7292
2026-03-25 18:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F272%252F15f5e7bf60184189ad8cdae3ba1d9139%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/272/15f5e7bf60184189ad8cdae3ba1d9139/images/large/1.jpg not downloaded yet
2026-03-25 18:31:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/308/5b446a065ec2486e9ba8c48e9f8aec45/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/277/8342c3df4cf94e028bfdbee7706cec85/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:35 [ayvens.es] INFO: Found listing with ID: 1983075
2026-03-25 18:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983075%27 HTTP/1.1" 200 None
2026-03-25 18:31:35 [ayvens.es] INFO: Scrape type for 1983075: 1
2026-03-25 18:31:35 [ayvens.es] INFO: Extracting data for car ID: 1983075
2026-03-25 18:31:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a31edcb3-f343-5488-ba8b-ecbfdf41f9da with identifier: 1983075
2026-03-25 18:31:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a31edcb3-f343-5488-ba8b-ecbfdf41f9da with scrape type 1
2026-03-25 18:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a31edcb3-f343-5488-ba8b-ecbfdf41f9da
2026-03-25 18:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F753%252F0ba46563ba664d5586c47ecfc2ff661f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/753/0ba46563ba664d5586c47ecfc2ff661f/images/large/1.jpg not downloaded yet
2026-03-25 18:31:35 [ayvens.es] INFO: Found listing with ID: 1983076
2026-03-25 18:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983076%27 HTTP/1.1" 200 None
2026-03-25 18:31:35 [ayvens.es] INFO: Scrape type for 1983076: 1
2026-03-25 18:31:35 [ayvens.es] INFO: Extracting data for car ID: 1983076
2026-03-25 18:31:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad5340be-d6c1-5f20-8ecb-348a3194a1a0 with identifier: 1983076
2026-03-25 18:31:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad5340be-d6c1-5f20-8ecb-348a3194a1a0 with scrape type 1
2026-03-25 18:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ad5340be-d6c1-5f20-8ecb-348a3194a1a0
2026-03-25 18:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F745%252F17161bedd30e418285f610aed0c85ce5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/745/17161bedd30e418285f610aed0c85ce5/images/large/1.jpg not downloaded yet
2026-03-25 18:31:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/822/0395759565ef40f5ad775dab29a2357e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:35 [ayvens.es] INFO: Found listing with ID: 1983077
2026-03-25 18:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983077%27 HTTP/1.1" 200 None
2026-03-25 18:31:35 [ayvens.es] INFO: Scrape type for 1983077: 1
2026-03-25 18:31:35 [ayvens.es] INFO: Extracting data for car ID: 1983077
2026-03-25 18:31:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00ea5495-2955-5d98-900a-36cd6fda0cea with identifier: 1983077
2026-03-25 18:31:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00ea5495-2955-5d98-900a-36cd6fda0cea with scrape type 1
2026-03-25 18:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 00ea5495-2955-5d98-900a-36cd6fda0cea
2026-03-25 18:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F397%252F051c37c93f244967a54cf254c9b362a5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/397/051c37c93f244967a54cf254c9b362a5/images/large/1.jpg not downloaded yet
2026-03-25 18:31:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ed00190>
2026-03-25 18:31:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ca1f7b2-56ea-5681-9ee0-d0bc93c45442/9ca1f7b2-56ea-5681-9ee0-d0bc93c45442_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F722%252Fea237c23ee494a1c81e6a4605bb1756b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/722/ea237c23ee494a1c81e6a4605bb1756b/images/large/1.jpg saved to cache
2026-03-25 18:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9ca1f7b2-56ea-5681-9ee0-d0bc93c45442
2026-03-25 18:31:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9ca1f7b2-56ea-5681-9ee0-d0bc93c45442, skipping ID generation
2026-03-25 18:31:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ca1f7b2-56ea-5681-9ee0-d0bc93c45442 with scrape type 1
2026-03-25 18:31:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9ca1f7b2-56ea-5681-9ee0-d0bc93c45442 sending to next pipeline
2026-03-25 18:31:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9ca1f7b2-56ea-5681-9ee0-d0bc93c45442, identifier: 1983067
2026-03-25 18:31:36 [ayvens.es] INFO: Found listing with ID: 1983078
2026-03-25 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983078%27 HTTP/1.1" 200 None
2026-03-25 18:31:36 [ayvens.es] INFO: Scrape type for 1983078: 1
2026-03-25 18:31:36 [ayvens.es] INFO: Extracting data for car ID: 1983078
2026-03-25 18:31:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1022b21-2f9a-549a-b14a-03d58836858d with identifier: 1983078
2026-03-25 18:31:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1022b21-2f9a-549a-b14a-03d58836858d with scrape type 1
2026-03-25 18:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e1022b21-2f9a-549a-b14a-03d58836858d
2026-03-25 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F425%252Fa543ec2c1a8a4beead2bc9e3fe72c8d4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/425/a543ec2c1a8a4beead2bc9e3fe72c8d4/images/large/1.jpg not downloaded yet
2026-03-25 18:31:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9ca1f7b2-56ea-5681-9ee0-d0bc93c45442 with identifier: 1983067
2026-03-25 18:31:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:31:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9ca1f7b2-56ea-5681-9ee0-d0bc93c45442 with identifier: 1983067
2026-03-25 18:31:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9ca1f7b2-56ea-5681-9ee0-d0bc93c45442 with identifier: 1983067 to the API
2026-03-25 18:31:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/722/ea237c23ee494a1c81e6a4605bb1756b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Signal',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '9ca1f7b2-56ea-5681-9ee0-d0bc93c45442',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'STONIC',
 'odometer': 54722,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ca1f7b2-56ea-5681-9ee0-d0bc93c45442/9ca1f7b2-56ea-5681-9ee0-d0bc93c45442_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 371199,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/722/ea237c23ee494a1c81e6a4605bb1756b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA STONIC 1.2 DPi 62kW (84CV) Concept',
 'transmission': 'manual',
 'trim': '1.2 DPi 62kW (84CV) Concept',
 'vin': None,
 'year': 2022}
2026-03-25 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983067%27 HTTP/1.1" 200 None
2026-03-25 18:31:36 [ayvens.es] INFO: Saving data for 1983067: {'created_time': 1774463496.487129, 'last_price_update_time': 1774463496.487139, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983067') HTTP/1.1" 204 0
2026-03-25 18:31:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8d3f5090>
2026-03-25 18:31:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9d8328e-59f9-5e2a-ae69-fe71b28f3e5d/e9d8328e-59f9-5e2a-ae69-fe71b28f3e5d_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F308%252F5b446a065ec2486e9ba8c48e9f8aec45%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/308/5b446a065ec2486e9ba8c48e9f8aec45/images/large/1.jpg saved to cache
2026-03-25 18:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e9d8328e-59f9-5e2a-ae69-fe71b28f3e5d
2026-03-25 18:31:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e9d8328e-59f9-5e2a-ae69-fe71b28f3e5d, skipping ID generation
2026-03-25 18:31:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9d8328e-59f9-5e2a-ae69-fe71b28f3e5d with scrape type 1
2026-03-25 18:31:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e9d8328e-59f9-5e2a-ae69-fe71b28f3e5d sending to next pipeline
2026-03-25 18:31:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e9d8328e-59f9-5e2a-ae69-fe71b28f3e5d, identifier: 1983068
2026-03-25 18:31:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ecdbf90>
2026-03-25 18:31:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e612fc6c-a8b0-57e1-a1f0-0da5a3a0811f/e612fc6c-a8b0-57e1-a1f0-0da5a3a0811f_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F277%252F8342c3df4cf94e028bfdbee7706cec85%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/277/8342c3df4cf94e028bfdbee7706cec85/images/large/1.jpg saved to cache
2026-03-25 18:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e612fc6c-a8b0-57e1-a1f0-0da5a3a0811f
2026-03-25 18:31:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e612fc6c-a8b0-57e1-a1f0-0da5a3a0811f, skipping ID generation
2026-03-25 18:31:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e612fc6c-a8b0-57e1-a1f0-0da5a3a0811f with scrape type 1
2026-03-25 18:31:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e612fc6c-a8b0-57e1-a1f0-0da5a3a0811f sending to next pipeline
2026-03-25 18:31:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e612fc6c-a8b0-57e1-a1f0-0da5a3a0811f, identifier: 1983069
2026-03-25 18:31:36 [ayvens.es] INFO: Found listing with ID: 1983079
2026-03-25 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983079%27 HTTP/1.1" 200 None
2026-03-25 18:31:36 [ayvens.es] INFO: Scrape type for 1983079: 1
2026-03-25 18:31:36 [ayvens.es] INFO: Extracting data for car ID: 1983079
2026-03-25 18:31:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e01167c-a78d-52ff-b60d-df2e365a28f6 with identifier: 1983079
2026-03-25 18:31:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e01167c-a78d-52ff-b60d-df2e365a28f6 with scrape type 1
2026-03-25 18:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4e01167c-a78d-52ff-b60d-df2e365a28f6
2026-03-25 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F700%252F20914720b1d14d1baad2d3dd1c644c97%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/700/20914720b1d14d1baad2d3dd1c644c97/images/large/1.jpg not downloaded yet
2026-03-25 18:31:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e9d8328e-59f9-5e2a-ae69-fe71b28f3e5d with identifier: 1983068
2026-03-25 18:31:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e9d8328e-59f9-5e2a-ae69-fe71b28f3e5d with identifier: 1983068
2026-03-25 18:31:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e9d8328e-59f9-5e2a-ae69-fe71b28f3e5d with identifier: 1983068 to the API
2026-03-25 18:31:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/308/5b446a065ec2486e9ba8c48e9f8aec45/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'e9d8328e-59f9-5e2a-ae69-fe71b28f3e5d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 66935,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9d8328e-59f9-5e2a-ae69-fe71b28f3e5d/e9d8328e-59f9-5e2a-ae69-fe71b28f3e5d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 506080,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/308/5b446a065ec2486e9ba8c48e9f8aec45/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON 1.0 TSI 81kW S&S Style Go',
 'transmission': 'manual',
 'trim': '1.0 TSI 81kW S&S Style Go',
 'vin': None,
 'year': 2022}
2026-03-25 18:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983068%27 HTTP/1.1" 200 None
2026-03-25 18:31:37 [ayvens.es] INFO: Saving data for 1983068: {'created_time': 1774463497.275078, 'last_price_update_time': 1774463497.275093, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983068') HTTP/1.1" 204 0
2026-03-25 18:31:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e612fc6c-a8b0-57e1-a1f0-0da5a3a0811f with identifier: 1983069
2026-03-25 18:31:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e612fc6c-a8b0-57e1-a1f0-0da5a3a0811f with identifier: 1983069
2026-03-25 18:31:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e612fc6c-a8b0-57e1-a1f0-0da5a3a0811f with identifier: 1983069 to the API
2026-03-25 18:31:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/277/8342c3df4cf94e028bfdbee7706cec85/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e612fc6c-a8b0-57e1-a1f0-0da5a3a0811f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 157294,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e612fc6c-a8b0-57e1-a1f0-0da5a3a0811f/e612fc6c-a8b0-57e1-a1f0-0da5a3a0811f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 333188,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/277/8342c3df4cf94e028bfdbee7706cec85/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 Active BlueHDI 81kW (110CV)',
 'transmission': 'manual',
 'trim': 'Active BlueHDI 81kW (110CV)',
 'vin': None,
 'year': 2022}
2026-03-25 18:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983069%27 HTTP/1.1" 200 None
2026-03-25 18:31:37 [ayvens.es] INFO: Saving data for 1983069: {'created_time': 1774463497.830368, 'last_price_update_time': 1774463497.83038, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983069') HTTP/1.1" 204 0
2026-03-25 18:31:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/821/89f8203e5de7418a9100d0b6608b8def/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ecdf690>
2026-03-25 18:31:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_797c61a0-3302-51ce-b650-3065a2d624f3/797c61a0-3302-51ce-b650-3065a2d624f3_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F822%252F0395759565ef40f5ad775dab29a2357e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/822/0395759565ef40f5ad775dab29a2357e/images/large/1.jpg saved to cache
2026-03-25 18:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 797c61a0-3302-51ce-b650-3065a2d624f3
2026-03-25 18:31:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 797c61a0-3302-51ce-b650-3065a2d624f3, skipping ID generation
2026-03-25 18:31:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 797c61a0-3302-51ce-b650-3065a2d624f3 with scrape type 1
2026-03-25 18:31:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 797c61a0-3302-51ce-b650-3065a2d624f3 sending to next pipeline
2026-03-25 18:31:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 797c61a0-3302-51ce-b650-3065a2d624f3, identifier: 1983070
2026-03-25 18:31:37 [ayvens.es] INFO: Found listing with ID: 1983080
2026-03-25 18:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983080%27 HTTP/1.1" 200 None
2026-03-25 18:31:38 [ayvens.es] INFO: Scrape type for 1983080: 1
2026-03-25 18:31:38 [ayvens.es] INFO: Extracting data for car ID: 1983080
2026-03-25 18:31:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24b44276-5ed8-58ec-9d84-6a647764292d with identifier: 1983080
2026-03-25 18:31:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24b44276-5ed8-58ec-9d84-6a647764292d with scrape type 1
2026-03-25 18:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 24b44276-5ed8-58ec-9d84-6a647764292d
2026-03-25 18:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F134%252Fe3fd19ecc8f74b2fbd5ddc38ee15976d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/134/e3fd19ecc8f74b2fbd5ddc38ee15976d/images/large/1.jpg not downloaded yet
2026-03-25 18:31:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 797c61a0-3302-51ce-b650-3065a2d624f3 with identifier: 1983070
2026-03-25 18:31:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 797c61a0-3302-51ce-b650-3065a2d624f3 with identifier: 1983070
2026-03-25 18:31:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 797c61a0-3302-51ce-b650-3065a2d624f3 with identifier: 1983070 to the API
2026-03-25 18:31:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/822/0395759565ef40f5ad775dab29a2357e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '797c61a0-3302-51ce-b650-3065a2d624f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 117468,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_797c61a0-3302-51ce-b650-3065a2d624f3/797c61a0-3302-51ce-b650-3065a2d624f3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 473299,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/822/0395759565ef40f5ad775dab29a2357e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 Active Puretech 100 S&S BVM6',
 'transmission': 'manual',
 'trim': 'Active Puretech 100 S&S BVM6',
 'vin': None,
 'year': 2020}
2026-03-25 18:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983070%27 HTTP/1.1" 200 None
2026-03-25 18:31:38 [ayvens.es] INFO: Saving data for 1983070: {'created_time': 1774463498.356176, 'last_price_update_time': 1774463498.356187, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983070') HTTP/1.1" 204 0
2026-03-25 18:31:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/430/ad3c0b7990614fd9b2c35cbcf5f0a402/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/753/0ba46563ba664d5586c47ecfc2ff661f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/918/0198574aa11048f793b2fceb11587ef4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:38 [ayvens.es] INFO: Found listing with ID: 1983081
2026-03-25 18:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983081%27 HTTP/1.1" 200 None
2026-03-25 18:31:38 [ayvens.es] INFO: Scrape type for 1983081: 1
2026-03-25 18:31:38 [ayvens.es] INFO: Extracting data for car ID: 1983081
2026-03-25 18:31:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13d2a16d-6ac9-57dd-8998-e49c3b2f9363 with identifier: 1983081
2026-03-25 18:31:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13d2a16d-6ac9-57dd-8998-e49c3b2f9363 with scrape type 1
2026-03-25 18:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 13d2a16d-6ac9-57dd-8998-e49c3b2f9363
2026-03-25 18:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F621%252F4bb4eb8fa3d6492e8fe360289db1818a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/621/4bb4eb8fa3d6492e8fe360289db1818a/images/large/1.jpg not downloaded yet
2026-03-25 18:31:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ee58250>
2026-03-25 18:31:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9d2cb7d-1f84-5fe9-94fb-ba51f1b726f2/f9d2cb7d-1f84-5fe9-94fb-ba51f1b726f2_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F821%252F89f8203e5de7418a9100d0b6608b8def%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/821/89f8203e5de7418a9100d0b6608b8def/images/large/1.jpg saved to cache
2026-03-25 18:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f9d2cb7d-1f84-5fe9-94fb-ba51f1b726f2
2026-03-25 18:31:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f9d2cb7d-1f84-5fe9-94fb-ba51f1b726f2, skipping ID generation
2026-03-25 18:31:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9d2cb7d-1f84-5fe9-94fb-ba51f1b726f2 with scrape type 1
2026-03-25 18:31:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f9d2cb7d-1f84-5fe9-94fb-ba51f1b726f2 sending to next pipeline
2026-03-25 18:31:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f9d2cb7d-1f84-5fe9-94fb-ba51f1b726f2, identifier: 1983072
2026-03-25 18:31:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/745/17161bedd30e418285f610aed0c85ce5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:38 [ayvens.es] INFO: Found listing with ID: 1983082
2026-03-25 18:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983082%27 HTTP/1.1" 200 None
2026-03-25 18:31:38 [ayvens.es] INFO: Scrape type for 1983082: 1
2026-03-25 18:31:38 [ayvens.es] INFO: Extracting data for car ID: 1983082
2026-03-25 18:31:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e69dc82-b2e4-576f-9a7d-50d485046f2c with identifier: 1983082
2026-03-25 18:31:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e69dc82-b2e4-576f-9a7d-50d485046f2c with scrape type 1
2026-03-25 18:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0e69dc82-b2e4-576f-9a7d-50d485046f2c
2026-03-25 18:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F883%252Fb10acf6e02ea4c5c85c0d35892b2d3a9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/883/b10acf6e02ea4c5c85c0d35892b2d3a9/images/large/1.jpg not downloaded yet
2026-03-25 18:31:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f9d2cb7d-1f84-5fe9-94fb-ba51f1b726f2 with identifier: 1983072
2026-03-25 18:31:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f9d2cb7d-1f84-5fe9-94fb-ba51f1b726f2 with identifier: 1983072
2026-03-25 18:31:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f9d2cb7d-1f84-5fe9-94fb-ba51f1b726f2 with identifier: 1983072 to the API
2026-03-25 18:31:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/821/89f8203e5de7418a9100d0b6608b8def/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f9d2cb7d-1f84-5fe9-94fb-ba51f1b726f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 144974,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9d2cb7d-1f84-5fe9-94fb-ba51f1b726f2/f9d2cb7d-1f84-5fe9-94fb-ba51f1b726f2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 383116,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/821/89f8203e5de7418a9100d0b6608b8def/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.5 BlueHDi 96kW (130CV) S&S Active Pack',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi 96kW (130CV) S&S Active Pack',
 'vin': None,
 'year': 2021}
2026-03-25 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983072%27 HTTP/1.1" 200 None
2026-03-25 18:31:39 [ayvens.es] INFO: Saving data for 1983072: {'created_time': 1774463499.053377, 'last_price_update_time': 1774463499.053392, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983072') HTTP/1.1" 204 0
2026-03-25 18:31:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/272/15f5e7bf60184189ad8cdae3ba1d9139/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:39 [ayvens.es] INFO: Found listing with ID: 1983083
2026-03-25 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983083%27 HTTP/1.1" 200 None
2026-03-25 18:31:39 [ayvens.es] INFO: Scrape type for 1983083: 1
2026-03-25 18:31:39 [ayvens.es] INFO: Extracting data for car ID: 1983083
2026-03-25 18:31:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39a8d024-d9b3-5db0-8bb2-93d9c1267d65 with identifier: 1983083
2026-03-25 18:31:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39a8d024-d9b3-5db0-8bb2-93d9c1267d65 with scrape type 1
2026-03-25 18:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 39a8d024-d9b3-5db0-8bb2-93d9c1267d65
2026-03-25 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F228%252Fdc6aa06f6a144fed9aff1631ea6422b4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/228/dc6aa06f6a144fed9aff1631ea6422b4/images/large/1.jpg not downloaded yet
2026-03-25 18:31:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/425/a543ec2c1a8a4beead2bc9e3fe72c8d4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8f42ef10>
2026-03-25 18:31:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4a37647-1fcc-503e-8e3e-51d31c78fc8b/f4a37647-1fcc-503e-8e3e-51d31c78fc8b_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F430%252Fad3c0b7990614fd9b2c35cbcf5f0a402%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/430/ad3c0b7990614fd9b2c35cbcf5f0a402/images/large/1.jpg saved to cache
2026-03-25 18:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f4a37647-1fcc-503e-8e3e-51d31c78fc8b
2026-03-25 18:31:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f4a37647-1fcc-503e-8e3e-51d31c78fc8b, skipping ID generation
2026-03-25 18:31:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4a37647-1fcc-503e-8e3e-51d31c78fc8b with scrape type 1
2026-03-25 18:31:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f4a37647-1fcc-503e-8e3e-51d31c78fc8b sending to next pipeline
2026-03-25 18:31:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f4a37647-1fcc-503e-8e3e-51d31c78fc8b, identifier: 1983071
2026-03-25 18:31:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e5b9990>
2026-03-25 18:31:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a31edcb3-f343-5488-ba8b-ecbfdf41f9da/a31edcb3-f343-5488-ba8b-ecbfdf41f9da_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F753%252F0ba46563ba664d5586c47ecfc2ff661f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/753/0ba46563ba664d5586c47ecfc2ff661f/images/large/1.jpg saved to cache
2026-03-25 18:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a31edcb3-f343-5488-ba8b-ecbfdf41f9da
2026-03-25 18:31:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a31edcb3-f343-5488-ba8b-ecbfdf41f9da, skipping ID generation
2026-03-25 18:31:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a31edcb3-f343-5488-ba8b-ecbfdf41f9da with scrape type 1
2026-03-25 18:31:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a31edcb3-f343-5488-ba8b-ecbfdf41f9da sending to next pipeline
2026-03-25 18:31:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a31edcb3-f343-5488-ba8b-ecbfdf41f9da, identifier: 1983075
2026-03-25 18:31:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e57c9d0>
2026-03-25 18:31:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1167005e-506a-5cf2-8240-6107998eabcc/1167005e-506a-5cf2-8240-6107998eabcc_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F918%252F0198574aa11048f793b2fceb11587ef4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/918/0198574aa11048f793b2fceb11587ef4/images/large/1.jpg saved to cache
2026-03-25 18:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1167005e-506a-5cf2-8240-6107998eabcc
2026-03-25 18:31:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1167005e-506a-5cf2-8240-6107998eabcc, skipping ID generation
2026-03-25 18:31:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1167005e-506a-5cf2-8240-6107998eabcc with scrape type 1
2026-03-25 18:31:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1167005e-506a-5cf2-8240-6107998eabcc sending to next pipeline
2026-03-25 18:31:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1167005e-506a-5cf2-8240-6107998eabcc, identifier: 1983073
2026-03-25 18:31:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e5d2910>
2026-03-25 18:31:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad5340be-d6c1-5f20-8ecb-348a3194a1a0/ad5340be-d6c1-5f20-8ecb-348a3194a1a0_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F745%252F17161bedd30e418285f610aed0c85ce5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/745/17161bedd30e418285f610aed0c85ce5/images/large/1.jpg saved to cache
2026-03-25 18:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ad5340be-d6c1-5f20-8ecb-348a3194a1a0
2026-03-25 18:31:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ad5340be-d6c1-5f20-8ecb-348a3194a1a0, skipping ID generation
2026-03-25 18:31:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad5340be-d6c1-5f20-8ecb-348a3194a1a0 with scrape type 1
2026-03-25 18:31:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ad5340be-d6c1-5f20-8ecb-348a3194a1a0 sending to next pipeline
2026-03-25 18:31:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ad5340be-d6c1-5f20-8ecb-348a3194a1a0, identifier: 1983076
2026-03-25 18:31:39 [ayvens.es] INFO: Found listing with ID: 1983084
2026-03-25 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983084%27 HTTP/1.1" 200 None
2026-03-25 18:31:39 [ayvens.es] INFO: Scrape type for 1983084: 1
2026-03-25 18:31:39 [ayvens.es] INFO: Extracting data for car ID: 1983084
2026-03-25 18:31:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e2e9690-55d5-5ad3-ac97-18f4bc1ca47a with identifier: 1983084
2026-03-25 18:31:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e2e9690-55d5-5ad3-ac97-18f4bc1ca47a with scrape type 1
2026-03-25 18:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4e2e9690-55d5-5ad3-ac97-18f4bc1ca47a
2026-03-25 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F411%252Feb85f7d291bd46adacf968ce8a5712ec%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/411/eb85f7d291bd46adacf968ce8a5712ec/images/large/1.jpg not downloaded yet
2026-03-25 18:31:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f4a37647-1fcc-503e-8e3e-51d31c78fc8b with identifier: 1983071
2026-03-25 18:31:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f4a37647-1fcc-503e-8e3e-51d31c78fc8b with identifier: 1983071
2026-03-25 18:31:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f4a37647-1fcc-503e-8e3e-51d31c78fc8b with identifier: 1983071 to the API
2026-03-25 18:31:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/430/ad3c0b7990614fd9b2c35cbcf5f0a402/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f4a37647-1fcc-503e-8e3e-51d31c78fc8b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 70496,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4a37647-1fcc-503e-8e3e-51d31c78fc8b/f4a37647-1fcc-503e-8e3e-51d31c78fc8b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 359562,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/430/ad3c0b7990614fd9b2c35cbcf5f0a402/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 Active Pack BlueHDI 81kW (110CV)',
 'transmission': 'manual',
 'trim': 'Active Pack BlueHDI 81kW (110CV)',
 'vin': None,
 'year': 2021}
2026-03-25 18:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983071%27 HTTP/1.1" 200 None
2026-03-25 18:31:40 [ayvens.es] INFO: Saving data for 1983071: {'created_time': 1774463500.660233, 'last_price_update_time': 1774463500.660249, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983071') HTTP/1.1" 204 0
2026-03-25 18:31:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a31edcb3-f343-5488-ba8b-ecbfdf41f9da with identifier: 1983075
2026-03-25 18:31:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a31edcb3-f343-5488-ba8b-ecbfdf41f9da with identifier: 1983075
2026-03-25 18:31:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a31edcb3-f343-5488-ba8b-ecbfdf41f9da with identifier: 1983075 to the API
2026-03-25 18:31:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/753/0ba46563ba664d5586c47ecfc2ff661f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 172,
 'color': 'Serie',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '3.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a31edcb3-f343-5488-ba8b-ecbfdf41f9da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q8',
 'odometer': 135542,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a31edcb3-f343-5488-ba8b-ecbfdf41f9da/a31edcb3-f343-5488-ba8b-ecbfdf41f9da_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 368097,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/753/0ba46563ba664d5586c47ecfc2ff661f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q8 50 TDI 210kW (286CV) quattro tiptronic',
 'transmission': 'manual',
 'trim': '50 TDI 210kW (286CV) quattro tiptronic',
 'vin': None,
 'year': 2018}
2026-03-25 18:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983075%27 HTTP/1.1" 200 None
2026-03-25 18:31:41 [ayvens.es] INFO: Saving data for 1983075: {'created_time': 1774463501.00439, 'last_price_update_time': 1774463501.004401, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983075') HTTP/1.1" 204 0
2026-03-25 18:31:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1167005e-506a-5cf2-8240-6107998eabcc with identifier: 1983073
2026-03-25 18:31:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1167005e-506a-5cf2-8240-6107998eabcc with identifier: 1983073
2026-03-25 18:31:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1167005e-506a-5cf2-8240-6107998eabcc with identifier: 1983073 to the API
2026-03-25 18:31:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/918/0198574aa11048f793b2fceb11587ef4/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '1167005e-506a-5cf2-8240-6107998eabcc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 91475,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1167005e-506a-5cf2-8240-6107998eabcc/1167005e-506a-5cf2-8240-6107998eabcc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 343690,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/918/0198574aa11048f793b2fceb11587ef4/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO (O) Intens Blue dCi 74kW (100CV)',
 'transmission': 'manual',
 'trim': '(O) Intens Blue dCi 74kW (100CV)',
 'vin': None,
 'year': 2022}
2026-03-25 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983073%27 HTTP/1.1" 200 None
2026-03-25 18:31:41 [ayvens.es] INFO: Saving data for 1983073: {'created_time': 1774463501.32334, 'last_price_update_time': 1774463501.323351, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983073') HTTP/1.1" 204 0
2026-03-25 18:31:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ad5340be-d6c1-5f20-8ecb-348a3194a1a0 with identifier: 1983076
2026-03-25 18:31:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ad5340be-d6c1-5f20-8ecb-348a3194a1a0 with identifier: 1983076
2026-03-25 18:31:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ad5340be-d6c1-5f20-8ecb-348a3194a1a0 with identifier: 1983076 to the API
2026-03-25 18:31:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/745/17161bedd30e418285f610aed0c85ce5/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ad5340be-d6c1-5f20-8ecb-348a3194a1a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C3 AIRCROSS',
 'odometer': 177464,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad5340be-d6c1-5f20-8ecb-348a3194a1a0/ad5340be-d6c1-5f20-8ecb-348a3194a1a0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 437260,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/745/17161bedd30e418285f610aed0c85ce5/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C3 AIRCROSS BlueHDi 81kW (110CV) S&S Live Pack',
 'transmission': 'manual',
 'trim': 'BlueHDi 81kW (110CV) S&S Live Pack',
 'vin': None,
 'year': 2022}
2026-03-25 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983076%27 HTTP/1.1" 200 None
2026-03-25 18:31:41 [ayvens.es] INFO: Saving data for 1983076: {'created_time': 1774463501.705462, 'last_price_update_time': 1774463501.705473, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983076') HTTP/1.1" 204 0
2026-03-25 18:31:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/397/051c37c93f244967a54cf254c9b362a5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/700/20914720b1d14d1baad2d3dd1c644c97/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:41 [ayvens.es] INFO: Found listing with ID: 1983085
2026-03-25 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983085%27 HTTP/1.1" 200 None
2026-03-25 18:31:41 [ayvens.es] INFO: Scrape type for 1983085: 1
2026-03-25 18:31:41 [ayvens.es] INFO: Extracting data for car ID: 1983085
2026-03-25 18:31:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1a2b8a6-72ed-51ba-a552-a67dfa4dc313 with identifier: 1983085
2026-03-25 18:31:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1a2b8a6-72ed-51ba-a552-a67dfa4dc313 with scrape type 1
2026-03-25 18:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d1a2b8a6-72ed-51ba-a552-a67dfa4dc313
2026-03-25 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F965%252Fbffc79e70008496486e22eaf6f5c1dbf%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/965/bffc79e70008496486e22eaf6f5c1dbf/images/large/1.jpg not downloaded yet
2026-03-25 18:31:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/134/e3fd19ecc8f74b2fbd5ddc38ee15976d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae90fcfbd0>
2026-03-25 18:31:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d530f2ce-2363-5c67-ad28-0b35550b7292/d530f2ce-2363-5c67-ad28-0b35550b7292_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F272%252F15f5e7bf60184189ad8cdae3ba1d9139%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/272/15f5e7bf60184189ad8cdae3ba1d9139/images/large/1.jpg saved to cache
2026-03-25 18:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d530f2ce-2363-5c67-ad28-0b35550b7292
2026-03-25 18:31:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d530f2ce-2363-5c67-ad28-0b35550b7292, skipping ID generation
2026-03-25 18:31:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d530f2ce-2363-5c67-ad28-0b35550b7292 with scrape type 1
2026-03-25 18:31:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d530f2ce-2363-5c67-ad28-0b35550b7292 sending to next pipeline
2026-03-25 18:31:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d530f2ce-2363-5c67-ad28-0b35550b7292, identifier: 1983074
2026-03-25 18:31:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ed34890>
2026-03-25 18:31:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1022b21-2f9a-549a-b14a-03d58836858d/e1022b21-2f9a-549a-b14a-03d58836858d_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F425%252Fa543ec2c1a8a4beead2bc9e3fe72c8d4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/425/a543ec2c1a8a4beead2bc9e3fe72c8d4/images/large/1.jpg saved to cache
2026-03-25 18:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e1022b21-2f9a-549a-b14a-03d58836858d
2026-03-25 18:31:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e1022b21-2f9a-549a-b14a-03d58836858d, skipping ID generation
2026-03-25 18:31:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1022b21-2f9a-549a-b14a-03d58836858d with scrape type 1
2026-03-25 18:31:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e1022b21-2f9a-549a-b14a-03d58836858d sending to next pipeline
2026-03-25 18:31:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e1022b21-2f9a-549a-b14a-03d58836858d, identifier: 1983078
2026-03-25 18:31:42 [ayvens.es] INFO: Found listing with ID: 1983086
2026-03-25 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983086%27 HTTP/1.1" 200 None
2026-03-25 18:31:42 [ayvens.es] INFO: Scrape type for 1983086: 1
2026-03-25 18:31:42 [ayvens.es] INFO: Extracting data for car ID: 1983086
2026-03-25 18:31:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28971d46-2995-58ce-b584-6f7d850d354a with identifier: 1983086
2026-03-25 18:31:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28971d46-2995-58ce-b584-6f7d850d354a with scrape type 1
2026-03-25 18:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 28971d46-2995-58ce-b584-6f7d850d354a
2026-03-25 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F872%252F23c5713a07f649458acbc4d8efca4aa6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/872/23c5713a07f649458acbc4d8efca4aa6/images/large/1.jpg not downloaded yet
2026-03-25 18:31:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d530f2ce-2363-5c67-ad28-0b35550b7292 with identifier: 1983074
2026-03-25 18:31:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d530f2ce-2363-5c67-ad28-0b35550b7292 with identifier: 1983074
2026-03-25 18:31:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d530f2ce-2363-5c67-ad28-0b35550b7292 with identifier: 1983074 to the API
2026-03-25 18:31:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/272/15f5e7bf60184189ad8cdae3ba1d9139/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 172,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd530f2ce-2363-5c67-ad28-0b35550b7292',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q5 SPORTBACK',
 'odometer': 64060,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d530f2ce-2363-5c67-ad28-0b35550b7292/d530f2ce-2363-5c67-ad28-0b35550b7292_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682430,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/272/15f5e7bf60184189ad8cdae3ba1d9139/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q5 SPORTBACK Black line 40 TDI 150kW quattro-ultra',
 'transmission': 'manual',
 'trim': 'Black line 40 TDI 150kW quattro-ultra',
 'vin': None,
 'year': 2022}
2026-03-25 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983074%27 HTTP/1.1" 200 None
2026-03-25 18:31:42 [ayvens.es] INFO: Saving data for 1983074: {'created_time': 1774463502.567072, 'last_price_update_time': 1774463502.567087, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983074') HTTP/1.1" 204 0
2026-03-25 18:31:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e1022b21-2f9a-549a-b14a-03d58836858d with identifier: 1983078
2026-03-25 18:31:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e1022b21-2f9a-549a-b14a-03d58836858d with identifier: 1983078
2026-03-25 18:31:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e1022b21-2f9a-549a-b14a-03d58836858d with identifier: 1983078 to the API
2026-03-25 18:31:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/425/a543ec2c1a8a4beead2bc9e3fe72c8d4/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 88,
 'color': 'Azul',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'e1022b21-2f9a-549a-b14a-03d58836858d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': '500',
 'odometer': 55928,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1022b21-2f9a-549a-b14a-03d58836858d/e1022b21-2f9a-549a-b14a-03d58836858d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353049,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/425/a543ec2c1a8a4beead2bc9e3fe72c8d4/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-10',
 'seats_number': 4,
 'seller_name': None,
 'title': 'FIAT 500 Lounge 1.0 6v GSE 52KW (70 CV)',
 'transmission': 'manual',
 'trim': 'Lounge 1.0 6v GSE 52KW (70 CV)',
 'vin': None,
 'year': 2020}
2026-03-25 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983078%27 HTTP/1.1" 200 None
2026-03-25 18:31:42 [ayvens.es] INFO: Saving data for 1983078: {'created_time': 1774463502.929023, 'last_price_update_time': 1774463502.929039, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983078') HTTP/1.1" 204 0
2026-03-25 18:31:42 [ayvens.es] INFO: Found listing with ID: 1983087
2026-03-25 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983087%27 HTTP/1.1" 200 None
2026-03-25 18:31:42 [ayvens.es] INFO: Scrape type for 1983087: 1
2026-03-25 18:31:42 [ayvens.es] INFO: Extracting data for car ID: 1983087
2026-03-25 18:31:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f892866-51f9-5ce3-a192-abd49efc8514 with identifier: 1983087
2026-03-25 18:31:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f892866-51f9-5ce3-a192-abd49efc8514 with scrape type 1
2026-03-25 18:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5f892866-51f9-5ce3-a192-abd49efc8514
2026-03-25 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F035%252F2b2c90c3e61a48f680393b22fe378977%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/035/2b2c90c3e61a48f680393b22fe378977/images/large/1.jpg not downloaded yet
2026-03-25 18:31:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ed15290>
2026-03-25 18:31:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00ea5495-2955-5d98-900a-36cd6fda0cea/00ea5495-2955-5d98-900a-36cd6fda0cea_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F397%252F051c37c93f244967a54cf254c9b362a5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/397/051c37c93f244967a54cf254c9b362a5/images/large/1.jpg saved to cache
2026-03-25 18:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 00ea5495-2955-5d98-900a-36cd6fda0cea
2026-03-25 18:31:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 00ea5495-2955-5d98-900a-36cd6fda0cea, skipping ID generation
2026-03-25 18:31:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00ea5495-2955-5d98-900a-36cd6fda0cea with scrape type 1
2026-03-25 18:31:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 00ea5495-2955-5d98-900a-36cd6fda0cea sending to next pipeline
2026-03-25 18:31:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 00ea5495-2955-5d98-900a-36cd6fda0cea, identifier: 1983077
2026-03-25 18:31:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ed84590>
2026-03-25 18:31:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e01167c-a78d-52ff-b60d-df2e365a28f6/4e01167c-a78d-52ff-b60d-df2e365a28f6_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F700%252F20914720b1d14d1baad2d3dd1c644c97%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/700/20914720b1d14d1baad2d3dd1c644c97/images/large/1.jpg saved to cache
2026-03-25 18:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4e01167c-a78d-52ff-b60d-df2e365a28f6
2026-03-25 18:31:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4e01167c-a78d-52ff-b60d-df2e365a28f6, skipping ID generation
2026-03-25 18:31:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e01167c-a78d-52ff-b60d-df2e365a28f6 with scrape type 1
2026-03-25 18:31:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4e01167c-a78d-52ff-b60d-df2e365a28f6 sending to next pipeline
2026-03-25 18:31:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4e01167c-a78d-52ff-b60d-df2e365a28f6, identifier: 1983079
2026-03-25 18:31:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae90b06490>
2026-03-25 18:31:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24b44276-5ed8-58ec-9d84-6a647764292d/24b44276-5ed8-58ec-9d84-6a647764292d_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F134%252Fe3fd19ecc8f74b2fbd5ddc38ee15976d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/134/e3fd19ecc8f74b2fbd5ddc38ee15976d/images/large/1.jpg saved to cache
2026-03-25 18:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 24b44276-5ed8-58ec-9d84-6a647764292d
2026-03-25 18:31:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 24b44276-5ed8-58ec-9d84-6a647764292d, skipping ID generation
2026-03-25 18:31:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24b44276-5ed8-58ec-9d84-6a647764292d with scrape type 1
2026-03-25 18:31:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 24b44276-5ed8-58ec-9d84-6a647764292d sending to next pipeline
2026-03-25 18:31:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 24b44276-5ed8-58ec-9d84-6a647764292d, identifier: 1983080
2026-03-25 18:31:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/621/4bb4eb8fa3d6492e8fe360289db1818a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:43 [ayvens.es] INFO: Found listing with ID: 1983088
2026-03-25 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983088%27 HTTP/1.1" 200 None
2026-03-25 18:31:43 [ayvens.es] INFO: Scrape type for 1983088: 1
2026-03-25 18:31:43 [ayvens.es] INFO: Extracting data for car ID: 1983088
2026-03-25 18:31:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90104017-583a-5852-be20-52f6ff148376 with identifier: 1983088
2026-03-25 18:31:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90104017-583a-5852-be20-52f6ff148376 with scrape type 1
2026-03-25 18:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 90104017-583a-5852-be20-52f6ff148376
2026-03-25 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F552%252Fa796b4a6b18a486c91a2e0683134b6ae%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/552/a796b4a6b18a486c91a2e0683134b6ae/images/large/1.jpg not downloaded yet
2026-03-25 18:31:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 00ea5495-2955-5d98-900a-36cd6fda0cea with identifier: 1983077
2026-03-25 18:31:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 00ea5495-2955-5d98-900a-36cd6fda0cea with identifier: 1983077
2026-03-25 18:31:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 00ea5495-2955-5d98-900a-36cd6fda0cea with identifier: 1983077 to the API
2026-03-25 18:31:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/397/051c37c93f244967a54cf254c9b362a5/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '00ea5495-2955-5d98-900a-36cd6fda0cea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS 3 CROSSBACK',
 'odometer': 39620,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00ea5495-2955-5d98-900a-36cd6fda0cea/00ea5495-2955-5d98-900a-36cd6fda0cea_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 483238,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/397/051c37c93f244967a54cf254c9b362a5/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS 3 CROSSBACK BlueHDi 81 kW Manual SO CHIC',
 'transmission': 'manual',
 'trim': 'BlueHDi 81 kW Manual SO CHIC',
 'vin': None,
 'year': 2021}
2026-03-25 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983077%27 HTTP/1.1" 200 None
2026-03-25 18:31:43 [ayvens.es] INFO: Saving data for 1983077: {'created_time': 1774463503.92328, 'last_price_update_time': 1774463503.923292, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983077') HTTP/1.1" 204 0
2026-03-25 18:31:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4e01167c-a78d-52ff-b60d-df2e365a28f6 with identifier: 1983079
2026-03-25 18:31:43 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:31:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4e01167c-a78d-52ff-b60d-df2e365a28f6 with identifier: 1983079
2026-03-25 18:31:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 4e01167c-a78d-52ff-b60d-df2e365a28f6 with identifier: 1983079 to the API
2026-03-25 18:31:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/700/20914720b1d14d1baad2d3dd1c644c97/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'Metalizado',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.2L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '4e01167c-a78d-52ff-b60d-df2e365a28f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': '500',
 'odometer': 95468,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e01167c-a78d-52ff-b60d-df2e365a28f6/4e01167c-a78d-52ff-b60d-df2e365a28f6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342968,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/700/20914720b1d14d1baad2d3dd1c644c97/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-18',
 'seats_number': 4,
 'seller_name': None,
 'title': 'FIAT 500 Lounge 1.2 8v 51KW (69 CV)',
 'transmission': 'manual',
 'trim': 'Lounge 1.2 8v 51KW (69 CV)',
 'vin': None,
 'year': 2019}
2026-03-25 18:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983079%27 HTTP/1.1" 200 None
2026-03-25 18:31:44 [ayvens.es] INFO: Saving data for 1983079: {'created_time': 1774463504.311317, 'last_price_update_time': 1774463504.311328, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983079') HTTP/1.1" 204 0
2026-03-25 18:31:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 24b44276-5ed8-58ec-9d84-6a647764292d with identifier: 1983080
2026-03-25 18:31:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 24b44276-5ed8-58ec-9d84-6a647764292d with identifier: 1983080
2026-03-25 18:31:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 24b44276-5ed8-58ec-9d84-6a647764292d with identifier: 1983080 to the API
2026-03-25 18:31:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/134/e3fd19ecc8f74b2fbd5ddc38ee15976d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 166,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '24b44276-5ed8-58ec-9d84-6a647764292d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'DOBLO CARGO',
 'odometer': 49374,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24b44276-5ed8-58ec-9d84-6a647764292d/24b44276-5ed8-58ec-9d84-6a647764292d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 326368,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/134/e3fd19ecc8f74b2fbd5ddc38ee15976d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-11',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FIAT DOBLO CARGO Cargo Maxi XL SX 1.6 Mjet 78kW (105CV)',
 'transmission': 'manual',
 'trim': 'Cargo Maxi XL SX 1.6 Mjet 78kW (105CV)',
 'vin': None,
 'year': 2021}
2026-03-25 18:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983080%27 HTTP/1.1" 200 None
2026-03-25 18:31:44 [ayvens.es] INFO: Saving data for 1983080: {'created_time': 1774463504.677789, 'last_price_update_time': 1774463504.6778, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983080') HTTP/1.1" 204 0
2026-03-25 18:31:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/883/b10acf6e02ea4c5c85c0d35892b2d3a9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/228/dc6aa06f6a144fed9aff1631ea6422b4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:44 [ayvens.es] INFO: Found listing with ID: 1983089
2026-03-25 18:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983089%27 HTTP/1.1" 200 None
2026-03-25 18:31:44 [ayvens.es] INFO: Scrape type for 1983089: 1
2026-03-25 18:31:44 [ayvens.es] INFO: Extracting data for car ID: 1983089
2026-03-25 18:31:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3716b417-efbc-566b-99ff-8e0895b52af6 with identifier: 1983089
2026-03-25 18:31:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3716b417-efbc-566b-99ff-8e0895b52af6 with scrape type 1
2026-03-25 18:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3716b417-efbc-566b-99ff-8e0895b52af6
2026-03-25 18:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F962%252Ff13a98ce7b6140689b74402f51280ed6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/962/f13a98ce7b6140689b74402f51280ed6/images/large/1.jpg not downloaded yet
2026-03-25 18:31:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ea77a10>
2026-03-25 18:31:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13d2a16d-6ac9-57dd-8998-e49c3b2f9363/13d2a16d-6ac9-57dd-8998-e49c3b2f9363_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F621%252F4bb4eb8fa3d6492e8fe360289db1818a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/621/4bb4eb8fa3d6492e8fe360289db1818a/images/large/1.jpg saved to cache
2026-03-25 18:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 13d2a16d-6ac9-57dd-8998-e49c3b2f9363
2026-03-25 18:31:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 13d2a16d-6ac9-57dd-8998-e49c3b2f9363, skipping ID generation
2026-03-25 18:31:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13d2a16d-6ac9-57dd-8998-e49c3b2f9363 with scrape type 1
2026-03-25 18:31:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 13d2a16d-6ac9-57dd-8998-e49c3b2f9363 sending to next pipeline
2026-03-25 18:31:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 13d2a16d-6ac9-57dd-8998-e49c3b2f9363, identifier: 1983081
2026-03-25 18:31:44 [ayvens.es] INFO: Found listing with ID: 1983090
2026-03-25 18:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983090%27 HTTP/1.1" 200 None
2026-03-25 18:31:44 [ayvens.es] INFO: Scrape type for 1983090: 1
2026-03-25 18:31:44 [ayvens.es] INFO: Extracting data for car ID: 1983090
2026-03-25 18:31:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13dedd9a-073d-5d0d-8e49-b950df5b3d8d with identifier: 1983090
2026-03-25 18:31:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13dedd9a-073d-5d0d-8e49-b950df5b3d8d with scrape type 1
2026-03-25 18:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 13dedd9a-073d-5d0d-8e49-b950df5b3d8d
2026-03-25 18:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F643%252F7aca1f58b392475aa79b6f36856e902d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/643/7aca1f58b392475aa79b6f36856e902d/images/large/1.jpg not downloaded yet
2026-03-25 18:31:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 13d2a16d-6ac9-57dd-8998-e49c3b2f9363 with identifier: 1983081
2026-03-25 18:31:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 13d2a16d-6ac9-57dd-8998-e49c3b2f9363 with identifier: 1983081
2026-03-25 18:31:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 13d2a16d-6ac9-57dd-8998-e49c3b2f9363 with identifier: 1983081 to the API
2026-03-25 18:31:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/621/4bb4eb8fa3d6492e8fe360289db1818a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '13d2a16d-6ac9-57dd-8998-e49c3b2f9363',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'DOBLO CARGO',
 'odometer': 30902,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13d2a16d-6ac9-57dd-8998-e49c3b2f9363/13d2a16d-6ac9-57dd-8998-e49c3b2f9363_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 490023,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/621/4bb4eb8fa3d6492e8fe360289db1818a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-28',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FIAT DOBLO CARGO Cargo SX 1.6 Mjet 77kW (105CV)',
 'transmission': 'manual',
 'trim': 'Cargo SX 1.6 Mjet 77kW (105CV)',
 'vin': None,
 'year': 2021}
2026-03-25 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983081%27 HTTP/1.1" 200 None
2026-03-25 18:31:45 [ayvens.es] INFO: Saving data for 1983081: {'created_time': 1774463505.389857, 'last_price_update_time': 1774463505.389868, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983081') HTTP/1.1" 204 0
2026-03-25 18:31:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/965/bffc79e70008496486e22eaf6f5c1dbf/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/411/eb85f7d291bd46adacf968ce8a5712ec/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:45 [ayvens.es] INFO: Found listing with ID: 1983091
2026-03-25 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983091%27 HTTP/1.1" 200 None
2026-03-25 18:31:45 [ayvens.es] INFO: Scrape type for 1983091: 1
2026-03-25 18:31:45 [ayvens.es] INFO: Extracting data for car ID: 1983091
2026-03-25 18:31:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afa0383e-33ab-59b8-88db-0d95fd094e91 with identifier: 1983091
2026-03-25 18:31:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afa0383e-33ab-59b8-88db-0d95fd094e91 with scrape type 1
2026-03-25 18:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item afa0383e-33ab-59b8-88db-0d95fd094e91
2026-03-25 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F693%252F3b556b7e62854813a0b7318d69cae36f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/693/3b556b7e62854813a0b7318d69cae36f/images/large/1.jpg not downloaded yet
2026-03-25 18:31:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e5e5f90>
2026-03-25 18:31:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e69dc82-b2e4-576f-9a7d-50d485046f2c/0e69dc82-b2e4-576f-9a7d-50d485046f2c_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F883%252Fb10acf6e02ea4c5c85c0d35892b2d3a9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/883/b10acf6e02ea4c5c85c0d35892b2d3a9/images/large/1.jpg saved to cache
2026-03-25 18:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0e69dc82-b2e4-576f-9a7d-50d485046f2c
2026-03-25 18:31:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0e69dc82-b2e4-576f-9a7d-50d485046f2c, skipping ID generation
2026-03-25 18:31:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e69dc82-b2e4-576f-9a7d-50d485046f2c with scrape type 1
2026-03-25 18:31:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0e69dc82-b2e4-576f-9a7d-50d485046f2c sending to next pipeline
2026-03-25 18:31:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0e69dc82-b2e4-576f-9a7d-50d485046f2c, identifier: 1983082
2026-03-25 18:31:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae921c5590>
2026-03-25 18:31:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39a8d024-d9b3-5db0-8bb2-93d9c1267d65/39a8d024-d9b3-5db0-8bb2-93d9c1267d65_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F228%252Fdc6aa06f6a144fed9aff1631ea6422b4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/228/dc6aa06f6a144fed9aff1631ea6422b4/images/large/1.jpg saved to cache
2026-03-25 18:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 39a8d024-d9b3-5db0-8bb2-93d9c1267d65
2026-03-25 18:31:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 39a8d024-d9b3-5db0-8bb2-93d9c1267d65, skipping ID generation
2026-03-25 18:31:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39a8d024-d9b3-5db0-8bb2-93d9c1267d65 with scrape type 1
2026-03-25 18:31:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 39a8d024-d9b3-5db0-8bb2-93d9c1267d65 sending to next pipeline
2026-03-25 18:31:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 39a8d024-d9b3-5db0-8bb2-93d9c1267d65, identifier: 1983083
2026-03-25 18:31:45 [ayvens.es] INFO: Found listing with ID: 1983092
2026-03-25 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983092%27 HTTP/1.1" 200 None
2026-03-25 18:31:45 [ayvens.es] INFO: Scrape type for 1983092: 1
2026-03-25 18:31:45 [ayvens.es] INFO: Extracting data for car ID: 1983092
2026-03-25 18:31:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 743f4540-2248-52d5-adbf-87718af464a4 with identifier: 1983092
2026-03-25 18:31:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 743f4540-2248-52d5-adbf-87718af464a4 with scrape type 1
2026-03-25 18:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 743f4540-2248-52d5-adbf-87718af464a4
2026-03-25 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F104%252F727514c8eb7d43dea52b5757ecaeea7f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/104/727514c8eb7d43dea52b5757ecaeea7f/images/large/1.jpg not downloaded yet
2026-03-25 18:31:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0e69dc82-b2e4-576f-9a7d-50d485046f2c with identifier: 1983082
2026-03-25 18:31:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0e69dc82-b2e4-576f-9a7d-50d485046f2c with identifier: 1983082
2026-03-25 18:31:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0e69dc82-b2e4-576f-9a7d-50d485046f2c with identifier: 1983082 to the API
2026-03-25 18:31:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/883/b10acf6e02ea4c5c85c0d35892b2d3a9/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 209,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '0e69dc82-b2e4-576f-9a7d-50d485046f2c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT',
 'odometer': 73988,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e69dc82-b2e4-576f-9a7d-50d485046f2c/0e69dc82-b2e4-576f-9a7d-50d485046f2c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324631,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/883/b10acf6e02ea4c5c85c0d35892b2d3a9/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-28',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 350 96kW L2H2 Van Trend FWD MHEV',
 'transmission': 'manual',
 'trim': '350 96kW L2H2 Van Trend FWD MHEV',
 'vin': None,
 'year': 2021}
2026-03-25 18:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983082%27 HTTP/1.1" 200 None
2026-03-25 18:31:46 [ayvens.es] INFO: Saving data for 1983082: {'created_time': 1774463506.339023, 'last_price_update_time': 1774463506.339034, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983082') HTTP/1.1" 204 0
2026-03-25 18:31:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 39a8d024-d9b3-5db0-8bb2-93d9c1267d65 with identifier: 1983083
2026-03-25 18:31:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:31:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 39a8d024-d9b3-5db0-8bb2-93d9c1267d65 with identifier: 1983083
2026-03-25 18:31:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 39a8d024-d9b3-5db0-8bb2-93d9c1267d65 with identifier: 1983083 to the API
2026-03-25 18:31:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/228/dc6aa06f6a144fed9aff1631ea6422b4/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'Silky',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '39a8d024-d9b3-5db0-8bb2-93d9c1267d65',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'STONIC',
 'odometer': 77792,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39a8d024-d9b3-5db0-8bb2-93d9c1267d65/39a8d024-d9b3-5db0-8bb2-93d9c1267d65_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344543,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/228/dc6aa06f6a144fed9aff1631ea6422b4/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA STONIC 1.0 T-GDi 74kW (100CV) MHEV iMT Concept',
 'transmission': 'manual',
 'trim': '1.0 T-GDi 74kW (100CV) MHEV iMT Concept',
 'vin': None,
 'year': 2022}
2026-03-25 18:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983083%27 HTTP/1.1" 200 None
2026-03-25 18:31:47 [ayvens.es] INFO: Saving data for 1983083: {'created_time': 1774463507.344826, 'last_price_update_time': 1774463507.34484, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983083') HTTP/1.1" 204 0
2026-03-25 18:31:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/872/23c5713a07f649458acbc4d8efca4aa6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/035/2b2c90c3e61a48f680393b22fe378977/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:47 [ayvens.es] INFO: Found listing with ID: 1983093
2026-03-25 18:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983093%27 HTTP/1.1" 200 None
2026-03-25 18:31:47 [ayvens.es] INFO: Scrape type for 1983093: 1
2026-03-25 18:31:47 [ayvens.es] INFO: Extracting data for car ID: 1983093
2026-03-25 18:31:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc6de128-a775-59ca-a580-dd332a5b698d with identifier: 1983093
2026-03-25 18:31:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc6de128-a775-59ca-a580-dd332a5b698d with scrape type 1
2026-03-25 18:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item cc6de128-a775-59ca-a580-dd332a5b698d
2026-03-25 18:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F170%252F8a1987c8bf294b2bab5022a366292e9c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/170/8a1987c8bf294b2bab5022a366292e9c/images/large/1.jpg not downloaded yet
2026-03-25 18:31:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae9e41c950>
2026-03-25 18:31:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1a2b8a6-72ed-51ba-a552-a67dfa4dc313/d1a2b8a6-72ed-51ba-a552-a67dfa4dc313_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F965%252Fbffc79e70008496486e22eaf6f5c1dbf%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/965/bffc79e70008496486e22eaf6f5c1dbf/images/large/1.jpg saved to cache
2026-03-25 18:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d1a2b8a6-72ed-51ba-a552-a67dfa4dc313
2026-03-25 18:31:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d1a2b8a6-72ed-51ba-a552-a67dfa4dc313, skipping ID generation
2026-03-25 18:31:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1a2b8a6-72ed-51ba-a552-a67dfa4dc313 with scrape type 1
2026-03-25 18:31:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d1a2b8a6-72ed-51ba-a552-a67dfa4dc313 sending to next pipeline
2026-03-25 18:31:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d1a2b8a6-72ed-51ba-a552-a67dfa4dc313, identifier: 1983085
2026-03-25 18:31:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8d421f10>
2026-03-25 18:31:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e2e9690-55d5-5ad3-ac97-18f4bc1ca47a/4e2e9690-55d5-5ad3-ac97-18f4bc1ca47a_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F411%252Feb85f7d291bd46adacf968ce8a5712ec%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/411/eb85f7d291bd46adacf968ce8a5712ec/images/large/1.jpg saved to cache
2026-03-25 18:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4e2e9690-55d5-5ad3-ac97-18f4bc1ca47a
2026-03-25 18:31:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4e2e9690-55d5-5ad3-ac97-18f4bc1ca47a, skipping ID generation
2026-03-25 18:31:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e2e9690-55d5-5ad3-ac97-18f4bc1ca47a with scrape type 1
2026-03-25 18:31:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4e2e9690-55d5-5ad3-ac97-18f4bc1ca47a sending to next pipeline
2026-03-25 18:31:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4e2e9690-55d5-5ad3-ac97-18f4bc1ca47a, identifier: 1983084
2026-03-25 18:31:47 [ayvens.es] INFO: Found listing with ID: 1983094
2026-03-25 18:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983094%27 HTTP/1.1" 200 None
2026-03-25 18:31:47 [ayvens.es] INFO: Scrape type for 1983094: 1
2026-03-25 18:31:47 [ayvens.es] INFO: Extracting data for car ID: 1983094
2026-03-25 18:31:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c26b163e-d808-526a-977a-d366dc10dbfc with identifier: 1983094
2026-03-25 18:31:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c26b163e-d808-526a-977a-d366dc10dbfc with scrape type 1
2026-03-25 18:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c26b163e-d808-526a-977a-d366dc10dbfc
2026-03-25 18:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F190%252F8f773b3bb69e4ae2ab106eb775310c46%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/190/8f773b3bb69e4ae2ab106eb775310c46/images/large/1.jpg not downloaded yet
2026-03-25 18:31:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d1a2b8a6-72ed-51ba-a552-a67dfa4dc313 with identifier: 1983085
2026-03-25 18:31:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d1a2b8a6-72ed-51ba-a552-a67dfa4dc313 with identifier: 1983085
2026-03-25 18:31:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d1a2b8a6-72ed-51ba-a552-a67dfa4dc313 with identifier: 1983085 to the API
2026-03-25 18:31:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/965/bffc79e70008496486e22eaf6f5c1dbf/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd1a2b8a6-72ed-51ba-a552-a67dfa4dc313',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 142342,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1a2b8a6-72ed-51ba-a552-a67dfa4dc313/d1a2b8a6-72ed-51ba-a552-a67dfa4dc313_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 356395,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/965/bffc79e70008496486e22eaf6f5c1dbf/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI dCi 81 kW (110 CV) ACENTA',
 'transmission': 'manual',
 'trim': 'dCi 81 kW (110 CV) ACENTA',
 'vin': None,
 'year': 2018}
2026-03-25 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983085%27 HTTP/1.1" 200 None
2026-03-25 18:31:48 [ayvens.es] INFO: Saving data for 1983085: {'created_time': 1774463508.147747, 'last_price_update_time': 1774463508.147764, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983085') HTTP/1.1" 204 0
2026-03-25 18:31:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4e2e9690-55d5-5ad3-ac97-18f4bc1ca47a with identifier: 1983084
2026-03-25 18:31:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4e2e9690-55d5-5ad3-ac97-18f4bc1ca47a with identifier: 1983084
2026-03-25 18:31:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 4e2e9690-55d5-5ad3-ac97-18f4bc1ca47a with identifier: 1983084 to the API
2026-03-25 18:31:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/411/eb85f7d291bd46adacf968ce8a5712ec/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '4e2e9690-55d5-5ad3-ac97-18f4bc1ca47a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS',
 'odometer': 91640,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e2e9690-55d5-5ad3-ac97-18f4bc1ca47a/4e2e9690-55d5-5ad3-ac97-18f4bc1ca47a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340681,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/411/eb85f7d291bd46adacf968ce8a5712ec/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS A 180 d',
 'transmission': 'manual',
 'trim': 'A 180 d',
 'vin': None,
 'year': 2019}
2026-03-25 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983084%27 HTTP/1.1" 200 None
2026-03-25 18:31:48 [ayvens.es] INFO: Saving data for 1983084: {'created_time': 1774463508.479778, 'last_price_update_time': 1774463508.47979, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983084') HTTP/1.1" 204 0
2026-03-25 18:31:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/552/a796b4a6b18a486c91a2e0683134b6ae/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:48 [ayvens.es] INFO: Found listing with ID: 1983095
2026-03-25 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983095%27 HTTP/1.1" 200 None
2026-03-25 18:31:48 [ayvens.es] INFO: Scrape type for 1983095: 1
2026-03-25 18:31:48 [ayvens.es] INFO: Extracting data for car ID: 1983095
2026-03-25 18:31:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd8516ad-bbdf-592c-be41-fffab07ddb2e with identifier: 1983095
2026-03-25 18:31:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd8516ad-bbdf-592c-be41-fffab07ddb2e with scrape type 1
2026-03-25 18:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item fd8516ad-bbdf-592c-be41-fffab07ddb2e
2026-03-25 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F561%252Fe8e7910daf0e42caa52b664cdba8435c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/561/e8e7910daf0e42caa52b664cdba8435c/images/large/1.jpg not downloaded yet
2026-03-25 18:31:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e554750>
2026-03-25 18:31:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28971d46-2995-58ce-b584-6f7d850d354a/28971d46-2995-58ce-b584-6f7d850d354a_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F872%252F23c5713a07f649458acbc4d8efca4aa6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/872/23c5713a07f649458acbc4d8efca4aa6/images/large/1.jpg saved to cache
2026-03-25 18:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 28971d46-2995-58ce-b584-6f7d850d354a
2026-03-25 18:31:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 28971d46-2995-58ce-b584-6f7d850d354a, skipping ID generation
2026-03-25 18:31:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28971d46-2995-58ce-b584-6f7d850d354a with scrape type 1
2026-03-25 18:31:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 28971d46-2995-58ce-b584-6f7d850d354a sending to next pipeline
2026-03-25 18:31:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 28971d46-2995-58ce-b584-6f7d850d354a, identifier: 1983086
2026-03-25 18:31:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ee78a50>
2026-03-25 18:31:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f892866-51f9-5ce3-a192-abd49efc8514/5f892866-51f9-5ce3-a192-abd49efc8514_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F035%252F2b2c90c3e61a48f680393b22fe378977%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/035/2b2c90c3e61a48f680393b22fe378977/images/large/1.jpg saved to cache
2026-03-25 18:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5f892866-51f9-5ce3-a192-abd49efc8514
2026-03-25 18:31:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5f892866-51f9-5ce3-a192-abd49efc8514, skipping ID generation
2026-03-25 18:31:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f892866-51f9-5ce3-a192-abd49efc8514 with scrape type 1
2026-03-25 18:31:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5f892866-51f9-5ce3-a192-abd49efc8514 sending to next pipeline
2026-03-25 18:31:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5f892866-51f9-5ce3-a192-abd49efc8514, identifier: 1983087
2026-03-25 18:31:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/962/f13a98ce7b6140689b74402f51280ed6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:48 [ayvens.es] INFO: Found listing with ID: 1983096
2026-03-25 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983096%27 HTTP/1.1" 200 None
2026-03-25 18:31:48 [ayvens.es] INFO: Scrape type for 1983096: 1
2026-03-25 18:31:48 [ayvens.es] INFO: Extracting data for car ID: 1983096
2026-03-25 18:31:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47efd2fe-2deb-55ea-b331-559e006ae09b with identifier: 1983096
2026-03-25 18:31:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47efd2fe-2deb-55ea-b331-559e006ae09b with scrape type 1
2026-03-25 18:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 47efd2fe-2deb-55ea-b331-559e006ae09b
2026-03-25 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F432%252Fc1c39569fc08403caf4f2dc55ef177cc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/432/c1c39569fc08403caf4f2dc55ef177cc/images/large/1.jpg not downloaded yet
2026-03-25 18:31:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 28971d46-2995-58ce-b584-6f7d850d354a with identifier: 1983086
2026-03-25 18:31:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 28971d46-2995-58ce-b584-6f7d850d354a with identifier: 1983086
2026-03-25 18:31:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 28971d46-2995-58ce-b584-6f7d850d354a with identifier: 1983086 to the API
2026-03-25 18:31:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/872/23c5713a07f649458acbc4d8efca4aa6/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '28971d46-2995-58ce-b584-6f7d850d354a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 135697,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28971d46-2995-58ce-b584-6f7d850d354a/28971d46-2995-58ce-b584-6f7d850d354a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324922,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/872/23c5713a07f649458acbc4d8efca4aa6/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-11',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS Profesional dCi 55kW (75CV) Euro 6',
 'transmission': 'manual',
 'trim': 'Profesional dCi 55kW (75CV) Euro 6',
 'vin': None,
 'year': 2018}
2026-03-25 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983086%27 HTTP/1.1" 200 None
2026-03-25 18:31:49 [ayvens.es] INFO: Saving data for 1983086: {'created_time': 1774463509.285677, 'last_price_update_time': 1774463509.285687, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983086') HTTP/1.1" 204 0
2026-03-25 18:31:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5f892866-51f9-5ce3-a192-abd49efc8514 with identifier: 1983087
2026-03-25 18:31:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5f892866-51f9-5ce3-a192-abd49efc8514 with identifier: 1983087
2026-03-25 18:31:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5f892866-51f9-5ce3-a192-abd49efc8514 with identifier: 1983087 to the API
2026-03-25 18:31:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/035/2b2c90c3e61a48f680393b22fe378977/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 100,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '5f892866-51f9-5ce3-a192-abd49efc8514',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 241996,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f892866-51f9-5ce3-a192-abd49efc8514/5f892866-51f9-5ce3-a192-abd49efc8514_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 326369,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/035/2b2c90c3e61a48f680393b22fe378977/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI dCi 85 kW (115 CV) E6D ACENTA',
 'transmission': 'manual',
 'trim': 'dCi 85 kW (115 CV) E6D ACENTA',
 'vin': None,
 'year': 2019}
2026-03-25 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983087%27 HTTP/1.1" 200 None
2026-03-25 18:31:49 [ayvens.es] INFO: Saving data for 1983087: {'created_time': 1774463509.668985, 'last_price_update_time': 1774463509.668995, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983087') HTTP/1.1" 204 0
2026-03-25 18:31:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/693/3b556b7e62854813a0b7318d69cae36f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/643/7aca1f58b392475aa79b6f36856e902d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:49 [ayvens.es] INFO: Found listing with ID: 1983097
2026-03-25 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983097%27 HTTP/1.1" 200 None
2026-03-25 18:31:49 [ayvens.es] INFO: Scrape type for 1983097: 1
2026-03-25 18:31:49 [ayvens.es] INFO: Extracting data for car ID: 1983097
2026-03-25 18:31:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af056fcf-66aa-5d47-acac-46e4db3b3069 with identifier: 1983097
2026-03-25 18:31:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af056fcf-66aa-5d47-acac-46e4db3b3069 with scrape type 1
2026-03-25 18:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item af056fcf-66aa-5d47-acac-46e4db3b3069
2026-03-25 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F582%252Ffc8c04278bbe47059166bbd1cda4b8d5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/582/fc8c04278bbe47059166bbd1cda4b8d5/images/large/1.jpg not downloaded yet
2026-03-25 18:31:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ee79dd0>
2026-03-25 18:31:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90104017-583a-5852-be20-52f6ff148376/90104017-583a-5852-be20-52f6ff148376_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F552%252Fa796b4a6b18a486c91a2e0683134b6ae%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/552/a796b4a6b18a486c91a2e0683134b6ae/images/large/1.jpg saved to cache
2026-03-25 18:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 90104017-583a-5852-be20-52f6ff148376
2026-03-25 18:31:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 90104017-583a-5852-be20-52f6ff148376, skipping ID generation
2026-03-25 18:31:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90104017-583a-5852-be20-52f6ff148376 with scrape type 1
2026-03-25 18:31:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 90104017-583a-5852-be20-52f6ff148376 sending to next pipeline
2026-03-25 18:31:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 90104017-583a-5852-be20-52f6ff148376, identifier: 1983088
2026-03-25 18:31:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e5c1990>
2026-03-25 18:31:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3716b417-efbc-566b-99ff-8e0895b52af6/3716b417-efbc-566b-99ff-8e0895b52af6_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F962%252Ff13a98ce7b6140689b74402f51280ed6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/962/f13a98ce7b6140689b74402f51280ed6/images/large/1.jpg saved to cache
2026-03-25 18:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3716b417-efbc-566b-99ff-8e0895b52af6
2026-03-25 18:31:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3716b417-efbc-566b-99ff-8e0895b52af6, skipping ID generation
2026-03-25 18:31:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3716b417-efbc-566b-99ff-8e0895b52af6 with scrape type 1
2026-03-25 18:31:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3716b417-efbc-566b-99ff-8e0895b52af6 sending to next pipeline
2026-03-25 18:31:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3716b417-efbc-566b-99ff-8e0895b52af6, identifier: 1983089
2026-03-25 18:31:50 [ayvens.es] INFO: Found listing with ID: 1983098
2026-03-25 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983098%27 HTTP/1.1" 200 None
2026-03-25 18:31:50 [ayvens.es] INFO: Scrape type for 1983098: 1
2026-03-25 18:31:50 [ayvens.es] INFO: Extracting data for car ID: 1983098
2026-03-25 18:31:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 137f8a31-f6c2-5462-9b54-5e6e7b187518 with identifier: 1983098
2026-03-25 18:31:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 137f8a31-f6c2-5462-9b54-5e6e7b187518 with scrape type 1
2026-03-25 18:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 137f8a31-f6c2-5462-9b54-5e6e7b187518
2026-03-25 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F110%252F7930069e68694686b9d82cdd7a948c64%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/110/7930069e68694686b9d82cdd7a948c64/images/large/1.jpg not downloaded yet
2026-03-25 18:31:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 90104017-583a-5852-be20-52f6ff148376 with identifier: 1983088
2026-03-25 18:31:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 90104017-583a-5852-be20-52f6ff148376 with identifier: 1983088
2026-03-25 18:31:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 90104017-583a-5852-be20-52f6ff148376 with identifier: 1983088 to the API
2026-03-25 18:31:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/552/a796b4a6b18a486c91a2e0683134b6ae/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 100,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '90104017-583a-5852-be20-52f6ff148376',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 115474,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90104017-583a-5852-be20-52f6ff148376/90104017-583a-5852-be20-52f6ff148376_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 341474,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/552/a796b4a6b18a486c91a2e0683134b6ae/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI dCi 85 kW (115 CV) E6D ACENTA',
 'transmission': 'manual',
 'trim': 'dCi 85 kW (115 CV) E6D ACENTA',
 'vin': None,
 'year': 2019}
2026-03-25 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983088%27 HTTP/1.1" 200 None
2026-03-25 18:31:50 [ayvens.es] INFO: Saving data for 1983088: {'created_time': 1774463510.480848, 'last_price_update_time': 1774463510.480858, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983088') HTTP/1.1" 204 0
2026-03-25 18:31:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3716b417-efbc-566b-99ff-8e0895b52af6 with identifier: 1983089
2026-03-25 18:31:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3716b417-efbc-566b-99ff-8e0895b52af6 with identifier: 1983089
2026-03-25 18:31:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3716b417-efbc-566b-99ff-8e0895b52af6 with identifier: 1983089 to the API
2026-03-25 18:31:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/962/f13a98ce7b6140689b74402f51280ed6/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '3716b417-efbc-566b-99ff-8e0895b52af6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'CORSA',
 'odometer': 55157,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3716b417-efbc-566b-99ff-8e0895b52af6/3716b417-efbc-566b-99ff-8e0895b52af6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 469114,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/962/f13a98ce7b6140689b74402f51280ed6/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL CORSA 1.2T XHL 74kW (100CV) Edition',
 'transmission': 'manual',
 'trim': '1.2T XHL 74kW (100CV) Edition',
 'vin': None,
 'year': 2022}
2026-03-25 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983089%27 HTTP/1.1" 200 None
2026-03-25 18:31:50 [ayvens.es] INFO: Saving data for 1983089: {'created_time': 1774463510.881338, 'last_price_update_time': 1774463510.881348, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983089') HTTP/1.1" 204 0
2026-03-25 18:31:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/104/727514c8eb7d43dea52b5757ecaeea7f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/170/8a1987c8bf294b2bab5022a366292e9c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:50 [ayvens.es] INFO: Found listing with ID: 1983099
2026-03-25 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983099%27 HTTP/1.1" 200 None
2026-03-25 18:31:50 [ayvens.es] INFO: Scrape type for 1983099: 1
2026-03-25 18:31:50 [ayvens.es] INFO: Extracting data for car ID: 1983099
2026-03-25 18:31:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52554666-c30a-5188-a7b4-1c642536488d with identifier: 1983099
2026-03-25 18:31:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52554666-c30a-5188-a7b4-1c642536488d with scrape type 1
2026-03-25 18:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 52554666-c30a-5188-a7b4-1c642536488d
2026-03-25 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F887%252Fdac95c9a09bd406c9ea74761d6e036b3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/887/dac95c9a09bd406c9ea74761d6e036b3/images/large/1.jpg not downloaded yet
2026-03-25 18:31:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ea6f650>
2026-03-25 18:31:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afa0383e-33ab-59b8-88db-0d95fd094e91/afa0383e-33ab-59b8-88db-0d95fd094e91_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F693%252F3b556b7e62854813a0b7318d69cae36f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/693/3b556b7e62854813a0b7318d69cae36f/images/large/1.jpg saved to cache
2026-03-25 18:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item afa0383e-33ab-59b8-88db-0d95fd094e91
2026-03-25 18:31:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: afa0383e-33ab-59b8-88db-0d95fd094e91, skipping ID generation
2026-03-25 18:31:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afa0383e-33ab-59b8-88db-0d95fd094e91 with scrape type 1
2026-03-25 18:31:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item afa0383e-33ab-59b8-88db-0d95fd094e91 sending to next pipeline
2026-03-25 18:31:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: afa0383e-33ab-59b8-88db-0d95fd094e91, identifier: 1983091
2026-03-25 18:31:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ecd9d50>
2026-03-25 18:31:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13dedd9a-073d-5d0d-8e49-b950df5b3d8d/13dedd9a-073d-5d0d-8e49-b950df5b3d8d_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F643%252F7aca1f58b392475aa79b6f36856e902d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/643/7aca1f58b392475aa79b6f36856e902d/images/large/1.jpg saved to cache
2026-03-25 18:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 13dedd9a-073d-5d0d-8e49-b950df5b3d8d
2026-03-25 18:31:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 13dedd9a-073d-5d0d-8e49-b950df5b3d8d, skipping ID generation
2026-03-25 18:31:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13dedd9a-073d-5d0d-8e49-b950df5b3d8d with scrape type 1
2026-03-25 18:31:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 13dedd9a-073d-5d0d-8e49-b950df5b3d8d sending to next pipeline
2026-03-25 18:31:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 13dedd9a-073d-5d0d-8e49-b950df5b3d8d, identifier: 1983090
2026-03-25 18:31:51 [ayvens.es] INFO: Found listing with ID: 1983100
2026-03-25 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983100%27 HTTP/1.1" 200 None
2026-03-25 18:31:51 [ayvens.es] INFO: Scrape type for 1983100: 1
2026-03-25 18:31:51 [ayvens.es] INFO: Extracting data for car ID: 1983100
2026-03-25 18:31:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3eaec995-2b0a-5035-8767-b62c00a8d45f with identifier: 1983100
2026-03-25 18:31:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3eaec995-2b0a-5035-8767-b62c00a8d45f with scrape type 1
2026-03-25 18:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3eaec995-2b0a-5035-8767-b62c00a8d45f
2026-03-25 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F608%252F32699ef910e4405dbd09777d970c57e6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/608/32699ef910e4405dbd09777d970c57e6/images/large/1.jpg not downloaded yet
2026-03-25 18:31:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: afa0383e-33ab-59b8-88db-0d95fd094e91 with identifier: 1983091
2026-03-25 18:31:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: afa0383e-33ab-59b8-88db-0d95fd094e91 with identifier: 1983091
2026-03-25 18:31:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: afa0383e-33ab-59b8-88db-0d95fd094e91 with identifier: 1983091 to the API
2026-03-25 18:31:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/693/3b556b7e62854813a0b7318d69cae36f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'afa0383e-33ab-59b8-88db-0d95fd094e91',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CAPTUR',
 'odometer': 77944,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afa0383e-33ab-59b8-88db-0d95fd094e91/afa0383e-33ab-59b8-88db-0d95fd094e91_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 338234,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/693/3b556b7e62854813a0b7318d69cae36f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CAPTUR Intens TCe 140CV GPF Micro Hibrido',
 'transmission': 'manual',
 'trim': 'Intens TCe 140CV GPF Micro Hibrido',
 'vin': None,
 'year': 2022}
2026-03-25 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983091%27 HTTP/1.1" 200 None
2026-03-25 18:31:51 [ayvens.es] INFO: Saving data for 1983091: {'created_time': 1774463511.759172, 'last_price_update_time': 1774463511.759187, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983091') HTTP/1.1" 204 0
2026-03-25 18:31:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 13dedd9a-073d-5d0d-8e49-b950df5b3d8d with identifier: 1983090
2026-03-25 18:31:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 13dedd9a-073d-5d0d-8e49-b950df5b3d8d with identifier: 1983090
2026-03-25 18:31:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 13dedd9a-073d-5d0d-8e49-b950df5b3d8d with identifier: 1983090 to the API
2026-03-25 18:31:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/643/7aca1f58b392475aa79b6f36856e902d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Azul',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '13dedd9a-073d-5d0d-8e49-b950df5b3d8d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508',
 'odometer': 147976,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13dedd9a-073d-5d0d-8e49-b950df5b3d8d/13dedd9a-073d-5d0d-8e49-b950df5b3d8d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 378717,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/643/7aca1f58b392475aa79b6f36856e902d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 5P Active BlueHDi 130 S&S EAT8',
 'transmission': 'manual',
 'trim': '5P Active BlueHDi 130 S&S EAT8',
 'vin': None,
 'year': 2021}
2026-03-25 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983090%27 HTTP/1.1" 200 None
2026-03-25 18:31:52 [ayvens.es] INFO: Saving data for 1983090: {'created_time': 1774463512.096867, 'last_price_update_time': 1774463512.096879, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983090') HTTP/1.1" 204 0
2026-03-25 18:31:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/190/8f773b3bb69e4ae2ab106eb775310c46/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:52 [ayvens.es] INFO: Found listing with ID: 1983101
2026-03-25 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983101%27 HTTP/1.1" 200 None
2026-03-25 18:31:52 [ayvens.es] INFO: Scrape type for 1983101: 1
2026-03-25 18:31:52 [ayvens.es] INFO: Extracting data for car ID: 1983101
2026-03-25 18:31:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 492d12b0-fc44-5ac4-97e7-609de8a37ed7 with identifier: 1983101
2026-03-25 18:31:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 492d12b0-fc44-5ac4-97e7-609de8a37ed7 with scrape type 1
2026-03-25 18:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 492d12b0-fc44-5ac4-97e7-609de8a37ed7
2026-03-25 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F159%252F69aef960f6b34a3587072b7ee16d3fb1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/159/69aef960f6b34a3587072b7ee16d3fb1/images/large/1.jpg not downloaded yet
2026-03-25 18:31:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8d444250>
2026-03-25 18:31:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_743f4540-2248-52d5-adbf-87718af464a4/743f4540-2248-52d5-adbf-87718af464a4_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F104%252F727514c8eb7d43dea52b5757ecaeea7f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/104/727514c8eb7d43dea52b5757ecaeea7f/images/large/1.jpg saved to cache
2026-03-25 18:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 743f4540-2248-52d5-adbf-87718af464a4
2026-03-25 18:31:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 743f4540-2248-52d5-adbf-87718af464a4, skipping ID generation
2026-03-25 18:31:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 743f4540-2248-52d5-adbf-87718af464a4 with scrape type 1
2026-03-25 18:31:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 743f4540-2248-52d5-adbf-87718af464a4 sending to next pipeline
2026-03-25 18:31:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 743f4540-2248-52d5-adbf-87718af464a4, identifier: 1983092
2026-03-25 18:31:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae9efd4fd0>
2026-03-25 18:31:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc6de128-a775-59ca-a580-dd332a5b698d/cc6de128-a775-59ca-a580-dd332a5b698d_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F170%252F8a1987c8bf294b2bab5022a366292e9c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/170/8a1987c8bf294b2bab5022a366292e9c/images/large/1.jpg saved to cache
2026-03-25 18:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cc6de128-a775-59ca-a580-dd332a5b698d
2026-03-25 18:31:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cc6de128-a775-59ca-a580-dd332a5b698d, skipping ID generation
2026-03-25 18:31:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc6de128-a775-59ca-a580-dd332a5b698d with scrape type 1
2026-03-25 18:31:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cc6de128-a775-59ca-a580-dd332a5b698d sending to next pipeline
2026-03-25 18:31:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: cc6de128-a775-59ca-a580-dd332a5b698d, identifier: 1983093
2026-03-25 18:31:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/561/e8e7910daf0e42caa52b664cdba8435c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:52 [ayvens.es] INFO: Found listing with ID: 1983102
2026-03-25 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983102%27 HTTP/1.1" 200 None
2026-03-25 18:31:52 [ayvens.es] INFO: Scrape type for 1983102: 1
2026-03-25 18:31:52 [ayvens.es] INFO: Extracting data for car ID: 1983102
2026-03-25 18:31:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a5add81-0576-58bd-bd54-373c60b9f22f with identifier: 1983102
2026-03-25 18:31:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a5add81-0576-58bd-bd54-373c60b9f22f with scrape type 1
2026-03-25 18:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2a5add81-0576-58bd-bd54-373c60b9f22f
2026-03-25 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F573%252Fc13aadd615ec4ca2b4f87cd184b0d89f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/573/c13aadd615ec4ca2b4f87cd184b0d89f/images/large/1.jpg not downloaded yet
2026-03-25 18:31:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 743f4540-2248-52d5-adbf-87718af464a4 with identifier: 1983092
2026-03-25 18:31:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 743f4540-2248-52d5-adbf-87718af464a4 with identifier: 1983092
2026-03-25 18:31:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 743f4540-2248-52d5-adbf-87718af464a4 with identifier: 1983092 to the API
2026-03-25 18:31:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/104/727514c8eb7d43dea52b5757ecaeea7f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Pintura',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '743f4540-2248-52d5-adbf-87718af464a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 35129,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_743f4540-2248-52d5-adbf-87718af464a4/743f4540-2248-52d5-adbf-87718af464a4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 276679,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/104/727514c8eb7d43dea52b5757ecaeea7f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-04',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS Maxi 2p Blue dCi 70 kW (95CV)',
 'transmission': 'manual',
 'trim': 'Maxi 2p Blue dCi 70 kW (95CV)',
 'vin': None,
 'year': 2020}
2026-03-25 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983092%27 HTTP/1.1" 200 None
2026-03-25 18:31:52 [ayvens.es] INFO: Saving data for 1983092: {'created_time': 1774463512.840781, 'last_price_update_time': 1774463512.840795, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983092') HTTP/1.1" 204 0
2026-03-25 18:31:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: cc6de128-a775-59ca-a580-dd332a5b698d with identifier: 1983093
2026-03-25 18:31:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: cc6de128-a775-59ca-a580-dd332a5b698d with identifier: 1983093
2026-03-25 18:31:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: cc6de128-a775-59ca-a580-dd332a5b698d with identifier: 1983093 to the API
2026-03-25 18:31:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/170/8a1987c8bf294b2bab5022a366292e9c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 98,
 'color': 'Azul',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'cc6de128-a775-59ca-a580-dd332a5b698d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MEGANE',
 'odometer': 232157,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc6de128-a775-59ca-a580-dd332a5b698d/cc6de128-a775-59ca-a580-dd332a5b698d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 381451,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/170/8a1987c8bf294b2bab5022a366292e9c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT MEGANE Sp. Tourer Zen En. dCi 81kW (110CV) EDC',
 'transmission': 'manual',
 'trim': 'Sp. Tourer Zen En. dCi 81kW (110CV) EDC',
 'vin': None,
 'year': 2018}
2026-03-25 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983093%27 HTTP/1.1" 200 None
2026-03-25 18:31:53 [ayvens.es] INFO: Saving data for 1983093: {'created_time': 1774463513.287197, 'last_price_update_time': 1774463513.287207, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983093') HTTP/1.1" 204 0
2026-03-25 18:31:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/582/fc8c04278bbe47059166bbd1cda4b8d5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:53 [ayvens.es] INFO: Found listing with ID: 1983103
2026-03-25 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983103%27 HTTP/1.1" 200 None
2026-03-25 18:31:53 [ayvens.es] INFO: Scrape type for 1983103: 1
2026-03-25 18:31:53 [ayvens.es] INFO: Extracting data for car ID: 1983103
2026-03-25 18:31:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 501d5ea0-059b-58bb-89a2-6838a5d91e5a with identifier: 1983103
2026-03-25 18:31:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 501d5ea0-059b-58bb-89a2-6838a5d91e5a with scrape type 1
2026-03-25 18:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 501d5ea0-059b-58bb-89a2-6838a5d91e5a
2026-03-25 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F017%252Fcf5f5f25fc1f4ab18d611836ad632e9c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/017/cf5f5f25fc1f4ab18d611836ad632e9c/images/large/1.jpg not downloaded yet
2026-03-25 18:31:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8d417d10>
2026-03-25 18:31:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c26b163e-d808-526a-977a-d366dc10dbfc/c26b163e-d808-526a-977a-d366dc10dbfc_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F190%252F8f773b3bb69e4ae2ab106eb775310c46%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/190/8f773b3bb69e4ae2ab106eb775310c46/images/large/1.jpg saved to cache
2026-03-25 18:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c26b163e-d808-526a-977a-d366dc10dbfc
2026-03-25 18:31:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c26b163e-d808-526a-977a-d366dc10dbfc, skipping ID generation
2026-03-25 18:31:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c26b163e-d808-526a-977a-d366dc10dbfc with scrape type 1
2026-03-25 18:31:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c26b163e-d808-526a-977a-d366dc10dbfc sending to next pipeline
2026-03-25 18:31:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c26b163e-d808-526a-977a-d366dc10dbfc, identifier: 1983094
2026-03-25 18:31:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8eda27d0>
2026-03-25 18:31:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd8516ad-bbdf-592c-be41-fffab07ddb2e/fd8516ad-bbdf-592c-be41-fffab07ddb2e_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F561%252Fe8e7910daf0e42caa52b664cdba8435c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/561/e8e7910daf0e42caa52b664cdba8435c/images/large/1.jpg saved to cache
2026-03-25 18:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fd8516ad-bbdf-592c-be41-fffab07ddb2e
2026-03-25 18:31:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fd8516ad-bbdf-592c-be41-fffab07ddb2e, skipping ID generation
2026-03-25 18:31:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd8516ad-bbdf-592c-be41-fffab07ddb2e with scrape type 1
2026-03-25 18:31:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fd8516ad-bbdf-592c-be41-fffab07ddb2e sending to next pipeline
2026-03-25 18:31:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: fd8516ad-bbdf-592c-be41-fffab07ddb2e, identifier: 1983095
2026-03-25 18:31:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/432/c1c39569fc08403caf4f2dc55ef177cc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:53 [ayvens.es] INFO: Found listing with ID: 1983104
2026-03-25 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983104%27 HTTP/1.1" 200 None
2026-03-25 18:31:53 [ayvens.es] INFO: Scrape type for 1983104: 1
2026-03-25 18:31:53 [ayvens.es] INFO: Extracting data for car ID: 1983104
2026-03-25 18:31:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94f0cace-33c0-52a2-be68-e188273ca63d with identifier: 1983104
2026-03-25 18:31:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94f0cace-33c0-52a2-be68-e188273ca63d with scrape type 1
2026-03-25 18:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 94f0cace-33c0-52a2-be68-e188273ca63d
2026-03-25 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F256%252Fc8bbf824ba894e879937682320bf92b5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/256/c8bbf824ba894e879937682320bf92b5/images/large/1.jpg not downloaded yet
2026-03-25 18:31:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c26b163e-d808-526a-977a-d366dc10dbfc with identifier: 1983094
2026-03-25 18:31:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c26b163e-d808-526a-977a-d366dc10dbfc with identifier: 1983094
2026-03-25 18:31:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c26b163e-d808-526a-977a-d366dc10dbfc with identifier: 1983094 to the API
2026-03-25 18:31:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/190/8f773b3bb69e4ae2ab106eb775310c46/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'c26b163e-d808-526a-977a-d366dc10dbfc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ARONA',
 'odometer': 99155,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c26b163e-d808-526a-977a-d366dc10dbfc/c26b163e-d808-526a-977a-d366dc10dbfc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 299539,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/190/8f773b3bb69e4ae2ab106eb775310c46/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ARONA 1.0 TSI 85kW (115CV) Style Edition Eco',
 'transmission': 'manual',
 'trim': '1.0 TSI 85kW (115CV) Style Edition Eco',
 'vin': None,
 'year': 2020}
2026-03-25 18:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983094%27 HTTP/1.1" 200 None
2026-03-25 18:31:54 [ayvens.es] INFO: Saving data for 1983094: {'created_time': 1774463514.992511, 'last_price_update_time': 1774463514.992522, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983094') HTTP/1.1" 204 0
2026-03-25 18:31:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: fd8516ad-bbdf-592c-be41-fffab07ddb2e with identifier: 1983095
2026-03-25 18:31:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: fd8516ad-bbdf-592c-be41-fffab07ddb2e with identifier: 1983095
2026-03-25 18:31:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: fd8516ad-bbdf-592c-be41-fffab07ddb2e with identifier: 1983095 to the API
2026-03-25 18:31:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/561/e8e7910daf0e42caa52b664cdba8435c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'fd8516ad-bbdf-592c-be41-fffab07ddb2e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 54185,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd8516ad-bbdf-592c-be41-fffab07ddb2e/fd8516ad-bbdf-592c-be41-fffab07ddb2e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 497764,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/561/e8e7910daf0e42caa52b664cdba8435c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON 1.5 TSI 110kW S&S Xcellence Go M',
 'transmission': 'manual',
 'trim': '1.5 TSI 110kW S&S Xcellence Go M',
 'vin': None,
 'year': 2022}
2026-03-25 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983095%27 HTTP/1.1" 200 None
2026-03-25 18:31:55 [ayvens.es] INFO: Saving data for 1983095: {'created_time': 1774463515.397278, 'last_price_update_time': 1774463515.397287, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983095') HTTP/1.1" 204 0
2026-03-25 18:31:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/887/dac95c9a09bd406c9ea74761d6e036b3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:55 [ayvens.es] INFO: Found listing with ID: 1983105
2026-03-25 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983105%27 HTTP/1.1" 200 None
2026-03-25 18:31:55 [ayvens.es] INFO: Scrape type for 1983105: 1
2026-03-25 18:31:55 [ayvens.es] INFO: Extracting data for car ID: 1983105
2026-03-25 18:31:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99a5e38c-6a6f-5139-8d3e-1642ed893514 with identifier: 1983105
2026-03-25 18:31:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99a5e38c-6a6f-5139-8d3e-1642ed893514 with scrape type 1
2026-03-25 18:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 99a5e38c-6a6f-5139-8d3e-1642ed893514
2026-03-25 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F956%252F60460f36467c401c8634f59723924bb8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/956/60460f36467c401c8634f59723924bb8/images/large/1.jpg not downloaded yet
2026-03-25 18:31:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e589f50>
2026-03-25 18:31:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af056fcf-66aa-5d47-acac-46e4db3b3069/af056fcf-66aa-5d47-acac-46e4db3b3069_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F582%252Ffc8c04278bbe47059166bbd1cda4b8d5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/582/fc8c04278bbe47059166bbd1cda4b8d5/images/large/1.jpg saved to cache
2026-03-25 18:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item af056fcf-66aa-5d47-acac-46e4db3b3069
2026-03-25 18:31:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: af056fcf-66aa-5d47-acac-46e4db3b3069, skipping ID generation
2026-03-25 18:31:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af056fcf-66aa-5d47-acac-46e4db3b3069 with scrape type 1
2026-03-25 18:31:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item af056fcf-66aa-5d47-acac-46e4db3b3069 sending to next pipeline
2026-03-25 18:31:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: af056fcf-66aa-5d47-acac-46e4db3b3069, identifier: 1983097
2026-03-25 18:31:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e59e090>
2026-03-25 18:31:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47efd2fe-2deb-55ea-b331-559e006ae09b/47efd2fe-2deb-55ea-b331-559e006ae09b_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F432%252Fc1c39569fc08403caf4f2dc55ef177cc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/432/c1c39569fc08403caf4f2dc55ef177cc/images/large/1.jpg saved to cache
2026-03-25 18:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 47efd2fe-2deb-55ea-b331-559e006ae09b
2026-03-25 18:31:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 47efd2fe-2deb-55ea-b331-559e006ae09b, skipping ID generation
2026-03-25 18:31:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47efd2fe-2deb-55ea-b331-559e006ae09b with scrape type 1
2026-03-25 18:31:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 47efd2fe-2deb-55ea-b331-559e006ae09b sending to next pipeline
2026-03-25 18:31:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 47efd2fe-2deb-55ea-b331-559e006ae09b, identifier: 1983096
2026-03-25 18:31:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/110/7930069e68694686b9d82cdd7a948c64/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:55 [ayvens.es] INFO: Found listing with ID: 1983106
2026-03-25 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983106%27 HTTP/1.1" 200 None
2026-03-25 18:31:55 [ayvens.es] INFO: Scrape type for 1983106: 1
2026-03-25 18:31:55 [ayvens.es] INFO: Extracting data for car ID: 1983106
2026-03-25 18:31:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c23167be-92ab-5416-8947-0909800e029c with identifier: 1983106
2026-03-25 18:31:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c23167be-92ab-5416-8947-0909800e029c with scrape type 1
2026-03-25 18:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c23167be-92ab-5416-8947-0909800e029c
2026-03-25 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F729%252F6c44e14d79834092a58b72f4a0a375a7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/729/6c44e14d79834092a58b72f4a0a375a7/images/large/1.jpg not downloaded yet
2026-03-25 18:31:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: af056fcf-66aa-5d47-acac-46e4db3b3069 with identifier: 1983097
2026-03-25 18:31:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: af056fcf-66aa-5d47-acac-46e4db3b3069 with identifier: 1983097
2026-03-25 18:31:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: af056fcf-66aa-5d47-acac-46e4db3b3069 with identifier: 1983097 to the API
2026-03-25 18:31:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/582/fc8c04278bbe47059166bbd1cda4b8d5/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'af056fcf-66aa-5d47-acac-46e4db3b3069',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'MICRA',
 'odometer': 97722,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af056fcf-66aa-5d47-acac-46e4db3b3069/af056fcf-66aa-5d47-acac-46e4db3b3069_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 326753,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/582/fc8c04278bbe47059166bbd1cda4b8d5/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN MICRA IG-T 68 kW (92 CV) E6D-F Acenta',
 'transmission': 'manual',
 'trim': 'IG-T 68 kW (92 CV) E6D-F Acenta',
 'vin': None,
 'year': 2022}
2026-03-25 18:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983097%27 HTTP/1.1" 200 None
2026-03-25 18:31:56 [ayvens.es] INFO: Saving data for 1983097: {'created_time': 1774463516.170189, 'last_price_update_time': 1774463516.170206, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983097') HTTP/1.1" 204 0
2026-03-25 18:31:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 47efd2fe-2deb-55ea-b331-559e006ae09b with identifier: 1983096
2026-03-25 18:31:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 47efd2fe-2deb-55ea-b331-559e006ae09b with identifier: 1983096
2026-03-25 18:31:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 47efd2fe-2deb-55ea-b331-559e006ae09b with identifier: 1983096 to the API
2026-03-25 18:31:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/432/c1c39569fc08403caf4f2dc55ef177cc/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '47efd2fe-2deb-55ea-b331-559e006ae09b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'PUMA',
 'odometer': 112697,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47efd2fe-2deb-55ea-b331-559e006ae09b/47efd2fe-2deb-55ea-b331-559e006ae09b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 498169,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/432/c1c39569fc08403caf4f2dc55ef177cc/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD PUMA 1.5 Ecoblue 120cv Titanium',
 'transmission': 'manual',
 'trim': '1.5 Ecoblue 120cv Titanium',
 'vin': None,
 'year': 2021}
2026-03-25 18:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983096%27 HTTP/1.1" 200 None
2026-03-25 18:31:56 [ayvens.es] INFO: Saving data for 1983096: {'created_time': 1774463516.567181, 'last_price_update_time': 1774463516.567192, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983096') HTTP/1.1" 204 0
2026-03-25 18:31:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/159/69aef960f6b34a3587072b7ee16d3fb1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/608/32699ef910e4405dbd09777d970c57e6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:56 [ayvens.es] INFO: Found listing with ID: 1983107
2026-03-25 18:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983107%27 HTTP/1.1" 200 None
2026-03-25 18:31:56 [ayvens.es] INFO: Scrape type for 1983107: 1
2026-03-25 18:31:56 [ayvens.es] INFO: Extracting data for car ID: 1983107
2026-03-25 18:31:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94dab669-4e47-5c93-8fca-219027815e76 with identifier: 1983107
2026-03-25 18:31:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94dab669-4e47-5c93-8fca-219027815e76 with scrape type 1
2026-03-25 18:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 94dab669-4e47-5c93-8fca-219027815e76
2026-03-25 18:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F095%252F150a5c7d24824faf857852d4d230deaa%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/095/150a5c7d24824faf857852d4d230deaa/images/large/1.jpg not downloaded yet
2026-03-25 18:31:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ee3c590>
2026-03-25 18:31:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52554666-c30a-5188-a7b4-1c642536488d/52554666-c30a-5188-a7b4-1c642536488d_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F887%252Fdac95c9a09bd406c9ea74761d6e036b3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/887/dac95c9a09bd406c9ea74761d6e036b3/images/large/1.jpg saved to cache
2026-03-25 18:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 52554666-c30a-5188-a7b4-1c642536488d
2026-03-25 18:31:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 52554666-c30a-5188-a7b4-1c642536488d, skipping ID generation
2026-03-25 18:31:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52554666-c30a-5188-a7b4-1c642536488d with scrape type 1
2026-03-25 18:31:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 52554666-c30a-5188-a7b4-1c642536488d sending to next pipeline
2026-03-25 18:31:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 52554666-c30a-5188-a7b4-1c642536488d, identifier: 1983099
2026-03-25 18:31:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ee3d290>
2026-03-25 18:31:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_137f8a31-f6c2-5462-9b54-5e6e7b187518/137f8a31-f6c2-5462-9b54-5e6e7b187518_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F110%252F7930069e68694686b9d82cdd7a948c64%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/110/7930069e68694686b9d82cdd7a948c64/images/large/1.jpg saved to cache
2026-03-25 18:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 137f8a31-f6c2-5462-9b54-5e6e7b187518
2026-03-25 18:31:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 137f8a31-f6c2-5462-9b54-5e6e7b187518, skipping ID generation
2026-03-25 18:31:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 137f8a31-f6c2-5462-9b54-5e6e7b187518 with scrape type 1
2026-03-25 18:31:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 137f8a31-f6c2-5462-9b54-5e6e7b187518 sending to next pipeline
2026-03-25 18:31:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 137f8a31-f6c2-5462-9b54-5e6e7b187518, identifier: 1983098
2026-03-25 18:31:57 [ayvens.es] INFO: Found listing with ID: 1983108
2026-03-25 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983108%27 HTTP/1.1" 200 None
2026-03-25 18:31:57 [ayvens.es] INFO: Scrape type for 1983108: 1
2026-03-25 18:31:57 [ayvens.es] INFO: Extracting data for car ID: 1983108
2026-03-25 18:31:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29a3efc9-acfe-564c-941d-eddd6fba42ae with identifier: 1983108
2026-03-25 18:31:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29a3efc9-acfe-564c-941d-eddd6fba42ae with scrape type 1
2026-03-25 18:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 29a3efc9-acfe-564c-941d-eddd6fba42ae
2026-03-25 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F973%252Ff0992b9106084fdd9a0b4b97bb56de5c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/973/f0992b9106084fdd9a0b4b97bb56de5c/images/large/1.jpg not downloaded yet
2026-03-25 18:31:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 52554666-c30a-5188-a7b4-1c642536488d with identifier: 1983099
2026-03-25 18:31:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 52554666-c30a-5188-a7b4-1c642536488d with identifier: 1983099
2026-03-25 18:31:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 52554666-c30a-5188-a7b4-1c642536488d with identifier: 1983099 to the API
2026-03-25 18:31:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/887/dac95c9a09bd406c9ea74761d6e036b3/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '52554666-c30a-5188-a7b4-1c642536488d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 77190,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52554666-c30a-5188-a7b4-1c642536488d/52554666-c30a-5188-a7b4-1c642536488d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 334072,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/887/dac95c9a09bd406c9ea74761d6e036b3/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 Active Pack Puretech 100 S&S BVM6',
 'transmission': 'manual',
 'trim': 'Active Pack Puretech 100 S&S BVM6',
 'vin': None,
 'year': 2021}
2026-03-25 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983099%27 HTTP/1.1" 200 None
2026-03-25 18:31:57 [ayvens.es] INFO: Saving data for 1983099: {'created_time': 1774463517.970946, 'last_price_update_time': 1774463517.970957, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983099') HTTP/1.1" 204 0
2026-03-25 18:31:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 137f8a31-f6c2-5462-9b54-5e6e7b187518 with identifier: 1983098
2026-03-25 18:31:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 137f8a31-f6c2-5462-9b54-5e6e7b187518 with identifier: 1983098
2026-03-25 18:31:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 137f8a31-f6c2-5462-9b54-5e6e7b187518 with identifier: 1983098 to the API
2026-03-25 18:31:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/110/7930069e68694686b9d82cdd7a948c64/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '137f8a31-f6c2-5462-9b54-5e6e7b187518',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'COMBO',
 'odometer': 86697,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_137f8a31-f6c2-5462-9b54-5e6e7b187518/137f8a31-f6c2-5462-9b54-5e6e7b187518_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 485079,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/110/7930069e68694686b9d82cdd7a948c64/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-20',
 'seats_number': 2,
 'seller_name': None,
 'title': 'OPEL COMBO 1.5 TD 75kW (100CV) Express L H1 650kg',
 'transmission': 'manual',
 'trim': '1.5 TD 75kW (100CV) Express L H1 650kg',
 'vin': None,
 'year': 2021}
2026-03-25 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983098%27 HTTP/1.1" 200 None
2026-03-25 18:31:58 [ayvens.es] INFO: Saving data for 1983098: {'created_time': 1774463518.344289, 'last_price_update_time': 1774463518.344305, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983098') HTTP/1.1" 204 0
2026-03-25 18:31:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/017/cf5f5f25fc1f4ab18d611836ad632e9c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:58 [ayvens.es] INFO: Found listing with ID: 1983109
2026-03-25 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983109%27 HTTP/1.1" 200 None
2026-03-25 18:31:58 [ayvens.es] INFO: Scrape type for 1983109: 1
2026-03-25 18:31:58 [ayvens.es] INFO: Extracting data for car ID: 1983109
2026-03-25 18:31:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b228689-d4ec-569c-a005-9ba54089ab7d with identifier: 1983109
2026-03-25 18:31:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b228689-d4ec-569c-a005-9ba54089ab7d with scrape type 1
2026-03-25 18:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8b228689-d4ec-569c-a005-9ba54089ab7d
2026-03-25 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F440%252Fcfc2bf367bb0437e9612471c9ccf47cd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/440/cfc2bf367bb0437e9612471c9ccf47cd/images/large/1.jpg not downloaded yet
2026-03-25 18:31:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8edeab10>
2026-03-25 18:31:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_492d12b0-fc44-5ac4-97e7-609de8a37ed7/492d12b0-fc44-5ac4-97e7-609de8a37ed7_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F159%252F69aef960f6b34a3587072b7ee16d3fb1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/159/69aef960f6b34a3587072b7ee16d3fb1/images/large/1.jpg saved to cache
2026-03-25 18:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 492d12b0-fc44-5ac4-97e7-609de8a37ed7
2026-03-25 18:31:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 492d12b0-fc44-5ac4-97e7-609de8a37ed7, skipping ID generation
2026-03-25 18:31:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 492d12b0-fc44-5ac4-97e7-609de8a37ed7 with scrape type 1
2026-03-25 18:31:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 492d12b0-fc44-5ac4-97e7-609de8a37ed7 sending to next pipeline
2026-03-25 18:31:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 492d12b0-fc44-5ac4-97e7-609de8a37ed7, identifier: 1983101
2026-03-25 18:31:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:31:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae909037d0>
2026-03-25 18:31:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:31:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:31:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:31:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3eaec995-2b0a-5035-8767-b62c00a8d45f/3eaec995-2b0a-5035-8767-b62c00a8d45f_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F608%252F32699ef910e4405dbd09777d970c57e6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/608/32699ef910e4405dbd09777d970c57e6/images/large/1.jpg saved to cache
2026-03-25 18:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3eaec995-2b0a-5035-8767-b62c00a8d45f
2026-03-25 18:31:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3eaec995-2b0a-5035-8767-b62c00a8d45f, skipping ID generation
2026-03-25 18:31:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3eaec995-2b0a-5035-8767-b62c00a8d45f with scrape type 1
2026-03-25 18:31:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3eaec995-2b0a-5035-8767-b62c00a8d45f sending to next pipeline
2026-03-25 18:31:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3eaec995-2b0a-5035-8767-b62c00a8d45f, identifier: 1983100
2026-03-25 18:31:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/256/c8bbf824ba894e879937682320bf92b5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:31:58 [ayvens.es] INFO: Found listing with ID: 1983110
2026-03-25 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983110%27 HTTP/1.1" 200 None
2026-03-25 18:31:58 [ayvens.es] INFO: Scrape type for 1983110: 1
2026-03-25 18:31:58 [ayvens.es] INFO: Extracting data for car ID: 1983110
2026-03-25 18:31:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c63f6426-e4a1-579d-9e14-6409b9c26ae8 with identifier: 1983110
2026-03-25 18:31:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c63f6426-e4a1-579d-9e14-6409b9c26ae8 with scrape type 1
2026-03-25 18:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c63f6426-e4a1-579d-9e14-6409b9c26ae8
2026-03-25 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F805%252Fcc3d21d203bc429d8c8fd44575f9e472%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/805/cc3d21d203bc429d8c8fd44575f9e472/images/large/1.jpg not downloaded yet
2026-03-25 18:31:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 492d12b0-fc44-5ac4-97e7-609de8a37ed7 with identifier: 1983101
2026-03-25 18:31:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 492d12b0-fc44-5ac4-97e7-609de8a37ed7 with identifier: 1983101
2026-03-25 18:31:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 492d12b0-fc44-5ac4-97e7-609de8a37ed7 with identifier: 1983101 to the API
2026-03-25 18:31:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:31:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:31:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/159/69aef960f6b34a3587072b7ee16d3fb1/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '492d12b0-fc44-5ac4-97e7-609de8a37ed7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'RIFTER',
 'odometer': 137314,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_492d12b0-fc44-5ac4-97e7-609de8a37ed7/492d12b0-fc44-5ac4-97e7-609de8a37ed7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 326840,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/159/69aef960f6b34a3587072b7ee16d3fb1/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT RIFTER Access Standard BlueHDi 73kW',
 'transmission': 'manual',
 'trim': 'Access Standard BlueHDi 73kW',
 'vin': None,
 'year': 2020}
2026-03-25 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983101%27 HTTP/1.1" 200 None
2026-03-25 18:31:59 [ayvens.es] INFO: Saving data for 1983101: {'created_time': 1774463519.964605, 'last_price_update_time': 1774463519.964618, 'auction_closing_time': 1774526400.0}
2026-03-25 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983101') HTTP/1.1" 204 0
2026-03-25 18:31:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3eaec995-2b0a-5035-8767-b62c00a8d45f with identifier: 1983100
2026-03-25 18:31:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3eaec995-2b0a-5035-8767-b62c00a8d45f with identifier: 1983100
2026-03-25 18:32:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3eaec995-2b0a-5035-8767-b62c00a8d45f with identifier: 1983100 to the API
2026-03-25 18:32:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/608/32699ef910e4405dbd09777d970c57e6/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '3eaec995-2b0a-5035-8767-b62c00a8d45f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508',
 'odometer': 110043,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3eaec995-2b0a-5035-8767-b62c00a8d45f/3eaec995-2b0a-5035-8767-b62c00a8d45f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336403,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/608/32699ef910e4405dbd09777d970c57e6/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 SW Allure Pack BlueHDi 130 S&S EAT8',
 'transmission': 'manual',
 'trim': 'SW Allure Pack BlueHDi 130 S&S EAT8',
 'vin': None,
 'year': 2022}
2026-03-25 18:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983100%27 HTTP/1.1" 200 None
2026-03-25 18:32:00 [ayvens.es] INFO: Saving data for 1983100: {'created_time': 1774463520.974834, 'last_price_update_time': 1774463520.974844, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983100') HTTP/1.1" 204 0
2026-03-25 18:32:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/573/c13aadd615ec4ca2b4f87cd184b0d89f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/956/60460f36467c401c8634f59723924bb8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:01 [ayvens.es] INFO: Found listing with ID: 1983111
2026-03-25 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983111%27 HTTP/1.1" 200 None
2026-03-25 18:32:01 [ayvens.es] INFO: Scrape type for 1983111: 1
2026-03-25 18:32:01 [ayvens.es] INFO: Extracting data for car ID: 1983111
2026-03-25 18:32:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 374b89c4-10d9-5072-8b28-cf10967ec142 with identifier: 1983111
2026-03-25 18:32:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 374b89c4-10d9-5072-8b28-cf10967ec142 with scrape type 1
2026-03-25 18:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 374b89c4-10d9-5072-8b28-cf10967ec142
2026-03-25 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F859%252Ff0fcc5bd34c94371824ef8dc0d043a77%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/859/f0fcc5bd34c94371824ef8dc0d043a77/images/large/1.jpg not downloaded yet
2026-03-25 18:32:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8d415f90>
2026-03-25 18:32:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_501d5ea0-059b-58bb-89a2-6838a5d91e5a/501d5ea0-059b-58bb-89a2-6838a5d91e5a_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F017%252Fcf5f5f25fc1f4ab18d611836ad632e9c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/017/cf5f5f25fc1f4ab18d611836ad632e9c/images/large/1.jpg saved to cache
2026-03-25 18:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 501d5ea0-059b-58bb-89a2-6838a5d91e5a
2026-03-25 18:32:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 501d5ea0-059b-58bb-89a2-6838a5d91e5a, skipping ID generation
2026-03-25 18:32:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 501d5ea0-059b-58bb-89a2-6838a5d91e5a with scrape type 1
2026-03-25 18:32:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 501d5ea0-059b-58bb-89a2-6838a5d91e5a sending to next pipeline
2026-03-25 18:32:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 501d5ea0-059b-58bb-89a2-6838a5d91e5a, identifier: 1983103
2026-03-25 18:32:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ea8be10>
2026-03-25 18:32:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94f0cace-33c0-52a2-be68-e188273ca63d/94f0cace-33c0-52a2-be68-e188273ca63d_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F256%252Fc8bbf824ba894e879937682320bf92b5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/256/c8bbf824ba894e879937682320bf92b5/images/large/1.jpg saved to cache
2026-03-25 18:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 94f0cace-33c0-52a2-be68-e188273ca63d
2026-03-25 18:32:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 94f0cace-33c0-52a2-be68-e188273ca63d, skipping ID generation
2026-03-25 18:32:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94f0cace-33c0-52a2-be68-e188273ca63d with scrape type 1
2026-03-25 18:32:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 94f0cace-33c0-52a2-be68-e188273ca63d sending to next pipeline
2026-03-25 18:32:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 94f0cace-33c0-52a2-be68-e188273ca63d, identifier: 1983104
2026-03-25 18:32:01 [ayvens.es] INFO: Found listing with ID: 1983112
2026-03-25 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983112%27 HTTP/1.1" 200 None
2026-03-25 18:32:01 [ayvens.es] INFO: Scrape type for 1983112: 1
2026-03-25 18:32:01 [ayvens.es] INFO: Extracting data for car ID: 1983112
2026-03-25 18:32:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f88e601f-9fed-51f9-ac1c-6ec477ef7856 with identifier: 1983112
2026-03-25 18:32:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f88e601f-9fed-51f9-ac1c-6ec477ef7856 with scrape type 1
2026-03-25 18:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f88e601f-9fed-51f9-ac1c-6ec477ef7856
2026-03-25 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F495%252F3efdea3175444ea0ba675bbe6073b1b9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/495/3efdea3175444ea0ba675bbe6073b1b9/images/large/1.jpg not downloaded yet
2026-03-25 18:32:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 501d5ea0-059b-58bb-89a2-6838a5d91e5a with identifier: 1983103
2026-03-25 18:32:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 501d5ea0-059b-58bb-89a2-6838a5d91e5a with identifier: 1983103
2026-03-25 18:32:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 501d5ea0-059b-58bb-89a2-6838a5d91e5a with identifier: 1983103 to the API
2026-03-25 18:32:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/017/cf5f5f25fc1f4ab18d611836ad632e9c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '501d5ea0-059b-58bb-89a2-6838a5d91e5a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 142525,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_501d5ea0-059b-58bb-89a2-6838a5d91e5a/501d5ea0-059b-58bb-89a2-6838a5d91e5a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 322365,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/017/cf5f5f25fc1f4ab18d611836ad632e9c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO Equilibre Blue dCi 74kW (100CV)',
 'transmission': 'manual',
 'trim': 'Equilibre Blue dCi 74kW (100CV)',
 'vin': None,
 'year': 2022}
2026-03-25 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983103%27 HTTP/1.1" 200 None
2026-03-25 18:32:01 [ayvens.es] INFO: Saving data for 1983103: {'created_time': 1774463521.704378, 'last_price_update_time': 1774463521.704389, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983103') HTTP/1.1" 204 0
2026-03-25 18:32:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 94f0cace-33c0-52a2-be68-e188273ca63d with identifier: 1983104
2026-03-25 18:32:01 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:32:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 94f0cace-33c0-52a2-be68-e188273ca63d with identifier: 1983104
2026-03-25 18:32:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 94f0cace-33c0-52a2-be68-e188273ca63d with identifier: 1983104 to the API
2026-03-25 18:32:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/256/c8bbf824ba894e879937682320bf92b5/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Skyscraper',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '94f0cace-33c0-52a2-be68-e188273ca63d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'SERIES 2',
 'odometer': 83468,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94f0cace-33c0-52a2-be68-e188273ca63d/94f0cace-33c0-52a2-be68-e188273ca63d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 350815,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/256/c8bbf824ba894e879937682320bf92b5/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW SERIES 2 216dA DCT Gran Coupe',
 'transmission': 'manual',
 'trim': '216dA DCT Gran Coupe',
 'vin': None,
 'year': 2022}
2026-03-25 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983104%27 HTTP/1.1" 200 None
2026-03-25 18:32:03 [ayvens.es] INFO: Saving data for 1983104: {'created_time': 1774463523.0046, 'last_price_update_time': 1774463523.004616, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983104') HTTP/1.1" 204 0
2026-03-25 18:32:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/095/150a5c7d24824faf857852d4d230deaa/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/729/6c44e14d79834092a58b72f4a0a375a7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:03 [ayvens.es] INFO: Found listing with ID: 1983113
2026-03-25 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983113%27 HTTP/1.1" 200 None
2026-03-25 18:32:03 [ayvens.es] INFO: Scrape type for 1983113: 1
2026-03-25 18:32:03 [ayvens.es] INFO: Extracting data for car ID: 1983113
2026-03-25 18:32:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc9e8706-981c-5e84-80e4-20e542c019e1 with identifier: 1983113
2026-03-25 18:32:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc9e8706-981c-5e84-80e4-20e542c019e1 with scrape type 1
2026-03-25 18:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item dc9e8706-981c-5e84-80e4-20e542c019e1
2026-03-25 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F627%252F5e052e5d8b8142cd90ea5521a6a4bc57%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/627/5e052e5d8b8142cd90ea5521a6a4bc57/images/large/1.jpg not downloaded yet
2026-03-25 18:32:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ef2ad90>
2026-03-25 18:32:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a5add81-0576-58bd-bd54-373c60b9f22f/2a5add81-0576-58bd-bd54-373c60b9f22f_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F573%252Fc13aadd615ec4ca2b4f87cd184b0d89f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/573/c13aadd615ec4ca2b4f87cd184b0d89f/images/large/1.jpg saved to cache
2026-03-25 18:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2a5add81-0576-58bd-bd54-373c60b9f22f
2026-03-25 18:32:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2a5add81-0576-58bd-bd54-373c60b9f22f, skipping ID generation
2026-03-25 18:32:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a5add81-0576-58bd-bd54-373c60b9f22f with scrape type 1
2026-03-25 18:32:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2a5add81-0576-58bd-bd54-373c60b9f22f sending to next pipeline
2026-03-25 18:32:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2a5add81-0576-58bd-bd54-373c60b9f22f, identifier: 1983102
2026-03-25 18:32:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e5c08d0>
2026-03-25 18:32:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99a5e38c-6a6f-5139-8d3e-1642ed893514/99a5e38c-6a6f-5139-8d3e-1642ed893514_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F956%252F60460f36467c401c8634f59723924bb8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/956/60460f36467c401c8634f59723924bb8/images/large/1.jpg saved to cache
2026-03-25 18:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 99a5e38c-6a6f-5139-8d3e-1642ed893514
2026-03-25 18:32:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 99a5e38c-6a6f-5139-8d3e-1642ed893514, skipping ID generation
2026-03-25 18:32:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99a5e38c-6a6f-5139-8d3e-1642ed893514 with scrape type 1
2026-03-25 18:32:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 99a5e38c-6a6f-5139-8d3e-1642ed893514 sending to next pipeline
2026-03-25 18:32:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 99a5e38c-6a6f-5139-8d3e-1642ed893514, identifier: 1983105
2026-03-25 18:32:03 [ayvens.es] INFO: Found listing with ID: 1983114
2026-03-25 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983114%27 HTTP/1.1" 200 None
2026-03-25 18:32:03 [ayvens.es] INFO: Scrape type for 1983114: 1
2026-03-25 18:32:03 [ayvens.es] INFO: Extracting data for car ID: 1983114
2026-03-25 18:32:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41f29403-cae5-5be4-a217-96137b082132 with identifier: 1983114
2026-03-25 18:32:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41f29403-cae5-5be4-a217-96137b082132 with scrape type 1
2026-03-25 18:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 41f29403-cae5-5be4-a217-96137b082132
2026-03-25 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F544%252Fc9739774a45848eaac5424ef98bf1de9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/544/c9739774a45848eaac5424ef98bf1de9/images/large/1.jpg not downloaded yet
2026-03-25 18:32:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2a5add81-0576-58bd-bd54-373c60b9f22f with identifier: 1983102
2026-03-25 18:32:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2a5add81-0576-58bd-bd54-373c60b9f22f with identifier: 1983102
2026-03-25 18:32:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 2a5add81-0576-58bd-bd54-373c60b9f22f with identifier: 1983102 to the API
2026-03-25 18:32:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/573/c13aadd615ec4ca2b4f87cd184b0d89f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '2a5add81-0576-58bd-bd54-373c60b9f22f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CAPTUR',
 'odometer': 70584,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a5add81-0576-58bd-bd54-373c60b9f22f/2a5add81-0576-58bd-bd54-373c60b9f22f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 524862,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/573/c13aadd615ec4ca2b4f87cd184b0d89f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CAPTUR Intens TCe 90',
 'transmission': 'manual',
 'trim': 'Intens TCe 90',
 'vin': None,
 'year': 2021}
2026-03-25 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983102%27 HTTP/1.1" 200 None
2026-03-25 18:32:03 [ayvens.es] INFO: Saving data for 1983102: {'created_time': 1774463523.732969, 'last_price_update_time': 1774463523.73298, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983102') HTTP/1.1" 204 0
2026-03-25 18:32:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 99a5e38c-6a6f-5139-8d3e-1642ed893514 with identifier: 1983105
2026-03-25 18:32:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 99a5e38c-6a6f-5139-8d3e-1642ed893514 with identifier: 1983105
2026-03-25 18:32:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 99a5e38c-6a6f-5139-8d3e-1642ed893514 with identifier: 1983105 to the API
2026-03-25 18:32:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/956/60460f36467c401c8634f59723924bb8/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 239,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.2L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '99a5e38c-6a6f-5139-8d3e-1642ed893514',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'JUMPER',
 'odometer': 89173,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99a5e38c-6a6f-5139-8d3e-1642ed893514/99a5e38c-6a6f-5139-8d3e-1642ed893514_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 355735,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/956/60460f36467c401c8634f59723924bb8/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-12-27',
 'seats_number': 3,
 'seller_name': None,
 'title': 'CITROËN JUMPER BlueHDi 103KW (140CV) Furgon 35L2H2',
 'transmission': 'manual',
 'trim': 'BlueHDi 103KW (140CV) Furgon 35L2H2',
 'vin': None,
 'year': 2023}
2026-03-25 18:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983105%27 HTTP/1.1" 200 None
2026-03-25 18:32:04 [ayvens.es] INFO: Saving data for 1983105: {'created_time': 1774463524.940753, 'last_price_update_time': 1774463524.940767, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983105') HTTP/1.1" 204 0
2026-03-25 18:32:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/973/f0992b9106084fdd9a0b4b97bb56de5c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/440/cfc2bf367bb0437e9612471c9ccf47cd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:04 [ayvens.es] INFO: Found listing with ID: 1983115
2026-03-25 18:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983115%27 HTTP/1.1" 200 None
2026-03-25 18:32:04 [ayvens.es] INFO: Scrape type for 1983115: 1
2026-03-25 18:32:04 [ayvens.es] INFO: Extracting data for car ID: 1983115
2026-03-25 18:32:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2b39aeb-9aa2-5824-8b12-4a8ce7321d8e with identifier: 1983115
2026-03-25 18:32:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2b39aeb-9aa2-5824-8b12-4a8ce7321d8e with scrape type 1
2026-03-25 18:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b2b39aeb-9aa2-5824-8b12-4a8ce7321d8e
2026-03-25 18:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F856%252F19b1a165551d4c41b57d7f4889f65a80%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/856/19b1a165551d4c41b57d7f4889f65a80/images/large/1.jpg not downloaded yet
2026-03-25 18:32:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae90b0e950>
2026-03-25 18:32:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94dab669-4e47-5c93-8fca-219027815e76/94dab669-4e47-5c93-8fca-219027815e76_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F095%252F150a5c7d24824faf857852d4d230deaa%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/095/150a5c7d24824faf857852d4d230deaa/images/large/1.jpg saved to cache
2026-03-25 18:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 94dab669-4e47-5c93-8fca-219027815e76
2026-03-25 18:32:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 94dab669-4e47-5c93-8fca-219027815e76, skipping ID generation
2026-03-25 18:32:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94dab669-4e47-5c93-8fca-219027815e76 with scrape type 1
2026-03-25 18:32:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 94dab669-4e47-5c93-8fca-219027815e76 sending to next pipeline
2026-03-25 18:32:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 94dab669-4e47-5c93-8fca-219027815e76, identifier: 1983107
2026-03-25 18:32:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ec5b490>
2026-03-25 18:32:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c23167be-92ab-5416-8947-0909800e029c/c23167be-92ab-5416-8947-0909800e029c_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F729%252F6c44e14d79834092a58b72f4a0a375a7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/729/6c44e14d79834092a58b72f4a0a375a7/images/large/1.jpg saved to cache
2026-03-25 18:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c23167be-92ab-5416-8947-0909800e029c
2026-03-25 18:32:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c23167be-92ab-5416-8947-0909800e029c, skipping ID generation
2026-03-25 18:32:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c23167be-92ab-5416-8947-0909800e029c with scrape type 1
2026-03-25 18:32:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c23167be-92ab-5416-8947-0909800e029c sending to next pipeline
2026-03-25 18:32:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c23167be-92ab-5416-8947-0909800e029c, identifier: 1983106
2026-03-25 18:32:05 [ayvens.es] INFO: Found listing with ID: 1983116
2026-03-25 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983116%27 HTTP/1.1" 200 None
2026-03-25 18:32:05 [ayvens.es] INFO: Scrape type for 1983116: 1
2026-03-25 18:32:05 [ayvens.es] INFO: Extracting data for car ID: 1983116
2026-03-25 18:32:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9e0c71c-6f18-5474-9f20-0dde9c4eb7a3 with identifier: 1983116
2026-03-25 18:32:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9e0c71c-6f18-5474-9f20-0dde9c4eb7a3 with scrape type 1
2026-03-25 18:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b9e0c71c-6f18-5474-9f20-0dde9c4eb7a3
2026-03-25 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F022%252Fcc321a36c03e42289c21ff14b23af3bd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/022/cc321a36c03e42289c21ff14b23af3bd/images/large/1.jpg not downloaded yet
2026-03-25 18:32:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 94dab669-4e47-5c93-8fca-219027815e76 with identifier: 1983107
2026-03-25 18:32:05 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:32:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 94dab669-4e47-5c93-8fca-219027815e76 with identifier: 1983107
2026-03-25 18:32:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 94dab669-4e47-5c93-8fca-219027815e76 with identifier: 1983107 to the API
2026-03-25 18:32:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/095/150a5c7d24824faf857852d4d230deaa/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 168,
 'color': 'Santorini',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '94dab669-4e47-5c93-8fca-219027815e76',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER VELAR',
 'odometer': 117493,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94dab669-4e47-5c93-8fca-219027815e76/94dab669-4e47-5c93-8fca-219027815e76_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325952,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/095/150a5c7d24824faf857852d4d230deaa/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER RANGE ROVER VELAR 2.0D I4 150kW (204CV) S 4WD Auto',
 'transmission': 'manual',
 'trim': '2.0D I4 150kW (204CV) S 4WD Auto',
 'vin': None,
 'year': 2021}
2026-03-25 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983107%27 HTTP/1.1" 200 None
2026-03-25 18:32:05 [ayvens.es] INFO: Saving data for 1983107: {'created_time': 1774463525.742078, 'last_price_update_time': 1774463525.742089, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983107') HTTP/1.1" 204 0
2026-03-25 18:32:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c23167be-92ab-5416-8947-0909800e029c with identifier: 1983106
2026-03-25 18:32:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c23167be-92ab-5416-8947-0909800e029c with identifier: 1983106
2026-03-25 18:32:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c23167be-92ab-5416-8947-0909800e029c with identifier: 1983106 to the API
2026-03-25 18:32:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/729/6c44e14d79834092a58b72f4a0a375a7/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 184,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c23167be-92ab-5416-8947-0909800e029c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT CUSTOM',
 'odometer': 247460,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c23167be-92ab-5416-8947-0909800e029c/c23167be-92ab-5416-8947-0909800e029c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342086,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/729/6c44e14d79834092a58b72f4a0a375a7/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-09',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT CUSTOM Van 2.0 TDCI 125kW 300 L2 MHEV Limited',
 'transmission': 'manual',
 'trim': 'Van 2.0 TDCI 125kW 300 L2 MHEV Limited',
 'vin': None,
 'year': 2022}
2026-03-25 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983106%27 HTTP/1.1" 200 None
2026-03-25 18:32:06 [ayvens.es] INFO: Saving data for 1983106: {'created_time': 1774463526.105571, 'last_price_update_time': 1774463526.105582, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983106') HTTP/1.1" 204 0
2026-03-25 18:32:06 [scrapy.extensions.logstats] INFO: Crawled 5 pages (at 1 pages/min), scraped 154 items (at 91 items/min)
2026-03-25 18:32:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 174MiB
2026-03-25 18:32:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/805/cc3d21d203bc429d8c8fd44575f9e472/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:06 [ayvens.es] INFO: Found listing with ID: 1983117
2026-03-25 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983117%27 HTTP/1.1" 200 None
2026-03-25 18:32:06 [ayvens.es] INFO: Scrape type for 1983117: 1
2026-03-25 18:32:06 [ayvens.es] INFO: Extracting data for car ID: 1983117
2026-03-25 18:32:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97d628e6-0a8f-5784-adff-3691a0e45cfe with identifier: 1983117
2026-03-25 18:32:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97d628e6-0a8f-5784-adff-3691a0e45cfe with scrape type 1
2026-03-25 18:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 97d628e6-0a8f-5784-adff-3691a0e45cfe
2026-03-25 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F991%252Fcb44d0b854554a188ae99197e3677aeb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/991/cb44d0b854554a188ae99197e3677aeb/images/large/1.jpg not downloaded yet
2026-03-25 18:32:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ee59350>
2026-03-25 18:32:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29a3efc9-acfe-564c-941d-eddd6fba42ae/29a3efc9-acfe-564c-941d-eddd6fba42ae_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F973%252Ff0992b9106084fdd9a0b4b97bb56de5c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/973/f0992b9106084fdd9a0b4b97bb56de5c/images/large/1.jpg saved to cache
2026-03-25 18:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 29a3efc9-acfe-564c-941d-eddd6fba42ae
2026-03-25 18:32:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 29a3efc9-acfe-564c-941d-eddd6fba42ae, skipping ID generation
2026-03-25 18:32:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29a3efc9-acfe-564c-941d-eddd6fba42ae with scrape type 1
2026-03-25 18:32:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 29a3efc9-acfe-564c-941d-eddd6fba42ae sending to next pipeline
2026-03-25 18:32:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 29a3efc9-acfe-564c-941d-eddd6fba42ae, identifier: 1983108
2026-03-25 18:32:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ed0e1d0>
2026-03-25 18:32:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b228689-d4ec-569c-a005-9ba54089ab7d/8b228689-d4ec-569c-a005-9ba54089ab7d_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F440%252Fcfc2bf367bb0437e9612471c9ccf47cd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/440/cfc2bf367bb0437e9612471c9ccf47cd/images/large/1.jpg saved to cache
2026-03-25 18:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8b228689-d4ec-569c-a005-9ba54089ab7d
2026-03-25 18:32:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8b228689-d4ec-569c-a005-9ba54089ab7d, skipping ID generation
2026-03-25 18:32:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b228689-d4ec-569c-a005-9ba54089ab7d with scrape type 1
2026-03-25 18:32:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8b228689-d4ec-569c-a005-9ba54089ab7d sending to next pipeline
2026-03-25 18:32:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8b228689-d4ec-569c-a005-9ba54089ab7d, identifier: 1983109
2026-03-25 18:32:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 29a3efc9-acfe-564c-941d-eddd6fba42ae with identifier: 1983108
2026-03-25 18:32:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 29a3efc9-acfe-564c-941d-eddd6fba42ae with identifier: 1983108
2026-03-25 18:32:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 29a3efc9-acfe-564c-941d-eddd6fba42ae with identifier: 1983108 to the API
2026-03-25 18:32:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/973/f0992b9106084fdd9a0b4b97bb56de5c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '29a3efc9-acfe-564c-941d-eddd6fba42ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 117168,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29a3efc9-acfe-564c-941d-eddd6fba42ae/29a3efc9-acfe-564c-941d-eddd6fba42ae_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 319906,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/973/f0992b9106084fdd9a0b4b97bb56de5c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO Business Blue dCi 74kW (100CV)',
 'transmission': 'manual',
 'trim': 'Business Blue dCi 74kW (100CV)',
 'vin': None,
 'year': 2022}
2026-03-25 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983108%27 HTTP/1.1" 200 None
2026-03-25 18:32:06 [ayvens.es] INFO: Saving data for 1983108: {'created_time': 1774463526.800957, 'last_price_update_time': 1774463526.800968, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983108') HTTP/1.1" 204 0
2026-03-25 18:32:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8b228689-d4ec-569c-a005-9ba54089ab7d with identifier: 1983109
2026-03-25 18:32:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8b228689-d4ec-569c-a005-9ba54089ab7d with identifier: 1983109
2026-03-25 18:32:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8b228689-d4ec-569c-a005-9ba54089ab7d with identifier: 1983109 to the API
2026-03-25 18:32:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/440/cfc2bf367bb0437e9612471c9ccf47cd/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '8b228689-d4ec-569c-a005-9ba54089ab7d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'IBIZA',
 'odometer': 75775,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b228689-d4ec-569c-a005-9ba54089ab7d/8b228689-d4ec-569c-a005-9ba54089ab7d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 348933,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/440/cfc2bf367bb0437e9612471c9ccf47cd/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT IBIZA 1.0 MPI 59kW (80CV) Reference XL',
 'transmission': 'manual',
 'trim': '1.0 MPI 59kW (80CV) Reference XL',
 'vin': None,
 'year': 2023}
2026-03-25 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983109%27 HTTP/1.1" 200 None
2026-03-25 18:32:07 [ayvens.es] INFO: Saving data for 1983109: {'created_time': 1774463527.187698, 'last_price_update_time': 1774463527.187709, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983109') HTTP/1.1" 204 0
2026-03-25 18:32:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/859/f0fcc5bd34c94371824ef8dc0d043a77/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:07 [ayvens.es] INFO: Found listing with ID: 1983118
2026-03-25 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983118%27 HTTP/1.1" 200 None
2026-03-25 18:32:07 [ayvens.es] INFO: Scrape type for 1983118: 1
2026-03-25 18:32:07 [ayvens.es] INFO: Extracting data for car ID: 1983118
2026-03-25 18:32:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8736362c-6acc-53f2-8f07-f305b594c27e with identifier: 1983118
2026-03-25 18:32:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8736362c-6acc-53f2-8f07-f305b594c27e with scrape type 1
2026-03-25 18:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8736362c-6acc-53f2-8f07-f305b594c27e
2026-03-25 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F796%252F3ae97389fd1a41da8bad44d0ba2dcfc6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/796/3ae97389fd1a41da8bad44d0ba2dcfc6/images/large/1.jpg not downloaded yet
2026-03-25 18:32:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ee0a4d0>
2026-03-25 18:32:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c63f6426-e4a1-579d-9e14-6409b9c26ae8/c63f6426-e4a1-579d-9e14-6409b9c26ae8_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F805%252Fcc3d21d203bc429d8c8fd44575f9e472%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/805/cc3d21d203bc429d8c8fd44575f9e472/images/large/1.jpg saved to cache
2026-03-25 18:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c63f6426-e4a1-579d-9e14-6409b9c26ae8
2026-03-25 18:32:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c63f6426-e4a1-579d-9e14-6409b9c26ae8, skipping ID generation
2026-03-25 18:32:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c63f6426-e4a1-579d-9e14-6409b9c26ae8 with scrape type 1
2026-03-25 18:32:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c63f6426-e4a1-579d-9e14-6409b9c26ae8 sending to next pipeline
2026-03-25 18:32:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c63f6426-e4a1-579d-9e14-6409b9c26ae8, identifier: 1983110
2026-03-25 18:32:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/627/5e052e5d8b8142cd90ea5521a6a4bc57/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/495/3efdea3175444ea0ba675bbe6073b1b9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:07 [ayvens.es] INFO: Found listing with ID: 1983119
2026-03-25 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983119%27 HTTP/1.1" 200 None
2026-03-25 18:32:07 [ayvens.es] INFO: Scrape type for 1983119: 1
2026-03-25 18:32:07 [ayvens.es] INFO: Extracting data for car ID: 1983119
2026-03-25 18:32:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0631e652-351b-5515-841f-6a59d7d06844 with identifier: 1983119
2026-03-25 18:32:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0631e652-351b-5515-841f-6a59d7d06844 with scrape type 1
2026-03-25 18:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0631e652-351b-5515-841f-6a59d7d06844
2026-03-25 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F646%252Fe5c9f6c3c1af45b1b33c6e7a632d3b8a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/646/e5c9f6c3c1af45b1b33c6e7a632d3b8a/images/large/1.jpg not downloaded yet
2026-03-25 18:32:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c63f6426-e4a1-579d-9e14-6409b9c26ae8 with identifier: 1983110
2026-03-25 18:32:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c63f6426-e4a1-579d-9e14-6409b9c26ae8 with identifier: 1983110
2026-03-25 18:32:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c63f6426-e4a1-579d-9e14-6409b9c26ae8 with identifier: 1983110 to the API
2026-03-25 18:32:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/805/cc3d21d203bc429d8c8fd44575f9e472/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 151,
 'color': 'Azul',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'c63f6426-e4a1-579d-9e14-6409b9c26ae8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TOURNEO COURIER',
 'odometer': 25573,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c63f6426-e4a1-579d-9e14-6409b9c26ae8/c63f6426-e4a1-579d-9e14-6409b9c26ae8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 362926,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/805/cc3d21d203bc429d8c8fd44575f9e472/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-03-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD TOURNEO COURIER 1.0 Ecoboost 92kW (125CV) Trend',
 'transmission': 'manual',
 'trim': '1.0 Ecoboost 92kW (125CV) Trend',
 'vin': None,
 'year': 2025}
2026-03-25 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983110%27 HTTP/1.1" 200 None
2026-03-25 18:32:07 [ayvens.es] INFO: Saving data for 1983110: {'created_time': 1774463527.781245, 'last_price_update_time': 1774463527.781256, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983110') HTTP/1.1" 204 0
2026-03-25 18:32:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/856/19b1a165551d4c41b57d7f4889f65a80/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:07 [ayvens.es] INFO: Found listing with ID: 1983120
2026-03-25 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983120%27 HTTP/1.1" 200 None
2026-03-25 18:32:07 [ayvens.es] INFO: Scrape type for 1983120: 1
2026-03-25 18:32:07 [ayvens.es] INFO: Extracting data for car ID: 1983120
2026-03-25 18:32:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ecb9e1ea-698e-5b32-bb74-f1c52f9d5661 with identifier: 1983120
2026-03-25 18:32:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecb9e1ea-698e-5b32-bb74-f1c52f9d5661 with scrape type 1
2026-03-25 18:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ecb9e1ea-698e-5b32-bb74-f1c52f9d5661
2026-03-25 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F724%252Fdebae314d265411a95594527fa5d7f7a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/724/debae314d265411a95594527fa5d7f7a/images/large/1.jpg not downloaded yet
2026-03-25 18:32:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8edaf510>
2026-03-25 18:32:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_374b89c4-10d9-5072-8b28-cf10967ec142/374b89c4-10d9-5072-8b28-cf10967ec142_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F859%252Ff0fcc5bd34c94371824ef8dc0d043a77%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/859/f0fcc5bd34c94371824ef8dc0d043a77/images/large/1.jpg saved to cache
2026-03-25 18:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 374b89c4-10d9-5072-8b28-cf10967ec142
2026-03-25 18:32:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 374b89c4-10d9-5072-8b28-cf10967ec142, skipping ID generation
2026-03-25 18:32:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 374b89c4-10d9-5072-8b28-cf10967ec142 with scrape type 1
2026-03-25 18:32:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 374b89c4-10d9-5072-8b28-cf10967ec142 sending to next pipeline
2026-03-25 18:32:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 374b89c4-10d9-5072-8b28-cf10967ec142, identifier: 1983111
2026-03-25 18:32:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8f39e250>
2026-03-25 18:32:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc9e8706-981c-5e84-80e4-20e542c019e1/dc9e8706-981c-5e84-80e4-20e542c019e1_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F627%252F5e052e5d8b8142cd90ea5521a6a4bc57%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/627/5e052e5d8b8142cd90ea5521a6a4bc57/images/large/1.jpg saved to cache
2026-03-25 18:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dc9e8706-981c-5e84-80e4-20e542c019e1
2026-03-25 18:32:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dc9e8706-981c-5e84-80e4-20e542c019e1, skipping ID generation
2026-03-25 18:32:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc9e8706-981c-5e84-80e4-20e542c019e1 with scrape type 1
2026-03-25 18:32:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dc9e8706-981c-5e84-80e4-20e542c019e1 sending to next pipeline
2026-03-25 18:32:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: dc9e8706-981c-5e84-80e4-20e542c019e1, identifier: 1983113
2026-03-25 18:32:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8f406110>
2026-03-25 18:32:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f88e601f-9fed-51f9-ac1c-6ec477ef7856/f88e601f-9fed-51f9-ac1c-6ec477ef7856_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F495%252F3efdea3175444ea0ba675bbe6073b1b9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/495/3efdea3175444ea0ba675bbe6073b1b9/images/large/1.jpg saved to cache
2026-03-25 18:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f88e601f-9fed-51f9-ac1c-6ec477ef7856
2026-03-25 18:32:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f88e601f-9fed-51f9-ac1c-6ec477ef7856, skipping ID generation
2026-03-25 18:32:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f88e601f-9fed-51f9-ac1c-6ec477ef7856 with scrape type 1
2026-03-25 18:32:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f88e601f-9fed-51f9-ac1c-6ec477ef7856 sending to next pipeline
2026-03-25 18:32:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f88e601f-9fed-51f9-ac1c-6ec477ef7856, identifier: 1983112
2026-03-25 18:32:08 [ayvens.es] INFO: Found listing with ID: 1983121
2026-03-25 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983121%27 HTTP/1.1" 200 None
2026-03-25 18:32:08 [ayvens.es] INFO: Scrape type for 1983121: 1
2026-03-25 18:32:08 [ayvens.es] INFO: Extracting data for car ID: 1983121
2026-03-25 18:32:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d697d28d-5691-5cc5-9317-c75a6012f52a with identifier: 1983121
2026-03-25 18:32:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d697d28d-5691-5cc5-9317-c75a6012f52a with scrape type 1
2026-03-25 18:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d697d28d-5691-5cc5-9317-c75a6012f52a
2026-03-25 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F341%252F4be6e080ce734fc481b73c3526320fcf%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/341/4be6e080ce734fc481b73c3526320fcf/images/large/1.jpg not downloaded yet
2026-03-25 18:32:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 374b89c4-10d9-5072-8b28-cf10967ec142 with identifier: 1983111
2026-03-25 18:32:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 374b89c4-10d9-5072-8b28-cf10967ec142 with identifier: 1983111
2026-03-25 18:32:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 374b89c4-10d9-5072-8b28-cf10967ec142 with identifier: 1983111 to the API
2026-03-25 18:32:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/859/f0fcc5bd34c94371824ef8dc0d043a77/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 193,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '374b89c4-10d9-5072-8b28-cf10967ec142',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT CUSTOM',
 'odometer': 126829,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_374b89c4-10d9-5072-8b28-cf10967ec142/374b89c4-10d9-5072-8b28-cf10967ec142_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 514505,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/859/f0fcc5bd34c94371824ef8dc0d043a77/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-25',
 'seats_number': 9,
 'seller_name': None,
 'title': 'FORD TRANSIT CUSTOM (O) Kombi 2.0 TDCI 110kW 320 L1 Trend MH',
 'transmission': 'manual',
 'trim': '(O) Kombi 2.0 TDCI 110kW 320 L1 Trend MH',
 'vin': None,
 'year': 2023}
2026-03-25 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983111%27 HTTP/1.1" 200 None
2026-03-25 18:32:08 [ayvens.es] INFO: Saving data for 1983111: {'created_time': 1774463528.68919, 'last_price_update_time': 1774463528.689203, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983111') HTTP/1.1" 204 0
2026-03-25 18:32:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: dc9e8706-981c-5e84-80e4-20e542c019e1 with identifier: 1983113
2026-03-25 18:32:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: dc9e8706-981c-5e84-80e4-20e542c019e1 with identifier: 1983113
2026-03-25 18:32:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: dc9e8706-981c-5e84-80e4-20e542c019e1 with identifier: 1983113 to the API
2026-03-25 18:32:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/627/5e052e5d8b8142cd90ea5521a6a4bc57/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'dc9e8706-981c-5e84-80e4-20e542c019e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008',
 'odometer': 171432,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc9e8706-981c-5e84-80e4-20e542c019e1/dc9e8706-981c-5e84-80e4-20e542c019e1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340268,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/627/5e052e5d8b8142cd90ea5521a6a4bc57/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-13',
 'seats_number': 7,
 'seller_name': None,
 'title': 'PEUGEOT 5008 Allure 1.5L BlueHDi 96kW (130CV) S&S',
 'transmission': 'manual',
 'trim': 'Allure 1.5L BlueHDi 96kW (130CV) S&S',
 'vin': None,
 'year': 2020}
2026-03-25 18:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983113%27 HTTP/1.1" 200 None
2026-03-25 18:32:09 [ayvens.es] INFO: Saving data for 1983113: {'created_time': 1774463529.88959, 'last_price_update_time': 1774463529.8896, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983113') HTTP/1.1" 204 0
2026-03-25 18:32:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f88e601f-9fed-51f9-ac1c-6ec477ef7856 with identifier: 1983112
2026-03-25 18:32:09 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:32:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f88e601f-9fed-51f9-ac1c-6ec477ef7856 with identifier: 1983112
2026-03-25 18:32:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f88e601f-9fed-51f9-ac1c-6ec477ef7856 with identifier: 1983112 to the API
2026-03-25 18:32:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/495/3efdea3175444ea0ba675bbe6073b1b9/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 97,
 'color': 'Corporativo',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f88e601f-9fed-51f9-ac1c-6ec477ef7856',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '208',
 'odometer': 51552,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f88e601f-9fed-51f9-ac1c-6ec477ef7856/f88e601f-9fed-51f9-ac1c-6ec477ef7856_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353864,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/495/3efdea3175444ea0ba675bbe6073b1b9/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 208 5P ACTIVE BlueHDi 73kW (100CV)',
 'transmission': 'manual',
 'trim': '5P ACTIVE BlueHDi 73kW (100CV)',
 'vin': None,
 'year': 2018}
2026-03-25 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983112%27 HTTP/1.1" 200 None
2026-03-25 18:32:10 [ayvens.es] INFO: Saving data for 1983112: {'created_time': 1774463530.242978, 'last_price_update_time': 1774463530.242992, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983112') HTTP/1.1" 204 0
2026-03-25 18:32:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/544/c9739774a45848eaac5424ef98bf1de9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/022/cc321a36c03e42289c21ff14b23af3bd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:10 [ayvens.es] INFO: Found listing with ID: 1983122
2026-03-25 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983122%27 HTTP/1.1" 200 None
2026-03-25 18:32:10 [ayvens.es] INFO: Scrape type for 1983122: 1
2026-03-25 18:32:10 [ayvens.es] INFO: Extracting data for car ID: 1983122
2026-03-25 18:32:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6db3f53d-bbca-57bb-9d37-ea03df808da7 with identifier: 1983122
2026-03-25 18:32:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6db3f53d-bbca-57bb-9d37-ea03df808da7 with scrape type 1
2026-03-25 18:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6db3f53d-bbca-57bb-9d37-ea03df808da7
2026-03-25 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F666%252F105eba25753741af8727f830d409ba26%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/666/105eba25753741af8727f830d409ba26/images/large/1.jpg not downloaded yet
2026-03-25 18:32:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ec53610>
2026-03-25 18:32:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2b39aeb-9aa2-5824-8b12-4a8ce7321d8e/b2b39aeb-9aa2-5824-8b12-4a8ce7321d8e_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F856%252F19b1a165551d4c41b57d7f4889f65a80%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/856/19b1a165551d4c41b57d7f4889f65a80/images/large/1.jpg saved to cache
2026-03-25 18:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b2b39aeb-9aa2-5824-8b12-4a8ce7321d8e
2026-03-25 18:32:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b2b39aeb-9aa2-5824-8b12-4a8ce7321d8e, skipping ID generation
2026-03-25 18:32:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2b39aeb-9aa2-5824-8b12-4a8ce7321d8e with scrape type 1
2026-03-25 18:32:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b2b39aeb-9aa2-5824-8b12-4a8ce7321d8e sending to next pipeline
2026-03-25 18:32:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b2b39aeb-9aa2-5824-8b12-4a8ce7321d8e, identifier: 1983115
2026-03-25 18:32:10 [ayvens.es] INFO: Found listing with ID: 1983123
2026-03-25 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983123%27 HTTP/1.1" 200 None
2026-03-25 18:32:10 [ayvens.es] INFO: Scrape type for 1983123: 1
2026-03-25 18:32:10 [ayvens.es] INFO: Extracting data for car ID: 1983123
2026-03-25 18:32:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66ceaec1-6605-523c-9a8a-bb963dbe0468 with identifier: 1983123
2026-03-25 18:32:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66ceaec1-6605-523c-9a8a-bb963dbe0468 with scrape type 1
2026-03-25 18:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 66ceaec1-6605-523c-9a8a-bb963dbe0468
2026-03-25 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F701%252F6fc226dd21994321b898b6f51ec36c73%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/701/6fc226dd21994321b898b6f51ec36c73/images/large/1.jpg not downloaded yet
2026-03-25 18:32:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b2b39aeb-9aa2-5824-8b12-4a8ce7321d8e with identifier: 1983115
2026-03-25 18:32:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b2b39aeb-9aa2-5824-8b12-4a8ce7321d8e with identifier: 1983115
2026-03-25 18:32:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b2b39aeb-9aa2-5824-8b12-4a8ce7321d8e with identifier: 1983115 to the API
2026-03-25 18:32:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/856/19b1a165551d4c41b57d7f4889f65a80/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 186,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.3L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b2b39aeb-9aa2-5824-8b12-4a8ce7321d8e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'DUCATO',
 'odometer': 125343,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2b39aeb-9aa2-5824-8b12-4a8ce7321d8e/b2b39aeb-9aa2-5824-8b12-4a8ce7321d8e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 285247,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/856/19b1a165551d4c41b57d7f4889f65a80/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-31',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FIAT DUCATO 30 L1 H1 2.3 1 (103 kW) Euro 6d-temp',
 'transmission': 'manual',
 'trim': '30 L1 H1 2.3 1 (103 kW) Euro 6d-temp',
 'vin': None,
 'year': 2020}
2026-03-25 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983115%27 HTTP/1.1" 200 None
2026-03-25 18:32:10 [ayvens.es] INFO: Saving data for 1983115: {'created_time': 1774463530.862145, 'last_price_update_time': 1774463530.862156, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983115') HTTP/1.1" 204 0
2026-03-25 18:32:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/991/cb44d0b854554a188ae99197e3677aeb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:10 [ayvens.es] INFO: Found listing with ID: 1983124
2026-03-25 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983124%27 HTTP/1.1" 200 None
2026-03-25 18:32:10 [ayvens.es] INFO: Scrape type for 1983124: 1
2026-03-25 18:32:10 [ayvens.es] INFO: Extracting data for car ID: 1983124
2026-03-25 18:32:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4929c8a-adf9-5dfb-a57f-34c99131f798 with identifier: 1983124
2026-03-25 18:32:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4929c8a-adf9-5dfb-a57f-34c99131f798 with scrape type 1
2026-03-25 18:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e4929c8a-adf9-5dfb-a57f-34c99131f798
2026-03-25 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F595%252Ff95916e837f54a398fbe848cd16c5419%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/595/f95916e837f54a398fbe848cd16c5419/images/large/1.jpg not downloaded yet
2026-03-25 18:32:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/646/e5c9f6c3c1af45b1b33c6e7a632d3b8a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8f251e50>
2026-03-25 18:32:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41f29403-cae5-5be4-a217-96137b082132/41f29403-cae5-5be4-a217-96137b082132_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F544%252Fc9739774a45848eaac5424ef98bf1de9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/544/c9739774a45848eaac5424ef98bf1de9/images/large/1.jpg saved to cache
2026-03-25 18:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 41f29403-cae5-5be4-a217-96137b082132
2026-03-25 18:32:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 41f29403-cae5-5be4-a217-96137b082132, skipping ID generation
2026-03-25 18:32:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41f29403-cae5-5be4-a217-96137b082132 with scrape type 1
2026-03-25 18:32:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 41f29403-cae5-5be4-a217-96137b082132 sending to next pipeline
2026-03-25 18:32:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 41f29403-cae5-5be4-a217-96137b082132, identifier: 1983114
2026-03-25 18:32:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ea1a8d0>
2026-03-25 18:32:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9e0c71c-6f18-5474-9f20-0dde9c4eb7a3/b9e0c71c-6f18-5474-9f20-0dde9c4eb7a3_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F022%252Fcc321a36c03e42289c21ff14b23af3bd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/022/cc321a36c03e42289c21ff14b23af3bd/images/large/1.jpg saved to cache
2026-03-25 18:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b9e0c71c-6f18-5474-9f20-0dde9c4eb7a3
2026-03-25 18:32:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b9e0c71c-6f18-5474-9f20-0dde9c4eb7a3, skipping ID generation
2026-03-25 18:32:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9e0c71c-6f18-5474-9f20-0dde9c4eb7a3 with scrape type 1
2026-03-25 18:32:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b9e0c71c-6f18-5474-9f20-0dde9c4eb7a3 sending to next pipeline
2026-03-25 18:32:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b9e0c71c-6f18-5474-9f20-0dde9c4eb7a3, identifier: 1983116
2026-03-25 18:32:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/796/3ae97389fd1a41da8bad44d0ba2dcfc6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:11 [ayvens.es] INFO: Found listing with ID: 1983125
2026-03-25 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983125%27 HTTP/1.1" 200 None
2026-03-25 18:32:11 [ayvens.es] INFO: Scrape type for 1983125: 1
2026-03-25 18:32:11 [ayvens.es] INFO: Extracting data for car ID: 1983125
2026-03-25 18:32:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 208b79e4-5fd8-5b10-8394-c806250446f0 with identifier: 1983125
2026-03-25 18:32:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 208b79e4-5fd8-5b10-8394-c806250446f0 with scrape type 1
2026-03-25 18:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 208b79e4-5fd8-5b10-8394-c806250446f0
2026-03-25 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F735%252Fb4b21c3222734ce8989d1492f88994d5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/735/b4b21c3222734ce8989d1492f88994d5/images/large/1.jpg not downloaded yet
2026-03-25 18:32:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 41f29403-cae5-5be4-a217-96137b082132 with identifier: 1983114
2026-03-25 18:32:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 41f29403-cae5-5be4-a217-96137b082132 with identifier: 1983114
2026-03-25 18:32:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 41f29403-cae5-5be4-a217-96137b082132 with identifier: 1983114 to the API
2026-03-25 18:32:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/544/c9739774a45848eaac5424ef98bf1de9/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.2L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '41f29403-cae5-5be4-a217-96137b082132',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'BOXER',
 'odometer': 68886,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41f29403-cae5-5be4-a217-96137b082132/41f29403-cae5-5be4-a217-96137b082132_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 460318,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/544/c9739774a45848eaac5424ef98bf1de9/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-28',
 'seats_number': 3,
 'seller_name': None,
 'title': 'PEUGEOT BOXER Pack 333 L2 H2 BHDI 103kW (140CV) S&S',
 'transmission': 'manual',
 'trim': 'Pack 333 L2 H2 BHDI 103kW (140CV) S&S',
 'vin': None,
 'year': 2020}
2026-03-25 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983114%27 HTTP/1.1" 200 None
2026-03-25 18:32:11 [ayvens.es] INFO: Saving data for 1983114: {'created_time': 1774463531.641853, 'last_price_update_time': 1774463531.641866, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983114') HTTP/1.1" 204 0
2026-03-25 18:32:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b9e0c71c-6f18-5474-9f20-0dde9c4eb7a3 with identifier: 1983116
2026-03-25 18:32:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b9e0c71c-6f18-5474-9f20-0dde9c4eb7a3 with identifier: 1983116
2026-03-25 18:32:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b9e0c71c-6f18-5474-9f20-0dde9c4eb7a3 with identifier: 1983116 to the API
2026-03-25 18:32:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/022/cc321a36c03e42289c21ff14b23af3bd/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 176,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b9e0c71c-6f18-5474-9f20-0dde9c4eb7a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'SCUDO',
 'odometer': 40455,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9e0c71c-6f18-5474-9f20-0dde9c4eb7a3/b9e0c71c-6f18-5474-9f20-0dde9c4eb7a3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342244,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/022/cc321a36c03e42289c21ff14b23af3bd/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-08-29',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FIAT SCUDO Fur L2 1,5 L 120 hp S&S MT',
 'transmission': 'manual',
 'trim': 'Fur L2 1,5 L 120 hp S&S MT',
 'vin': None,
 'year': 2024}
2026-03-25 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983116%27 HTTP/1.1" 200 None
2026-03-25 18:32:13 [ayvens.es] INFO: Saving data for 1983116: {'created_time': 1774463533.039742, 'last_price_update_time': 1774463533.039756, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983116') HTTP/1.1" 204 0
2026-03-25 18:32:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/724/debae314d265411a95594527fa5d7f7a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:13 [ayvens.es] INFO: Found listing with ID: 1983126
2026-03-25 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983126%27 HTTP/1.1" 200 None
2026-03-25 18:32:13 [ayvens.es] INFO: Scrape type for 1983126: 1
2026-03-25 18:32:13 [ayvens.es] INFO: Extracting data for car ID: 1983126
2026-03-25 18:32:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce8c67b2-2ffa-5c00-90e0-9caf7feda18e with identifier: 1983126
2026-03-25 18:32:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce8c67b2-2ffa-5c00-90e0-9caf7feda18e with scrape type 1
2026-03-25 18:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ce8c67b2-2ffa-5c00-90e0-9caf7feda18e
2026-03-25 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F455%252F5aee223f3d364beba3e4123e190e8413%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/455/5aee223f3d364beba3e4123e190e8413/images/large/1.jpg not downloaded yet
2026-03-25 18:32:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ee59510>
2026-03-25 18:32:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97d628e6-0a8f-5784-adff-3691a0e45cfe/97d628e6-0a8f-5784-adff-3691a0e45cfe_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F991%252Fcb44d0b854554a188ae99197e3677aeb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/991/cb44d0b854554a188ae99197e3677aeb/images/large/1.jpg saved to cache
2026-03-25 18:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 97d628e6-0a8f-5784-adff-3691a0e45cfe
2026-03-25 18:32:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 97d628e6-0a8f-5784-adff-3691a0e45cfe, skipping ID generation
2026-03-25 18:32:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97d628e6-0a8f-5784-adff-3691a0e45cfe with scrape type 1
2026-03-25 18:32:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 97d628e6-0a8f-5784-adff-3691a0e45cfe sending to next pipeline
2026-03-25 18:32:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 97d628e6-0a8f-5784-adff-3691a0e45cfe, identifier: 1983117
2026-03-25 18:32:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ee7b390>
2026-03-25 18:32:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0631e652-351b-5515-841f-6a59d7d06844/0631e652-351b-5515-841f-6a59d7d06844_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F646%252Fe5c9f6c3c1af45b1b33c6e7a632d3b8a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/646/e5c9f6c3c1af45b1b33c6e7a632d3b8a/images/large/1.jpg saved to cache
2026-03-25 18:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0631e652-351b-5515-841f-6a59d7d06844
2026-03-25 18:32:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0631e652-351b-5515-841f-6a59d7d06844, skipping ID generation
2026-03-25 18:32:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0631e652-351b-5515-841f-6a59d7d06844 with scrape type 1
2026-03-25 18:32:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0631e652-351b-5515-841f-6a59d7d06844 sending to next pipeline
2026-03-25 18:32:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0631e652-351b-5515-841f-6a59d7d06844, identifier: 1983119
2026-03-25 18:32:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8f39d350>
2026-03-25 18:32:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8736362c-6acc-53f2-8f07-f305b594c27e/8736362c-6acc-53f2-8f07-f305b594c27e_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F796%252F3ae97389fd1a41da8bad44d0ba2dcfc6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/796/3ae97389fd1a41da8bad44d0ba2dcfc6/images/large/1.jpg saved to cache
2026-03-25 18:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8736362c-6acc-53f2-8f07-f305b594c27e
2026-03-25 18:32:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8736362c-6acc-53f2-8f07-f305b594c27e, skipping ID generation
2026-03-25 18:32:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8736362c-6acc-53f2-8f07-f305b594c27e with scrape type 1
2026-03-25 18:32:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8736362c-6acc-53f2-8f07-f305b594c27e sending to next pipeline
2026-03-25 18:32:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8736362c-6acc-53f2-8f07-f305b594c27e, identifier: 1983118
2026-03-25 18:32:13 [ayvens.es] INFO: Found listing with ID: 1983127
2026-03-25 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983127%27 HTTP/1.1" 200 None
2026-03-25 18:32:13 [ayvens.es] INFO: Scrape type for 1983127: 1
2026-03-25 18:32:13 [ayvens.es] INFO: Extracting data for car ID: 1983127
2026-03-25 18:32:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45c34bf8-77ae-54fa-aaa1-03d60fc9dc9c with identifier: 1983127
2026-03-25 18:32:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45c34bf8-77ae-54fa-aaa1-03d60fc9dc9c with scrape type 1
2026-03-25 18:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 45c34bf8-77ae-54fa-aaa1-03d60fc9dc9c
2026-03-25 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F406%252Fa2a2695bc4d2498baca6f695e2a97391%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/406/a2a2695bc4d2498baca6f695e2a97391/images/large/1.jpg not downloaded yet
2026-03-25 18:32:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 97d628e6-0a8f-5784-adff-3691a0e45cfe with identifier: 1983117
2026-03-25 18:32:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 97d628e6-0a8f-5784-adff-3691a0e45cfe with identifier: 1983117
2026-03-25 18:32:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 97d628e6-0a8f-5784-adff-3691a0e45cfe with identifier: 1983117 to the API
2026-03-25 18:32:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/991/cb44d0b854554a188ae99197e3677aeb/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 173,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '97d628e6-0a8f-5784-adff-3691a0e45cfe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER EVOQUE',
 'odometer': 162240,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97d628e6-0a8f-5784-adff-3691a0e45cfe/97d628e6-0a8f-5784-adff-3691a0e45cfe_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 515185,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/991/cb44d0b854554a188ae99197e3677aeb/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER RANGE ROVER EVOQUE 2.0 D204 R-Dynamic SE AUTO 4WD MHEV',
 'transmission': 'manual',
 'trim': '2.0 D204 R-Dynamic SE AUTO 4WD MHEV',
 'vin': None,
 'year': 2021}
2026-03-25 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983117%27 HTTP/1.1" 200 None
2026-03-25 18:32:14 [ayvens.es] INFO: Saving data for 1983117: {'created_time': 1774463534.012179, 'last_price_update_time': 1774463534.012188, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983117') HTTP/1.1" 204 0
2026-03-25 18:32:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0631e652-351b-5515-841f-6a59d7d06844 with identifier: 1983119
2026-03-25 18:32:14 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:32:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0631e652-351b-5515-841f-6a59d7d06844 with identifier: 1983119
2026-03-25 18:32:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0631e652-351b-5515-841f-6a59d7d06844 with identifier: 1983119 to the API
2026-03-25 18:32:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/646/e5c9f6c3c1af45b1b33c6e7a632d3b8a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'Deep',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '0631e652-351b-5515-841f-6a59d7d06844',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'MAZDA',
 'model': 'CX-30',
 'odometer': 56809,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0631e652-351b-5515-841f-6a59d7d06844/0631e652-351b-5515-841f-6a59d7d06844_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 366784,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/646/e5c9f6c3c1af45b1b33c6e7a632d3b8a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MAZDA CX-30 e-SKYACTIV-G 2.0 90 kW 2WD Evolution',
 'transmission': 'manual',
 'trim': 'e-SKYACTIV-G 2.0 90 kW 2WD Evolution',
 'vin': None,
 'year': 2021}
2026-03-25 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983119%27 HTTP/1.1" 200 None
2026-03-25 18:32:14 [ayvens.es] INFO: Saving data for 1983119: {'created_time': 1774463534.327886, 'last_price_update_time': 1774463534.327896, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983119') HTTP/1.1" 204 0
2026-03-25 18:32:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8736362c-6acc-53f2-8f07-f305b594c27e with identifier: 1983118
2026-03-25 18:32:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8736362c-6acc-53f2-8f07-f305b594c27e with identifier: 1983118
2026-03-25 18:32:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8736362c-6acc-53f2-8f07-f305b594c27e with identifier: 1983118 to the API
2026-03-25 18:32:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/796/3ae97389fd1a41da8bad44d0ba2dcfc6/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 200,
 'color': 'Santorini',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '3.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '8736362c-6acc-53f2-8f07-f305b594c27e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER SPORT',
 'odometer': 126702,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8736362c-6acc-53f2-8f07-f305b594c27e/8736362c-6acc-53f2-8f07-f305b594c27e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 501086,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/796/3ae97389fd1a41da8bad44d0ba2dcfc6/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER RANGE ROVER SPORT 3.0D I6 220kW (300CV) MHEV AWD Auto '
          'HSE',
 'transmission': 'manual',
 'trim': '3.0D I6 220kW (300CV) MHEV AWD Auto HSE',
 'vin': None,
 'year': 2022}
2026-03-25 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983118%27 HTTP/1.1" 200 None
2026-03-25 18:32:14 [ayvens.es] INFO: Saving data for 1983118: {'created_time': 1774463534.667894, 'last_price_update_time': 1774463534.667905, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983118') HTTP/1.1" 204 0
2026-03-25 18:32:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/666/105eba25753741af8727f830d409ba26/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:14 [ayvens.es] INFO: Found listing with ID: 1983128
2026-03-25 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983128%27 HTTP/1.1" 200 None
2026-03-25 18:32:14 [ayvens.es] INFO: Scrape type for 1983128: 1
2026-03-25 18:32:14 [ayvens.es] INFO: Extracting data for car ID: 1983128
2026-03-25 18:32:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce171ac2-d3e1-5969-9dac-d7960bebf490 with identifier: 1983128
2026-03-25 18:32:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce171ac2-d3e1-5969-9dac-d7960bebf490 with scrape type 1
2026-03-25 18:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ce171ac2-d3e1-5969-9dac-d7960bebf490
2026-03-25 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F595%252Fcc041e4ac17a44b4abe7235e7fcdd28a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/595/cc041e4ac17a44b4abe7235e7fcdd28a/images/large/1.jpg not downloaded yet
2026-03-25 18:32:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e58f0d0>
2026-03-25 18:32:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecb9e1ea-698e-5b32-bb74-f1c52f9d5661/ecb9e1ea-698e-5b32-bb74-f1c52f9d5661_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F724%252Fdebae314d265411a95594527fa5d7f7a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/724/debae314d265411a95594527fa5d7f7a/images/large/1.jpg saved to cache
2026-03-25 18:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ecb9e1ea-698e-5b32-bb74-f1c52f9d5661
2026-03-25 18:32:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ecb9e1ea-698e-5b32-bb74-f1c52f9d5661, skipping ID generation
2026-03-25 18:32:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecb9e1ea-698e-5b32-bb74-f1c52f9d5661 with scrape type 1
2026-03-25 18:32:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ecb9e1ea-698e-5b32-bb74-f1c52f9d5661 sending to next pipeline
2026-03-25 18:32:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ecb9e1ea-698e-5b32-bb74-f1c52f9d5661, identifier: 1983120
2026-03-25 18:32:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/341/4be6e080ce734fc481b73c3526320fcf/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:15 [ayvens.es] INFO: Found listing with ID: 1983129
2026-03-25 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983129%27 HTTP/1.1" 200 None
2026-03-25 18:32:15 [ayvens.es] INFO: Scrape type for 1983129: 1
2026-03-25 18:32:15 [ayvens.es] INFO: Extracting data for car ID: 1983129
2026-03-25 18:32:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22ae14d0-8c89-515f-9df4-e58c2cb71997 with identifier: 1983129
2026-03-25 18:32:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22ae14d0-8c89-515f-9df4-e58c2cb71997 with scrape type 1
2026-03-25 18:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 22ae14d0-8c89-515f-9df4-e58c2cb71997
2026-03-25 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F765%252F6110d289ba284529921687c893fa08da%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/765/6110d289ba284529921687c893fa08da/images/large/1.jpg not downloaded yet
2026-03-25 18:32:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ecb9e1ea-698e-5b32-bb74-f1c52f9d5661 with identifier: 1983120
2026-03-25 18:32:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ecb9e1ea-698e-5b32-bb74-f1c52f9d5661 with identifier: 1983120
2026-03-25 18:32:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ecb9e1ea-698e-5b32-bb74-f1c52f9d5661 with identifier: 1983120 to the API
2026-03-25 18:32:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/724/debae314d265411a95594527fa5d7f7a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ecb9e1ea-698e-5b32-bb74-f1c52f9d5661',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'BERLINGO',
 'odometer': 240966,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecb9e1ea-698e-5b32-bb74-f1c52f9d5661/ecb9e1ea-698e-5b32-bb74-f1c52f9d5661_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 312983,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/724/debae314d265411a95594527fa5d7f7a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN BERLINGO Talla M BlueHDi 100 S&S FEEL',
 'transmission': 'manual',
 'trim': 'Talla M BlueHDi 100 S&S FEEL',
 'vin': None,
 'year': 2021}
2026-03-25 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983120%27 HTTP/1.1" 200 None
2026-03-25 18:32:15 [ayvens.es] INFO: Saving data for 1983120: {'created_time': 1774463535.513257, 'last_price_update_time': 1774463535.513269, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983120') HTTP/1.1" 204 0
2026-03-25 18:32:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/701/6fc226dd21994321b898b6f51ec36c73/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/595/f95916e837f54a398fbe848cd16c5419/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:15 [ayvens.es] INFO: Found listing with ID: 1983130
2026-03-25 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983130%27 HTTP/1.1" 200 None
2026-03-25 18:32:15 [ayvens.es] INFO: Scrape type for 1983130: 1
2026-03-25 18:32:15 [ayvens.es] INFO: Extracting data for car ID: 1983130
2026-03-25 18:32:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ead18666-8c3c-5229-a9e9-b6a604534dc8 with identifier: 1983130
2026-03-25 18:32:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ead18666-8c3c-5229-a9e9-b6a604534dc8 with scrape type 1
2026-03-25 18:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ead18666-8c3c-5229-a9e9-b6a604534dc8
2026-03-25 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F277%252Faee144c454d141778be85fd9d7209c99%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/277/aee144c454d141778be85fd9d7209c99/images/large/1.jpg not downloaded yet
2026-03-25 18:32:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e58d9d0>
2026-03-25 18:32:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6db3f53d-bbca-57bb-9d37-ea03df808da7/6db3f53d-bbca-57bb-9d37-ea03df808da7_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F666%252F105eba25753741af8727f830d409ba26%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/666/105eba25753741af8727f830d409ba26/images/large/1.jpg saved to cache
2026-03-25 18:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6db3f53d-bbca-57bb-9d37-ea03df808da7
2026-03-25 18:32:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6db3f53d-bbca-57bb-9d37-ea03df808da7, skipping ID generation
2026-03-25 18:32:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6db3f53d-bbca-57bb-9d37-ea03df808da7 with scrape type 1
2026-03-25 18:32:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6db3f53d-bbca-57bb-9d37-ea03df808da7 sending to next pipeline
2026-03-25 18:32:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6db3f53d-bbca-57bb-9d37-ea03df808da7, identifier: 1983122
2026-03-25 18:32:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e5c8190>
2026-03-25 18:32:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d697d28d-5691-5cc5-9317-c75a6012f52a/d697d28d-5691-5cc5-9317-c75a6012f52a_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F341%252F4be6e080ce734fc481b73c3526320fcf%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/341/4be6e080ce734fc481b73c3526320fcf/images/large/1.jpg saved to cache
2026-03-25 18:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d697d28d-5691-5cc5-9317-c75a6012f52a
2026-03-25 18:32:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d697d28d-5691-5cc5-9317-c75a6012f52a, skipping ID generation
2026-03-25 18:32:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d697d28d-5691-5cc5-9317-c75a6012f52a with scrape type 1
2026-03-25 18:32:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d697d28d-5691-5cc5-9317-c75a6012f52a sending to next pipeline
2026-03-25 18:32:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d697d28d-5691-5cc5-9317-c75a6012f52a, identifier: 1983121
2026-03-25 18:32:16 [ayvens.es] INFO: Found listing with ID: 1983131
2026-03-25 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983131%27 HTTP/1.1" 200 None
2026-03-25 18:32:16 [ayvens.es] INFO: Scrape type for 1983131: 1
2026-03-25 18:32:16 [ayvens.es] INFO: Extracting data for car ID: 1983131
2026-03-25 18:32:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c7862ce-1b89-5a7c-9399-6162b8307e25 with identifier: 1983131
2026-03-25 18:32:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c7862ce-1b89-5a7c-9399-6162b8307e25 with scrape type 1
2026-03-25 18:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4c7862ce-1b89-5a7c-9399-6162b8307e25
2026-03-25 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F630%252F6319adbde6794d30a828ce6c820038cc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/630/6319adbde6794d30a828ce6c820038cc/images/large/1.jpg not downloaded yet
2026-03-25 18:32:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6db3f53d-bbca-57bb-9d37-ea03df808da7 with identifier: 1983122
2026-03-25 18:32:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6db3f53d-bbca-57bb-9d37-ea03df808da7 with identifier: 1983122
2026-03-25 18:32:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 6db3f53d-bbca-57bb-9d37-ea03df808da7 with identifier: 1983122 to the API
2026-03-25 18:32:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/666/105eba25753741af8727f830d409ba26/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '6db3f53d-bbca-57bb-9d37-ea03df808da7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'COMBO',
 'odometer': 147791,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6db3f53d-bbca-57bb-9d37-ea03df808da7/6db3f53d-bbca-57bb-9d37-ea03df808da7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 322142,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/666/105eba25753741af8727f830d409ba26/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL COMBO 1.5 TD 75kW Business Edition Plus L1 N1',
 'transmission': 'manual',
 'trim': '1.5 TD 75kW Business Edition Plus L1 N1',
 'vin': None,
 'year': 2022}
2026-03-25 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983122%27 HTTP/1.1" 200 None
2026-03-25 18:32:16 [ayvens.es] INFO: Saving data for 1983122: {'created_time': 1774463536.876132, 'last_price_update_time': 1774463536.876147, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983122') HTTP/1.1" 204 0
2026-03-25 18:32:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d697d28d-5691-5cc5-9317-c75a6012f52a with identifier: 1983121
2026-03-25 18:32:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d697d28d-5691-5cc5-9317-c75a6012f52a with identifier: 1983121
2026-03-25 18:32:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d697d28d-5691-5cc5-9317-c75a6012f52a with identifier: 1983121 to the API
2026-03-25 18:32:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/341/4be6e080ce734fc481b73c3526320fcf/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 96,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd697d28d-5691-5cc5-9317-c75a6012f52a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FIESTA',
 'odometer': 130943,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d697d28d-5691-5cc5-9317-c75a6012f52a/d697d28d-5691-5cc5-9317-c75a6012f52a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 520819,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/341/4be6e080ce734fc481b73c3526320fcf/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FIESTA 1.5 TDCi 63kW Trend 5p',
 'transmission': 'manual',
 'trim': '1.5 TDCi 63kW Trend 5p',
 'vin': None,
 'year': 2019}
2026-03-25 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983121%27 HTTP/1.1" 200 None
2026-03-25 18:32:17 [ayvens.es] INFO: Saving data for 1983121: {'created_time': 1774463537.350959, 'last_price_update_time': 1774463537.350972, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983121') HTTP/1.1" 204 0
2026-03-25 18:32:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/455/5aee223f3d364beba3e4123e190e8413/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:17 [ayvens.es] INFO: Found listing with ID: 1983132
2026-03-25 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983132%27 HTTP/1.1" 200 None
2026-03-25 18:32:17 [ayvens.es] INFO: Scrape type for 1983132: 1
2026-03-25 18:32:17 [ayvens.es] INFO: Extracting data for car ID: 1983132
2026-03-25 18:32:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3e6824e-21e9-5c32-8e88-5b9db2f0a818 with identifier: 1983132
2026-03-25 18:32:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3e6824e-21e9-5c32-8e88-5b9db2f0a818 with scrape type 1
2026-03-25 18:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d3e6824e-21e9-5c32-8e88-5b9db2f0a818
2026-03-25 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F292%252F735f64613c114700aa55c2389cb81430%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/292/735f64613c114700aa55c2389cb81430/images/large/1.jpg not downloaded yet
2026-03-25 18:32:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8eebdc10>
2026-03-25 18:32:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66ceaec1-6605-523c-9a8a-bb963dbe0468/66ceaec1-6605-523c-9a8a-bb963dbe0468_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F701%252F6fc226dd21994321b898b6f51ec36c73%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/701/6fc226dd21994321b898b6f51ec36c73/images/large/1.jpg saved to cache
2026-03-25 18:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 66ceaec1-6605-523c-9a8a-bb963dbe0468
2026-03-25 18:32:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 66ceaec1-6605-523c-9a8a-bb963dbe0468, skipping ID generation
2026-03-25 18:32:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66ceaec1-6605-523c-9a8a-bb963dbe0468 with scrape type 1
2026-03-25 18:32:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 66ceaec1-6605-523c-9a8a-bb963dbe0468 sending to next pipeline
2026-03-25 18:32:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 66ceaec1-6605-523c-9a8a-bb963dbe0468, identifier: 1983123
2026-03-25 18:32:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8eebc7d0>
2026-03-25 18:32:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4929c8a-adf9-5dfb-a57f-34c99131f798/e4929c8a-adf9-5dfb-a57f-34c99131f798_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F595%252Ff95916e837f54a398fbe848cd16c5419%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/595/f95916e837f54a398fbe848cd16c5419/images/large/1.jpg saved to cache
2026-03-25 18:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e4929c8a-adf9-5dfb-a57f-34c99131f798
2026-03-25 18:32:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e4929c8a-adf9-5dfb-a57f-34c99131f798, skipping ID generation
2026-03-25 18:32:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4929c8a-adf9-5dfb-a57f-34c99131f798 with scrape type 1
2026-03-25 18:32:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e4929c8a-adf9-5dfb-a57f-34c99131f798 sending to next pipeline
2026-03-25 18:32:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e4929c8a-adf9-5dfb-a57f-34c99131f798, identifier: 1983124
2026-03-25 18:32:18 [ayvens.es] INFO: Found listing with ID: 1983133
2026-03-25 18:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983133%27 HTTP/1.1" 200 None
2026-03-25 18:32:18 [ayvens.es] INFO: Scrape type for 1983133: 1
2026-03-25 18:32:18 [ayvens.es] INFO: Extracting data for car ID: 1983133
2026-03-25 18:32:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0557863-78ca-5d35-a38b-cb2367d7a9b5 with identifier: 1983133
2026-03-25 18:32:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0557863-78ca-5d35-a38b-cb2367d7a9b5 with scrape type 1
2026-03-25 18:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b0557863-78ca-5d35-a38b-cb2367d7a9b5
2026-03-25 18:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F076%252F62b42da05ec54bc5b034aa3f58417055%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/076/62b42da05ec54bc5b034aa3f58417055/images/large/1.jpg not downloaded yet
2026-03-25 18:32:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 66ceaec1-6605-523c-9a8a-bb963dbe0468 with identifier: 1983123
2026-03-25 18:32:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 66ceaec1-6605-523c-9a8a-bb963dbe0468 with identifier: 1983123
2026-03-25 18:32:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 66ceaec1-6605-523c-9a8a-bb963dbe0468 with identifier: 1983123 to the API
2026-03-25 18:32:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/701/6fc226dd21994321b898b6f51ec36c73/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '66ceaec1-6605-523c-9a8a-bb963dbe0468',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'MOKKA X',
 'odometer': 125997,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66ceaec1-6605-523c-9a8a-bb963dbe0468/66ceaec1-6605-523c-9a8a-bb963dbe0468_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 318599,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/701/6fc226dd21994321b898b6f51ec36c73/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL MOKKA X 1.6 CDTi 100kW 4X4 S&S Selective',
 'transmission': 'manual',
 'trim': '1.6 CDTi 100kW 4X4 S&S Selective',
 'vin': None,
 'year': 2019}
2026-03-25 18:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983123%27 HTTP/1.1" 200 None
2026-03-25 18:32:18 [ayvens.es] INFO: Saving data for 1983123: {'created_time': 1774463538.406012, 'last_price_update_time': 1774463538.406022, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983123') HTTP/1.1" 204 0
2026-03-25 18:32:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e4929c8a-adf9-5dfb-a57f-34c99131f798 with identifier: 1983124
2026-03-25 18:32:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e4929c8a-adf9-5dfb-a57f-34c99131f798 with identifier: 1983124
2026-03-25 18:32:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e4929c8a-adf9-5dfb-a57f-34c99131f798 with identifier: 1983124 to the API
2026-03-25 18:32:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/595/f95916e837f54a398fbe848cd16c5419/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 164,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e4929c8a-adf9-5dfb-a57f-34c99131f798',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'EXPERT',
 'odometer': 143053,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4929c8a-adf9-5dfb-a57f-34c99131f798/e4929c8a-adf9-5dfb-a57f-34c99131f798_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324337,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/595/f95916e837f54a398fbe848cd16c5419/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-10',
 'seats_number': 2,
 'seller_name': None,
 'title': 'PEUGEOT EXPERT Furgon Pro 1.5 BlueHDi 120 S&S Standard',
 'transmission': 'manual',
 'trim': 'Furgon Pro 1.5 BlueHDi 120 S&S Standard',
 'vin': None,
 'year': 2021}
2026-03-25 18:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983124%27 HTTP/1.1" 200 None
2026-03-25 18:32:18 [ayvens.es] INFO: Saving data for 1983124: {'created_time': 1774463538.891665, 'last_price_update_time': 1774463538.891675, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983124') HTTP/1.1" 204 0
2026-03-25 18:32:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/735/b4b21c3222734ce8989d1492f88994d5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/406/a2a2695bc4d2498baca6f695e2a97391/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/595/cc041e4ac17a44b4abe7235e7fcdd28a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:19 [ayvens.es] INFO: Found listing with ID: 1983134
2026-03-25 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983134%27 HTTP/1.1" 200 None
2026-03-25 18:32:19 [ayvens.es] INFO: Scrape type for 1983134: 1
2026-03-25 18:32:19 [ayvens.es] INFO: Extracting data for car ID: 1983134
2026-03-25 18:32:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b876501-3cf1-5cbe-a680-2eb68840bee4 with identifier: 1983134
2026-03-25 18:32:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b876501-3cf1-5cbe-a680-2eb68840bee4 with scrape type 1
2026-03-25 18:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6b876501-3cf1-5cbe-a680-2eb68840bee4
2026-03-25 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F266%252Ffd856dc23ae84e3194f7a76fc8de505e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/266/fd856dc23ae84e3194f7a76fc8de505e/images/large/1.jpg not downloaded yet
2026-03-25 18:32:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8eca4550>
2026-03-25 18:32:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce8c67b2-2ffa-5c00-90e0-9caf7feda18e/ce8c67b2-2ffa-5c00-90e0-9caf7feda18e_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F455%252F5aee223f3d364beba3e4123e190e8413%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/455/5aee223f3d364beba3e4123e190e8413/images/large/1.jpg saved to cache
2026-03-25 18:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ce8c67b2-2ffa-5c00-90e0-9caf7feda18e
2026-03-25 18:32:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ce8c67b2-2ffa-5c00-90e0-9caf7feda18e, skipping ID generation
2026-03-25 18:32:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce8c67b2-2ffa-5c00-90e0-9caf7feda18e with scrape type 1
2026-03-25 18:32:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ce8c67b2-2ffa-5c00-90e0-9caf7feda18e sending to next pipeline
2026-03-25 18:32:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ce8c67b2-2ffa-5c00-90e0-9caf7feda18e, identifier: 1983126
2026-03-25 18:32:19 [ayvens.es] INFO: Found listing with ID: 1983135
2026-03-25 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983135%27 HTTP/1.1" 200 None
2026-03-25 18:32:19 [ayvens.es] INFO: Scrape type for 1983135: 1
2026-03-25 18:32:19 [ayvens.es] INFO: Extracting data for car ID: 1983135
2026-03-25 18:32:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b69254f0-34e7-5755-ba58-bd134471ccbe with identifier: 1983135
2026-03-25 18:32:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b69254f0-34e7-5755-ba58-bd134471ccbe with scrape type 1
2026-03-25 18:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b69254f0-34e7-5755-ba58-bd134471ccbe
2026-03-25 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F579%252F0af70b93f88642b185cfeace3e85474f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/579/0af70b93f88642b185cfeace3e85474f/images/large/1.jpg not downloaded yet
2026-03-25 18:32:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ce8c67b2-2ffa-5c00-90e0-9caf7feda18e with identifier: 1983126
2026-03-25 18:32:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ce8c67b2-2ffa-5c00-90e0-9caf7feda18e with identifier: 1983126
2026-03-25 18:32:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ce8c67b2-2ffa-5c00-90e0-9caf7feda18e with identifier: 1983126 to the API
2026-03-25 18:32:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/455/5aee223f3d364beba3e4123e190e8413/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 148,
 'color': 'Azul',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ce8c67b2-2ffa-5c00-90e0-9caf7feda18e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'MONDEO',
 'odometer': 209346,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce8c67b2-2ffa-5c00-90e0-9caf7feda18e/ce8c67b2-2ffa-5c00-90e0-9caf7feda18e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 375796,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/455/5aee223f3d364beba3e4123e190e8413/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD MONDEO 2.0 TDCi 110kW Titanium PowShift SB',
 'transmission': 'manual',
 'trim': '2.0 TDCi 110kW Titanium PowShift SB',
 'vin': None,
 'year': 2021}
2026-03-25 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983126%27 HTTP/1.1" 200 None
2026-03-25 18:32:19 [ayvens.es] INFO: Saving data for 1983126: {'created_time': 1774463539.849473, 'last_price_update_time': 1774463539.849485, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983126') HTTP/1.1" 204 0
2026-03-25 18:32:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/765/6110d289ba284529921687c893fa08da/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/277/aee144c454d141778be85fd9d7209c99/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:19 [ayvens.es] INFO: Found listing with ID: 1983136
2026-03-25 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983136%27 HTTP/1.1" 200 None
2026-03-25 18:32:19 [ayvens.es] INFO: Scrape type for 1983136: 1
2026-03-25 18:32:19 [ayvens.es] INFO: Extracting data for car ID: 1983136
2026-03-25 18:32:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cab76c1b-ea05-59e8-a6a0-cc02617173fe with identifier: 1983136
2026-03-25 18:32:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cab76c1b-ea05-59e8-a6a0-cc02617173fe with scrape type 1
2026-03-25 18:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item cab76c1b-ea05-59e8-a6a0-cc02617173fe
2026-03-25 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F130%252Fd359811cebd244958fc4d9999cb02dbd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/130/d359811cebd244958fc4d9999cb02dbd/images/large/1.jpg not downloaded yet
2026-03-25 18:32:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ecd9310>
2026-03-25 18:32:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_208b79e4-5fd8-5b10-8394-c806250446f0/208b79e4-5fd8-5b10-8394-c806250446f0_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F735%252Fb4b21c3222734ce8989d1492f88994d5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/735/b4b21c3222734ce8989d1492f88994d5/images/large/1.jpg saved to cache
2026-03-25 18:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 208b79e4-5fd8-5b10-8394-c806250446f0
2026-03-25 18:32:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 208b79e4-5fd8-5b10-8394-c806250446f0, skipping ID generation
2026-03-25 18:32:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 208b79e4-5fd8-5b10-8394-c806250446f0 with scrape type 1
2026-03-25 18:32:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 208b79e4-5fd8-5b10-8394-c806250446f0 sending to next pipeline
2026-03-25 18:32:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 208b79e4-5fd8-5b10-8394-c806250446f0, identifier: 1983125
2026-03-25 18:32:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ee7add0>
2026-03-25 18:32:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45c34bf8-77ae-54fa-aaa1-03d60fc9dc9c/45c34bf8-77ae-54fa-aaa1-03d60fc9dc9c_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F406%252Fa2a2695bc4d2498baca6f695e2a97391%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/406/a2a2695bc4d2498baca6f695e2a97391/images/large/1.jpg saved to cache
2026-03-25 18:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 45c34bf8-77ae-54fa-aaa1-03d60fc9dc9c
2026-03-25 18:32:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 45c34bf8-77ae-54fa-aaa1-03d60fc9dc9c, skipping ID generation
2026-03-25 18:32:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45c34bf8-77ae-54fa-aaa1-03d60fc9dc9c with scrape type 1
2026-03-25 18:32:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 45c34bf8-77ae-54fa-aaa1-03d60fc9dc9c sending to next pipeline
2026-03-25 18:32:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 45c34bf8-77ae-54fa-aaa1-03d60fc9dc9c, identifier: 1983127
2026-03-25 18:32:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae9e434850>
2026-03-25 18:32:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce171ac2-d3e1-5969-9dac-d7960bebf490/ce171ac2-d3e1-5969-9dac-d7960bebf490_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F595%252Fcc041e4ac17a44b4abe7235e7fcdd28a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/595/cc041e4ac17a44b4abe7235e7fcdd28a/images/large/1.jpg saved to cache
2026-03-25 18:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ce171ac2-d3e1-5969-9dac-d7960bebf490
2026-03-25 18:32:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ce171ac2-d3e1-5969-9dac-d7960bebf490, skipping ID generation
2026-03-25 18:32:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce171ac2-d3e1-5969-9dac-d7960bebf490 with scrape type 1
2026-03-25 18:32:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ce171ac2-d3e1-5969-9dac-d7960bebf490 sending to next pipeline
2026-03-25 18:32:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ce171ac2-d3e1-5969-9dac-d7960bebf490, identifier: 1983128
2026-03-25 18:32:20 [ayvens.es] INFO: Found listing with ID: 1983137
2026-03-25 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983137%27 HTTP/1.1" 200 None
2026-03-25 18:32:20 [ayvens.es] INFO: Scrape type for 1983137: 1
2026-03-25 18:32:20 [ayvens.es] INFO: Extracting data for car ID: 1983137
2026-03-25 18:32:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 590c5d01-49fc-582a-ab77-c03884a81e34 with identifier: 1983137
2026-03-25 18:32:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 590c5d01-49fc-582a-ab77-c03884a81e34 with scrape type 1
2026-03-25 18:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 590c5d01-49fc-582a-ab77-c03884a81e34
2026-03-25 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F935%252F9fa7553060f84618a6d1fb40489de496%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/935/9fa7553060f84618a6d1fb40489de496/images/large/1.jpg not downloaded yet
2026-03-25 18:32:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 208b79e4-5fd8-5b10-8394-c806250446f0 with identifier: 1983125
2026-03-25 18:32:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 208b79e4-5fd8-5b10-8394-c806250446f0 with identifier: 1983125
2026-03-25 18:32:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 208b79e4-5fd8-5b10-8394-c806250446f0 with identifier: 1983125 to the API
2026-03-25 18:32:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/735/b4b21c3222734ce8989d1492f88994d5/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '208b79e4-5fd8-5b10-8394-c806250446f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'KUGA',
 'odometer': 50524,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_208b79e4-5fd8-5b10-8394-c806250446f0/208b79e4-5fd8-5b10-8394-c806250446f0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 612327,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/735/b4b21c3222734ce8989d1492f88994d5/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD KUGA ST-Line X 2.5 Duratec FHEV Auto',
 'transmission': 'manual',
 'trim': 'ST-Line X 2.5 Duratec FHEV Auto',
 'vin': None,
 'year': 2023}
2026-03-25 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983125%27 HTTP/1.1" 200 None
2026-03-25 18:32:20 [ayvens.es] INFO: Saving data for 1983125: {'created_time': 1774463540.840791, 'last_price_update_time': 1774463540.840806, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983125') HTTP/1.1" 204 0
2026-03-25 18:32:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 45c34bf8-77ae-54fa-aaa1-03d60fc9dc9c with identifier: 1983127
2026-03-25 18:32:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:32:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 45c34bf8-77ae-54fa-aaa1-03d60fc9dc9c with identifier: 1983127
2026-03-25 18:32:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 45c34bf8-77ae-54fa-aaa1-03d60fc9dc9c with identifier: 1983127 to the API
2026-03-25 18:32:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/406/a2a2695bc4d2498baca6f695e2a97391/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'Loire',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '45c34bf8-77ae-54fa-aaa1-03d60fc9dc9c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'JAGUAR',
 'model': 'F-PACE',
 'odometer': 157048,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45c34bf8-77ae-54fa-aaa1-03d60fc9dc9c/45c34bf8-77ae-54fa-aaa1-03d60fc9dc9c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 372108,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/406/a2a2695bc4d2498baca6f695e2a97391/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'JAGUAR F-PACE (O) 2.0L i4D AWD Automatico Prestige',
 'transmission': 'manual',
 'trim': '(O) 2.0L i4D AWD Automatico Prestige',
 'vin': None,
 'year': 2018}
2026-03-25 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983127%27 HTTP/1.1" 200 None
2026-03-25 18:32:21 [ayvens.es] INFO: Saving data for 1983127: {'created_time': 1774463541.269033, 'last_price_update_time': 1774463541.269044, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983127') HTTP/1.1" 204 0
2026-03-25 18:32:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ce171ac2-d3e1-5969-9dac-d7960bebf490 with identifier: 1983128
2026-03-25 18:32:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ce171ac2-d3e1-5969-9dac-d7960bebf490 with identifier: 1983128
2026-03-25 18:32:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ce171ac2-d3e1-5969-9dac-d7960bebf490 with identifier: 1983128 to the API
2026-03-25 18:32:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/595/cc041e4ac17a44b4abe7235e7fcdd28a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'color': 'Cassa',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'ce171ac2-d3e1-5969-9dac-d7960bebf490',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'CEED',
 'odometer': 60091,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce171ac2-d3e1-5969-9dac-d7960bebf490/ce171ac2-d3e1-5969-9dac-d7960bebf490_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342143,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/595/cc041e4ac17a44b4abe7235e7fcdd28a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA CEED 1.0 T-GDi 74kW (100CV) Concept',
 'transmission': 'manual',
 'trim': '1.0 T-GDi 74kW (100CV) Concept',
 'vin': None,
 'year': 2022}
2026-03-25 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983128%27 HTTP/1.1" 200 None
2026-03-25 18:32:21 [ayvens.es] INFO: Saving data for 1983128: {'created_time': 1774463541.591799, 'last_price_update_time': 1774463541.59181, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983128') HTTP/1.1" 204 0
2026-03-25 18:32:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/292/735f64613c114700aa55c2389cb81430/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:23 [ayvens.es] INFO: Found listing with ID: 1983138
2026-03-25 18:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983138%27 HTTP/1.1" 200 None
2026-03-25 18:32:23 [ayvens.es] INFO: Scrape type for 1983138: 1
2026-03-25 18:32:23 [ayvens.es] INFO: Extracting data for car ID: 1983138
2026-03-25 18:32:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa2c8bf0-d7c1-5b22-8456-d1066204e6ba with identifier: 1983138
2026-03-25 18:32:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa2c8bf0-d7c1-5b22-8456-d1066204e6ba with scrape type 1
2026-03-25 18:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item fa2c8bf0-d7c1-5b22-8456-d1066204e6ba
2026-03-25 18:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F936%252Fce2209db42474a8289776df0abb16266%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/936/ce2209db42474a8289776df0abb16266/images/large/1.jpg not downloaded yet
2026-03-25 18:32:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ed028d0>
2026-03-25 18:32:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22ae14d0-8c89-515f-9df4-e58c2cb71997/22ae14d0-8c89-515f-9df4-e58c2cb71997_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F765%252F6110d289ba284529921687c893fa08da%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/765/6110d289ba284529921687c893fa08da/images/large/1.jpg saved to cache
2026-03-25 18:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 22ae14d0-8c89-515f-9df4-e58c2cb71997
2026-03-25 18:32:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 22ae14d0-8c89-515f-9df4-e58c2cb71997, skipping ID generation
2026-03-25 18:32:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22ae14d0-8c89-515f-9df4-e58c2cb71997 with scrape type 1
2026-03-25 18:32:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 22ae14d0-8c89-515f-9df4-e58c2cb71997 sending to next pipeline
2026-03-25 18:32:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 22ae14d0-8c89-515f-9df4-e58c2cb71997, identifier: 1983129
2026-03-25 18:32:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8eecea50>
2026-03-25 18:32:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ead18666-8c3c-5229-a9e9-b6a604534dc8/ead18666-8c3c-5229-a9e9-b6a604534dc8_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F277%252Faee144c454d141778be85fd9d7209c99%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/277/aee144c454d141778be85fd9d7209c99/images/large/1.jpg saved to cache
2026-03-25 18:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ead18666-8c3c-5229-a9e9-b6a604534dc8
2026-03-25 18:32:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ead18666-8c3c-5229-a9e9-b6a604534dc8, skipping ID generation
2026-03-25 18:32:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ead18666-8c3c-5229-a9e9-b6a604534dc8 with scrape type 1
2026-03-25 18:32:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ead18666-8c3c-5229-a9e9-b6a604534dc8 sending to next pipeline
2026-03-25 18:32:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ead18666-8c3c-5229-a9e9-b6a604534dc8, identifier: 1983130
2026-03-25 18:32:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 22ae14d0-8c89-515f-9df4-e58c2cb71997 with identifier: 1983129
2026-03-25 18:32:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 22ae14d0-8c89-515f-9df4-e58c2cb71997 with identifier: 1983129
2026-03-25 18:32:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 22ae14d0-8c89-515f-9df4-e58c2cb71997 with identifier: 1983129 to the API
2026-03-25 18:32:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/765/6110d289ba284529921687c893fa08da/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '22ae14d0-8c89-515f-9df4-e58c2cb71997',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO',
 'odometer': 121514,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22ae14d0-8c89-515f-9df4-e58c2cb71997/22ae14d0-8c89-515f-9df4-e58c2cb71997_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 314587,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/765/6110d289ba284529921687c893fa08da/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT KANGOO Profesional N1 Energy dCi 66kW (90CV)',
 'transmission': 'manual',
 'trim': 'Profesional N1 Energy dCi 66kW (90CV)',
 'vin': None,
 'year': 2019}
2026-03-25 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983129%27 HTTP/1.1" 200 None
2026-03-25 18:32:28 [ayvens.es] INFO: Saving data for 1983129: {'created_time': 1774463548.873285, 'last_price_update_time': 1774463548.873298, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983129') HTTP/1.1" 204 0
2026-03-25 18:32:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ead18666-8c3c-5229-a9e9-b6a604534dc8 with identifier: 1983130
2026-03-25 18:32:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ead18666-8c3c-5229-a9e9-b6a604534dc8 with identifier: 1983130
2026-03-25 18:32:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ead18666-8c3c-5229-a9e9-b6a604534dc8 with identifier: 1983130 to the API
2026-03-25 18:32:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/277/aee144c454d141778be85fd9d7209c99/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'ead18666-8c3c-5229-a9e9-b6a604534dc8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TAIGO',
 'odometer': 206807,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ead18666-8c3c-5229-a9e9-b6a604534dc8/ead18666-8c3c-5229-a9e9-b6a604534dc8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 335355,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/277/aee144c454d141778be85fd9d7209c99/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN TAIGO Life 1.0 TSI 81kW (110CV) DSG',
 'transmission': 'manual',
 'trim': 'Life 1.0 TSI 81kW (110CV) DSG',
 'vin': None,
 'year': 2022}
2026-03-25 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983130%27 HTTP/1.1" 200 None
2026-03-25 18:32:29 [ayvens.es] INFO: Saving data for 1983130: {'created_time': 1774463549.236093, 'last_price_update_time': 1774463549.236103, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983130') HTTP/1.1" 204 0
2026-03-25 18:32:29 [ayvens.es] INFO: Found listing with ID: 1983139
2026-03-25 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983139%27 HTTP/1.1" 200 None
2026-03-25 18:32:29 [ayvens.es] INFO: Scrape type for 1983139: 1
2026-03-25 18:32:29 [ayvens.es] INFO: Extracting data for car ID: 1983139
2026-03-25 18:32:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7cd584a2-74e6-55fe-8697-21f736967174 with identifier: 1983139
2026-03-25 18:32:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7cd584a2-74e6-55fe-8697-21f736967174 with scrape type 1
2026-03-25 18:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 7cd584a2-74e6-55fe-8697-21f736967174
2026-03-25 18:32:29 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 7cd584a2-74e6-55fe-8697-21f736967174
2026-03-25 18:32:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7cd584a2-74e6-55fe-8697-21f736967174, identifier: 1983139
2026-03-25 18:32:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/630/6319adbde6794d30a828ce6c820038cc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7cd584a2-74e6-55fe-8697-21f736967174 with identifier: 1983139
2026-03-25 18:32:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7cd584a2-74e6-55fe-8697-21f736967174 with identifier: 1983139
2026-03-25 18:32:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7cd584a2-74e6-55fe-8697-21f736967174 with identifier: 1983139 to the API
2026-03-25 18:32:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '7cd584a2-74e6-55fe-8697-21f736967174',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'TRAFIC',
 'odometer': 71223,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-18',
 'seats_number': 8,
 'seller_name': None,
 'title': 'RENAULT TRAFIC Passenger Energy Blue dCi 88 kW (120 CV)',
 'transmission': 'manual',
 'trim': 'Passenger Energy Blue dCi 88 kW (120 CV)',
 'vin': None,
 'year': 2020}
2026-03-25 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983139%27 HTTP/1.1" 200 None
2026-03-25 18:32:29 [ayvens.es] INFO: Saving data for 1983139: {'created_time': 1774463549.661349, 'last_price_update_time': 1774463549.66136, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983139') HTTP/1.1" 204 0
2026-03-25 18:32:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ee3f050>
2026-03-25 18:32:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3e6824e-21e9-5c32-8e88-5b9db2f0a818/d3e6824e-21e9-5c32-8e88-5b9db2f0a818_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F292%252F735f64613c114700aa55c2389cb81430%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/292/735f64613c114700aa55c2389cb81430/images/large/1.jpg saved to cache
2026-03-25 18:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d3e6824e-21e9-5c32-8e88-5b9db2f0a818
2026-03-25 18:32:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d3e6824e-21e9-5c32-8e88-5b9db2f0a818, skipping ID generation
2026-03-25 18:32:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3e6824e-21e9-5c32-8e88-5b9db2f0a818 with scrape type 1
2026-03-25 18:32:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d3e6824e-21e9-5c32-8e88-5b9db2f0a818 sending to next pipeline
2026-03-25 18:32:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d3e6824e-21e9-5c32-8e88-5b9db2f0a818, identifier: 1983132
2026-03-25 18:32:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/076/62b42da05ec54bc5b034aa3f58417055/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:29 [ayvens.es] INFO: Found listing with ID: 1983140
2026-03-25 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983140%27 HTTP/1.1" 200 None
2026-03-25 18:32:29 [ayvens.es] INFO: Scrape type for 1983140: 1
2026-03-25 18:32:29 [ayvens.es] INFO: Extracting data for car ID: 1983140
2026-03-25 18:32:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87ba062c-67a7-5ba5-ac0f-3889f8cb7395 with identifier: 1983140
2026-03-25 18:32:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87ba062c-67a7-5ba5-ac0f-3889f8cb7395 with scrape type 1
2026-03-25 18:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 87ba062c-67a7-5ba5-ac0f-3889f8cb7395
2026-03-25 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F993%252F4d5f2b082b56471a9559aaefef3f97a2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/993/4d5f2b082b56471a9559aaefef3f97a2/images/large/1.jpg not downloaded yet
2026-03-25 18:32:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d3e6824e-21e9-5c32-8e88-5b9db2f0a818 with identifier: 1983132
2026-03-25 18:32:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:32:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d3e6824e-21e9-5c32-8e88-5b9db2f0a818 with identifier: 1983132
2026-03-25 18:32:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d3e6824e-21e9-5c32-8e88-5b9db2f0a818 with identifier: 1983132 to the API
2026-03-25 18:32:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/292/735f64613c114700aa55c2389cb81430/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'color': 'Amarillo',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd3e6824e-21e9-5c32-8e88-5b9db2f0a818',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TRANSPORTER',
 'odometer': 90276,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3e6824e-21e9-5c32-8e88-5b9db2f0a818/d3e6824e-21e9-5c32-8e88-5b9db2f0a818_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 355955,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/292/735f64613c114700aa55c2389cb81430/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-07',
 'seats_number': 3,
 'seller_name': None,
 'title': 'VOLKSWAGEN TRANSPORTER Furgon Corto TN 2.0 TDI 75kW (102CV) BMT',
 'transmission': 'manual',
 'trim': 'Furgon Corto TN 2.0 TDI 75kW (102CV) BMT',
 'vin': None,
 'year': 2019}
2026-03-25 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983132%27 HTTP/1.1" 200 None
2026-03-25 18:32:30 [ayvens.es] INFO: Saving data for 1983132: {'created_time': 1774463550.172992, 'last_price_update_time': 1774463550.173003, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983132') HTTP/1.1" 204 0
2026-03-25 18:32:30 [ayvens.es] INFO: Found listing with ID: 1983141
2026-03-25 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983141%27 HTTP/1.1" 200 None
2026-03-25 18:32:30 [ayvens.es] INFO: Scrape type for 1983141: 1
2026-03-25 18:32:30 [ayvens.es] INFO: Extracting data for car ID: 1983141
2026-03-25 18:32:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee19b90b-c824-50e9-a950-40c49b06b432 with identifier: 1983141
2026-03-25 18:32:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee19b90b-c824-50e9-a950-40c49b06b432 with scrape type 1
2026-03-25 18:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ee19b90b-c824-50e9-a950-40c49b06b432
2026-03-25 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F040%252Fb102353ce65e45a2833ac78aa38ed20c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/040/b102353ce65e45a2833ac78aa38ed20c/images/large/1.jpg not downloaded yet
2026-03-25 18:32:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/266/fd856dc23ae84e3194f7a76fc8de505e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/130/d359811cebd244958fc4d9999cb02dbd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/579/0af70b93f88642b185cfeace3e85474f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ece9a90>
2026-03-25 18:32:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c7862ce-1b89-5a7c-9399-6162b8307e25/4c7862ce-1b89-5a7c-9399-6162b8307e25_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F630%252F6319adbde6794d30a828ce6c820038cc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/630/6319adbde6794d30a828ce6c820038cc/images/large/1.jpg saved to cache
2026-03-25 18:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4c7862ce-1b89-5a7c-9399-6162b8307e25
2026-03-25 18:32:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4c7862ce-1b89-5a7c-9399-6162b8307e25, skipping ID generation
2026-03-25 18:32:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c7862ce-1b89-5a7c-9399-6162b8307e25 with scrape type 1
2026-03-25 18:32:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4c7862ce-1b89-5a7c-9399-6162b8307e25 sending to next pipeline
2026-03-25 18:32:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4c7862ce-1b89-5a7c-9399-6162b8307e25, identifier: 1983131
2026-03-25 18:32:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ee09410>
2026-03-25 18:32:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0557863-78ca-5d35-a38b-cb2367d7a9b5/b0557863-78ca-5d35-a38b-cb2367d7a9b5_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F076%252F62b42da05ec54bc5b034aa3f58417055%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/076/62b42da05ec54bc5b034aa3f58417055/images/large/1.jpg saved to cache
2026-03-25 18:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b0557863-78ca-5d35-a38b-cb2367d7a9b5
2026-03-25 18:32:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b0557863-78ca-5d35-a38b-cb2367d7a9b5, skipping ID generation
2026-03-25 18:32:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0557863-78ca-5d35-a38b-cb2367d7a9b5 with scrape type 1
2026-03-25 18:32:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b0557863-78ca-5d35-a38b-cb2367d7a9b5 sending to next pipeline
2026-03-25 18:32:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b0557863-78ca-5d35-a38b-cb2367d7a9b5, identifier: 1983133
2026-03-25 18:32:30 [ayvens.es] INFO: Found listing with ID: 1983142
2026-03-25 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983142%27 HTTP/1.1" 200 None
2026-03-25 18:32:30 [ayvens.es] INFO: Scrape type for 1983142: 1
2026-03-25 18:32:30 [ayvens.es] INFO: Extracting data for car ID: 1983142
2026-03-25 18:32:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c52bc9a-0541-56ee-8134-d5c97437b7b2 with identifier: 1983142
2026-03-25 18:32:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c52bc9a-0541-56ee-8134-d5c97437b7b2 with scrape type 1
2026-03-25 18:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5c52bc9a-0541-56ee-8134-d5c97437b7b2
2026-03-25 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F870%252F4b4ca09e479c4656b4f85c2aece1af6f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/870/4b4ca09e479c4656b4f85c2aece1af6f/images/large/1.jpg not downloaded yet
2026-03-25 18:32:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4c7862ce-1b89-5a7c-9399-6162b8307e25 with identifier: 1983131
2026-03-25 18:32:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:32:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4c7862ce-1b89-5a7c-9399-6162b8307e25 with identifier: 1983131
2026-03-25 18:32:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 4c7862ce-1b89-5a7c-9399-6162b8307e25 with identifier: 1983131 to the API
2026-03-25 18:32:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/630/6319adbde6794d30a828ce6c820038cc/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '4c7862ce-1b89-5a7c-9399-6162b8307e25',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN ALLSPACE',
 'odometer': 69731,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c7862ce-1b89-5a7c-9399-6162b8307e25/4c7862ce-1b89-5a7c-9399-6162b8307e25_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 587029,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/630/6319adbde6794d30a828ce6c820038cc/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-17',
 'seats_number': 7,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN ALLSPACE Sport 2.0 TDI 140kW (190CV) 4Motion DSG',
 'transmission': 'manual',
 'trim': 'Sport 2.0 TDI 140kW (190CV) 4Motion DSG',
 'vin': None,
 'year': 2020}
2026-03-25 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983131%27 HTTP/1.1" 200 None
2026-03-25 18:32:30 [ayvens.es] INFO: Saving data for 1983131: {'created_time': 1774463550.934602, 'last_price_update_time': 1774463550.934612, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983131') HTTP/1.1" 204 0
2026-03-25 18:32:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b0557863-78ca-5d35-a38b-cb2367d7a9b5 with identifier: 1983133
2026-03-25 18:32:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b0557863-78ca-5d35-a38b-cb2367d7a9b5 with identifier: 1983133
2026-03-25 18:32:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b0557863-78ca-5d35-a38b-cb2367d7a9b5 with identifier: 1983133 to the API
2026-03-25 18:32:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/076/62b42da05ec54bc5b034aa3f58417055/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'Rojo',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'b0557863-78ca-5d35-a38b-cb2367d7a9b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'RAV4',
 'odometer': 69753,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0557863-78ca-5d35-a38b-cb2367d7a9b5/b0557863-78ca-5d35-a38b-cb2367d7a9b5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 365422,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/076/62b42da05ec54bc5b034aa3f58417055/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA RAV4 2.5l 220H Advance',
 'transmission': 'manual',
 'trim': '2.5l 220H Advance',
 'vin': None,
 'year': 2022}
2026-03-25 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983133%27 HTTP/1.1" 200 None
2026-03-25 18:32:31 [ayvens.es] INFO: Saving data for 1983133: {'created_time': 1774463551.351203, 'last_price_update_time': 1774463551.351215, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983133') HTTP/1.1" 204 0
2026-03-25 18:32:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/935/9fa7553060f84618a6d1fb40489de496/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/936/ce2209db42474a8289776df0abb16266/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:31 [ayvens.es] INFO: Found listing with ID: 1983143
2026-03-25 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983143%27 HTTP/1.1" 200 None
2026-03-25 18:32:31 [ayvens.es] INFO: Scrape type for 1983143: 1
2026-03-25 18:32:31 [ayvens.es] INFO: Extracting data for car ID: 1983143
2026-03-25 18:32:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab505f16-ca93-5308-924b-957be45c9bce with identifier: 1983143
2026-03-25 18:32:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab505f16-ca93-5308-924b-957be45c9bce with scrape type 1
2026-03-25 18:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ab505f16-ca93-5308-924b-957be45c9bce
2026-03-25 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F981%252F1651d16b9a12474f9ff2c99526d3c268%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/981/1651d16b9a12474f9ff2c99526d3c268/images/large/1.jpg not downloaded yet
2026-03-25 18:32:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ee5b790>
2026-03-25 18:32:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b876501-3cf1-5cbe-a680-2eb68840bee4/6b876501-3cf1-5cbe-a680-2eb68840bee4_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F266%252Ffd856dc23ae84e3194f7a76fc8de505e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/266/fd856dc23ae84e3194f7a76fc8de505e/images/large/1.jpg saved to cache
2026-03-25 18:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6b876501-3cf1-5cbe-a680-2eb68840bee4
2026-03-25 18:32:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6b876501-3cf1-5cbe-a680-2eb68840bee4, skipping ID generation
2026-03-25 18:32:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b876501-3cf1-5cbe-a680-2eb68840bee4 with scrape type 1
2026-03-25 18:32:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6b876501-3cf1-5cbe-a680-2eb68840bee4 sending to next pipeline
2026-03-25 18:32:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6b876501-3cf1-5cbe-a680-2eb68840bee4, identifier: 1983134
2026-03-25 18:32:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8d447d90>
2026-03-25 18:32:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cab76c1b-ea05-59e8-a6a0-cc02617173fe/cab76c1b-ea05-59e8-a6a0-cc02617173fe_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F130%252Fd359811cebd244958fc4d9999cb02dbd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/130/d359811cebd244958fc4d9999cb02dbd/images/large/1.jpg saved to cache
2026-03-25 18:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cab76c1b-ea05-59e8-a6a0-cc02617173fe
2026-03-25 18:32:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cab76c1b-ea05-59e8-a6a0-cc02617173fe, skipping ID generation
2026-03-25 18:32:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cab76c1b-ea05-59e8-a6a0-cc02617173fe with scrape type 1
2026-03-25 18:32:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cab76c1b-ea05-59e8-a6a0-cc02617173fe sending to next pipeline
2026-03-25 18:32:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: cab76c1b-ea05-59e8-a6a0-cc02617173fe, identifier: 1983136
2026-03-25 18:32:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ea25450>
2026-03-25 18:32:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b69254f0-34e7-5755-ba58-bd134471ccbe/b69254f0-34e7-5755-ba58-bd134471ccbe_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F579%252F0af70b93f88642b185cfeace3e85474f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/579/0af70b93f88642b185cfeace3e85474f/images/large/1.jpg saved to cache
2026-03-25 18:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b69254f0-34e7-5755-ba58-bd134471ccbe
2026-03-25 18:32:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b69254f0-34e7-5755-ba58-bd134471ccbe, skipping ID generation
2026-03-25 18:32:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b69254f0-34e7-5755-ba58-bd134471ccbe with scrape type 1
2026-03-25 18:32:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b69254f0-34e7-5755-ba58-bd134471ccbe sending to next pipeline
2026-03-25 18:32:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b69254f0-34e7-5755-ba58-bd134471ccbe, identifier: 1983135
2026-03-25 18:32:31 [ayvens.es] INFO: Found listing with ID: 1983144
2026-03-25 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983144%27 HTTP/1.1" 200 None
2026-03-25 18:32:31 [ayvens.es] INFO: Scrape type for 1983144: 1
2026-03-25 18:32:31 [ayvens.es] INFO: Extracting data for car ID: 1983144
2026-03-25 18:32:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8026b17b-426e-5d9c-a3dc-b3987bb60d1e with identifier: 1983144
2026-03-25 18:32:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8026b17b-426e-5d9c-a3dc-b3987bb60d1e with scrape type 1
2026-03-25 18:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8026b17b-426e-5d9c-a3dc-b3987bb60d1e
2026-03-25 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F365%252Fe3b90452b4c442349423e88021036b41%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/365/e3b90452b4c442349423e88021036b41/images/large/1.jpg not downloaded yet
2026-03-25 18:32:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6b876501-3cf1-5cbe-a680-2eb68840bee4 with identifier: 1983134
2026-03-25 18:32:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6b876501-3cf1-5cbe-a680-2eb68840bee4 with identifier: 1983134
2026-03-25 18:32:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 6b876501-3cf1-5cbe-a680-2eb68840bee4 with identifier: 1983134 to the API
2026-03-25 18:32:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/266/fd856dc23ae84e3194f7a76fc8de505e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 151,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.3L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '6b876501-3cf1-5cbe-a680-2eb68840bee4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO',
 'odometer': 44437,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b876501-3cf1-5cbe-a680-2eb68840bee4/6b876501-3cf1-5cbe-a680-2eb68840bee4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 550232,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/266/fd856dc23ae84e3194f7a76fc8de505e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-03-01',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO L1 1.3 TCe 96kW(130CV) EDC',
 'transmission': 'manual',
 'trim': 'L1 1.3 TCe 96kW(130CV) EDC',
 'vin': None,
 'year': 2024}
2026-03-25 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983134%27 HTTP/1.1" 200 None
2026-03-25 18:32:32 [ayvens.es] INFO: Saving data for 1983134: {'created_time': 1774463552.291844, 'last_price_update_time': 1774463552.291854, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983134') HTTP/1.1" 204 0
2026-03-25 18:32:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: cab76c1b-ea05-59e8-a6a0-cc02617173fe with identifier: 1983136
2026-03-25 18:32:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:32:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: cab76c1b-ea05-59e8-a6a0-cc02617173fe with identifier: 1983136
2026-03-25 18:32:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: cab76c1b-ea05-59e8-a6a0-cc02617173fe with identifier: 1983136 to the API
2026-03-25 18:32:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/130/d359811cebd244958fc4d9999cb02dbd/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'Blanco polar',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.3L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'cab76c1b-ea05-59e8-a6a0-cc02617173fe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA',
 'odometer': 127656,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cab76c1b-ea05-59e8-a6a0-cc02617173fe/cab76c1b-ea05-59e8-a6a0-cc02617173fe_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330673,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/130/d359811cebd244958fc4d9999cb02dbd/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA CLA 200',
 'transmission': 'manual',
 'trim': 'CLA 200',
 'vin': None,
 'year': 2019}
2026-03-25 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983136%27 HTTP/1.1" 200 None
2026-03-25 18:32:32 [ayvens.es] INFO: Saving data for 1983136: {'created_time': 1774463552.63961, 'last_price_update_time': 1774463552.63962, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983136') HTTP/1.1" 204 0
2026-03-25 18:32:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b69254f0-34e7-5755-ba58-bd134471ccbe with identifier: 1983135
2026-03-25 18:32:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b69254f0-34e7-5755-ba58-bd134471ccbe with identifier: 1983135
2026-03-25 18:32:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b69254f0-34e7-5755-ba58-bd134471ccbe with identifier: 1983135 to the API
2026-03-25 18:32:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/579/0af70b93f88642b185cfeace3e85474f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.2L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b69254f0-34e7-5755-ba58-bd134471ccbe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'FIORINO',
 'odometer': 149133,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b69254f0-34e7-5755-ba58-bd134471ccbe/b69254f0-34e7-5755-ba58-bd134471ccbe_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 338281,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/579/0af70b93f88642b185cfeace3e85474f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-31',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FIAT FIORINO Cargo SX N1 1.3 MJet 70 kW (95 CV)',
 'transmission': 'manual',
 'trim': 'Cargo SX N1 1.3 MJet 70 kW (95 CV)',
 'vin': None,
 'year': 2021}
2026-03-25 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983135%27 HTTP/1.1" 200 None
2026-03-25 18:32:32 [ayvens.es] INFO: Saving data for 1983135: {'created_time': 1774463552.986837, 'last_price_update_time': 1774463552.986847, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983135') HTTP/1.1" 204 0
2026-03-25 18:32:33 [ayvens.es] INFO: Found listing with ID: 1983145
2026-03-25 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983145%27 HTTP/1.1" 200 None
2026-03-25 18:32:33 [ayvens.es] INFO: Scrape type for 1983145: 1
2026-03-25 18:32:33 [ayvens.es] INFO: Extracting data for car ID: 1983145
2026-03-25 18:32:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77e2f39b-000c-52bc-9bd4-338a7705ca53 with identifier: 1983145
2026-03-25 18:32:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77e2f39b-000c-52bc-9bd4-338a7705ca53 with scrape type 1
2026-03-25 18:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 77e2f39b-000c-52bc-9bd4-338a7705ca53
2026-03-25 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F167%252Fd5d8241b4fbe4fc39c324e964fc3e0b1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/167/d5d8241b4fbe4fc39c324e964fc3e0b1/images/large/1.jpg not downloaded yet
2026-03-25 18:32:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ed751d0>
2026-03-25 18:32:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_590c5d01-49fc-582a-ab77-c03884a81e34/590c5d01-49fc-582a-ab77-c03884a81e34_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F935%252F9fa7553060f84618a6d1fb40489de496%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/935/9fa7553060f84618a6d1fb40489de496/images/large/1.jpg saved to cache
2026-03-25 18:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 590c5d01-49fc-582a-ab77-c03884a81e34
2026-03-25 18:32:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 590c5d01-49fc-582a-ab77-c03884a81e34, skipping ID generation
2026-03-25 18:32:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 590c5d01-49fc-582a-ab77-c03884a81e34 with scrape type 1
2026-03-25 18:32:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 590c5d01-49fc-582a-ab77-c03884a81e34 sending to next pipeline
2026-03-25 18:32:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 590c5d01-49fc-582a-ab77-c03884a81e34, identifier: 1983137
2026-03-25 18:32:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ecddf10>
2026-03-25 18:32:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa2c8bf0-d7c1-5b22-8456-d1066204e6ba/fa2c8bf0-d7c1-5b22-8456-d1066204e6ba_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F936%252Fce2209db42474a8289776df0abb16266%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/936/ce2209db42474a8289776df0abb16266/images/large/1.jpg saved to cache
2026-03-25 18:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fa2c8bf0-d7c1-5b22-8456-d1066204e6ba
2026-03-25 18:32:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fa2c8bf0-d7c1-5b22-8456-d1066204e6ba, skipping ID generation
2026-03-25 18:32:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa2c8bf0-d7c1-5b22-8456-d1066204e6ba with scrape type 1
2026-03-25 18:32:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fa2c8bf0-d7c1-5b22-8456-d1066204e6ba sending to next pipeline
2026-03-25 18:32:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: fa2c8bf0-d7c1-5b22-8456-d1066204e6ba, identifier: 1983138
2026-03-25 18:32:33 [ayvens.es] INFO: Found listing with ID: 1983146
2026-03-25 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983146%27 HTTP/1.1" 200 None
2026-03-25 18:32:33 [ayvens.es] INFO: Scrape type for 1983146: 1
2026-03-25 18:32:33 [ayvens.es] INFO: Extracting data for car ID: 1983146
2026-03-25 18:32:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09e54ab3-e3b9-53f6-b800-02bb33bfec22 with identifier: 1983146
2026-03-25 18:32:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09e54ab3-e3b9-53f6-b800-02bb33bfec22 with scrape type 1
2026-03-25 18:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 09e54ab3-e3b9-53f6-b800-02bb33bfec22
2026-03-25 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F492%252F499e3186b3b14151b4be745e9904f40b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/492/499e3186b3b14151b4be745e9904f40b/images/large/1.jpg not downloaded yet
2026-03-25 18:32:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 590c5d01-49fc-582a-ab77-c03884a81e34 with identifier: 1983137
2026-03-25 18:32:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 590c5d01-49fc-582a-ab77-c03884a81e34 with identifier: 1983137
2026-03-25 18:32:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 590c5d01-49fc-582a-ab77-c03884a81e34 with identifier: 1983137 to the API
2026-03-25 18:32:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/935/9fa7553060f84618a6d1fb40489de496/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '590c5d01-49fc-582a-ab77-c03884a81e34',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'PARTNER',
 'odometer': 127109,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_590c5d01-49fc-582a-ab77-c03884a81e34/590c5d01-49fc-582a-ab77-c03884a81e34_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328678,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/935/9fa7553060f84618a6d1fb40489de496/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-18',
 'seats_number': 2,
 'seller_name': None,
 'title': 'PEUGEOT PARTNER Pro Standard 600kg BlueHDi 73kW',
 'transmission': 'manual',
 'trim': 'Pro Standard 600kg BlueHDi 73kW',
 'vin': None,
 'year': 2019}
2026-03-25 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983137%27 HTTP/1.1" 200 None
2026-03-25 18:32:33 [ayvens.es] INFO: Saving data for 1983137: {'created_time': 1774463553.771865, 'last_price_update_time': 1774463553.771876, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983137') HTTP/1.1" 204 0
2026-03-25 18:32:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: fa2c8bf0-d7c1-5b22-8456-d1066204e6ba with identifier: 1983138
2026-03-25 18:32:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: fa2c8bf0-d7c1-5b22-8456-d1066204e6ba with identifier: 1983138
2026-03-25 18:32:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: fa2c8bf0-d7c1-5b22-8456-d1066204e6ba with identifier: 1983138 to the API
2026-03-25 18:32:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/936/ce2209db42474a8289776df0abb16266/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 184,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'fa2c8bf0-d7c1-5b22-8456-d1066204e6ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CRAFTER',
 'odometer': 244105,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa2c8bf0-d7c1-5b22-8456-d1066204e6ba/fa2c8bf0-d7c1-5b22-8456-d1066204e6ba_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 321839,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/936/ce2209db42474a8289776df0abb16266/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-13',
 'seats_number': 3,
 'seller_name': None,
 'title': 'VOLKSWAGEN CRAFTER 35 Chasis CS BL 2.0 TDI 103kW (140CV)',
 'transmission': 'manual',
 'trim': '35 Chasis CS BL 2.0 TDI 103kW (140CV)',
 'vin': None,
 'year': 2018}
2026-03-25 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983138%27 HTTP/1.1" 200 None
2026-03-25 18:32:34 [ayvens.es] INFO: Saving data for 1983138: {'created_time': 1774463554.104825, 'last_price_update_time': 1774463554.104835, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983138') HTTP/1.1" 204 0
2026-03-25 18:32:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/040/b102353ce65e45a2833ac78aa38ed20c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/993/4d5f2b082b56471a9559aaefef3f97a2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:34 [ayvens.es] INFO: Found listing with ID: 1983147
2026-03-25 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983147%27 HTTP/1.1" 200 None
2026-03-25 18:32:34 [ayvens.es] INFO: Scrape type for 1983147: 1
2026-03-25 18:32:34 [ayvens.es] INFO: Extracting data for car ID: 1983147
2026-03-25 18:32:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6e760a7-ae85-5f1e-9553-b772e9899b97 with identifier: 1983147
2026-03-25 18:32:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6e760a7-ae85-5f1e-9553-b772e9899b97 with scrape type 1
2026-03-25 18:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d6e760a7-ae85-5f1e-9553-b772e9899b97
2026-03-25 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F450%252Fe65a6dd663ce4557b68c55d24cfb0a28%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/450/e65a6dd663ce4557b68c55d24cfb0a28/images/large/1.jpg not downloaded yet
2026-03-25 18:32:34 [ayvens.es] INFO: Found listing with ID: 1983148
2026-03-25 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983148%27 HTTP/1.1" 200 None
2026-03-25 18:32:34 [ayvens.es] INFO: Scrape type for 1983148: 1
2026-03-25 18:32:34 [ayvens.es] INFO: Extracting data for car ID: 1983148
2026-03-25 18:32:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 837d9b29-a71d-576b-b7dc-026ce5729a37 with identifier: 1983148
2026-03-25 18:32:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 837d9b29-a71d-576b-b7dc-026ce5729a37 with scrape type 1
2026-03-25 18:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 837d9b29-a71d-576b-b7dc-026ce5729a37
2026-03-25 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F875%252F8cfd9452fa604c9f87d7faae9889e927%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/875/8cfd9452fa604c9f87d7faae9889e927/images/large/1.jpg not downloaded yet
2026-03-25 18:32:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/870/4b4ca09e479c4656b4f85c2aece1af6f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:34 [ayvens.es] INFO: Found listing with ID: 1983149
2026-03-25 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983149%27 HTTP/1.1" 200 None
2026-03-25 18:32:34 [ayvens.es] INFO: Scrape type for 1983149: 1
2026-03-25 18:32:34 [ayvens.es] INFO: Extracting data for car ID: 1983149
2026-03-25 18:32:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84e2789e-382d-5d7b-8e94-482f43e651da with identifier: 1983149
2026-03-25 18:32:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84e2789e-382d-5d7b-8e94-482f43e651da with scrape type 1
2026-03-25 18:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 84e2789e-382d-5d7b-8e94-482f43e651da
2026-03-25 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F892%252F9c995989cf944b8e8bd5f51411d26aaf%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/892/9c995989cf944b8e8bd5f51411d26aaf/images/large/1.jpg not downloaded yet
2026-03-25 18:32:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ee3d010>
2026-03-25 18:32:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee19b90b-c824-50e9-a950-40c49b06b432/ee19b90b-c824-50e9-a950-40c49b06b432_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F040%252Fb102353ce65e45a2833ac78aa38ed20c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/040/b102353ce65e45a2833ac78aa38ed20c/images/large/1.jpg saved to cache
2026-03-25 18:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ee19b90b-c824-50e9-a950-40c49b06b432
2026-03-25 18:32:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ee19b90b-c824-50e9-a950-40c49b06b432, skipping ID generation
2026-03-25 18:32:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee19b90b-c824-50e9-a950-40c49b06b432 with scrape type 1
2026-03-25 18:32:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ee19b90b-c824-50e9-a950-40c49b06b432 sending to next pipeline
2026-03-25 18:32:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ee19b90b-c824-50e9-a950-40c49b06b432, identifier: 1983141
2026-03-25 18:32:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ee3d750>
2026-03-25 18:32:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87ba062c-67a7-5ba5-ac0f-3889f8cb7395/87ba062c-67a7-5ba5-ac0f-3889f8cb7395_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F993%252F4d5f2b082b56471a9559aaefef3f97a2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/993/4d5f2b082b56471a9559aaefef3f97a2/images/large/1.jpg saved to cache
2026-03-25 18:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 87ba062c-67a7-5ba5-ac0f-3889f8cb7395
2026-03-25 18:32:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 87ba062c-67a7-5ba5-ac0f-3889f8cb7395, skipping ID generation
2026-03-25 18:32:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87ba062c-67a7-5ba5-ac0f-3889f8cb7395 with scrape type 1
2026-03-25 18:32:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 87ba062c-67a7-5ba5-ac0f-3889f8cb7395 sending to next pipeline
2026-03-25 18:32:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 87ba062c-67a7-5ba5-ac0f-3889f8cb7395, identifier: 1983140
2026-03-25 18:32:34 [ayvens.es] INFO: Found listing with ID: 1983150
2026-03-25 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983150%27 HTTP/1.1" 200 None
2026-03-25 18:32:34 [ayvens.es] INFO: Scrape type for 1983150: 1
2026-03-25 18:32:34 [ayvens.es] INFO: Extracting data for car ID: 1983150
2026-03-25 18:32:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c7a8db9-0574-5c8f-95af-f419d7aec4e3 with identifier: 1983150
2026-03-25 18:32:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c7a8db9-0574-5c8f-95af-f419d7aec4e3 with scrape type 1
2026-03-25 18:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1c7a8db9-0574-5c8f-95af-f419d7aec4e3
2026-03-25 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F905%252Fcbe30ada3ffc4325b7395811db904af6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/905/cbe30ada3ffc4325b7395811db904af6/images/large/1.jpg not downloaded yet
2026-03-25 18:32:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ee19b90b-c824-50e9-a950-40c49b06b432 with identifier: 1983141
2026-03-25 18:32:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ee19b90b-c824-50e9-a950-40c49b06b432 with identifier: 1983141
2026-03-25 18:32:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ee19b90b-c824-50e9-a950-40c49b06b432 with identifier: 1983141 to the API
2026-03-25 18:32:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/040/b102353ce65e45a2833ac78aa38ed20c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ee19b90b-c824-50e9-a950-40c49b06b432',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'EXPRESS',
 'odometer': 84200,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee19b90b-c824-50e9-a950-40c49b06b432/ee19b90b-c824-50e9-a950-40c49b06b432_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 310999,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/040/b102353ce65e45a2833ac78aa38ed20c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-27',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT EXPRESS Confort 1.5 Blue dCi 55 kW (75 cv)',
 'transmission': 'manual',
 'trim': 'Confort 1.5 Blue dCi 55 kW (75 cv)',
 'vin': None,
 'year': 2022}
2026-03-25 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983141%27 HTTP/1.1" 200 None
2026-03-25 18:32:34 [ayvens.es] INFO: Saving data for 1983141: {'created_time': 1774463554.918107, 'last_price_update_time': 1774463554.918118, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983141') HTTP/1.1" 204 0
2026-03-25 18:32:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 87ba062c-67a7-5ba5-ac0f-3889f8cb7395 with identifier: 1983140
2026-03-25 18:32:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 87ba062c-67a7-5ba5-ac0f-3889f8cb7395 with identifier: 1983140
2026-03-25 18:32:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 87ba062c-67a7-5ba5-ac0f-3889f8cb7395 with identifier: 1983140 to the API
2026-03-25 18:32:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/993/4d5f2b082b56471a9559aaefef3f97a2/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 184,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '87ba062c-67a7-5ba5-ac0f-3889f8cb7395',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CRAFTER',
 'odometer': 187164,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87ba062c-67a7-5ba5-ac0f-3889f8cb7395/87ba062c-67a7-5ba5-ac0f-3889f8cb7395_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329605,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/993/4d5f2b082b56471a9559aaefef3f97a2/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-11',
 'seats_number': 3,
 'seller_name': None,
 'title': 'VOLKSWAGEN CRAFTER 35 Chasis CS BL 2.0 TDI 103kW (140CV)',
 'transmission': 'manual',
 'trim': '35 Chasis CS BL 2.0 TDI 103kW (140CV)',
 'vin': None,
 'year': 2019}
2026-03-25 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983140%27 HTTP/1.1" 200 None
2026-03-25 18:32:35 [ayvens.es] INFO: Saving data for 1983140: {'created_time': 1774463555.292357, 'last_price_update_time': 1774463555.292369, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983140') HTTP/1.1" 204 0
2026-03-25 18:32:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/981/1651d16b9a12474f9ff2c99526d3c268/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:35 [ayvens.es] INFO: Found listing with ID: 1983151
2026-03-25 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983151%27 HTTP/1.1" 200 None
2026-03-25 18:32:35 [ayvens.es] INFO: Scrape type for 1983151: 1
2026-03-25 18:32:35 [ayvens.es] INFO: Extracting data for car ID: 1983151
2026-03-25 18:32:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 205375df-2be9-592f-9b62-5dbcecbc1160 with identifier: 1983151
2026-03-25 18:32:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 205375df-2be9-592f-9b62-5dbcecbc1160 with scrape type 1
2026-03-25 18:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 205375df-2be9-592f-9b62-5dbcecbc1160
2026-03-25 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F018%252Fde19b4366d914c229795ff52a2b891e3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/018/de19b4366d914c229795ff52a2b891e3/images/large/1.jpg not downloaded yet
2026-03-25 18:32:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e5e4790>
2026-03-25 18:32:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c52bc9a-0541-56ee-8134-d5c97437b7b2/5c52bc9a-0541-56ee-8134-d5c97437b7b2_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F870%252F4b4ca09e479c4656b4f85c2aece1af6f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/870/4b4ca09e479c4656b4f85c2aece1af6f/images/large/1.jpg saved to cache
2026-03-25 18:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5c52bc9a-0541-56ee-8134-d5c97437b7b2
2026-03-25 18:32:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5c52bc9a-0541-56ee-8134-d5c97437b7b2, skipping ID generation
2026-03-25 18:32:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c52bc9a-0541-56ee-8134-d5c97437b7b2 with scrape type 1
2026-03-25 18:32:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5c52bc9a-0541-56ee-8134-d5c97437b7b2 sending to next pipeline
2026-03-25 18:32:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5c52bc9a-0541-56ee-8134-d5c97437b7b2, identifier: 1983142
2026-03-25 18:32:35 [ayvens.es] INFO: Found listing with ID: 1983152
2026-03-25 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983152%27 HTTP/1.1" 200 None
2026-03-25 18:32:35 [ayvens.es] INFO: Scrape type for 1983152: 1
2026-03-25 18:32:35 [ayvens.es] INFO: Extracting data for car ID: 1983152
2026-03-25 18:32:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d38a6b0-e877-5923-af5d-8b71506c11c3 with identifier: 1983152
2026-03-25 18:32:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d38a6b0-e877-5923-af5d-8b71506c11c3 with scrape type 1
2026-03-25 18:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1d38a6b0-e877-5923-af5d-8b71506c11c3
2026-03-25 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F876%252Fbf6296aa86e8433eac39e747b3e282c6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/876/bf6296aa86e8433eac39e747b3e282c6/images/large/1.jpg not downloaded yet
2026-03-25 18:32:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5c52bc9a-0541-56ee-8134-d5c97437b7b2 with identifier: 1983142
2026-03-25 18:32:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5c52bc9a-0541-56ee-8134-d5c97437b7b2 with identifier: 1983142
2026-03-25 18:32:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5c52bc9a-0541-56ee-8134-d5c97437b7b2 with identifier: 1983142 to the API
2026-03-25 18:32:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/870/4b4ca09e479c4656b4f85c2aece1af6f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 168,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '5c52bc9a-0541-56ee-8134-d5c97437b7b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'BOXER',
 'odometer': 103538,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c52bc9a-0541-56ee-8134-d5c97437b7b2/5c52bc9a-0541-56ee-8134-d5c97437b7b2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 322704,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/870/4b4ca09e479c4656b4f85c2aece1af6f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-17',
 'seats_number': 3,
 'seller_name': None,
 'title': 'PEUGEOT BOXER 435 L4H2 BlueHDi 120KW (160CV)+++Revisar '
          'peritacion+++',
 'transmission': 'manual',
 'trim': '435 L4H2 BlueHDi 120KW (160CV)+++Revisar peritacion+++',
 'vin': None,
 'year': 2019}
2026-03-25 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983142%27 HTTP/1.1" 200 None
2026-03-25 18:32:35 [ayvens.es] INFO: Saving data for 1983142: {'created_time': 1774463555.825469, 'last_price_update_time': 1774463555.825488, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983142') HTTP/1.1" 204 0
2026-03-25 18:32:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/365/e3b90452b4c442349423e88021036b41/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/450/e65a6dd663ce4557b68c55d24cfb0a28/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/492/499e3186b3b14151b4be745e9904f40b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:35 [ayvens.es] INFO: Found listing with ID: 1983153
2026-03-25 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983153%27 HTTP/1.1" 200 None
2026-03-25 18:32:35 [ayvens.es] INFO: Scrape type for 1983153: 1
2026-03-25 18:32:35 [ayvens.es] INFO: Extracting data for car ID: 1983153
2026-03-25 18:32:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c91bdb48-6525-50eb-bb33-4bba34c468c4 with identifier: 1983153
2026-03-25 18:32:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c91bdb48-6525-50eb-bb33-4bba34c468c4 with scrape type 1
2026-03-25 18:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c91bdb48-6525-50eb-bb33-4bba34c468c4
2026-03-25 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F925%252F3f5badc1298a40bfac09a62f3d9f9c69%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/925/3f5badc1298a40bfac09a62f3d9f9c69/images/large/1.jpg not downloaded yet
2026-03-25 18:32:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ed755d0>
2026-03-25 18:32:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab505f16-ca93-5308-924b-957be45c9bce/ab505f16-ca93-5308-924b-957be45c9bce_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F981%252F1651d16b9a12474f9ff2c99526d3c268%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/981/1651d16b9a12474f9ff2c99526d3c268/images/large/1.jpg saved to cache
2026-03-25 18:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ab505f16-ca93-5308-924b-957be45c9bce
2026-03-25 18:32:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ab505f16-ca93-5308-924b-957be45c9bce, skipping ID generation
2026-03-25 18:32:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab505f16-ca93-5308-924b-957be45c9bce with scrape type 1
2026-03-25 18:32:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ab505f16-ca93-5308-924b-957be45c9bce sending to next pipeline
2026-03-25 18:32:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ab505f16-ca93-5308-924b-957be45c9bce, identifier: 1983143
2026-03-25 18:32:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ab505f16-ca93-5308-924b-957be45c9bce with identifier: 1983143
2026-03-25 18:32:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:32:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ab505f16-ca93-5308-924b-957be45c9bce with identifier: 1983143
2026-03-25 18:32:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ab505f16-ca93-5308-924b-957be45c9bce with identifier: 1983143 to the API
2026-03-25 18:32:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/981/1651d16b9a12474f9ff2c99526d3c268/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'Blau atlantic',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ab505f16-ca93-5308-924b-957be45c9bce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF',
 'odometer': 154694,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab505f16-ca93-5308-924b-957be45c9bce/ab505f16-ca93-5308-924b-957be45c9bce_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 605553,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/981/1651d16b9a12474f9ff2c99526d3c268/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF Advance 2.0 TDI 110kW(150CV) DSG Variant',
 'transmission': 'manual',
 'trim': 'Advance 2.0 TDI 110kW(150CV) DSG Variant',
 'vin': None,
 'year': 2019}
2026-03-25 18:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983143%27 HTTP/1.1" 200 None
2026-03-25 18:32:36 [ayvens.es] INFO: Saving data for 1983143: {'created_time': 1774463556.362053, 'last_price_update_time': 1774463556.362064, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983143') HTTP/1.1" 204 0
2026-03-25 18:32:36 [ayvens.es] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 200
2026-03-25 18:32:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/167/d5d8241b4fbe4fc39c324e964fc3e0b1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/875/8cfd9452fa604c9f87d7faae9889e927/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/892/9c995989cf944b8e8bd5f51411d26aaf/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8d42ec10>
2026-03-25 18:32:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8026b17b-426e-5d9c-a3dc-b3987bb60d1e/8026b17b-426e-5d9c-a3dc-b3987bb60d1e_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F365%252Fe3b90452b4c442349423e88021036b41%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/365/e3b90452b4c442349423e88021036b41/images/large/1.jpg saved to cache
2026-03-25 18:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8026b17b-426e-5d9c-a3dc-b3987bb60d1e
2026-03-25 18:32:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8026b17b-426e-5d9c-a3dc-b3987bb60d1e, skipping ID generation
2026-03-25 18:32:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8026b17b-426e-5d9c-a3dc-b3987bb60d1e with scrape type 1
2026-03-25 18:32:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8026b17b-426e-5d9c-a3dc-b3987bb60d1e sending to next pipeline
2026-03-25 18:32:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8026b17b-426e-5d9c-a3dc-b3987bb60d1e, identifier: 1983144
2026-03-25 18:32:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ea1ae50>
2026-03-25 18:32:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6e760a7-ae85-5f1e-9553-b772e9899b97/d6e760a7-ae85-5f1e-9553-b772e9899b97_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F450%252Fe65a6dd663ce4557b68c55d24cfb0a28%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/450/e65a6dd663ce4557b68c55d24cfb0a28/images/large/1.jpg saved to cache
2026-03-25 18:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d6e760a7-ae85-5f1e-9553-b772e9899b97
2026-03-25 18:32:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d6e760a7-ae85-5f1e-9553-b772e9899b97, skipping ID generation
2026-03-25 18:32:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6e760a7-ae85-5f1e-9553-b772e9899b97 with scrape type 1
2026-03-25 18:32:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d6e760a7-ae85-5f1e-9553-b772e9899b97 sending to next pipeline
2026-03-25 18:32:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d6e760a7-ae85-5f1e-9553-b772e9899b97, identifier: 1983147
2026-03-25 18:32:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8eca7210>
2026-03-25 18:32:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09e54ab3-e3b9-53f6-b800-02bb33bfec22/09e54ab3-e3b9-53f6-b800-02bb33bfec22_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F492%252F499e3186b3b14151b4be745e9904f40b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/492/499e3186b3b14151b4be745e9904f40b/images/large/1.jpg saved to cache
2026-03-25 18:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 09e54ab3-e3b9-53f6-b800-02bb33bfec22
2026-03-25 18:32:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 09e54ab3-e3b9-53f6-b800-02bb33bfec22, skipping ID generation
2026-03-25 18:32:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09e54ab3-e3b9-53f6-b800-02bb33bfec22 with scrape type 1
2026-03-25 18:32:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 09e54ab3-e3b9-53f6-b800-02bb33bfec22 sending to next pipeline
2026-03-25 18:32:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 09e54ab3-e3b9-53f6-b800-02bb33bfec22, identifier: 1983146
2026-03-25 18:32:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8026b17b-426e-5d9c-a3dc-b3987bb60d1e with identifier: 1983144
2026-03-25 18:32:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:32:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:32:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8026b17b-426e-5d9c-a3dc-b3987bb60d1e with identifier: 1983144
2026-03-25 18:32:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8026b17b-426e-5d9c-a3dc-b3987bb60d1e with identifier: 1983144 to the API
2026-03-25 18:32:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/365/e3b90452b4c442349423e88021036b41/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Blanco puro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'electric',
 'id': '8026b17b-426e-5d9c-a3dc-b3987bb60d1e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF',
 'odometer': 108441,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8026b17b-426e-5d9c-a3dc-b3987bb60d1e/8026b17b-426e-5d9c-a3dc-b3987bb60d1e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 438359,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/365/e3b90452b4c442349423e88021036b41/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF (O) e-Golf ePower 100 kW (136CV)',
 'transmission': 'manual',
 'trim': '(O) e-Golf ePower 100 kW (136CV)',
 'vin': None,
 'year': 2020}
2026-03-25 18:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983144%27 HTTP/1.1" 200 None
2026-03-25 18:32:37 [ayvens.es] INFO: Saving data for 1983144: {'created_time': 1774463557.334553, 'last_price_update_time': 1774463557.334575, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983144') HTTP/1.1" 204 0
2026-03-25 18:32:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d6e760a7-ae85-5f1e-9553-b772e9899b97 with identifier: 1983147
2026-03-25 18:32:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d6e760a7-ae85-5f1e-9553-b772e9899b97 with identifier: 1983147
2026-03-25 18:32:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d6e760a7-ae85-5f1e-9553-b772e9899b97 with identifier: 1983147 to the API
2026-03-25 18:32:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/450/e65a6dd663ce4557b68c55d24cfb0a28/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'Gris monta',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd6e760a7-ae85-5f1e-9553-b772e9899b97',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA',
 'odometer': 98116,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6e760a7-ae85-5f1e-9553-b772e9899b97/d6e760a7-ae85-5f1e-9553-b772e9899b97_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 369469,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/450/e65a6dd663ce4557b68c55d24cfb0a28/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA CLA 220 D DCT Shooting Brake',
 'transmission': 'manual',
 'trim': 'CLA 220 D DCT Shooting Brake',
 'vin': None,
 'year': 2021}
2026-03-25 18:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983147%27 HTTP/1.1" 200 None
2026-03-25 18:32:37 [ayvens.es] INFO: Saving data for 1983147: {'created_time': 1774463557.890253, 'last_price_update_time': 1774463557.890262, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983147') HTTP/1.1" 204 0
2026-03-25 18:32:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 09e54ab3-e3b9-53f6-b800-02bb33bfec22 with identifier: 1983146
2026-03-25 18:32:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 09e54ab3-e3b9-53f6-b800-02bb33bfec22 with identifier: 1983146
2026-03-25 18:32:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 09e54ab3-e3b9-53f6-b800-02bb33bfec22 with identifier: 1983146 to the API
2026-03-25 18:32:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/492/499e3186b3b14151b4be745e9904f40b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 201,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.3L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '09e54ab3-e3b9-53f6-b800-02bb33bfec22',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'NV400',
 'odometer': 123649,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09e54ab3-e3b9-53f6-b800-02bb33bfec22/09e54ab3-e3b9-53f6-b800-02bb33bfec22_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332938,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/492/499e3186b3b14151b4be745e9904f40b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-31',
 'seats_number': 3,
 'seller_name': None,
 'title': 'NISSAN NV400 L3H2 3,5T 2.3dCi 99kW FWD Comfort',
 'transmission': 'manual',
 'trim': 'L3H2 3,5T 2.3dCi 99kW FWD Comfort',
 'vin': None,
 'year': 2020}
2026-03-25 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983146%27 HTTP/1.1" 200 None
2026-03-25 18:32:38 [ayvens.es] INFO: Saving data for 1983146: {'created_time': 1774463558.209505, 'last_price_update_time': 1774463558.209518, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983146') HTTP/1.1" 204 0
2026-03-25 18:32:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 18:32:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/905/cbe30ada3ffc4325b7395811db904af6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ea67dd0>
2026-03-25 18:32:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77e2f39b-000c-52bc-9bd4-338a7705ca53/77e2f39b-000c-52bc-9bd4-338a7705ca53_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F167%252Fd5d8241b4fbe4fc39c324e964fc3e0b1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/167/d5d8241b4fbe4fc39c324e964fc3e0b1/images/large/1.jpg saved to cache
2026-03-25 18:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 77e2f39b-000c-52bc-9bd4-338a7705ca53
2026-03-25 18:32:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 77e2f39b-000c-52bc-9bd4-338a7705ca53, skipping ID generation
2026-03-25 18:32:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77e2f39b-000c-52bc-9bd4-338a7705ca53 with scrape type 1
2026-03-25 18:32:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 77e2f39b-000c-52bc-9bd4-338a7705ca53 sending to next pipeline
2026-03-25 18:32:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 77e2f39b-000c-52bc-9bd4-338a7705ca53, identifier: 1983145
2026-03-25 18:32:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e5753d0>
2026-03-25 18:32:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_837d9b29-a71d-576b-b7dc-026ce5729a37/837d9b29-a71d-576b-b7dc-026ce5729a37_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F875%252F8cfd9452fa604c9f87d7faae9889e927%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/875/8cfd9452fa604c9f87d7faae9889e927/images/large/1.jpg saved to cache
2026-03-25 18:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 837d9b29-a71d-576b-b7dc-026ce5729a37
2026-03-25 18:32:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 837d9b29-a71d-576b-b7dc-026ce5729a37, skipping ID generation
2026-03-25 18:32:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 837d9b29-a71d-576b-b7dc-026ce5729a37 with scrape type 1
2026-03-25 18:32:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 837d9b29-a71d-576b-b7dc-026ce5729a37 sending to next pipeline
2026-03-25 18:32:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 837d9b29-a71d-576b-b7dc-026ce5729a37, identifier: 1983148
2026-03-25 18:32:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8f42fa90>
2026-03-25 18:32:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84e2789e-382d-5d7b-8e94-482f43e651da/84e2789e-382d-5d7b-8e94-482f43e651da_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F892%252F9c995989cf944b8e8bd5f51411d26aaf%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/892/9c995989cf944b8e8bd5f51411d26aaf/images/large/1.jpg saved to cache
2026-03-25 18:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 84e2789e-382d-5d7b-8e94-482f43e651da
2026-03-25 18:32:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 84e2789e-382d-5d7b-8e94-482f43e651da, skipping ID generation
2026-03-25 18:32:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84e2789e-382d-5d7b-8e94-482f43e651da with scrape type 1
2026-03-25 18:32:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 84e2789e-382d-5d7b-8e94-482f43e651da sending to next pipeline
2026-03-25 18:32:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 84e2789e-382d-5d7b-8e94-482f43e651da, identifier: 1983149
2026-03-25 18:32:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 77e2f39b-000c-52bc-9bd4-338a7705ca53 with identifier: 1983145
2026-03-25 18:32:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:32:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 77e2f39b-000c-52bc-9bd4-338a7705ca53 with identifier: 1983145
2026-03-25 18:32:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 77e2f39b-000c-52bc-9bd4-338a7705ca53 with identifier: 1983145 to the API
2026-03-25 18:32:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/167/d5d8241b4fbe4fc39c324e964fc3e0b1/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'Pintura blanco glaci',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '77e2f39b-000c-52bc-9bd4-338a7705ca53',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'EXPRESS',
 'odometer': 177382,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77e2f39b-000c-52bc-9bd4-338a7705ca53/77e2f39b-000c-52bc-9bd4-338a7705ca53_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 537445,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/167/d5d8241b4fbe4fc39c324e964fc3e0b1/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-08',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT EXPRESS Confort 1.5 Blue dCi 55 kW (75 cv)+++Revisar '
          'peritacion+++',
 'transmission': 'manual',
 'trim': 'Confort 1.5 Blue dCi 55 kW (75 cv)+++Revisar peritacion+++',
 'vin': None,
 'year': 2022}
2026-03-25 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983145%27 HTTP/1.1" 200 None
2026-03-25 18:32:39 [ayvens.es] INFO: Saving data for 1983145: {'created_time': 1774463559.036496, 'last_price_update_time': 1774463559.036506, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983145') HTTP/1.1" 204 0
2026-03-25 18:32:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 837d9b29-a71d-576b-b7dc-026ce5729a37 with identifier: 1983148
2026-03-25 18:32:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:32:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 837d9b29-a71d-576b-b7dc-026ce5729a37 with identifier: 1983148
2026-03-25 18:32:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 837d9b29-a71d-576b-b7dc-026ce5729a37 with identifier: 1983148 to the API
2026-03-25 18:32:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/875/8cfd9452fa604c9f87d7faae9889e927/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 166,
 'color': 'Blanco mineral',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '837d9b29-a71d-576b-b7dc-026ce5729a37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'NV250',
 'odometer': 130568,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_837d9b29-a71d-576b-b7dc-026ce5729a37/837d9b29-a71d-576b-b7dc-026ce5729a37_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 319189,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/875/8cfd9452fa604c9f87d7faae9889e927/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-07',
 'seats_number': 2,
 'seller_name': None,
 'title': 'NISSAN NV250 2pl 1.5dCi 70 kW (95CV) L1H1 OPTIMA',
 'transmission': 'manual',
 'trim': '2pl 1.5dCi 70 kW (95CV) L1H1 OPTIMA',
 'vin': None,
 'year': 2021}
2026-03-25 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983148%27 HTTP/1.1" 200 None
2026-03-25 18:32:39 [ayvens.es] INFO: Saving data for 1983148: {'created_time': 1774463559.335025, 'last_price_update_time': 1774463559.335035, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983148') HTTP/1.1" 204 0
2026-03-25 18:32:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 84e2789e-382d-5d7b-8e94-482f43e651da with identifier: 1983149
2026-03-25 18:32:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 84e2789e-382d-5d7b-8e94-482f43e651da with identifier: 1983149
2026-03-25 18:32:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 84e2789e-382d-5d7b-8e94-482f43e651da with identifier: 1983149 to the API
2026-03-25 18:32:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/892/9c995989cf944b8e8bd5f51411d26aaf/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.2L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '84e2789e-382d-5d7b-8e94-482f43e651da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'FIORINO',
 'odometer': 231247,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84e2789e-382d-5d7b-8e94-482f43e651da/84e2789e-382d-5d7b-8e94-482f43e651da_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 311928,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/892/9c995989cf944b8e8bd5f51411d26aaf/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-16',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FIAT FIORINO Cargo Base 1.3 Mjet 75cv E5+ Clase 2',
 'transmission': 'manual',
 'trim': 'Cargo Base 1.3 Mjet 75cv E5+ Clase 2',
 'vin': None,
 'year': 2017}
2026-03-25 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983149%27 HTTP/1.1" 200 None
2026-03-25 18:32:39 [ayvens.es] INFO: Saving data for 1983149: {'created_time': 1774463559.6332, 'last_price_update_time': 1774463559.63321, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983149') HTTP/1.1" 204 0
2026-03-25 18:32:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/018/de19b4366d914c229795ff52a2b891e3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/925/3f5badc1298a40bfac09a62f3d9f9c69/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e5751d0>
2026-03-25 18:32:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c7a8db9-0574-5c8f-95af-f419d7aec4e3/1c7a8db9-0574-5c8f-95af-f419d7aec4e3_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F905%252Fcbe30ada3ffc4325b7395811db904af6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/905/cbe30ada3ffc4325b7395811db904af6/images/large/1.jpg saved to cache
2026-03-25 18:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1c7a8db9-0574-5c8f-95af-f419d7aec4e3
2026-03-25 18:32:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1c7a8db9-0574-5c8f-95af-f419d7aec4e3, skipping ID generation
2026-03-25 18:32:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c7a8db9-0574-5c8f-95af-f419d7aec4e3 with scrape type 1
2026-03-25 18:32:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1c7a8db9-0574-5c8f-95af-f419d7aec4e3 sending to next pipeline
2026-03-25 18:32:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1c7a8db9-0574-5c8f-95af-f419d7aec4e3, identifier: 1983150
2026-03-25 18:32:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/876/bf6296aa86e8433eac39e747b3e282c6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1c7a8db9-0574-5c8f-95af-f419d7aec4e3 with identifier: 1983150
2026-03-25 18:32:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:32:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1c7a8db9-0574-5c8f-95af-f419d7aec4e3 with identifier: 1983150
2026-03-25 18:32:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1c7a8db9-0574-5c8f-95af-f419d7aec4e3 with identifier: 1983150 to the API
2026-03-25 18:32:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/905/cbe30ada3ffc4325b7395811db904af6/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'color': 'Gris monta',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '1c7a8db9-0574-5c8f-95af-f419d7aec4e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA',
 'odometer': 142577,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c7a8db9-0574-5c8f-95af-f419d7aec4e3/1c7a8db9-0574-5c8f-95af-f419d7aec4e3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 360534,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/905/cbe30ada3ffc4325b7395811db904af6/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA CLA 250 4MATIC',
 'transmission': 'manual',
 'trim': 'CLA 250 4MATIC',
 'vin': None,
 'year': 2022}
2026-03-25 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983150%27 HTTP/1.1" 200 None
2026-03-25 18:32:40 [ayvens.es] INFO: Saving data for 1983150: {'created_time': 1774463560.146971, 'last_price_update_time': 1774463560.146981, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983150') HTTP/1.1" 204 0
2026-03-25 18:32:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ea26210>
2026-03-25 18:32:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_205375df-2be9-592f-9b62-5dbcecbc1160/205375df-2be9-592f-9b62-5dbcecbc1160_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F018%252Fde19b4366d914c229795ff52a2b891e3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/018/de19b4366d914c229795ff52a2b891e3/images/large/1.jpg saved to cache
2026-03-25 18:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 205375df-2be9-592f-9b62-5dbcecbc1160
2026-03-25 18:32:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 205375df-2be9-592f-9b62-5dbcecbc1160, skipping ID generation
2026-03-25 18:32:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 205375df-2be9-592f-9b62-5dbcecbc1160 with scrape type 1
2026-03-25 18:32:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 205375df-2be9-592f-9b62-5dbcecbc1160 sending to next pipeline
2026-03-25 18:32:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 205375df-2be9-592f-9b62-5dbcecbc1160, identifier: 1983151
2026-03-25 18:32:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8f42ec90>
2026-03-25 18:32:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c91bdb48-6525-50eb-bb33-4bba34c468c4/c91bdb48-6525-50eb-bb33-4bba34c468c4_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F925%252F3f5badc1298a40bfac09a62f3d9f9c69%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/925/3f5badc1298a40bfac09a62f3d9f9c69/images/large/1.jpg saved to cache
2026-03-25 18:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c91bdb48-6525-50eb-bb33-4bba34c468c4
2026-03-25 18:32:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c91bdb48-6525-50eb-bb33-4bba34c468c4, skipping ID generation
2026-03-25 18:32:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c91bdb48-6525-50eb-bb33-4bba34c468c4 with scrape type 1
2026-03-25 18:32:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c91bdb48-6525-50eb-bb33-4bba34c468c4 sending to next pipeline
2026-03-25 18:32:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c91bdb48-6525-50eb-bb33-4bba34c468c4, identifier: 1983153
2026-03-25 18:32:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8edb5ad0>
2026-03-25 18:32:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d38a6b0-e877-5923-af5d-8b71506c11c3/1d38a6b0-e877-5923-af5d-8b71506c11c3_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F876%252Fbf6296aa86e8433eac39e747b3e282c6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/876/bf6296aa86e8433eac39e747b3e282c6/images/large/1.jpg saved to cache
2026-03-25 18:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1d38a6b0-e877-5923-af5d-8b71506c11c3
2026-03-25 18:32:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1d38a6b0-e877-5923-af5d-8b71506c11c3, skipping ID generation
2026-03-25 18:32:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d38a6b0-e877-5923-af5d-8b71506c11c3 with scrape type 1
2026-03-25 18:32:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1d38a6b0-e877-5923-af5d-8b71506c11c3 sending to next pipeline
2026-03-25 18:32:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1d38a6b0-e877-5923-af5d-8b71506c11c3, identifier: 1983152
2026-03-25 18:32:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 205375df-2be9-592f-9b62-5dbcecbc1160 with identifier: 1983151
2026-03-25 18:32:40 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:32:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 205375df-2be9-592f-9b62-5dbcecbc1160 with identifier: 1983151
2026-03-25 18:32:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 205375df-2be9-592f-9b62-5dbcecbc1160 with identifier: 1983151 to the API
2026-03-25 18:32:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/018/de19b4366d914c229795ff52a2b891e3/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'color': 'Rojo intenso metaliz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '205375df-2be9-592f-9b62-5dbcecbc1160',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN',
 'odometer': 56365,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_205375df-2be9-592f-9b62-5dbcecbc1160/205375df-2be9-592f-9b62-5dbcecbc1160_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 568553,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/018/de19b4366d914c229795ff52a2b891e3/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN Life 2.0 TDI 110kW (150CV)',
 'transmission': 'manual',
 'trim': 'Life 2.0 TDI 110kW (150CV)',
 'vin': None,
 'year': 2021}
2026-03-25 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983151%27 HTTP/1.1" 200 None
2026-03-25 18:32:40 [ayvens.es] INFO: Saving data for 1983151: {'created_time': 1774463560.876869, 'last_price_update_time': 1774463560.876882, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983151') HTTP/1.1" 204 0
2026-03-25 18:32:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c91bdb48-6525-50eb-bb33-4bba34c468c4 with identifier: 1983153
2026-03-25 18:32:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c91bdb48-6525-50eb-bb33-4bba34c468c4 with identifier: 1983153
2026-03-25 18:32:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c91bdb48-6525-50eb-bb33-4bba34c468c4 with identifier: 1983153 to the API
2026-03-25 18:32:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/925/3f5badc1298a40bfac09a62f3d9f9c69/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.2L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c91bdb48-6525-50eb-bb33-4bba34c468c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'FIORINO',
 'odometer': 45207,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c91bdb48-6525-50eb-bb33-4bba34c468c4/c91bdb48-6525-50eb-bb33-4bba34c468c4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 309342,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/925/3f5badc1298a40bfac09a62f3d9f9c69/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-31',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FIAT FIORINO Cargo SX N1 1.3 MJet 70 kW (95 CV)+++Revisar '
          'peritacion+++',
 'transmission': 'manual',
 'trim': 'Cargo SX N1 1.3 MJet 70 kW (95 CV)+++Revisar peritacion+++',
 'vin': None,
 'year': 2023}
2026-03-25 18:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983153%27 HTTP/1.1" 200 None
2026-03-25 18:32:41 [ayvens.es] INFO: Saving data for 1983153: {'created_time': 1774463561.169795, 'last_price_update_time': 1774463561.169806, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983153') HTTP/1.1" 204 0
2026-03-25 18:32:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1d38a6b0-e877-5923-af5d-8b71506c11c3 with identifier: 1983152
2026-03-25 18:32:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1d38a6b0-e877-5923-af5d-8b71506c11c3 with identifier: 1983152
2026-03-25 18:32:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1d38a6b0-e877-5923-af5d-8b71506c11c3 with identifier: 1983152 to the API
2026-03-25 18:32:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/876/bf6296aa86e8433eac39e747b3e282c6/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 76,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '1d38a6b0-e877-5923-af5d-8b71506c11c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'COROLLA',
 'odometer': 101992,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d38a6b0-e877-5923-af5d-8b71506c11c3/1d38a6b0-e877-5923-af5d-8b71506c11c3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 438234,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/876/bf6296aa86e8433eac39e747b3e282c6/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA COROLLA 1.8 125H BUSINESS PLUS E-CVT',
 'transmission': 'manual',
 'trim': '1.8 125H BUSINESS PLUS E-CVT',
 'vin': None,
 'year': 2021}
2026-03-25 18:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983152%27 HTTP/1.1" 200 None
2026-03-25 18:32:41 [ayvens.es] INFO: Saving data for 1983152: {'created_time': 1774463561.461326, 'last_price_update_time': 1774463561.461338, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983152') HTTP/1.1" 204 0
2026-03-25 18:32:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-25 18:32:43 [ayvens.es] INFO: Found listing with ID: 1983154
2026-03-25 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983154%27 HTTP/1.1" 200 None
2026-03-25 18:32:43 [ayvens.es] INFO: Scrape type for 1983154: 1
2026-03-25 18:32:43 [ayvens.es] INFO: Extracting data for car ID: 1983154
2026-03-25 18:32:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 770c4e50-35a5-573a-85e5-d52e2ed780d8 with identifier: 1983154
2026-03-25 18:32:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 770c4e50-35a5-573a-85e5-d52e2ed780d8 with scrape type 1
2026-03-25 18:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 770c4e50-35a5-573a-85e5-d52e2ed780d8
2026-03-25 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F442%252Fe5082c6edf07434ab15a28947bd8e673%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/442/e5082c6edf07434ab15a28947bd8e673/images/large/1.jpg not downloaded yet
2026-03-25 18:32:43 [ayvens.es] INFO: Found listing with ID: 1983155
2026-03-25 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983155%27 HTTP/1.1" 200 None
2026-03-25 18:32:43 [ayvens.es] INFO: Scrape type for 1983155: 1
2026-03-25 18:32:43 [ayvens.es] INFO: Extracting data for car ID: 1983155
2026-03-25 18:32:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef59955e-f231-54f1-8312-58ba9a57b1e7 with identifier: 1983155
2026-03-25 18:32:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef59955e-f231-54f1-8312-58ba9a57b1e7 with scrape type 1
2026-03-25 18:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ef59955e-f231-54f1-8312-58ba9a57b1e7
2026-03-25 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F992%252F400def3ba1194cf7aacbf23f2f1068e7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/992/400def3ba1194cf7aacbf23f2f1068e7/images/large/1.jpg not downloaded yet
2026-03-25 18:32:43 [ayvens.es] INFO: Found listing with ID: 1983156
2026-03-25 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983156%27 HTTP/1.1" 200 None
2026-03-25 18:32:43 [ayvens.es] INFO: Scrape type for 1983156: 1
2026-03-25 18:32:43 [ayvens.es] INFO: Extracting data for car ID: 1983156
2026-03-25 18:32:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf1f7a9d-f123-57d8-a39c-a4be477d7d63 with identifier: 1983156
2026-03-25 18:32:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf1f7a9d-f123-57d8-a39c-a4be477d7d63 with scrape type 1
2026-03-25 18:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item cf1f7a9d-f123-57d8-a39c-a4be477d7d63
2026-03-25 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F017%252Fcbd6c1dd7abc49a8bd583f32a96b7fc9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/017/cbd6c1dd7abc49a8bd583f32a96b7fc9/images/large/1.jpg not downloaded yet
2026-03-25 18:32:43 [ayvens.es] INFO: Found listing with ID: 1983157
2026-03-25 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983157%27 HTTP/1.1" 200 None
2026-03-25 18:32:43 [ayvens.es] INFO: Scrape type for 1983157: 1
2026-03-25 18:32:43 [ayvens.es] INFO: Extracting data for car ID: 1983157
2026-03-25 18:32:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0aa40c55-f06d-5298-a196-45ba8b9e7512 with identifier: 1983157
2026-03-25 18:32:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0aa40c55-f06d-5298-a196-45ba8b9e7512 with scrape type 1
2026-03-25 18:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0aa40c55-f06d-5298-a196-45ba8b9e7512
2026-03-25 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F442%252Fa01ae55ecd8d4d4c97846e78c8a6db91%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/442/a01ae55ecd8d4d4c97846e78c8a6db91/images/large/1.jpg not downloaded yet
2026-03-25 18:32:43 [ayvens.es] INFO: Found listing with ID: 1983158
2026-03-25 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983158%27 HTTP/1.1" 200 None
2026-03-25 18:32:43 [ayvens.es] INFO: Scrape type for 1983158: 1
2026-03-25 18:32:43 [ayvens.es] INFO: Extracting data for car ID: 1983158
2026-03-25 18:32:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6927b026-774e-5a12-bfb7-023d3d156e6b with identifier: 1983158
2026-03-25 18:32:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6927b026-774e-5a12-bfb7-023d3d156e6b with scrape type 1
2026-03-25 18:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6927b026-774e-5a12-bfb7-023d3d156e6b
2026-03-25 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F468%252F9f1d0fbab27d4e8cbefb073bfeca5b65%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/468/9f1d0fbab27d4e8cbefb073bfeca5b65/images/large/1.jpg not downloaded yet
2026-03-25 18:32:43 [ayvens.es] INFO: Found listing with ID: 1983159
2026-03-25 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983159%27 HTTP/1.1" 200 None
2026-03-25 18:32:43 [ayvens.es] INFO: Scrape type for 1983159: 1
2026-03-25 18:32:43 [ayvens.es] INFO: Extracting data for car ID: 1983159
2026-03-25 18:32:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc82c61a-d593-5d45-b4c4-e4a793225e4e with identifier: 1983159
2026-03-25 18:32:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc82c61a-d593-5d45-b4c4-e4a793225e4e with scrape type 1
2026-03-25 18:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item cc82c61a-d593-5d45-b4c4-e4a793225e4e
2026-03-25 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F828%252F784d3979cb234dca88ca0684f436cc0c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/828/784d3979cb234dca88ca0684f436cc0c/images/large/1.jpg not downloaded yet
2026-03-25 18:32:43 [ayvens.es] INFO: Found listing with ID: 1983160
2026-03-25 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983160%27 HTTP/1.1" 200 None
2026-03-25 18:32:43 [ayvens.es] INFO: Scrape type for 1983160: 1
2026-03-25 18:32:43 [ayvens.es] INFO: Extracting data for car ID: 1983160
2026-03-25 18:32:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2dc418ee-136c-589a-9941-99078d2f0e8a with identifier: 1983160
2026-03-25 18:32:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2dc418ee-136c-589a-9941-99078d2f0e8a with scrape type 1
2026-03-25 18:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2dc418ee-136c-589a-9941-99078d2f0e8a
2026-03-25 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F619%252F00fa6407e7df4d1b881f6966f2e74495%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/619/00fa6407e7df4d1b881f6966f2e74495/images/large/1.jpg not downloaded yet
2026-03-25 18:32:43 [ayvens.es] INFO: Found listing with ID: 1983161
2026-03-25 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983161%27 HTTP/1.1" 200 None
2026-03-25 18:32:43 [ayvens.es] INFO: Scrape type for 1983161: 1
2026-03-25 18:32:43 [ayvens.es] INFO: Extracting data for car ID: 1983161
2026-03-25 18:32:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d97abe07-d08a-5271-9cf5-091fc89b1090 with identifier: 1983161
2026-03-25 18:32:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d97abe07-d08a-5271-9cf5-091fc89b1090 with scrape type 1
2026-03-25 18:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d97abe07-d08a-5271-9cf5-091fc89b1090
2026-03-25 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F515%252Fae9061b4e40843f9bb8d8fab4b32e347%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/515/ae9061b4e40843f9bb8d8fab4b32e347/images/large/1.jpg not downloaded yet
2026-03-25 18:32:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/992/400def3ba1194cf7aacbf23f2f1068e7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:43 [ayvens.es] INFO: Found listing with ID: 1983162
2026-03-25 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983162%27 HTTP/1.1" 200 None
2026-03-25 18:32:43 [ayvens.es] INFO: Scrape type for 1983162: 1
2026-03-25 18:32:43 [ayvens.es] INFO: Extracting data for car ID: 1983162
2026-03-25 18:32:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13913013-0bd3-5c89-b0a7-d3dbc31d1a43 with identifier: 1983162
2026-03-25 18:32:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13913013-0bd3-5c89-b0a7-d3dbc31d1a43 with scrape type 1
2026-03-25 18:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 13913013-0bd3-5c89-b0a7-d3dbc31d1a43
2026-03-25 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F800%252F243e1d66d73c492ea857fa40d4e25b60%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/800/243e1d66d73c492ea857fa40d4e25b60/images/large/1.jpg not downloaded yet
2026-03-25 18:32:43 [ayvens.es] INFO: Found listing with ID: 1983163
2026-03-25 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983163%27 HTTP/1.1" 200 None
2026-03-25 18:32:43 [ayvens.es] INFO: Scrape type for 1983163: 1
2026-03-25 18:32:43 [ayvens.es] INFO: Extracting data for car ID: 1983163
2026-03-25 18:32:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5f82bcc-c4f6-5aab-a0ce-26607e770aaf with identifier: 1983163
2026-03-25 18:32:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5f82bcc-c4f6-5aab-a0ce-26607e770aaf with scrape type 1
2026-03-25 18:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a5f82bcc-c4f6-5aab-a0ce-26607e770aaf
2026-03-25 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F014%252F8f12bf38eab9466387fc130c456ca1dd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/014/8f12bf38eab9466387fc130c456ca1dd/images/large/1.jpg not downloaded yet
2026-03-25 18:32:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/442/e5082c6edf07434ab15a28947bd8e673/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:43 [ayvens.es] INFO: Found listing with ID: 1983164
2026-03-25 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983164%27 HTTP/1.1" 200 None
2026-03-25 18:32:43 [ayvens.es] INFO: Scrape type for 1983164: 1
2026-03-25 18:32:43 [ayvens.es] INFO: Extracting data for car ID: 1983164
2026-03-25 18:32:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5fdf524-7f0c-5a35-973e-07a2258d8c6e with identifier: 1983164
2026-03-25 18:32:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5fdf524-7f0c-5a35-973e-07a2258d8c6e with scrape type 1
2026-03-25 18:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a5fdf524-7f0c-5a35-973e-07a2258d8c6e
2026-03-25 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F014%252F3d8e313de4d742d7bde06c9577014ad2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/014/3d8e313de4d742d7bde06c9577014ad2/images/large/1.jpg not downloaded yet
2026-03-25 18:32:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/442/a01ae55ecd8d4d4c97846e78c8a6db91/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:43 [ayvens.es] INFO: Found listing with ID: 1983165
2026-03-25 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983165%27 HTTP/1.1" 200 None
2026-03-25 18:32:43 [ayvens.es] INFO: Scrape type for 1983165: 1
2026-03-25 18:32:43 [ayvens.es] INFO: Extracting data for car ID: 1983165
2026-03-25 18:32:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c50b57d-2857-553c-accd-e13797d55957 with identifier: 1983165
2026-03-25 18:32:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c50b57d-2857-553c-accd-e13797d55957 with scrape type 1
2026-03-25 18:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3c50b57d-2857-553c-accd-e13797d55957
2026-03-25 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F358%252Fccb30197f6084b77a9c2996e5e559734%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/358/ccb30197f6084b77a9c2996e5e559734/images/large/1.jpg not downloaded yet
2026-03-25 18:32:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e577a90>
2026-03-25 18:32:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef59955e-f231-54f1-8312-58ba9a57b1e7/ef59955e-f231-54f1-8312-58ba9a57b1e7_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F992%252F400def3ba1194cf7aacbf23f2f1068e7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/992/400def3ba1194cf7aacbf23f2f1068e7/images/large/1.jpg saved to cache
2026-03-25 18:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ef59955e-f231-54f1-8312-58ba9a57b1e7
2026-03-25 18:32:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ef59955e-f231-54f1-8312-58ba9a57b1e7, skipping ID generation
2026-03-25 18:32:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef59955e-f231-54f1-8312-58ba9a57b1e7 with scrape type 1
2026-03-25 18:32:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ef59955e-f231-54f1-8312-58ba9a57b1e7 sending to next pipeline
2026-03-25 18:32:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ef59955e-f231-54f1-8312-58ba9a57b1e7, identifier: 1983155
2026-03-25 18:32:44 [ayvens.es] INFO: Found listing with ID: 1983166
2026-03-25 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983166%27 HTTP/1.1" 200 None
2026-03-25 18:32:44 [ayvens.es] INFO: Scrape type for 1983166: 1
2026-03-25 18:32:44 [ayvens.es] INFO: Extracting data for car ID: 1983166
2026-03-25 18:32:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 728c561a-f6b6-5c13-ba38-bf187041d446 with identifier: 1983166
2026-03-25 18:32:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 728c561a-f6b6-5c13-ba38-bf187041d446 with scrape type 1
2026-03-25 18:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 728c561a-f6b6-5c13-ba38-bf187041d446
2026-03-25 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F952%252F01831b09e16846589842635dafeddd8c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/952/01831b09e16846589842635dafeddd8c/images/large/1.jpg not downloaded yet
2026-03-25 18:32:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ef59955e-f231-54f1-8312-58ba9a57b1e7 with identifier: 1983155
2026-03-25 18:32:44 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:32:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ef59955e-f231-54f1-8312-58ba9a57b1e7 with identifier: 1983155
2026-03-25 18:32:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ef59955e-f231-54f1-8312-58ba9a57b1e7 with identifier: 1983155 to the API
2026-03-25 18:32:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/992/400def3ba1194cf7aacbf23f2f1068e7/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'color': 'Bronce marco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'ef59955e-f231-54f1-8312-58ba9a57b1e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'AURIS',
 'odometer': 162477,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef59955e-f231-54f1-8312-58ba9a57b1e7/ef59955e-f231-54f1-8312-58ba9a57b1e7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 321139,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/992/400def3ba1194cf7aacbf23f2f1068e7/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA AURIS 130 Active',
 'transmission': 'manual',
 'trim': '130 Active',
 'vin': None,
 'year': 2014}
2026-03-25 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983155%27 HTTP/1.1" 200 None
2026-03-25 18:32:44 [ayvens.es] INFO: Saving data for 1983155: {'created_time': 1774463564.378902, 'last_price_update_time': 1774463564.378915, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983155') HTTP/1.1" 204 0
2026-03-25 18:32:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/828/784d3979cb234dca88ca0684f436cc0c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/017/cbd6c1dd7abc49a8bd583f32a96b7fc9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:44 [ayvens.es] INFO: Found listing with ID: 1983167
2026-03-25 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983167%27 HTTP/1.1" 200 None
2026-03-25 18:32:44 [ayvens.es] INFO: Scrape type for 1983167: 1
2026-03-25 18:32:44 [ayvens.es] INFO: Extracting data for car ID: 1983167
2026-03-25 18:32:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5da3479c-52c3-5ed5-8b49-1d5d1179e4e9 with identifier: 1983167
2026-03-25 18:32:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5da3479c-52c3-5ed5-8b49-1d5d1179e4e9 with scrape type 1
2026-03-25 18:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5da3479c-52c3-5ed5-8b49-1d5d1179e4e9
2026-03-25 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F382%252Fd88ac2d1973e4ad380a8de5a3d30f46a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/382/d88ac2d1973e4ad380a8de5a3d30f46a/images/large/1.jpg not downloaded yet
2026-03-25 18:32:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e5da510>
2026-03-25 18:32:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_770c4e50-35a5-573a-85e5-d52e2ed780d8/770c4e50-35a5-573a-85e5-d52e2ed780d8_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F442%252Fe5082c6edf07434ab15a28947bd8e673%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/442/e5082c6edf07434ab15a28947bd8e673/images/large/1.jpg saved to cache
2026-03-25 18:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 770c4e50-35a5-573a-85e5-d52e2ed780d8
2026-03-25 18:32:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 770c4e50-35a5-573a-85e5-d52e2ed780d8, skipping ID generation
2026-03-25 18:32:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 770c4e50-35a5-573a-85e5-d52e2ed780d8 with scrape type 1
2026-03-25 18:32:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 770c4e50-35a5-573a-85e5-d52e2ed780d8 sending to next pipeline
2026-03-25 18:32:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 770c4e50-35a5-573a-85e5-d52e2ed780d8, identifier: 1983154
2026-03-25 18:32:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ea3f110>
2026-03-25 18:32:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0aa40c55-f06d-5298-a196-45ba8b9e7512/0aa40c55-f06d-5298-a196-45ba8b9e7512_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F442%252Fa01ae55ecd8d4d4c97846e78c8a6db91%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/442/a01ae55ecd8d4d4c97846e78c8a6db91/images/large/1.jpg saved to cache
2026-03-25 18:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0aa40c55-f06d-5298-a196-45ba8b9e7512
2026-03-25 18:32:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0aa40c55-f06d-5298-a196-45ba8b9e7512, skipping ID generation
2026-03-25 18:32:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0aa40c55-f06d-5298-a196-45ba8b9e7512 with scrape type 1
2026-03-25 18:32:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0aa40c55-f06d-5298-a196-45ba8b9e7512 sending to next pipeline
2026-03-25 18:32:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0aa40c55-f06d-5298-a196-45ba8b9e7512, identifier: 1983157
2026-03-25 18:32:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 770c4e50-35a5-573a-85e5-d52e2ed780d8 with identifier: 1983154
2026-03-25 18:32:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 770c4e50-35a5-573a-85e5-d52e2ed780d8 with identifier: 1983154
2026-03-25 18:32:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 770c4e50-35a5-573a-85e5-d52e2ed780d8 with identifier: 1983154 to the API
2026-03-25 18:32:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/442/e5082c6edf07434ab15a28947bd8e673/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 173,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '770c4e50-35a5-573a-85e5-d52e2ed780d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'VIVARO',
 'odometer': 49928,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_770c4e50-35a5-573a-85e5-d52e2ed780d8/770c4e50-35a5-573a-85e5-d52e2ed780d8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329244,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/442/e5082c6edf07434ab15a28947bd8e673/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-01',
 'seats_number': 2,
 'seller_name': None,
 'title': 'OPEL VIVARO (O) 1.5 Diesel 88kW (120CV) M Std Expres',
 'transmission': 'manual',
 'trim': '(O) 1.5 Diesel 88kW (120CV) M Std Expres',
 'vin': None,
 'year': 2022}
2026-03-25 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983154%27 HTTP/1.1" 200 None
2026-03-25 18:32:45 [ayvens.es] INFO: Saving data for 1983154: {'created_time': 1774463565.143143, 'last_price_update_time': 1774463565.143158, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983154') HTTP/1.1" 204 0
2026-03-25 18:32:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0aa40c55-f06d-5298-a196-45ba8b9e7512 with identifier: 1983157
2026-03-25 18:32:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0aa40c55-f06d-5298-a196-45ba8b9e7512 with identifier: 1983157
2026-03-25 18:32:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0aa40c55-f06d-5298-a196-45ba8b9e7512 with identifier: 1983157 to the API
2026-03-25 18:32:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/442/a01ae55ecd8d4d4c97846e78c8a6db91/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 170,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '0aa40c55-f06d-5298-a196-45ba8b9e7512',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'VIVARO',
 'odometer': 44892,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0aa40c55-f06d-5298-a196-45ba8b9e7512/0aa40c55-f06d-5298-a196-45ba8b9e7512_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344484,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/442/a01ae55ecd8d4d4c97846e78c8a6db91/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-01',
 'seats_number': 3,
 'seller_name': None,
 'title': 'OPEL VIVARO 1.5 BlueHDi 74kW (100CV) M Std',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi 74kW (100CV) M Std',
 'vin': None,
 'year': 2022}
2026-03-25 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983157%27 HTTP/1.1" 200 None
2026-03-25 18:32:45 [ayvens.es] INFO: Saving data for 1983157: {'created_time': 1774463565.481457, 'last_price_update_time': 1774463565.481467, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983157') HTTP/1.1" 204 0
2026-03-25 18:32:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/515/ae9061b4e40843f9bb8d8fab4b32e347/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:45 [ayvens.es] INFO: Found listing with ID: 1983168
2026-03-25 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983168%27 HTTP/1.1" 200 None
2026-03-25 18:32:45 [ayvens.es] INFO: Scrape type for 1983168: 1
2026-03-25 18:32:45 [ayvens.es] INFO: Extracting data for car ID: 1983168
2026-03-25 18:32:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2918dbfa-31f1-5c3d-b677-fe3b844dd945 with identifier: 1983168
2026-03-25 18:32:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2918dbfa-31f1-5c3d-b677-fe3b844dd945 with scrape type 1
2026-03-25 18:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2918dbfa-31f1-5c3d-b677-fe3b844dd945
2026-03-25 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F828%252Fa2dd782acfc94b48b7dfea4b9647deee%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/828/a2dd782acfc94b48b7dfea4b9647deee/images/large/1.jpg not downloaded yet
2026-03-25 18:32:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/468/9f1d0fbab27d4e8cbefb073bfeca5b65/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/800/243e1d66d73c492ea857fa40d4e25b60/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/014/8f12bf38eab9466387fc130c456ca1dd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8f0e3590>
2026-03-25 18:32:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc82c61a-d593-5d45-b4c4-e4a793225e4e/cc82c61a-d593-5d45-b4c4-e4a793225e4e_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F828%252F784d3979cb234dca88ca0684f436cc0c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/828/784d3979cb234dca88ca0684f436cc0c/images/large/1.jpg saved to cache
2026-03-25 18:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cc82c61a-d593-5d45-b4c4-e4a793225e4e
2026-03-25 18:32:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cc82c61a-d593-5d45-b4c4-e4a793225e4e, skipping ID generation
2026-03-25 18:32:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc82c61a-d593-5d45-b4c4-e4a793225e4e with scrape type 1
2026-03-25 18:32:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cc82c61a-d593-5d45-b4c4-e4a793225e4e sending to next pipeline
2026-03-25 18:32:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: cc82c61a-d593-5d45-b4c4-e4a793225e4e, identifier: 1983159
2026-03-25 18:32:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8d4159d0>
2026-03-25 18:32:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf1f7a9d-f123-57d8-a39c-a4be477d7d63/cf1f7a9d-f123-57d8-a39c-a4be477d7d63_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F017%252Fcbd6c1dd7abc49a8bd583f32a96b7fc9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/017/cbd6c1dd7abc49a8bd583f32a96b7fc9/images/large/1.jpg saved to cache
2026-03-25 18:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cf1f7a9d-f123-57d8-a39c-a4be477d7d63
2026-03-25 18:32:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cf1f7a9d-f123-57d8-a39c-a4be477d7d63, skipping ID generation
2026-03-25 18:32:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf1f7a9d-f123-57d8-a39c-a4be477d7d63 with scrape type 1
2026-03-25 18:32:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cf1f7a9d-f123-57d8-a39c-a4be477d7d63 sending to next pipeline
2026-03-25 18:32:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: cf1f7a9d-f123-57d8-a39c-a4be477d7d63, identifier: 1983156
2026-03-25 18:32:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/619/00fa6407e7df4d1b881f6966f2e74495/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:45 [ayvens.es] INFO: Found listing with ID: 1983169
2026-03-25 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983169%27 HTTP/1.1" 200 None
2026-03-25 18:32:45 [ayvens.es] INFO: Scrape type for 1983169: 1
2026-03-25 18:32:45 [ayvens.es] INFO: Extracting data for car ID: 1983169
2026-03-25 18:32:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb4446c2-df01-520e-a904-bd3ebaa33134 with identifier: 1983169
2026-03-25 18:32:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb4446c2-df01-520e-a904-bd3ebaa33134 with scrape type 1
2026-03-25 18:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item eb4446c2-df01-520e-a904-bd3ebaa33134
2026-03-25 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F478%252F2f3c85d191d64f6d985475b4f11fad3d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/478/2f3c85d191d64f6d985475b4f11fad3d/images/large/1.jpg not downloaded yet
2026-03-25 18:32:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: cc82c61a-d593-5d45-b4c4-e4a793225e4e with identifier: 1983159
2026-03-25 18:32:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: cc82c61a-d593-5d45-b4c4-e4a793225e4e with identifier: 1983159
2026-03-25 18:32:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: cc82c61a-d593-5d45-b4c4-e4a793225e4e with identifier: 1983159 to the API
2026-03-25 18:32:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/828/784d3979cb234dca88ca0684f436cc0c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'Blanco puro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'cc82c61a-d593-5d45-b4c4-e4a793225e4e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF',
 'odometer': 164669,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc82c61a-d593-5d45-b4c4-e4a793225e4e/cc82c61a-d593-5d45-b4c4-e4a793225e4e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344833,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/828/784d3979cb234dca88ca0684f436cc0c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF Last Edition 1.6 TDI 85kW (115CV)',
 'transmission': 'manual',
 'trim': 'Last Edition 1.6 TDI 85kW (115CV)',
 'vin': None,
 'year': 2020}
2026-03-25 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983159%27 HTTP/1.1" 200 None
2026-03-25 18:32:46 [ayvens.es] INFO: Saving data for 1983159: {'created_time': 1774463566.194976, 'last_price_update_time': 1774463566.194988, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983159') HTTP/1.1" 204 0
2026-03-25 18:32:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: cf1f7a9d-f123-57d8-a39c-a4be477d7d63 with identifier: 1983156
2026-03-25 18:32:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:32:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: cf1f7a9d-f123-57d8-a39c-a4be477d7d63 with identifier: 1983156
2026-03-25 18:32:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: cf1f7a9d-f123-57d8-a39c-a4be477d7d63 with identifier: 1983156 to the API
2026-03-25 18:32:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/017/cbd6c1dd7abc49a8bd583f32a96b7fc9/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'Plata reflex',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'cf1f7a9d-f123-57d8-a39c-a4be477d7d63',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT',
 'odometer': 114293,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf1f7a9d-f123-57d8-a39c-a4be477d7d63/cf1f7a9d-f123-57d8-a39c-a4be477d7d63_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 360403,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/017/cbd6c1dd7abc49a8bd583f32a96b7fc9/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT Business 2.0 TDI 110kW (150CV)',
 'transmission': 'manual',
 'trim': 'Business 2.0 TDI 110kW (150CV)',
 'vin': None,
 'year': 2021}
2026-03-25 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983156%27 HTTP/1.1" 200 None
2026-03-25 18:32:46 [ayvens.es] INFO: Saving data for 1983156: {'created_time': 1774463566.508677, 'last_price_update_time': 1774463566.508687, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983156') HTTP/1.1" 204 0
2026-03-25 18:32:46 [ayvens.es] INFO: Found listing with ID: 1983170
2026-03-25 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983170%27 HTTP/1.1" 200 None
2026-03-25 18:32:46 [ayvens.es] INFO: Scrape type for 1983170: 1
2026-03-25 18:32:46 [ayvens.es] INFO: Extracting data for car ID: 1983170
2026-03-25 18:32:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18466aa8-125e-584a-b665-d25acebcfbcb with identifier: 1983170
2026-03-25 18:32:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18466aa8-125e-584a-b665-d25acebcfbcb with scrape type 1
2026-03-25 18:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 18466aa8-125e-584a-b665-d25acebcfbcb
2026-03-25 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F120%252F41edc021a805426daa786e7435ec8869%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/120/41edc021a805426daa786e7435ec8869/images/large/1.jpg not downloaded yet
2026-03-25 18:32:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/014/3d8e313de4d742d7bde06c9577014ad2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/358/ccb30197f6084b77a9c2996e5e559734/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ecb5710>
2026-03-25 18:32:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d97abe07-d08a-5271-9cf5-091fc89b1090/d97abe07-d08a-5271-9cf5-091fc89b1090_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F515%252Fae9061b4e40843f9bb8d8fab4b32e347%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/515/ae9061b4e40843f9bb8d8fab4b32e347/images/large/1.jpg saved to cache
2026-03-25 18:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d97abe07-d08a-5271-9cf5-091fc89b1090
2026-03-25 18:32:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d97abe07-d08a-5271-9cf5-091fc89b1090, skipping ID generation
2026-03-25 18:32:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d97abe07-d08a-5271-9cf5-091fc89b1090 with scrape type 1
2026-03-25 18:32:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d97abe07-d08a-5271-9cf5-091fc89b1090 sending to next pipeline
2026-03-25 18:32:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d97abe07-d08a-5271-9cf5-091fc89b1090, identifier: 1983161
2026-03-25 18:32:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ec51ad0>
2026-03-25 18:32:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6927b026-774e-5a12-bfb7-023d3d156e6b/6927b026-774e-5a12-bfb7-023d3d156e6b_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F468%252F9f1d0fbab27d4e8cbefb073bfeca5b65%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/468/9f1d0fbab27d4e8cbefb073bfeca5b65/images/large/1.jpg saved to cache
2026-03-25 18:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6927b026-774e-5a12-bfb7-023d3d156e6b
2026-03-25 18:32:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6927b026-774e-5a12-bfb7-023d3d156e6b, skipping ID generation
2026-03-25 18:32:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6927b026-774e-5a12-bfb7-023d3d156e6b with scrape type 1
2026-03-25 18:32:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6927b026-774e-5a12-bfb7-023d3d156e6b sending to next pipeline
2026-03-25 18:32:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6927b026-774e-5a12-bfb7-023d3d156e6b, identifier: 1983158
2026-03-25 18:32:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8edea2d0>
2026-03-25 18:32:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13913013-0bd3-5c89-b0a7-d3dbc31d1a43/13913013-0bd3-5c89-b0a7-d3dbc31d1a43_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F800%252F243e1d66d73c492ea857fa40d4e25b60%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/800/243e1d66d73c492ea857fa40d4e25b60/images/large/1.jpg saved to cache
2026-03-25 18:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 13913013-0bd3-5c89-b0a7-d3dbc31d1a43
2026-03-25 18:32:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 13913013-0bd3-5c89-b0a7-d3dbc31d1a43, skipping ID generation
2026-03-25 18:32:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13913013-0bd3-5c89-b0a7-d3dbc31d1a43 with scrape type 1
2026-03-25 18:32:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 13913013-0bd3-5c89-b0a7-d3dbc31d1a43 sending to next pipeline
2026-03-25 18:32:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 13913013-0bd3-5c89-b0a7-d3dbc31d1a43, identifier: 1983162
2026-03-25 18:32:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8f2522d0>
2026-03-25 18:32:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5f82bcc-c4f6-5aab-a0ce-26607e770aaf/a5f82bcc-c4f6-5aab-a0ce-26607e770aaf_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F014%252F8f12bf38eab9466387fc130c456ca1dd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/014/8f12bf38eab9466387fc130c456ca1dd/images/large/1.jpg saved to cache
2026-03-25 18:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a5f82bcc-c4f6-5aab-a0ce-26607e770aaf
2026-03-25 18:32:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a5f82bcc-c4f6-5aab-a0ce-26607e770aaf, skipping ID generation
2026-03-25 18:32:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5f82bcc-c4f6-5aab-a0ce-26607e770aaf with scrape type 1
2026-03-25 18:32:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a5f82bcc-c4f6-5aab-a0ce-26607e770aaf sending to next pipeline
2026-03-25 18:32:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a5f82bcc-c4f6-5aab-a0ce-26607e770aaf, identifier: 1983163
2026-03-25 18:32:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ee7e250>
2026-03-25 18:32:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dc418ee-136c-589a-9941-99078d2f0e8a/2dc418ee-136c-589a-9941-99078d2f0e8a_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F619%252F00fa6407e7df4d1b881f6966f2e74495%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/619/00fa6407e7df4d1b881f6966f2e74495/images/large/1.jpg saved to cache
2026-03-25 18:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2dc418ee-136c-589a-9941-99078d2f0e8a
2026-03-25 18:32:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2dc418ee-136c-589a-9941-99078d2f0e8a, skipping ID generation
2026-03-25 18:32:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2dc418ee-136c-589a-9941-99078d2f0e8a with scrape type 1
2026-03-25 18:32:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2dc418ee-136c-589a-9941-99078d2f0e8a sending to next pipeline
2026-03-25 18:32:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2dc418ee-136c-589a-9941-99078d2f0e8a, identifier: 1983160
2026-03-25 18:32:47 [ayvens.es] INFO: Found listing with ID: 1983171
2026-03-25 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983171%27 HTTP/1.1" 200 None
2026-03-25 18:32:47 [ayvens.es] INFO: Scrape type for 1983171: 1
2026-03-25 18:32:47 [ayvens.es] INFO: Extracting data for car ID: 1983171
2026-03-25 18:32:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02a3c5ff-69d4-5c0a-b3dc-09135eb0c843 with identifier: 1983171
2026-03-25 18:32:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02a3c5ff-69d4-5c0a-b3dc-09135eb0c843 with scrape type 1
2026-03-25 18:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 02a3c5ff-69d4-5c0a-b3dc-09135eb0c843
2026-03-25 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F374%252F68c7b31b02214ee59eef504dbe63c141%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/374/68c7b31b02214ee59eef504dbe63c141/images/large/1.jpg not downloaded yet
2026-03-25 18:32:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d97abe07-d08a-5271-9cf5-091fc89b1090 with identifier: 1983161
2026-03-25 18:32:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d97abe07-d08a-5271-9cf5-091fc89b1090 with identifier: 1983161
2026-03-25 18:32:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d97abe07-d08a-5271-9cf5-091fc89b1090 with identifier: 1983161 to the API
2026-03-25 18:32:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/515/ae9061b4e40843f9bb8d8fab4b32e347/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd97abe07-d08a-5271-9cf5-091fc89b1090',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'BERLINGO',
 'odometer': 133841,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d97abe07-d08a-5271-9cf5-091fc89b1090/d97abe07-d08a-5271-9cf5-091fc89b1090_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 317539,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/515/ae9061b4e40843f9bb8d8fab4b32e347/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN BERLINGO Talla M BlueHDi 75 LIVE',
 'transmission': 'manual',
 'trim': 'Talla M BlueHDi 75 LIVE',
 'vin': None,
 'year': 2018}
2026-03-25 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983161%27 HTTP/1.1" 200 None
2026-03-25 18:32:47 [ayvens.es] INFO: Saving data for 1983161: {'created_time': 1774463567.726598, 'last_price_update_time': 1774463567.726609, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983161') HTTP/1.1" 204 0
2026-03-25 18:32:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6927b026-774e-5a12-bfb7-023d3d156e6b with identifier: 1983158
2026-03-25 18:32:47 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:32:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6927b026-774e-5a12-bfb7-023d3d156e6b with identifier: 1983158
2026-03-25 18:32:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 6927b026-774e-5a12-bfb7-023d3d156e6b with identifier: 1983158 to the API
2026-03-25 18:32:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/468/9f1d0fbab27d4e8cbefb073bfeca5b65/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'color': 'Blanco bila',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '6927b026-774e-5a12-bfb7-023d3d156e6b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ATECA',
 'odometer': 197418,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6927b026-774e-5a12-bfb7-023d3d156e6b/6927b026-774e-5a12-bfb7-023d3d156e6b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 343519,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/468/9f1d0fbab27d4e8cbefb073bfeca5b65/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ATECA 2.0 TDI 85kW (115CV) St&Sp Reference',
 'transmission': 'manual',
 'trim': '2.0 TDI 85kW (115CV) St&Sp Reference',
 'vin': None,
 'year': 2022}
2026-03-25 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983158%27 HTTP/1.1" 200 None
2026-03-25 18:32:48 [ayvens.es] INFO: Saving data for 1983158: {'created_time': 1774463568.023545, 'last_price_update_time': 1774463568.023555, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983158') HTTP/1.1" 204 0
2026-03-25 18:32:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 13913013-0bd3-5c89-b0a7-d3dbc31d1a43 with identifier: 1983162
2026-03-25 18:32:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 13913013-0bd3-5c89-b0a7-d3dbc31d1a43 with identifier: 1983162
2026-03-25 18:32:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 13913013-0bd3-5c89-b0a7-d3dbc31d1a43 with identifier: 1983162 to the API
2026-03-25 18:32:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/800/243e1d66d73c492ea857fa40d4e25b60/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '13913013-0bd3-5c89-b0a7-d3dbc31d1a43',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '208',
 'odometer': 100984,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13913013-0bd3-5c89-b0a7-d3dbc31d1a43/13913013-0bd3-5c89-b0a7-d3dbc31d1a43_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 326021,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/800/243e1d66d73c492ea857fa40d4e25b60/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 208 5P ACTIVE PureTech 60kW (82CV)',
 'transmission': 'manual',
 'trim': '5P ACTIVE PureTech 60kW (82CV)',
 'vin': None,
 'year': 2019}
2026-03-25 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983162%27 HTTP/1.1" 200 None
2026-03-25 18:32:48 [ayvens.es] INFO: Saving data for 1983162: {'created_time': 1774463568.352586, 'last_price_update_time': 1774463568.352598, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983162') HTTP/1.1" 204 0
2026-03-25 18:32:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a5f82bcc-c4f6-5aab-a0ce-26607e770aaf with identifier: 1983163
2026-03-25 18:32:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a5f82bcc-c4f6-5aab-a0ce-26607e770aaf with identifier: 1983163
2026-03-25 18:32:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a5f82bcc-c4f6-5aab-a0ce-26607e770aaf with identifier: 1983163 to the API
2026-03-25 18:32:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/014/8f12bf38eab9466387fc130c456ca1dd/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Pintura',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a5f82bcc-c4f6-5aab-a0ce-26607e770aaf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 84955,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5f82bcc-c4f6-5aab-a0ce-26607e770aaf/a5f82bcc-c4f6-5aab-a0ce-26607e770aaf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 308472,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/014/8f12bf38eab9466387fc130c456ca1dd/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-18',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS Maxi 2p Blue dCi 70 kW (95CV)',
 'transmission': 'manual',
 'trim': 'Maxi 2p Blue dCi 70 kW (95CV)',
 'vin': None,
 'year': 2020}
2026-03-25 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983163%27 HTTP/1.1" 200 None
2026-03-25 18:32:48 [ayvens.es] INFO: Saving data for 1983163: {'created_time': 1774463568.713942, 'last_price_update_time': 1774463568.713954, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983163') HTTP/1.1" 204 0
2026-03-25 18:32:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2dc418ee-136c-589a-9941-99078d2f0e8a with identifier: 1983160
2026-03-25 18:32:48 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:32:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2dc418ee-136c-589a-9941-99078d2f0e8a with identifier: 1983160
2026-03-25 18:32:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 2dc418ee-136c-589a-9941-99078d2f0e8a with identifier: 1983160 to the API
2026-03-25 18:32:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/619/00fa6407e7df4d1b881f6966f2e74495/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 188,
 'color': 'Blanco glaciar',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '2dc418ee-136c-589a-9941-99078d2f0e8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'TRAFIC',
 'odometer': 48165,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dc418ee-136c-589a-9941-99078d2f0e8a/2dc418ee-136c-589a-9941-99078d2f0e8a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353345,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/619/00fa6407e7df4d1b881f6966f2e74495/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-06-21',
 'seats_number': 9,
 'seller_name': None,
 'title': 'RENAULT TRAFIC (O) Authentic Energy Blue dCi 81 kW (110CV)',
 'transmission': 'manual',
 'trim': '(O) Authentic Energy Blue dCi 81 kW (110CV)',
 'vin': None,
 'year': 2024}
2026-03-25 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983160%27 HTTP/1.1" 200 None
2026-03-25 18:32:49 [ayvens.es] INFO: Saving data for 1983160: {'created_time': 1774463569.179968, 'last_price_update_time': 1774463569.179981, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983160') HTTP/1.1" 204 0
2026-03-25 18:32:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/952/01831b09e16846589842635dafeddd8c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:49 [ayvens.es] INFO: Found listing with ID: 1983172
2026-03-25 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983172%27 HTTP/1.1" 200 None
2026-03-25 18:32:49 [ayvens.es] INFO: Scrape type for 1983172: 1
2026-03-25 18:32:49 [ayvens.es] INFO: Extracting data for car ID: 1983172
2026-03-25 18:32:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a77a78b-f9e0-5dec-bb15-f362ee06565a with identifier: 1983172
2026-03-25 18:32:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a77a78b-f9e0-5dec-bb15-f362ee06565a with scrape type 1
2026-03-25 18:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7a77a78b-f9e0-5dec-bb15-f362ee06565a
2026-03-25 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F967%252F02cbb033f9284b20a39bc6e419514cfe%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/967/02cbb033f9284b20a39bc6e419514cfe/images/large/1.jpg not downloaded yet
2026-03-25 18:32:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/382/d88ac2d1973e4ad380a8de5a3d30f46a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e5ba610>
2026-03-25 18:32:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5fdf524-7f0c-5a35-973e-07a2258d8c6e/a5fdf524-7f0c-5a35-973e-07a2258d8c6e_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F014%252F3d8e313de4d742d7bde06c9577014ad2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/014/3d8e313de4d742d7bde06c9577014ad2/images/large/1.jpg saved to cache
2026-03-25 18:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a5fdf524-7f0c-5a35-973e-07a2258d8c6e
2026-03-25 18:32:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a5fdf524-7f0c-5a35-973e-07a2258d8c6e, skipping ID generation
2026-03-25 18:32:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5fdf524-7f0c-5a35-973e-07a2258d8c6e with scrape type 1
2026-03-25 18:32:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a5fdf524-7f0c-5a35-973e-07a2258d8c6e sending to next pipeline
2026-03-25 18:32:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a5fdf524-7f0c-5a35-973e-07a2258d8c6e, identifier: 1983164
2026-03-25 18:32:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e9f6e90>
2026-03-25 18:32:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c50b57d-2857-553c-accd-e13797d55957/3c50b57d-2857-553c-accd-e13797d55957_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F358%252Fccb30197f6084b77a9c2996e5e559734%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/358/ccb30197f6084b77a9c2996e5e559734/images/large/1.jpg saved to cache
2026-03-25 18:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3c50b57d-2857-553c-accd-e13797d55957
2026-03-25 18:32:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3c50b57d-2857-553c-accd-e13797d55957, skipping ID generation
2026-03-25 18:32:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c50b57d-2857-553c-accd-e13797d55957 with scrape type 1
2026-03-25 18:32:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3c50b57d-2857-553c-accd-e13797d55957 sending to next pipeline
2026-03-25 18:32:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3c50b57d-2857-553c-accd-e13797d55957, identifier: 1983165
2026-03-25 18:32:49 [ayvens.es] INFO: Found listing with ID: 1983173
2026-03-25 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983173%27 HTTP/1.1" 200 None
2026-03-25 18:32:49 [ayvens.es] INFO: Scrape type for 1983173: 1
2026-03-25 18:32:49 [ayvens.es] INFO: Extracting data for car ID: 1983173
2026-03-25 18:32:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0d22ca9-9325-5c45-bfd0-2da7a7be5919 with identifier: 1983173
2026-03-25 18:32:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0d22ca9-9325-5c45-bfd0-2da7a7be5919 with scrape type 1
2026-03-25 18:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f0d22ca9-9325-5c45-bfd0-2da7a7be5919
2026-03-25 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F840%252Fab2c962b902d4b868c7e773565dae469%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/840/ab2c962b902d4b868c7e773565dae469/images/large/1.jpg not downloaded yet
2026-03-25 18:32:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a5fdf524-7f0c-5a35-973e-07a2258d8c6e with identifier: 1983164
2026-03-25 18:32:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a5fdf524-7f0c-5a35-973e-07a2258d8c6e with identifier: 1983164
2026-03-25 18:32:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a5fdf524-7f0c-5a35-973e-07a2258d8c6e with identifier: 1983164 to the API
2026-03-25 18:32:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/014/3d8e313de4d742d7bde06c9577014ad2/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Pintura',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a5fdf524-7f0c-5a35-973e-07a2258d8c6e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 44869,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5fdf524-7f0c-5a35-973e-07a2258d8c6e/a5fdf524-7f0c-5a35-973e-07a2258d8c6e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340078,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/014/3d8e313de4d742d7bde06c9577014ad2/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-18',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS Maxi 2p Blue dCi 70 kW (95CV)',
 'transmission': 'manual',
 'trim': 'Maxi 2p Blue dCi 70 kW (95CV)',
 'vin': None,
 'year': 2020}
2026-03-25 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983164%27 HTTP/1.1" 200 None
2026-03-25 18:32:49 [ayvens.es] INFO: Saving data for 1983164: {'created_time': 1774463569.985297, 'last_price_update_time': 1774463569.985307, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983164') HTTP/1.1" 204 0
2026-03-25 18:32:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3c50b57d-2857-553c-accd-e13797d55957 with identifier: 1983165
2026-03-25 18:32:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3c50b57d-2857-553c-accd-e13797d55957 with identifier: 1983165
2026-03-25 18:32:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3c50b57d-2857-553c-accd-e13797d55957 with identifier: 1983165 to the API
2026-03-25 18:32:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/358/ccb30197f6084b77a9c2996e5e559734/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 215,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '3c50b57d-2857-553c-accd-e13797d55957',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT',
 'odometer': 140459,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c50b57d-2857-553c-accd-e13797d55957/3c50b57d-2857-553c-accd-e13797d55957_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 317434,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/358/ccb30197f6084b77a9c2996e5e559734/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-28',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 350 96kW L3H2 Van Trend FWD MHEV',
 'transmission': 'manual',
 'trim': '350 96kW L3H2 Van Trend FWD MHEV',
 'vin': None,
 'year': 2023}
2026-03-25 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983165%27 HTTP/1.1" 200 None
2026-03-25 18:32:50 [ayvens.es] INFO: Saving data for 1983165: {'created_time': 1774463570.315789, 'last_price_update_time': 1774463570.3158, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983165') HTTP/1.1" 204 0
2026-03-25 18:32:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/828/a2dd782acfc94b48b7dfea4b9647deee/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:50 [ayvens.es] INFO: Found listing with ID: 1983174
2026-03-25 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983174%27 HTTP/1.1" 200 None
2026-03-25 18:32:50 [ayvens.es] INFO: Scrape type for 1983174: 1
2026-03-25 18:32:50 [ayvens.es] INFO: Extracting data for car ID: 1983174
2026-03-25 18:32:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f51bc747-d368-5829-a810-610b23e6d3bc with identifier: 1983174
2026-03-25 18:32:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f51bc747-d368-5829-a810-610b23e6d3bc with scrape type 1
2026-03-25 18:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f51bc747-d368-5829-a810-610b23e6d3bc
2026-03-25 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F520%252F7ddb80a0da7a4f2c841576bccdb7fc63%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/520/7ddb80a0da7a4f2c841576bccdb7fc63/images/large/1.jpg not downloaded yet
2026-03-25 18:32:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/478/2f3c85d191d64f6d985475b4f11fad3d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ecf5a50>
2026-03-25 18:32:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_728c561a-f6b6-5c13-ba38-bf187041d446/728c561a-f6b6-5c13-ba38-bf187041d446_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F952%252F01831b09e16846589842635dafeddd8c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/952/01831b09e16846589842635dafeddd8c/images/large/1.jpg saved to cache
2026-03-25 18:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 728c561a-f6b6-5c13-ba38-bf187041d446
2026-03-25 18:32:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 728c561a-f6b6-5c13-ba38-bf187041d446, skipping ID generation
2026-03-25 18:32:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 728c561a-f6b6-5c13-ba38-bf187041d446 with scrape type 1
2026-03-25 18:32:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 728c561a-f6b6-5c13-ba38-bf187041d446 sending to next pipeline
2026-03-25 18:32:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 728c561a-f6b6-5c13-ba38-bf187041d446, identifier: 1983166
2026-03-25 18:32:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ea0bf50>
2026-03-25 18:32:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5da3479c-52c3-5ed5-8b49-1d5d1179e4e9/5da3479c-52c3-5ed5-8b49-1d5d1179e4e9_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F382%252Fd88ac2d1973e4ad380a8de5a3d30f46a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/382/d88ac2d1973e4ad380a8de5a3d30f46a/images/large/1.jpg saved to cache
2026-03-25 18:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5da3479c-52c3-5ed5-8b49-1d5d1179e4e9
2026-03-25 18:32:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5da3479c-52c3-5ed5-8b49-1d5d1179e4e9, skipping ID generation
2026-03-25 18:32:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5da3479c-52c3-5ed5-8b49-1d5d1179e4e9 with scrape type 1
2026-03-25 18:32:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5da3479c-52c3-5ed5-8b49-1d5d1179e4e9 sending to next pipeline
2026-03-25 18:32:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5da3479c-52c3-5ed5-8b49-1d5d1179e4e9, identifier: 1983167
2026-03-25 18:32:50 [ayvens.es] INFO: Found listing with ID: 1983175
2026-03-25 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983175%27 HTTP/1.1" 200 None
2026-03-25 18:32:50 [ayvens.es] INFO: Scrape type for 1983175: 1
2026-03-25 18:32:50 [ayvens.es] INFO: Extracting data for car ID: 1983175
2026-03-25 18:32:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2312b424-19be-57bd-8ed9-3db4de5328cb with identifier: 1983175
2026-03-25 18:32:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2312b424-19be-57bd-8ed9-3db4de5328cb with scrape type 1
2026-03-25 18:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2312b424-19be-57bd-8ed9-3db4de5328cb
2026-03-25 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F513%252F826c5d919048434491888c6f056a853c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/513/826c5d919048434491888c6f056a853c/images/large/1.jpg not downloaded yet
2026-03-25 18:32:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 728c561a-f6b6-5c13-ba38-bf187041d446 with identifier: 1983166
2026-03-25 18:32:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 728c561a-f6b6-5c13-ba38-bf187041d446 with identifier: 1983166
2026-03-25 18:32:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 728c561a-f6b6-5c13-ba38-bf187041d446 with identifier: 1983166 to the API
2026-03-25 18:32:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/952/01831b09e16846589842635dafeddd8c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '728c561a-f6b6-5c13-ba38-bf187041d446',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'I10',
 'odometer': 85774,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_728c561a-f6b6-5c13-ba38-bf187041d446/728c561a-f6b6-5c13-ba38-bf187041d446_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 327162,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/952/01831b09e16846589842635dafeddd8c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI I10 1.0 Klass AT',
 'transmission': 'manual',
 'trim': '1.0 Klass AT',
 'vin': None,
 'year': 2023}
2026-03-25 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983166%27 HTTP/1.1" 200 None
2026-03-25 18:32:51 [ayvens.es] INFO: Saving data for 1983166: {'created_time': 1774463571.175203, 'last_price_update_time': 1774463571.175214, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983166') HTTP/1.1" 204 0
2026-03-25 18:32:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5da3479c-52c3-5ed5-8b49-1d5d1179e4e9 with identifier: 1983167
2026-03-25 18:32:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5da3479c-52c3-5ed5-8b49-1d5d1179e4e9 with identifier: 1983167
2026-03-25 18:32:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5da3479c-52c3-5ed5-8b49-1d5d1179e4e9 with identifier: 1983167 to the API
2026-03-25 18:32:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/382/d88ac2d1973e4ad380a8de5a3d30f46a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'color': 'Plata',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '5da3479c-52c3-5ed5-8b49-1d5d1179e4e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLC-CLASS',
 'odometer': 138341,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5da3479c-52c3-5ed5-8b49-1d5d1179e4e9/5da3479c-52c3-5ed5-8b49-1d5d1179e4e9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 363636,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/382/d88ac2d1973e4ad380a8de5a3d30f46a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLC-CLASS GLC 220 d 4MATIC',
 'transmission': 'manual',
 'trim': 'GLC 220 d 4MATIC',
 'vin': None,
 'year': 2021}
2026-03-25 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983167%27 HTTP/1.1" 200 None
2026-03-25 18:32:51 [ayvens.es] INFO: Saving data for 1983167: {'created_time': 1774463571.503396, 'last_price_update_time': 1774463571.503408, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983167') HTTP/1.1" 204 0
2026-03-25 18:32:51 [ayvens.es] INFO: Found listing with ID: 1983176
2026-03-25 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983176%27 HTTP/1.1" 200 None
2026-03-25 18:32:51 [ayvens.es] INFO: Scrape type for 1983176: 1
2026-03-25 18:32:51 [ayvens.es] INFO: Extracting data for car ID: 1983176
2026-03-25 18:32:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e83c7ee1-38f0-56e2-9c6e-8ac6c5be57c4 with identifier: 1983176
2026-03-25 18:32:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e83c7ee1-38f0-56e2-9c6e-8ac6c5be57c4 with scrape type 1
2026-03-25 18:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e83c7ee1-38f0-56e2-9c6e-8ac6c5be57c4
2026-03-25 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F161%252F632e4d4198d542699c90d7229106c649%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/161/632e4d4198d542699c90d7229106c649/images/large/1.jpg not downloaded yet
2026-03-25 18:32:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/374/68c7b31b02214ee59eef504dbe63c141/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e55c110>
2026-03-25 18:32:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2918dbfa-31f1-5c3d-b677-fe3b844dd945/2918dbfa-31f1-5c3d-b677-fe3b844dd945_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F828%252Fa2dd782acfc94b48b7dfea4b9647deee%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/828/a2dd782acfc94b48b7dfea4b9647deee/images/large/1.jpg saved to cache
2026-03-25 18:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2918dbfa-31f1-5c3d-b677-fe3b844dd945
2026-03-25 18:32:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2918dbfa-31f1-5c3d-b677-fe3b844dd945, skipping ID generation
2026-03-25 18:32:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2918dbfa-31f1-5c3d-b677-fe3b844dd945 with scrape type 1
2026-03-25 18:32:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2918dbfa-31f1-5c3d-b677-fe3b844dd945 sending to next pipeline
2026-03-25 18:32:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2918dbfa-31f1-5c3d-b677-fe3b844dd945, identifier: 1983168
2026-03-25 18:32:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ee08c10>
2026-03-25 18:32:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb4446c2-df01-520e-a904-bd3ebaa33134/eb4446c2-df01-520e-a904-bd3ebaa33134_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F478%252F2f3c85d191d64f6d985475b4f11fad3d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/478/2f3c85d191d64f6d985475b4f11fad3d/images/large/1.jpg saved to cache
2026-03-25 18:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eb4446c2-df01-520e-a904-bd3ebaa33134
2026-03-25 18:32:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eb4446c2-df01-520e-a904-bd3ebaa33134, skipping ID generation
2026-03-25 18:32:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb4446c2-df01-520e-a904-bd3ebaa33134 with scrape type 1
2026-03-25 18:32:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eb4446c2-df01-520e-a904-bd3ebaa33134 sending to next pipeline
2026-03-25 18:32:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: eb4446c2-df01-520e-a904-bd3ebaa33134, identifier: 1983169
2026-03-25 18:32:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/120/41edc021a805426daa786e7435ec8869/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:51 [ayvens.es] INFO: Found listing with ID: 1983177
2026-03-25 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983177%27 HTTP/1.1" 200 None
2026-03-25 18:32:51 [ayvens.es] INFO: Scrape type for 1983177: 1
2026-03-25 18:32:51 [ayvens.es] INFO: Extracting data for car ID: 1983177
2026-03-25 18:32:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de83ad14-f445-5090-bac1-060c12e6776c with identifier: 1983177
2026-03-25 18:32:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de83ad14-f445-5090-bac1-060c12e6776c with scrape type 1
2026-03-25 18:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item de83ad14-f445-5090-bac1-060c12e6776c
2026-03-25 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F805%252F8f3f250af2124a04b832e5978a2cfe49%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/805/8f3f250af2124a04b832e5978a2cfe49/images/large/1.jpg not downloaded yet
2026-03-25 18:32:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2918dbfa-31f1-5c3d-b677-fe3b844dd945 with identifier: 1983168
2026-03-25 18:32:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2918dbfa-31f1-5c3d-b677-fe3b844dd945 with identifier: 1983168
2026-03-25 18:32:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 2918dbfa-31f1-5c3d-b677-fe3b844dd945 with identifier: 1983168 to the API
2026-03-25 18:32:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/828/a2dd782acfc94b48b7dfea4b9647deee/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '2918dbfa-31f1-5c3d-b677-fe3b844dd945',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'COMBO',
 'odometer': 89274,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2918dbfa-31f1-5c3d-b677-fe3b844dd945/2918dbfa-31f1-5c3d-b677-fe3b844dd945_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 322605,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/828/a2dd782acfc94b48b7dfea4b9647deee/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL COMBO 1.5 TD 75kW XL Business Edition N1',
 'transmission': 'manual',
 'trim': '1.5 TD 75kW XL Business Edition N1',
 'vin': None,
 'year': 2023}
2026-03-25 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983168%27 HTTP/1.1" 200 None
2026-03-25 18:32:52 [ayvens.es] INFO: Saving data for 1983168: {'created_time': 1774463572.228073, 'last_price_update_time': 1774463572.228087, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983168') HTTP/1.1" 204 0
2026-03-25 18:32:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: eb4446c2-df01-520e-a904-bd3ebaa33134 with identifier: 1983169
2026-03-25 18:32:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: eb4446c2-df01-520e-a904-bd3ebaa33134 with identifier: 1983169
2026-03-25 18:32:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: eb4446c2-df01-520e-a904-bd3ebaa33134 with identifier: 1983169 to the API
2026-03-25 18:32:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/478/2f3c85d191d64f6d985475b4f11fad3d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'eb4446c2-df01-520e-a904-bd3ebaa33134',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 171413,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb4446c2-df01-520e-a904-bd3ebaa33134/eb4446c2-df01-520e-a904-bd3ebaa33134_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 331151,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/478/2f3c85d191d64f6d985475b4f11fad3d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.5 BlueHDi 96kW S&S GT Line EAT8',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi 96kW S&S GT Line EAT8',
 'vin': None,
 'year': 2020}
2026-03-25 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983169%27 HTTP/1.1" 200 None
2026-03-25 18:32:52 [ayvens.es] INFO: Saving data for 1983169: {'created_time': 1774463572.677328, 'last_price_update_time': 1774463572.677338, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983169') HTTP/1.1" 204 0
2026-03-25 18:32:52 [ayvens.es] INFO: Found listing with ID: 1983178
2026-03-25 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983178%27 HTTP/1.1" 200 None
2026-03-25 18:32:52 [ayvens.es] INFO: Scrape type for 1983178: 1
2026-03-25 18:32:52 [ayvens.es] INFO: Extracting data for car ID: 1983178
2026-03-25 18:32:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba69d158-f311-53fc-8732-928cc259181d with identifier: 1983178
2026-03-25 18:32:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba69d158-f311-53fc-8732-928cc259181d with scrape type 1
2026-03-25 18:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ba69d158-f311-53fc-8732-928cc259181d
2026-03-25 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F933%252F435eef31a84c4606982f360c15789320%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/933/435eef31a84c4606982f360c15789320/images/large/1.jpg not downloaded yet
2026-03-25 18:32:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e55d090>
2026-03-25 18:32:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02a3c5ff-69d4-5c0a-b3dc-09135eb0c843/02a3c5ff-69d4-5c0a-b3dc-09135eb0c843_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F374%252F68c7b31b02214ee59eef504dbe63c141%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/374/68c7b31b02214ee59eef504dbe63c141/images/large/1.jpg saved to cache
2026-03-25 18:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 02a3c5ff-69d4-5c0a-b3dc-09135eb0c843
2026-03-25 18:32:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 02a3c5ff-69d4-5c0a-b3dc-09135eb0c843, skipping ID generation
2026-03-25 18:32:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02a3c5ff-69d4-5c0a-b3dc-09135eb0c843 with scrape type 1
2026-03-25 18:32:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 02a3c5ff-69d4-5c0a-b3dc-09135eb0c843 sending to next pipeline
2026-03-25 18:32:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 02a3c5ff-69d4-5c0a-b3dc-09135eb0c843, identifier: 1983171
2026-03-25 18:32:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e553650>
2026-03-25 18:32:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18466aa8-125e-584a-b665-d25acebcfbcb/18466aa8-125e-584a-b665-d25acebcfbcb_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F120%252F41edc021a805426daa786e7435ec8869%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/120/41edc021a805426daa786e7435ec8869/images/large/1.jpg saved to cache
2026-03-25 18:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 18466aa8-125e-584a-b665-d25acebcfbcb
2026-03-25 18:32:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 18466aa8-125e-584a-b665-d25acebcfbcb, skipping ID generation
2026-03-25 18:32:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18466aa8-125e-584a-b665-d25acebcfbcb with scrape type 1
2026-03-25 18:32:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 18466aa8-125e-584a-b665-d25acebcfbcb sending to next pipeline
2026-03-25 18:32:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 18466aa8-125e-584a-b665-d25acebcfbcb, identifier: 1983170
2026-03-25 18:32:53 [ayvens.es] INFO: Found listing with ID: 1983179
2026-03-25 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983179%27 HTTP/1.1" 200 None
2026-03-25 18:32:53 [ayvens.es] INFO: Scrape type for 1983179: 1
2026-03-25 18:32:53 [ayvens.es] INFO: Extracting data for car ID: 1983179
2026-03-25 18:32:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8eee2c01-d124-5729-b1ad-38e1400219d5 with identifier: 1983179
2026-03-25 18:32:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8eee2c01-d124-5729-b1ad-38e1400219d5 with scrape type 1
2026-03-25 18:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8eee2c01-d124-5729-b1ad-38e1400219d5
2026-03-25 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F909%252F6ac57dcc7c74463494847121e465412e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/909/6ac57dcc7c74463494847121e465412e/images/large/1.jpg not downloaded yet
2026-03-25 18:32:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 02a3c5ff-69d4-5c0a-b3dc-09135eb0c843 with identifier: 1983171
2026-03-25 18:32:53 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:32:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 02a3c5ff-69d4-5c0a-b3dc-09135eb0c843 with identifier: 1983171
2026-03-25 18:32:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 02a3c5ff-69d4-5c0a-b3dc-09135eb0c843 with identifier: 1983171 to the API
2026-03-25 18:32:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/374/68c7b31b02214ee59eef504dbe63c141/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 174,
 'color': 'Black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '3.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '02a3c5ff-69d4-5c0a-b3dc-09135eb0c843',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X5',
 'odometer': 213238,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02a3c5ff-69d4-5c0a-b3dc-09135eb0c843/02a3c5ff-69d4-5c0a-b3dc-09135eb0c843_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 352838,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/374/68c7b31b02214ee59eef504dbe63c141/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X5 xDrive30d',
 'transmission': 'manual',
 'trim': 'xDrive30d',
 'vin': None,
 'year': 2021}
2026-03-25 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983171%27 HTTP/1.1" 200 None
2026-03-25 18:32:53 [ayvens.es] INFO: Saving data for 1983171: {'created_time': 1774463573.580014, 'last_price_update_time': 1774463573.58003, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983171') HTTP/1.1" 204 0
2026-03-25 18:32:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 18466aa8-125e-584a-b665-d25acebcfbcb with identifier: 1983170
2026-03-25 18:32:53 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:32:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 18466aa8-125e-584a-b665-d25acebcfbcb with identifier: 1983170
2026-03-25 18:32:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 18466aa8-125e-584a-b665-d25acebcfbcb with identifier: 1983170 to the API
2026-03-25 18:32:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/120/41edc021a805426daa786e7435ec8869/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'color': 'Banquise',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '18466aa8-125e-584a-b665-d25acebcfbcb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'PARTNER',
 'odometer': 196135,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18466aa8-125e-584a-b665-d25acebcfbcb/18466aa8-125e-584a-b665-d25acebcfbcb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 504373,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/120/41edc021a805426daa786e7435ec8869/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-24',
 'seats_number': 2,
 'seller_name': None,
 'title': 'PEUGEOT PARTNER Pro Long 1000kg BlueHDi 73kW',
 'transmission': 'manual',
 'trim': 'Pro Long 1000kg BlueHDi 73kW',
 'vin': None,
 'year': 2020}
2026-03-25 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983170%27 HTTP/1.1" 200 None
2026-03-25 18:32:53 [ayvens.es] INFO: Saving data for 1983170: {'created_time': 1774463573.949789, 'last_price_update_time': 1774463573.949809, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983170') HTTP/1.1" 204 0
2026-03-25 18:32:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/967/02cbb033f9284b20a39bc6e419514cfe/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/840/ab2c962b902d4b868c7e773565dae469/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/513/826c5d919048434491888c6f056a853c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:53 [ayvens.es] INFO: Found listing with ID: 1983180
2026-03-25 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983180%27 HTTP/1.1" 200 None
2026-03-25 18:32:54 [ayvens.es] INFO: Scrape type for 1983180: 1
2026-03-25 18:32:54 [ayvens.es] INFO: Extracting data for car ID: 1983180
2026-03-25 18:32:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbc2ca58-218a-51ba-8cf0-ccccf8f48d50 with identifier: 1983180
2026-03-25 18:32:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbc2ca58-218a-51ba-8cf0-ccccf8f48d50 with scrape type 1
2026-03-25 18:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item bbc2ca58-218a-51ba-8cf0-ccccf8f48d50
2026-03-25 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F509%252Feba0aa5c96964c25ac6e6a1d6a5f2bf2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/509/eba0aa5c96964c25ac6e6a1d6a5f2bf2/images/large/1.jpg not downloaded yet
2026-03-25 18:32:54 [ayvens.es] INFO: Found listing with ID: 1983181
2026-03-25 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983181%27 HTTP/1.1" 200 None
2026-03-25 18:32:54 [ayvens.es] INFO: Scrape type for 1983181: 1
2026-03-25 18:32:54 [ayvens.es] INFO: Extracting data for car ID: 1983181
2026-03-25 18:32:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f096bcd-ab7e-5a4f-8935-87e572544fc5 with identifier: 1983181
2026-03-25 18:32:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f096bcd-ab7e-5a4f-8935-87e572544fc5 with scrape type 1
2026-03-25 18:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0f096bcd-ab7e-5a4f-8935-87e572544fc5
2026-03-25 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F020%252F3fcef9ddcc754615b01a6baf66bc8aeb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/020/3fcef9ddcc754615b01a6baf66bc8aeb/images/large/1.jpg not downloaded yet
2026-03-25 18:32:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/520/7ddb80a0da7a4f2c841576bccdb7fc63/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8d417290>
2026-03-25 18:32:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a77a78b-f9e0-5dec-bb15-f362ee06565a/7a77a78b-f9e0-5dec-bb15-f362ee06565a_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F967%252F02cbb033f9284b20a39bc6e419514cfe%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/967/02cbb033f9284b20a39bc6e419514cfe/images/large/1.jpg saved to cache
2026-03-25 18:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7a77a78b-f9e0-5dec-bb15-f362ee06565a
2026-03-25 18:32:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7a77a78b-f9e0-5dec-bb15-f362ee06565a, skipping ID generation
2026-03-25 18:32:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a77a78b-f9e0-5dec-bb15-f362ee06565a with scrape type 1
2026-03-25 18:32:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7a77a78b-f9e0-5dec-bb15-f362ee06565a sending to next pipeline
2026-03-25 18:32:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7a77a78b-f9e0-5dec-bb15-f362ee06565a, identifier: 1983172
2026-03-25 18:32:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ecb6210>
2026-03-25 18:32:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0d22ca9-9325-5c45-bfd0-2da7a7be5919/f0d22ca9-9325-5c45-bfd0-2da7a7be5919_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F840%252Fab2c962b902d4b868c7e773565dae469%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/840/ab2c962b902d4b868c7e773565dae469/images/large/1.jpg saved to cache
2026-03-25 18:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f0d22ca9-9325-5c45-bfd0-2da7a7be5919
2026-03-25 18:32:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f0d22ca9-9325-5c45-bfd0-2da7a7be5919, skipping ID generation
2026-03-25 18:32:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0d22ca9-9325-5c45-bfd0-2da7a7be5919 with scrape type 1
2026-03-25 18:32:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f0d22ca9-9325-5c45-bfd0-2da7a7be5919 sending to next pipeline
2026-03-25 18:32:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f0d22ca9-9325-5c45-bfd0-2da7a7be5919, identifier: 1983173
2026-03-25 18:32:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ec54610>
2026-03-25 18:32:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2312b424-19be-57bd-8ed9-3db4de5328cb/2312b424-19be-57bd-8ed9-3db4de5328cb_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F513%252F826c5d919048434491888c6f056a853c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/513/826c5d919048434491888c6f056a853c/images/large/1.jpg saved to cache
2026-03-25 18:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2312b424-19be-57bd-8ed9-3db4de5328cb
2026-03-25 18:32:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2312b424-19be-57bd-8ed9-3db4de5328cb, skipping ID generation
2026-03-25 18:32:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2312b424-19be-57bd-8ed9-3db4de5328cb with scrape type 1
2026-03-25 18:32:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2312b424-19be-57bd-8ed9-3db4de5328cb sending to next pipeline
2026-03-25 18:32:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2312b424-19be-57bd-8ed9-3db4de5328cb, identifier: 1983175
2026-03-25 18:32:54 [ayvens.es] INFO: Found listing with ID: 1983182
2026-03-25 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983182%27 HTTP/1.1" 200 None
2026-03-25 18:32:54 [ayvens.es] INFO: Scrape type for 1983182: 1
2026-03-25 18:32:54 [ayvens.es] INFO: Extracting data for car ID: 1983182
2026-03-25 18:32:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7f860b6-1349-5fc0-bf10-050d9486c1cc with identifier: 1983182
2026-03-25 18:32:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7f860b6-1349-5fc0-bf10-050d9486c1cc with scrape type 1
2026-03-25 18:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b7f860b6-1349-5fc0-bf10-050d9486c1cc
2026-03-25 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F277%252F669d3c4186eb4c4e95f8dcac2f7ede0d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/277/669d3c4186eb4c4e95f8dcac2f7ede0d/images/large/1.jpg not downloaded yet
2026-03-25 18:32:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7a77a78b-f9e0-5dec-bb15-f362ee06565a with identifier: 1983172
2026-03-25 18:32:54 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:32:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7a77a78b-f9e0-5dec-bb15-f362ee06565a with identifier: 1983172
2026-03-25 18:32:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7a77a78b-f9e0-5dec-bb15-f362ee06565a with identifier: 1983172 to the API
2026-03-25 18:32:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/967/02cbb033f9284b20a39bc6e419514cfe/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 153,
 'color': 'Machine',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '7a77a78b-f9e0-5dec-bb15-f362ee06565a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'MAZDA',
 'model': 'CX-5',
 'odometer': 47880,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a77a78b-f9e0-5dec-bb15-f362ee06565a/7a77a78b-f9e0-5dec-bb15-f362ee06565a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 607559,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/967/02cbb033f9284b20a39bc6e419514cfe/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MAZDA CX-5 2.0 GE 121kW (165CV) 2WD Newground',
 'transmission': 'manual',
 'trim': '2.0 GE 121kW (165CV) 2WD Newground',
 'vin': None,
 'year': 2022}
2026-03-25 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983172%27 HTTP/1.1" 200 None
2026-03-25 18:32:55 [ayvens.es] INFO: Saving data for 1983172: {'created_time': 1774463575.069223, 'last_price_update_time': 1774463575.069234, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983172') HTTP/1.1" 204 0
2026-03-25 18:32:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f0d22ca9-9325-5c45-bfd0-2da7a7be5919 with identifier: 1983173
2026-03-25 18:32:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f0d22ca9-9325-5c45-bfd0-2da7a7be5919 with identifier: 1983173
2026-03-25 18:32:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f0d22ca9-9325-5c45-bfd0-2da7a7be5919 with identifier: 1983173 to the API
2026-03-25 18:32:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/840/ab2c962b902d4b868c7e773565dae469/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f0d22ca9-9325-5c45-bfd0-2da7a7be5919',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 62077,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0d22ca9-9325-5c45-bfd0-2da7a7be5919/f0d22ca9-9325-5c45-bfd0-2da7a7be5919_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 577303,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/840/ab2c962b902d4b868c7e773565dae469/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.5 BlueHDi 96kW (130CV) S&S Active Pack',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi 96kW (130CV) S&S Active Pack',
 'vin': None,
 'year': 2021}
2026-03-25 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983173%27 HTTP/1.1" 200 None
2026-03-25 18:32:55 [ayvens.es] INFO: Saving data for 1983173: {'created_time': 1774463575.383553, 'last_price_update_time': 1774463575.383564, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983173') HTTP/1.1" 204 0
2026-03-25 18:32:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2312b424-19be-57bd-8ed9-3db4de5328cb with identifier: 1983175
2026-03-25 18:32:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2312b424-19be-57bd-8ed9-3db4de5328cb with identifier: 1983175
2026-03-25 18:32:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 2312b424-19be-57bd-8ed9-3db4de5328cb with identifier: 1983175 to the API
2026-03-25 18:32:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/513/826c5d919048434491888c6f056a853c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '2312b424-19be-57bd-8ed9-3db4de5328cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ARONA',
 'odometer': 84010,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2312b424-19be-57bd-8ed9-3db4de5328cb/2312b424-19be-57bd-8ed9-3db4de5328cb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 301771,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/513/826c5d919048434491888c6f056a853c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ARONA 1.0 TSI 81kW (110CV) Style Go2',
 'transmission': 'manual',
 'trim': '1.0 TSI 81kW (110CV) Style Go2',
 'vin': None,
 'year': 2021}
2026-03-25 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983175%27 HTTP/1.1" 200 None
2026-03-25 18:32:55 [ayvens.es] INFO: Saving data for 1983175: {'created_time': 1774463575.718586, 'last_price_update_time': 1774463575.718597, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983175') HTTP/1.1" 204 0
2026-03-25 18:32:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/805/8f3f250af2124a04b832e5978a2cfe49/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/161/632e4d4198d542699c90d7229106c649/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:55 [ayvens.es] INFO: Found listing with ID: 1983183
2026-03-25 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983183%27 HTTP/1.1" 200 None
2026-03-25 18:32:55 [ayvens.es] INFO: Scrape type for 1983183: 1
2026-03-25 18:32:55 [ayvens.es] INFO: Extracting data for car ID: 1983183
2026-03-25 18:32:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9d5876e-7084-5be1-8c53-b6baca082c2c with identifier: 1983183
2026-03-25 18:32:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9d5876e-7084-5be1-8c53-b6baca082c2c with scrape type 1
2026-03-25 18:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b9d5876e-7084-5be1-8c53-b6baca082c2c
2026-03-25 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F043%252Ff0990fca3b1047b99396d6158d0a29ec%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/043/f0990fca3b1047b99396d6158d0a29ec/images/large/1.jpg not downloaded yet
2026-03-25 18:32:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/933/435eef31a84c4606982f360c15789320/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ed865d0>
2026-03-25 18:32:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f51bc747-d368-5829-a810-610b23e6d3bc/f51bc747-d368-5829-a810-610b23e6d3bc_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F520%252F7ddb80a0da7a4f2c841576bccdb7fc63%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/520/7ddb80a0da7a4f2c841576bccdb7fc63/images/large/1.jpg saved to cache
2026-03-25 18:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f51bc747-d368-5829-a810-610b23e6d3bc
2026-03-25 18:32:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f51bc747-d368-5829-a810-610b23e6d3bc, skipping ID generation
2026-03-25 18:32:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f51bc747-d368-5829-a810-610b23e6d3bc with scrape type 1
2026-03-25 18:32:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f51bc747-d368-5829-a810-610b23e6d3bc sending to next pipeline
2026-03-25 18:32:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f51bc747-d368-5829-a810-610b23e6d3bc, identifier: 1983174
2026-03-25 18:32:55 [ayvens.es] INFO: Found listing with ID: 1983184
2026-03-25 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983184%27 HTTP/1.1" 200 None
2026-03-25 18:32:55 [ayvens.es] INFO: Scrape type for 1983184: 1
2026-03-25 18:32:55 [ayvens.es] INFO: Extracting data for car ID: 1983184
2026-03-25 18:32:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7cb0c6c-02e3-5229-9d48-c74dd1c1be32 with identifier: 1983184
2026-03-25 18:32:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7cb0c6c-02e3-5229-9d48-c74dd1c1be32 with scrape type 1
2026-03-25 18:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e7cb0c6c-02e3-5229-9d48-c74dd1c1be32
2026-03-25 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F818%252F573a2cad6a424a9f94f9f6d4d8e71521%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/818/573a2cad6a424a9f94f9f6d4d8e71521/images/large/1.jpg not downloaded yet
2026-03-25 18:32:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f51bc747-d368-5829-a810-610b23e6d3bc with identifier: 1983174
2026-03-25 18:32:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f51bc747-d368-5829-a810-610b23e6d3bc with identifier: 1983174
2026-03-25 18:32:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f51bc747-d368-5829-a810-610b23e6d3bc with identifier: 1983174 to the API
2026-03-25 18:32:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/520/7ddb80a0da7a4f2c841576bccdb7fc63/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'color': 'Rojo',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f51bc747-d368-5829-a810-610b23e6d3bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO',
 'odometer': 227511,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f51bc747-d368-5829-a810-610b23e6d3bc/f51bc747-d368-5829-a810-610b23e6d3bc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 561315,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/520/7ddb80a0da7a4f2c841576bccdb7fc63/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT KANGOO Life Edition One 1.5 Blue dCi 55kW(75CV)',
 'transmission': 'manual',
 'trim': 'Life Edition One 1.5 Blue dCi 55kW(75CV)',
 'vin': None,
 'year': 2021}
2026-03-25 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983174%27 HTTP/1.1" 200 None
2026-03-25 18:32:56 [ayvens.es] INFO: Saving data for 1983174: {'created_time': 1774463576.296728, 'last_price_update_time': 1774463576.296739, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983174') HTTP/1.1" 204 0
2026-03-25 18:32:56 [ayvens.es] INFO: Found listing with ID: 1983185
2026-03-25 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983185%27 HTTP/1.1" 200 None
2026-03-25 18:32:56 [ayvens.es] INFO: Scrape type for 1983185: 1
2026-03-25 18:32:56 [ayvens.es] INFO: Extracting data for car ID: 1983185
2026-03-25 18:32:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 116eb0ad-cf83-5cd0-a679-72aa7913d207 with identifier: 1983185
2026-03-25 18:32:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 116eb0ad-cf83-5cd0-a679-72aa7913d207 with scrape type 1
2026-03-25 18:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 116eb0ad-cf83-5cd0-a679-72aa7913d207
2026-03-25 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F424%252F7d72420049854df79edbe50ff8b5178a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/424/7d72420049854df79edbe50ff8b5178a/images/large/1.jpg not downloaded yet
2026-03-25 18:32:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8eca7a90>
2026-03-25 18:32:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de83ad14-f445-5090-bac1-060c12e6776c/de83ad14-f445-5090-bac1-060c12e6776c_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F805%252F8f3f250af2124a04b832e5978a2cfe49%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/805/8f3f250af2124a04b832e5978a2cfe49/images/large/1.jpg saved to cache
2026-03-25 18:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item de83ad14-f445-5090-bac1-060c12e6776c
2026-03-25 18:32:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: de83ad14-f445-5090-bac1-060c12e6776c, skipping ID generation
2026-03-25 18:32:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de83ad14-f445-5090-bac1-060c12e6776c with scrape type 1
2026-03-25 18:32:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item de83ad14-f445-5090-bac1-060c12e6776c sending to next pipeline
2026-03-25 18:32:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: de83ad14-f445-5090-bac1-060c12e6776c, identifier: 1983177
2026-03-25 18:32:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ecdf410>
2026-03-25 18:32:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e83c7ee1-38f0-56e2-9c6e-8ac6c5be57c4/e83c7ee1-38f0-56e2-9c6e-8ac6c5be57c4_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F161%252F632e4d4198d542699c90d7229106c649%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/161/632e4d4198d542699c90d7229106c649/images/large/1.jpg saved to cache
2026-03-25 18:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e83c7ee1-38f0-56e2-9c6e-8ac6c5be57c4
2026-03-25 18:32:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e83c7ee1-38f0-56e2-9c6e-8ac6c5be57c4, skipping ID generation
2026-03-25 18:32:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e83c7ee1-38f0-56e2-9c6e-8ac6c5be57c4 with scrape type 1
2026-03-25 18:32:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e83c7ee1-38f0-56e2-9c6e-8ac6c5be57c4 sending to next pipeline
2026-03-25 18:32:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e83c7ee1-38f0-56e2-9c6e-8ac6c5be57c4, identifier: 1983176
2026-03-25 18:32:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8eda1d90>
2026-03-25 18:32:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba69d158-f311-53fc-8732-928cc259181d/ba69d158-f311-53fc-8732-928cc259181d_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F933%252F435eef31a84c4606982f360c15789320%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/933/435eef31a84c4606982f360c15789320/images/large/1.jpg saved to cache
2026-03-25 18:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ba69d158-f311-53fc-8732-928cc259181d
2026-03-25 18:32:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ba69d158-f311-53fc-8732-928cc259181d, skipping ID generation
2026-03-25 18:32:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba69d158-f311-53fc-8732-928cc259181d with scrape type 1
2026-03-25 18:32:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ba69d158-f311-53fc-8732-928cc259181d sending to next pipeline
2026-03-25 18:32:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ba69d158-f311-53fc-8732-928cc259181d, identifier: 1983178
2026-03-25 18:32:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/909/6ac57dcc7c74463494847121e465412e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:56 [ayvens.es] INFO: Found listing with ID: 1983186
2026-03-25 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983186%27 HTTP/1.1" 200 None
2026-03-25 18:32:56 [ayvens.es] INFO: Scrape type for 1983186: 1
2026-03-25 18:32:56 [ayvens.es] INFO: Extracting data for car ID: 1983186
2026-03-25 18:32:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f244aa4-2f50-5592-8712-c4ceb9a99598 with identifier: 1983186
2026-03-25 18:32:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f244aa4-2f50-5592-8712-c4ceb9a99598 with scrape type 1
2026-03-25 18:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0f244aa4-2f50-5592-8712-c4ceb9a99598
2026-03-25 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F410%252Faeb00a1e11324a55b3eaca2a813aa3d4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/410/aeb00a1e11324a55b3eaca2a813aa3d4/images/large/1.jpg not downloaded yet
2026-03-25 18:32:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: de83ad14-f445-5090-bac1-060c12e6776c with identifier: 1983177
2026-03-25 18:32:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:32:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: de83ad14-f445-5090-bac1-060c12e6776c with identifier: 1983177
2026-03-25 18:32:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: de83ad14-f445-5090-bac1-060c12e6776c with identifier: 1983177 to the API
2026-03-25 18:32:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/805/8f3f250af2124a04b832e5978a2cfe49/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 100,
 'color': 'B',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'de83ad14-f445-5090-bac1-060c12e6776c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'SERIES 1',
 'odometer': 101633,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de83ad14-f445-5090-bac1-060c12e6776c/de83ad14-f445-5090-bac1-060c12e6776c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 352780,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/805/8f3f250af2124a04b832e5978a2cfe49/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW SERIES 1 116d',
 'transmission': 'manual',
 'trim': '116d',
 'vin': None,
 'year': 2020}
2026-03-25 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983177%27 HTTP/1.1" 200 None
2026-03-25 18:32:57 [ayvens.es] INFO: Saving data for 1983177: {'created_time': 1774463577.479297, 'last_price_update_time': 1774463577.479307, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983177') HTTP/1.1" 204 0
2026-03-25 18:32:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e83c7ee1-38f0-56e2-9c6e-8ac6c5be57c4 with identifier: 1983176
2026-03-25 18:32:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e83c7ee1-38f0-56e2-9c6e-8ac6c5be57c4 with identifier: 1983176
2026-03-25 18:32:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e83c7ee1-38f0-56e2-9c6e-8ac6c5be57c4 with identifier: 1983176 to the API
2026-03-25 18:32:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/161/632e4d4198d542699c90d7229106c649/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e83c7ee1-38f0-56e2-9c6e-8ac6c5be57c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ATECA',
 'odometer': 214767,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e83c7ee1-38f0-56e2-9c6e-8ac6c5be57c4/e83c7ee1-38f0-56e2-9c6e-8ac6c5be57c4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 462020,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/161/632e4d4198d542699c90d7229106c649/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ATECA 2.0 TDI 110kW (150CV) DSG S&S Style Go',
 'transmission': 'manual',
 'trim': '2.0 TDI 110kW (150CV) DSG S&S Style Go',
 'vin': None,
 'year': 2020}
2026-03-25 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983176%27 HTTP/1.1" 200 None
2026-03-25 18:32:57 [ayvens.es] INFO: Saving data for 1983176: {'created_time': 1774463577.79415, 'last_price_update_time': 1774463577.794159, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983176') HTTP/1.1" 204 0
2026-03-25 18:32:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ba69d158-f311-53fc-8732-928cc259181d with identifier: 1983178
2026-03-25 18:32:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ba69d158-f311-53fc-8732-928cc259181d with identifier: 1983178
2026-03-25 18:32:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ba69d158-f311-53fc-8732-928cc259181d with identifier: 1983178 to the API
2026-03-25 18:32:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/933/435eef31a84c4606982f360c15789320/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Phytonicblau',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ba69d158-f311-53fc-8732-928cc259181d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 154621,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba69d158-f311-53fc-8732-928cc259181d/ba69d158-f311-53fc-8732-928cc259181d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 381069,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/933/435eef31a84c4606982f360c15789320/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 sDrive18d',
 'transmission': 'manual',
 'trim': 'sDrive18d',
 'vin': None,
 'year': 2022}
2026-03-25 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983178%27 HTTP/1.1" 200 None
2026-03-25 18:32:58 [ayvens.es] INFO: Saving data for 1983178: {'created_time': 1774463578.147816, 'last_price_update_time': 1774463578.147825, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983178') HTTP/1.1" 204 0
2026-03-25 18:32:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/509/eba0aa5c96964c25ac6e6a1d6a5f2bf2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/020/3fcef9ddcc754615b01a6baf66bc8aeb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:58 [ayvens.es] INFO: Found listing with ID: 1983187
2026-03-25 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983187%27 HTTP/1.1" 200 None
2026-03-25 18:32:58 [ayvens.es] INFO: Scrape type for 1983187: 1
2026-03-25 18:32:58 [ayvens.es] INFO: Extracting data for car ID: 1983187
2026-03-25 18:32:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24fdc60f-999b-5ee9-be61-6d46f750d474 with identifier: 1983187
2026-03-25 18:32:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24fdc60f-999b-5ee9-be61-6d46f750d474 with scrape type 1
2026-03-25 18:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 24fdc60f-999b-5ee9-be61-6d46f750d474
2026-03-25 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F540%252Fdf902a4fce984368bf16900b63683277%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/540/df902a4fce984368bf16900b63683277/images/large/1.jpg not downloaded yet
2026-03-25 18:32:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ec57fd0>
2026-03-25 18:32:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8eee2c01-d124-5729-b1ad-38e1400219d5/8eee2c01-d124-5729-b1ad-38e1400219d5_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F909%252F6ac57dcc7c74463494847121e465412e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/909/6ac57dcc7c74463494847121e465412e/images/large/1.jpg saved to cache
2026-03-25 18:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8eee2c01-d124-5729-b1ad-38e1400219d5
2026-03-25 18:32:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8eee2c01-d124-5729-b1ad-38e1400219d5, skipping ID generation
2026-03-25 18:32:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8eee2c01-d124-5729-b1ad-38e1400219d5 with scrape type 1
2026-03-25 18:32:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8eee2c01-d124-5729-b1ad-38e1400219d5 sending to next pipeline
2026-03-25 18:32:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8eee2c01-d124-5729-b1ad-38e1400219d5, identifier: 1983179
2026-03-25 18:32:58 [ayvens.es] INFO: Found listing with ID: 1983188
2026-03-25 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983188%27 HTTP/1.1" 200 None
2026-03-25 18:32:58 [ayvens.es] INFO: Scrape type for 1983188: 1
2026-03-25 18:32:58 [ayvens.es] INFO: Extracting data for car ID: 1983188
2026-03-25 18:32:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b549c764-4920-59ae-90bb-acb8703ae140 with identifier: 1983188
2026-03-25 18:32:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b549c764-4920-59ae-90bb-acb8703ae140 with scrape type 1
2026-03-25 18:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b549c764-4920-59ae-90bb-acb8703ae140
2026-03-25 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F087%252F7fb818a8993c493d935e213fe17498fb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/087/7fb818a8993c493d935e213fe17498fb/images/large/1.jpg not downloaded yet
2026-03-25 18:32:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8eee2c01-d124-5729-b1ad-38e1400219d5 with identifier: 1983179
2026-03-25 18:32:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8eee2c01-d124-5729-b1ad-38e1400219d5 with identifier: 1983179
2026-03-25 18:32:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8eee2c01-d124-5729-b1ad-38e1400219d5 with identifier: 1983179 to the API
2026-03-25 18:32:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/909/6ac57dcc7c74463494847121e465412e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'Plata',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '8eee2c01-d124-5729-b1ad-38e1400219d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': 36733,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8eee2c01-d124-5729-b1ad-38e1400219d5/8eee2c01-d124-5729-b1ad-38e1400219d5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 497582,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/909/6ac57dcc7c74463494847121e465412e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FOCUS 1.0 Ecoboost MHEV 92kW Trend+',
 'transmission': 'manual',
 'trim': '1.0 Ecoboost MHEV 92kW Trend+',
 'vin': None,
 'year': 2021}
2026-03-25 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983179%27 HTTP/1.1" 200 None
2026-03-25 18:32:58 [ayvens.es] INFO: Saving data for 1983179: {'created_time': 1774463578.68621, 'last_price_update_time': 1774463578.686221, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983179') HTTP/1.1" 204 0
2026-03-25 18:32:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/277/669d3c4186eb4c4e95f8dcac2f7ede0d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:58 [ayvens.es] INFO: Found listing with ID: 1983189
2026-03-25 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983189%27 HTTP/1.1" 200 None
2026-03-25 18:32:58 [ayvens.es] INFO: Scrape type for 1983189: 1
2026-03-25 18:32:58 [ayvens.es] INFO: Extracting data for car ID: 1983189
2026-03-25 18:32:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7aaea221-2caa-59b5-a66d-520f0fa92c3a with identifier: 1983189
2026-03-25 18:32:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7aaea221-2caa-59b5-a66d-520f0fa92c3a with scrape type 1
2026-03-25 18:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7aaea221-2caa-59b5-a66d-520f0fa92c3a
2026-03-25 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F884%252Fd5bd11b555004f2faa135c28a80c413c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/884/d5bd11b555004f2faa135c28a80c413c/images/large/1.jpg not downloaded yet
2026-03-25 18:32:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/818/573a2cad6a424a9f94f9f6d4d8e71521/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae9e434dd0>
2026-03-25 18:32:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbc2ca58-218a-51ba-8cf0-ccccf8f48d50/bbc2ca58-218a-51ba-8cf0-ccccf8f48d50_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F509%252Feba0aa5c96964c25ac6e6a1d6a5f2bf2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/509/eba0aa5c96964c25ac6e6a1d6a5f2bf2/images/large/1.jpg saved to cache
2026-03-25 18:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bbc2ca58-218a-51ba-8cf0-ccccf8f48d50
2026-03-25 18:32:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bbc2ca58-218a-51ba-8cf0-ccccf8f48d50, skipping ID generation
2026-03-25 18:32:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbc2ca58-218a-51ba-8cf0-ccccf8f48d50 with scrape type 1
2026-03-25 18:32:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bbc2ca58-218a-51ba-8cf0-ccccf8f48d50 sending to next pipeline
2026-03-25 18:32:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: bbc2ca58-218a-51ba-8cf0-ccccf8f48d50, identifier: 1983180
2026-03-25 18:32:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ec47890>
2026-03-25 18:32:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:32:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f096bcd-ab7e-5a4f-8935-87e572544fc5/0f096bcd-ab7e-5a4f-8935-87e572544fc5_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F020%252F3fcef9ddcc754615b01a6baf66bc8aeb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/020/3fcef9ddcc754615b01a6baf66bc8aeb/images/large/1.jpg saved to cache
2026-03-25 18:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0f096bcd-ab7e-5a4f-8935-87e572544fc5
2026-03-25 18:32:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0f096bcd-ab7e-5a4f-8935-87e572544fc5, skipping ID generation
2026-03-25 18:32:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f096bcd-ab7e-5a4f-8935-87e572544fc5 with scrape type 1
2026-03-25 18:32:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0f096bcd-ab7e-5a4f-8935-87e572544fc5 sending to next pipeline
2026-03-25 18:32:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0f096bcd-ab7e-5a4f-8935-87e572544fc5, identifier: 1983181
2026-03-25 18:32:59 [ayvens.es] INFO: Found listing with ID: 1983190
2026-03-25 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983190%27 HTTP/1.1" 200 None
2026-03-25 18:32:59 [ayvens.es] INFO: Scrape type for 1983190: 1
2026-03-25 18:32:59 [ayvens.es] INFO: Extracting data for car ID: 1983190
2026-03-25 18:32:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c982ae06-f8d2-5277-be3d-27d61bf4dec1 with identifier: 1983190
2026-03-25 18:32:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c982ae06-f8d2-5277-be3d-27d61bf4dec1 with scrape type 1
2026-03-25 18:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c982ae06-f8d2-5277-be3d-27d61bf4dec1
2026-03-25 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F629%252F7c7216b0700f48ca87f94c03dc65c42f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/629/7c7216b0700f48ca87f94c03dc65c42f/images/large/1.jpg not downloaded yet
2026-03-25 18:32:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: bbc2ca58-218a-51ba-8cf0-ccccf8f48d50 with identifier: 1983180
2026-03-25 18:32:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: bbc2ca58-218a-51ba-8cf0-ccccf8f48d50 with identifier: 1983180
2026-03-25 18:32:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: bbc2ca58-218a-51ba-8cf0-ccccf8f48d50 with identifier: 1983180 to the API
2026-03-25 18:32:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/509/eba0aa5c96964c25ac6e6a1d6a5f2bf2/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'bbc2ca58-218a-51ba-8cf0-ccccf8f48d50',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508',
 'odometer': 110411,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbc2ca58-218a-51ba-8cf0-ccccf8f48d50/bbc2ca58-218a-51ba-8cf0-ccccf8f48d50_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 467662,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/509/eba0aa5c96964c25ac6e6a1d6a5f2bf2/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 5P Active Pack BlueHDi 130 S&S EAT8',
 'transmission': 'manual',
 'trim': '5P Active Pack BlueHDi 130 S&S EAT8',
 'vin': None,
 'year': 2022}
2026-03-25 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983180%27 HTTP/1.1" 200 None
2026-03-25 18:32:59 [ayvens.es] INFO: Saving data for 1983180: {'created_time': 1774463579.539484, 'last_price_update_time': 1774463579.539495, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983180') HTTP/1.1" 204 0
2026-03-25 18:32:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0f096bcd-ab7e-5a4f-8935-87e572544fc5 with identifier: 1983181
2026-03-25 18:32:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0f096bcd-ab7e-5a4f-8935-87e572544fc5 with identifier: 1983181
2026-03-25 18:32:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0f096bcd-ab7e-5a4f-8935-87e572544fc5 with identifier: 1983181 to the API
2026-03-25 18:32:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:32:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:32:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/020/3fcef9ddcc754615b01a6baf66bc8aeb/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 94,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '0f096bcd-ab7e-5a4f-8935-87e572544fc5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508',
 'odometer': 265145,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f096bcd-ab7e-5a4f-8935-87e572544fc5/0f096bcd-ab7e-5a4f-8935-87e572544fc5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328730,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/020/3fcef9ddcc754615b01a6baf66bc8aeb/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 5P Business Line BlueHDi 96kW S&S 6vel',
 'transmission': 'manual',
 'trim': '5P Business Line BlueHDi 96kW S&S 6vel',
 'vin': None,
 'year': 2020}
2026-03-25 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983181%27 HTTP/1.1" 200 None
2026-03-25 18:32:59 [ayvens.es] INFO: Saving data for 1983181: {'created_time': 1774463579.90783, 'last_price_update_time': 1774463579.907841, 'auction_closing_time': 1774526400.0}
2026-03-25 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983181') HTTP/1.1" 204 0
2026-03-25 18:32:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/043/f0990fca3b1047b99396d6158d0a29ec/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:32:59 [ayvens.es] INFO: Found listing with ID: 1983191
2026-03-25 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983191%27 HTTP/1.1" 200 None
2026-03-25 18:32:59 [ayvens.es] INFO: Scrape type for 1983191: 1
2026-03-25 18:32:59 [ayvens.es] INFO: Extracting data for car ID: 1983191
2026-03-25 18:32:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ba0f578-1d3a-517a-9743-f3b4eb972ff9 with identifier: 1983191
2026-03-25 18:32:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ba0f578-1d3a-517a-9743-f3b4eb972ff9 with scrape type 1
2026-03-25 18:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4ba0f578-1d3a-517a-9743-f3b4eb972ff9
2026-03-25 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F442%252Ff47eae395e4b47ca884050091a455728%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/442/f47eae395e4b47ca884050091a455728/images/large/1.jpg not downloaded yet
2026-03-25 18:32:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:32:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae9e434850>
2026-03-25 18:32:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:32:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:32:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7f860b6-1349-5fc0-bf10-050d9486c1cc/b7f860b6-1349-5fc0-bf10-050d9486c1cc_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F277%252F669d3c4186eb4c4e95f8dcac2f7ede0d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/277/669d3c4186eb4c4e95f8dcac2f7ede0d/images/large/1.jpg saved to cache
2026-03-25 18:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b7f860b6-1349-5fc0-bf10-050d9486c1cc
2026-03-25 18:33:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b7f860b6-1349-5fc0-bf10-050d9486c1cc, skipping ID generation
2026-03-25 18:33:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7f860b6-1349-5fc0-bf10-050d9486c1cc with scrape type 1
2026-03-25 18:33:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b7f860b6-1349-5fc0-bf10-050d9486c1cc sending to next pipeline
2026-03-25 18:33:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b7f860b6-1349-5fc0-bf10-050d9486c1cc, identifier: 1983182
2026-03-25 18:33:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8f0182d0>
2026-03-25 18:33:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7cb0c6c-02e3-5229-9d48-c74dd1c1be32/e7cb0c6c-02e3-5229-9d48-c74dd1c1be32_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F818%252F573a2cad6a424a9f94f9f6d4d8e71521%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/818/573a2cad6a424a9f94f9f6d4d8e71521/images/large/1.jpg saved to cache
2026-03-25 18:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e7cb0c6c-02e3-5229-9d48-c74dd1c1be32
2026-03-25 18:33:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e7cb0c6c-02e3-5229-9d48-c74dd1c1be32, skipping ID generation
2026-03-25 18:33:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7cb0c6c-02e3-5229-9d48-c74dd1c1be32 with scrape type 1
2026-03-25 18:33:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e7cb0c6c-02e3-5229-9d48-c74dd1c1be32 sending to next pipeline
2026-03-25 18:33:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e7cb0c6c-02e3-5229-9d48-c74dd1c1be32, identifier: 1983184
2026-03-25 18:33:00 [ayvens.es] INFO: Found listing with ID: 1983192
2026-03-25 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983192%27 HTTP/1.1" 200 None
2026-03-25 18:33:00 [ayvens.es] INFO: Scrape type for 1983192: 1
2026-03-25 18:33:00 [ayvens.es] INFO: Extracting data for car ID: 1983192
2026-03-25 18:33:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d379777-4b3e-5c5d-b5ab-e30ec4d103a0 with identifier: 1983192
2026-03-25 18:33:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d379777-4b3e-5c5d-b5ab-e30ec4d103a0 with scrape type 1
2026-03-25 18:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1d379777-4b3e-5c5d-b5ab-e30ec4d103a0
2026-03-25 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F756%252F097b2ef5e9b64154bea8387677408f6c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/756/097b2ef5e9b64154bea8387677408f6c/images/large/1.jpg not downloaded yet
2026-03-25 18:33:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b7f860b6-1349-5fc0-bf10-050d9486c1cc with identifier: 1983182
2026-03-25 18:33:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b7f860b6-1349-5fc0-bf10-050d9486c1cc with identifier: 1983182
2026-03-25 18:33:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b7f860b6-1349-5fc0-bf10-050d9486c1cc with identifier: 1983182 to the API
2026-03-25 18:33:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/277/669d3c4186eb4c4e95f8dcac2f7ede0d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 170,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b7f860b6-1349-5fc0-bf10-050d9486c1cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'TRAFIC',
 'odometer': 179122,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f860b6-1349-5fc0-bf10-050d9486c1cc/b7f860b6-1349-5fc0-bf10-050d9486c1cc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 485329,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/277/669d3c4186eb4c4e95f8dcac2f7ede0d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-04',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT TRAFIC Furgon 29 L1H1 dCi 88kW (120CV) Euro 6',
 'transmission': 'manual',
 'trim': 'Furgon 29 L1H1 dCi 88kW (120CV) Euro 6',
 'vin': None,
 'year': 2018}
2026-03-25 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983182%27 HTTP/1.1" 200 None
2026-03-25 18:33:00 [ayvens.es] INFO: Saving data for 1983182: {'created_time': 1774463580.895659, 'last_price_update_time': 1774463580.89567, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983182') HTTP/1.1" 204 0
2026-03-25 18:33:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e7cb0c6c-02e3-5229-9d48-c74dd1c1be32 with identifier: 1983184
2026-03-25 18:33:00 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:33:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e7cb0c6c-02e3-5229-9d48-c74dd1c1be32 with identifier: 1983184
2026-03-25 18:33:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e7cb0c6c-02e3-5229-9d48-c74dd1c1be32 with identifier: 1983184 to the API
2026-03-25 18:33:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/818/573a2cad6a424a9f94f9f6d4d8e71521/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 176,
 'color': 'Glaciersilber',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'e7cb0c6c-02e3-5229-9d48-c74dd1c1be32',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X3',
 'odometer': 106161,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7cb0c6c-02e3-5229-9d48-c74dd1c1be32/e7cb0c6c-02e3-5229-9d48-c74dd1c1be32_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 355965,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/818/573a2cad6a424a9f94f9f6d4d8e71521/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 xDrive20i',
 'transmission': 'manual',
 'trim': 'xDrive20i',
 'vin': None,
 'year': 2021}
2026-03-25 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983184%27 HTTP/1.1" 200 None
2026-03-25 18:33:01 [ayvens.es] INFO: Saving data for 1983184: {'created_time': 1774463581.235521, 'last_price_update_time': 1774463581.235532, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983184') HTTP/1.1" 204 0
2026-03-25 18:33:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/424/7d72420049854df79edbe50ff8b5178a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/540/df902a4fce984368bf16900b63683277/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/410/aeb00a1e11324a55b3eaca2a813aa3d4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:01 [ayvens.es] INFO: Found listing with ID: 1983193
2026-03-25 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983193%27 HTTP/1.1" 200 None
2026-03-25 18:33:01 [ayvens.es] INFO: Scrape type for 1983193: 1
2026-03-25 18:33:01 [ayvens.es] INFO: Extracting data for car ID: 1983193
2026-03-25 18:33:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94f665c6-b78e-5838-8359-c8f5f8d0b67b with identifier: 1983193
2026-03-25 18:33:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94f665c6-b78e-5838-8359-c8f5f8d0b67b with scrape type 1
2026-03-25 18:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 94f665c6-b78e-5838-8359-c8f5f8d0b67b
2026-03-25 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F357%252F22af575607fa4c40a90d6d0c41143201%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/357/22af575607fa4c40a90d6d0c41143201/images/large/1.jpg not downloaded yet
2026-03-25 18:33:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ecf7b50>
2026-03-25 18:33:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b9d5876e-7084-5be1-8c53-b6baca082c2c/b9d5876e-7084-5be1-8c53-b6baca082c2c_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F043%252Ff0990fca3b1047b99396d6158d0a29ec%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/043/f0990fca3b1047b99396d6158d0a29ec/images/large/1.jpg saved to cache
2026-03-25 18:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b9d5876e-7084-5be1-8c53-b6baca082c2c
2026-03-25 18:33:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b9d5876e-7084-5be1-8c53-b6baca082c2c, skipping ID generation
2026-03-25 18:33:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9d5876e-7084-5be1-8c53-b6baca082c2c with scrape type 1
2026-03-25 18:33:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b9d5876e-7084-5be1-8c53-b6baca082c2c sending to next pipeline
2026-03-25 18:33:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b9d5876e-7084-5be1-8c53-b6baca082c2c, identifier: 1983183
2026-03-25 18:33:01 [ayvens.es] INFO: Found listing with ID: 1983194
2026-03-25 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983194%27 HTTP/1.1" 200 None
2026-03-25 18:33:01 [ayvens.es] INFO: Scrape type for 1983194: 1
2026-03-25 18:33:01 [ayvens.es] INFO: Extracting data for car ID: 1983194
2026-03-25 18:33:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3631fe63-dd79-502f-8b45-9200fe82d920 with identifier: 1983194
2026-03-25 18:33:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3631fe63-dd79-502f-8b45-9200fe82d920 with scrape type 1
2026-03-25 18:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3631fe63-dd79-502f-8b45-9200fe82d920
2026-03-25 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F129%252F84be14b6208446839c711161e270f6f3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/129/84be14b6208446839c711161e270f6f3/images/large/1.jpg not downloaded yet
2026-03-25 18:33:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b9d5876e-7084-5be1-8c53-b6baca082c2c with identifier: 1983183
2026-03-25 18:33:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b9d5876e-7084-5be1-8c53-b6baca082c2c with identifier: 1983183
2026-03-25 18:33:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b9d5876e-7084-5be1-8c53-b6baca082c2c with identifier: 1983183 to the API
2026-03-25 18:33:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/043/f0990fca3b1047b99396d6158d0a29ec/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 189,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b9d5876e-7084-5be1-8c53-b6baca082c2c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ALHAMBRA',
 'odometer': 60466,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9d5876e-7084-5be1-8c53-b6baca082c2c/b9d5876e-7084-5be1-8c53-b6baca082c2c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 563796,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/043/f0990fca3b1047b99396d6158d0a29ec/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-04',
 'seats_number': 7,
 'seller_name': None,
 'title': 'SEAT ALHAMBRA 1.4 TSI 110kW DSG St&Sp Style GO',
 'transmission': 'manual',
 'trim': '1.4 TSI 110kW DSG St&Sp Style GO',
 'vin': None,
 'year': 2021}
2026-03-25 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983183%27 HTTP/1.1" 200 None
2026-03-25 18:33:01 [ayvens.es] INFO: Saving data for 1983183: {'created_time': 1774463581.856609, 'last_price_update_time': 1774463581.856619, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983183') HTTP/1.1" 204 0
2026-03-25 18:33:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/087/7fb818a8993c493d935e213fe17498fb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:01 [ayvens.es] INFO: Found listing with ID: 1983195
2026-03-25 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983195%27 HTTP/1.1" 200 None
2026-03-25 18:33:01 [ayvens.es] INFO: Scrape type for 1983195: 1
2026-03-25 18:33:01 [ayvens.es] INFO: Extracting data for car ID: 1983195
2026-03-25 18:33:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88a36e0f-98a2-5add-9d09-adda15b51587 with identifier: 1983195
2026-03-25 18:33:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88a36e0f-98a2-5add-9d09-adda15b51587 with scrape type 1
2026-03-25 18:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 88a36e0f-98a2-5add-9d09-adda15b51587
2026-03-25 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F387%252Fb8fcab621c5145d3aabf1b204bf3040c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/387/b8fcab621c5145d3aabf1b204bf3040c/images/large/1.jpg not downloaded yet
2026-03-25 18:33:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8eea3e90>
2026-03-25 18:33:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_116eb0ad-cf83-5cd0-a679-72aa7913d207/116eb0ad-cf83-5cd0-a679-72aa7913d207_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F424%252F7d72420049854df79edbe50ff8b5178a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/424/7d72420049854df79edbe50ff8b5178a/images/large/1.jpg saved to cache
2026-03-25 18:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 116eb0ad-cf83-5cd0-a679-72aa7913d207
2026-03-25 18:33:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 116eb0ad-cf83-5cd0-a679-72aa7913d207, skipping ID generation
2026-03-25 18:33:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 116eb0ad-cf83-5cd0-a679-72aa7913d207 with scrape type 1
2026-03-25 18:33:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 116eb0ad-cf83-5cd0-a679-72aa7913d207 sending to next pipeline
2026-03-25 18:33:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 116eb0ad-cf83-5cd0-a679-72aa7913d207, identifier: 1983185
2026-03-25 18:33:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ecf6ad0>
2026-03-25 18:33:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24fdc60f-999b-5ee9-be61-6d46f750d474/24fdc60f-999b-5ee9-be61-6d46f750d474_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F540%252Fdf902a4fce984368bf16900b63683277%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/540/df902a4fce984368bf16900b63683277/images/large/1.jpg saved to cache
2026-03-25 18:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 24fdc60f-999b-5ee9-be61-6d46f750d474
2026-03-25 18:33:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 24fdc60f-999b-5ee9-be61-6d46f750d474, skipping ID generation
2026-03-25 18:33:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24fdc60f-999b-5ee9-be61-6d46f750d474 with scrape type 1
2026-03-25 18:33:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 24fdc60f-999b-5ee9-be61-6d46f750d474 sending to next pipeline
2026-03-25 18:33:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 24fdc60f-999b-5ee9-be61-6d46f750d474, identifier: 1983187
2026-03-25 18:33:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e5c8610>
2026-03-25 18:33:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f244aa4-2f50-5592-8712-c4ceb9a99598/0f244aa4-2f50-5592-8712-c4ceb9a99598_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F410%252Faeb00a1e11324a55b3eaca2a813aa3d4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/410/aeb00a1e11324a55b3eaca2a813aa3d4/images/large/1.jpg saved to cache
2026-03-25 18:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0f244aa4-2f50-5592-8712-c4ceb9a99598
2026-03-25 18:33:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0f244aa4-2f50-5592-8712-c4ceb9a99598, skipping ID generation
2026-03-25 18:33:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f244aa4-2f50-5592-8712-c4ceb9a99598 with scrape type 1
2026-03-25 18:33:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0f244aa4-2f50-5592-8712-c4ceb9a99598 sending to next pipeline
2026-03-25 18:33:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0f244aa4-2f50-5592-8712-c4ceb9a99598, identifier: 1983186
2026-03-25 18:33:02 [ayvens.es] INFO: Found listing with ID: 1983196
2026-03-25 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983196%27 HTTP/1.1" 200 None
2026-03-25 18:33:02 [ayvens.es] INFO: Scrape type for 1983196: 1
2026-03-25 18:33:02 [ayvens.es] INFO: Extracting data for car ID: 1983196
2026-03-25 18:33:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5acdde55-82d3-576b-b949-10d37fc6cd39 with identifier: 1983196
2026-03-25 18:33:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5acdde55-82d3-576b-b949-10d37fc6cd39 with scrape type 1
2026-03-25 18:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5acdde55-82d3-576b-b949-10d37fc6cd39
2026-03-25 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F875%252F644c846228f04ce8a852ac9443e0cc32%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/875/644c846228f04ce8a852ac9443e0cc32/images/large/1.jpg not downloaded yet
2026-03-25 18:33:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 116eb0ad-cf83-5cd0-a679-72aa7913d207 with identifier: 1983185
2026-03-25 18:33:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 116eb0ad-cf83-5cd0-a679-72aa7913d207 with identifier: 1983185
2026-03-25 18:33:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 116eb0ad-cf83-5cd0-a679-72aa7913d207 with identifier: 1983185 to the API
2026-03-25 18:33:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/424/7d72420049854df79edbe50ff8b5178a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'Azul',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '116eb0ad-cf83-5cd0-a679-72aa7913d207',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'KUGA',
 'odometer': 152193,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_116eb0ad-cf83-5cd0-a679-72aa7913d207/116eb0ad-cf83-5cd0-a679-72aa7913d207_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 524611,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/424/7d72420049854df79edbe50ff8b5178a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD KUGA ST-Line 2.5 Duratec FHEV 140kW Auto',
 'transmission': 'manual',
 'trim': 'ST-Line 2.5 Duratec FHEV 140kW Auto',
 'vin': None,
 'year': 2021}
2026-03-25 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983185%27 HTTP/1.1" 200 None
2026-03-25 18:33:02 [ayvens.es] INFO: Saving data for 1983185: {'created_time': 1774463582.798781, 'last_price_update_time': 1774463582.798794, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983185') HTTP/1.1" 204 0
2026-03-25 18:33:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 24fdc60f-999b-5ee9-be61-6d46f750d474 with identifier: 1983187
2026-03-25 18:33:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 24fdc60f-999b-5ee9-be61-6d46f750d474 with identifier: 1983187
2026-03-25 18:33:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 24fdc60f-999b-5ee9-be61-6d46f750d474 with identifier: 1983187 to the API
2026-03-25 18:33:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/540/df902a4fce984368bf16900b63683277/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 185,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '24fdc60f-999b-5ee9-be61-6d46f750d474',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'RANGER',
 'odometer': 149876,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24fdc60f-999b-5ee9-be61-6d46f750d474/24fdc60f-999b-5ee9-be61-6d46f750d474_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 296921,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/540/df902a4fce984368bf16900b63683277/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD RANGER 2.0 TDCi 125kW 4x4 Doble Cab. XLT S/S',
 'transmission': 'manual',
 'trim': '2.0 TDCi 125kW 4x4 Doble Cab. XLT S/S',
 'vin': None,
 'year': 2020}
2026-03-25 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983187%27 HTTP/1.1" 200 None
2026-03-25 18:33:03 [ayvens.es] INFO: Saving data for 1983187: {'created_time': 1774463583.154087, 'last_price_update_time': 1774463583.154097, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983187') HTTP/1.1" 204 0
2026-03-25 18:33:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0f244aa4-2f50-5592-8712-c4ceb9a99598 with identifier: 1983186
2026-03-25 18:33:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0f244aa4-2f50-5592-8712-c4ceb9a99598 with identifier: 1983186
2026-03-25 18:33:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0f244aa4-2f50-5592-8712-c4ceb9a99598 with identifier: 1983186 to the API
2026-03-25 18:33:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/410/aeb00a1e11324a55b3eaca2a813aa3d4/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '0f244aa4-2f50-5592-8712-c4ceb9a99598',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'PUMA',
 'odometer': 117664,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f244aa4-2f50-5592-8712-c4ceb9a99598/0f244aa4-2f50-5592-8712-c4ceb9a99598_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 352110,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/410/aeb00a1e11324a55b3eaca2a813aa3d4/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD PUMA 1.0 EcoBoost 92kW (125cv) Titanium',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost 92kW (125cv) Titanium',
 'vin': None,
 'year': 2020}
2026-03-25 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983186%27 HTTP/1.1" 200 None
2026-03-25 18:33:03 [ayvens.es] INFO: Saving data for 1983186: {'created_time': 1774463583.488592, 'last_price_update_time': 1774463583.488602, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983186') HTTP/1.1" 204 0
2026-03-25 18:33:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/629/7c7216b0700f48ca87f94c03dc65c42f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/442/f47eae395e4b47ca884050091a455728/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:03 [ayvens.es] INFO: Found listing with ID: 1983197
2026-03-25 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983197%27 HTTP/1.1" 200 None
2026-03-25 18:33:03 [ayvens.es] INFO: Scrape type for 1983197: 1
2026-03-25 18:33:03 [ayvens.es] INFO: Extracting data for car ID: 1983197
2026-03-25 18:33:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3fcfd416-b160-5f84-a56f-872cfad01d1c with identifier: 1983197
2026-03-25 18:33:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fcfd416-b160-5f84-a56f-872cfad01d1c with scrape type 1
2026-03-25 18:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3fcfd416-b160-5f84-a56f-872cfad01d1c
2026-03-25 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F937%252Fc5ed7583f76c4ffa918507f6cf567c3a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/937/c5ed7583f76c4ffa918507f6cf567c3a/images/large/1.jpg not downloaded yet
2026-03-25 18:33:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/884/d5bd11b555004f2faa135c28a80c413c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e5d9250>
2026-03-25 18:33:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b549c764-4920-59ae-90bb-acb8703ae140/b549c764-4920-59ae-90bb-acb8703ae140_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F087%252F7fb818a8993c493d935e213fe17498fb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/087/7fb818a8993c493d935e213fe17498fb/images/large/1.jpg saved to cache
2026-03-25 18:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b549c764-4920-59ae-90bb-acb8703ae140
2026-03-25 18:33:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b549c764-4920-59ae-90bb-acb8703ae140, skipping ID generation
2026-03-25 18:33:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b549c764-4920-59ae-90bb-acb8703ae140 with scrape type 1
2026-03-25 18:33:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b549c764-4920-59ae-90bb-acb8703ae140 sending to next pipeline
2026-03-25 18:33:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b549c764-4920-59ae-90bb-acb8703ae140, identifier: 1983188
2026-03-25 18:33:03 [ayvens.es] INFO: Found listing with ID: 1983198
2026-03-25 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983198%27 HTTP/1.1" 200 None
2026-03-25 18:33:03 [ayvens.es] INFO: Scrape type for 1983198: 1
2026-03-25 18:33:03 [ayvens.es] INFO: Extracting data for car ID: 1983198
2026-03-25 18:33:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72bcfac5-765c-56a3-8f36-3234e82ae920 with identifier: 1983198
2026-03-25 18:33:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72bcfac5-765c-56a3-8f36-3234e82ae920 with scrape type 1
2026-03-25 18:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 72bcfac5-765c-56a3-8f36-3234e82ae920
2026-03-25 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F960%252F931bc358219444b3b1c53f5ed8b32b56%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/960/931bc358219444b3b1c53f5ed8b32b56/images/large/1.jpg not downloaded yet
2026-03-25 18:33:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b549c764-4920-59ae-90bb-acb8703ae140 with identifier: 1983188
2026-03-25 18:33:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b549c764-4920-59ae-90bb-acb8703ae140 with identifier: 1983188
2026-03-25 18:33:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b549c764-4920-59ae-90bb-acb8703ae140 with identifier: 1983188 to the API
2026-03-25 18:33:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/087/7fb818a8993c493d935e213fe17498fb/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 167,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b549c764-4920-59ae-90bb-acb8703ae140',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT CUSTOM',
 'odometer': 192134,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b549c764-4920-59ae-90bb-acb8703ae140/b549c764-4920-59ae-90bb-acb8703ae140_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 313238,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/087/7fb818a8993c493d935e213fe17498fb/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-26',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT CUSTOM (O) Van 2.0 TDCI 96kW 290 L1 Trend',
 'transmission': 'manual',
 'trim': '(O) Van 2.0 TDCI 96kW 290 L1 Trend',
 'vin': None,
 'year': 2018}
2026-03-25 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983188%27 HTTP/1.1" 200 None
2026-03-25 18:33:04 [ayvens.es] INFO: Saving data for 1983188: {'created_time': 1774463584.096723, 'last_price_update_time': 1774463584.096737, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983188') HTTP/1.1" 204 0
2026-03-25 18:33:04 [ayvens.es] INFO: Found listing with ID: 1983199
2026-03-25 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983199%27 HTTP/1.1" 200 None
2026-03-25 18:33:04 [ayvens.es] INFO: Scrape type for 1983199: 1
2026-03-25 18:33:04 [ayvens.es] INFO: Extracting data for car ID: 1983199
2026-03-25 18:33:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c17077e-6c33-5043-914a-587f09533b8d with identifier: 1983199
2026-03-25 18:33:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c17077e-6c33-5043-914a-587f09533b8d with scrape type 1
2026-03-25 18:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0c17077e-6c33-5043-914a-587f09533b8d
2026-03-25 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F155%252Fe75f2bf9cdfc4bfc8cdb76eafd6a8c56%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/155/e75f2bf9cdfc4bfc8cdb76eafd6a8c56/images/large/1.jpg not downloaded yet
2026-03-25 18:33:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8d4159d0>
2026-03-25 18:33:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c982ae06-f8d2-5277-be3d-27d61bf4dec1/c982ae06-f8d2-5277-be3d-27d61bf4dec1_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F629%252F7c7216b0700f48ca87f94c03dc65c42f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/629/7c7216b0700f48ca87f94c03dc65c42f/images/large/1.jpg saved to cache
2026-03-25 18:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c982ae06-f8d2-5277-be3d-27d61bf4dec1
2026-03-25 18:33:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c982ae06-f8d2-5277-be3d-27d61bf4dec1, skipping ID generation
2026-03-25 18:33:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c982ae06-f8d2-5277-be3d-27d61bf4dec1 with scrape type 1
2026-03-25 18:33:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c982ae06-f8d2-5277-be3d-27d61bf4dec1 sending to next pipeline
2026-03-25 18:33:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c982ae06-f8d2-5277-be3d-27d61bf4dec1, identifier: 1983190
2026-03-25 18:33:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ed2b050>
2026-03-25 18:33:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ba0f578-1d3a-517a-9743-f3b4eb972ff9/4ba0f578-1d3a-517a-9743-f3b4eb972ff9_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F442%252Ff47eae395e4b47ca884050091a455728%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/442/f47eae395e4b47ca884050091a455728/images/large/1.jpg saved to cache
2026-03-25 18:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4ba0f578-1d3a-517a-9743-f3b4eb972ff9
2026-03-25 18:33:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4ba0f578-1d3a-517a-9743-f3b4eb972ff9, skipping ID generation
2026-03-25 18:33:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ba0f578-1d3a-517a-9743-f3b4eb972ff9 with scrape type 1
2026-03-25 18:33:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4ba0f578-1d3a-517a-9743-f3b4eb972ff9 sending to next pipeline
2026-03-25 18:33:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4ba0f578-1d3a-517a-9743-f3b4eb972ff9, identifier: 1983191
2026-03-25 18:33:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e5d3cd0>
2026-03-25 18:33:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7aaea221-2caa-59b5-a66d-520f0fa92c3a/7aaea221-2caa-59b5-a66d-520f0fa92c3a_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F884%252Fd5bd11b555004f2faa135c28a80c413c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/884/d5bd11b555004f2faa135c28a80c413c/images/large/1.jpg saved to cache
2026-03-25 18:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7aaea221-2caa-59b5-a66d-520f0fa92c3a
2026-03-25 18:33:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7aaea221-2caa-59b5-a66d-520f0fa92c3a, skipping ID generation
2026-03-25 18:33:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7aaea221-2caa-59b5-a66d-520f0fa92c3a with scrape type 1
2026-03-25 18:33:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7aaea221-2caa-59b5-a66d-520f0fa92c3a sending to next pipeline
2026-03-25 18:33:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7aaea221-2caa-59b5-a66d-520f0fa92c3a, identifier: 1983189
2026-03-25 18:33:04 [ayvens.es] INFO: Found listing with ID: 1983200
2026-03-25 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983200%27 HTTP/1.1" 200 None
2026-03-25 18:33:04 [ayvens.es] INFO: Scrape type for 1983200: 1
2026-03-25 18:33:04 [ayvens.es] INFO: Extracting data for car ID: 1983200
2026-03-25 18:33:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0707208e-e750-5e7c-bdfc-56e185672570 with identifier: 1983200
2026-03-25 18:33:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0707208e-e750-5e7c-bdfc-56e185672570 with scrape type 1
2026-03-25 18:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0707208e-e750-5e7c-bdfc-56e185672570
2026-03-25 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F735%252F97f0d1ec7b6e4049a83f83e4a4bf5c01%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/735/97f0d1ec7b6e4049a83f83e4a4bf5c01/images/large/1.jpg not downloaded yet
2026-03-25 18:33:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c982ae06-f8d2-5277-be3d-27d61bf4dec1 with identifier: 1983190
2026-03-25 18:33:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c982ae06-f8d2-5277-be3d-27d61bf4dec1 with identifier: 1983190
2026-03-25 18:33:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c982ae06-f8d2-5277-be3d-27d61bf4dec1 with identifier: 1983190 to the API
2026-03-25 18:33:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/629/7c7216b0700f48ca87f94c03dc65c42f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'c982ae06-f8d2-5277-be3d-27d61bf4dec1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'XCEED',
 'odometer': 70680,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c982ae06-f8d2-5277-be3d-27d61bf4dec1/c982ae06-f8d2-5277-be3d-27d61bf4dec1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324527,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/629/7c7216b0700f48ca87f94c03dc65c42f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA XCEED 1.0 T-GDi Drive 88kW (120CV)',
 'transmission': 'manual',
 'trim': '1.0 T-GDi Drive 88kW (120CV)',
 'vin': None,
 'year': 2022}
2026-03-25 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983190%27 HTTP/1.1" 200 None
2026-03-25 18:33:05 [ayvens.es] INFO: Saving data for 1983190: {'created_time': 1774463585.038642, 'last_price_update_time': 1774463585.03866, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983190') HTTP/1.1" 204 0
2026-03-25 18:33:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4ba0f578-1d3a-517a-9743-f3b4eb972ff9 with identifier: 1983191
2026-03-25 18:33:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4ba0f578-1d3a-517a-9743-f3b4eb972ff9 with identifier: 1983191
2026-03-25 18:33:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 4ba0f578-1d3a-517a-9743-f3b4eb972ff9 with identifier: 1983191 to the API
2026-03-25 18:33:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/442/f47eae395e4b47ca884050091a455728/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '4ba0f578-1d3a-517a-9743-f3b4eb972ff9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLA',
 'odometer': 79809,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ba0f578-1d3a-517a-9743-f3b4eb972ff9/4ba0f578-1d3a-517a-9743-f3b4eb972ff9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 331722,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/442/f47eae395e4b47ca884050091a455728/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLA GLA 200 D',
 'transmission': 'manual',
 'trim': 'GLA 200 D',
 'vin': None,
 'year': 2020}
2026-03-25 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983191%27 HTTP/1.1" 200 None
2026-03-25 18:33:05 [ayvens.es] INFO: Saving data for 1983191: {'created_time': 1774463585.45673, 'last_price_update_time': 1774463585.456741, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983191') HTTP/1.1" 204 0
2026-03-25 18:33:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7aaea221-2caa-59b5-a66d-520f0fa92c3a with identifier: 1983189
2026-03-25 18:33:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7aaea221-2caa-59b5-a66d-520f0fa92c3a with identifier: 1983189
2026-03-25 18:33:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7aaea221-2caa-59b5-a66d-520f0fa92c3a with identifier: 1983189 to the API
2026-03-25 18:33:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/884/d5bd11b555004f2faa135c28a80c413c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '7aaea221-2caa-59b5-a66d-520f0fa92c3a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'STONIC',
 'odometer': 105452,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7aaea221-2caa-59b5-a66d-520f0fa92c3a/7aaea221-2caa-59b5-a66d-520f0fa92c3a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 708515,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/884/d5bd11b555004f2faa135c28a80c413c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA STONIC 1.0 T-GDi 88kW (120CV) Black Edition DCT',
 'transmission': 'manual',
 'trim': '1.0 T-GDi 88kW (120CV) Black Edition DCT',
 'vin': None,
 'year': 2020}
2026-03-25 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983189%27 HTTP/1.1" 200 None
2026-03-25 18:33:05 [ayvens.es] INFO: Saving data for 1983189: {'created_time': 1774463585.804665, 'last_price_update_time': 1774463585.804676, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983189') HTTP/1.1" 204 0
2026-03-25 18:33:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/756/097b2ef5e9b64154bea8387677408f6c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:05 [scrapy.extensions.logstats] INFO: Crawled 5 pages (at 0 pages/min), scraped 238 items (at 84 items/min)
2026-03-25 18:33:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 174MiB
2026-03-25 18:33:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/387/b8fcab621c5145d3aabf1b204bf3040c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:05 [ayvens.es] INFO: Found listing with ID: 1983201
2026-03-25 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983201%27 HTTP/1.1" 200 None
2026-03-25 18:33:05 [ayvens.es] INFO: Scrape type for 1983201: 1
2026-03-25 18:33:05 [ayvens.es] INFO: Extracting data for car ID: 1983201
2026-03-25 18:33:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2a80a91-70fc-54bc-b7db-58845acf0f80 with identifier: 1983201
2026-03-25 18:33:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2a80a91-70fc-54bc-b7db-58845acf0f80 with scrape type 1
2026-03-25 18:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c2a80a91-70fc-54bc-b7db-58845acf0f80
2026-03-25 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F443%252F4c6346256f60482abaf799463a57444b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/443/4c6346256f60482abaf799463a57444b/images/large/1.jpg not downloaded yet
2026-03-25 18:33:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/357/22af575607fa4c40a90d6d0c41143201/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/129/84be14b6208446839c711161e270f6f3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:05 [ayvens.es] INFO: Found listing with ID: 1983202
2026-03-25 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983202%27 HTTP/1.1" 200 None
2026-03-25 18:33:05 [ayvens.es] INFO: Scrape type for 1983202: 1
2026-03-25 18:33:05 [ayvens.es] INFO: Extracting data for car ID: 1983202
2026-03-25 18:33:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1c70fa3-a276-558c-be18-1af36f66d5b2 with identifier: 1983202
2026-03-25 18:33:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1c70fa3-a276-558c-be18-1af36f66d5b2 with scrape type 1
2026-03-25 18:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a1c70fa3-a276-558c-be18-1af36f66d5b2
2026-03-25 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F559%252F7e07d2329fbd431bbfb5130c4bfe1067%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/559/7e07d2329fbd431bbfb5130c4bfe1067/images/large/1.jpg not downloaded yet
2026-03-25 18:33:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/937/c5ed7583f76c4ffa918507f6cf567c3a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/875/644c846228f04ce8a852ac9443e0cc32/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:05 [ayvens.es] INFO: Found listing with ID: 1983203
2026-03-25 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983203%27 HTTP/1.1" 200 None
2026-03-25 18:33:05 [ayvens.es] INFO: Scrape type for 1983203: 1
2026-03-25 18:33:05 [ayvens.es] INFO: Extracting data for car ID: 1983203
2026-03-25 18:33:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ba84f69-88a0-5c8c-9cc2-babced0981c0 with identifier: 1983203
2026-03-25 18:33:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ba84f69-88a0-5c8c-9cc2-babced0981c0 with scrape type 1
2026-03-25 18:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7ba84f69-88a0-5c8c-9cc2-babced0981c0
2026-03-25 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F540%252F65bc0817483441adbe827e0536eac6cc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/540/65bc0817483441adbe827e0536eac6cc/images/large/1.jpg not downloaded yet
2026-03-25 18:33:05 [ayvens.es] INFO: Found listing with ID: 1983204
2026-03-25 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983204%27 HTTP/1.1" 200 None
2026-03-25 18:33:05 [ayvens.es] INFO: Scrape type for 1983204: 1
2026-03-25 18:33:05 [ayvens.es] INFO: Extracting data for car ID: 1983204
2026-03-25 18:33:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d7e63e0-d71e-572c-951c-1713543b4596 with identifier: 1983204
2026-03-25 18:33:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d7e63e0-d71e-572c-951c-1713543b4596 with scrape type 1
2026-03-25 18:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9d7e63e0-d71e-572c-951c-1713543b4596
2026-03-25 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F351%252Fb0af05bb2f4c481e81b3b3298195bb82%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/351/b0af05bb2f4c481e81b3b3298195bb82/images/large/1.jpg not downloaded yet
2026-03-25 18:33:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ec85890>
2026-03-25 18:33:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d379777-4b3e-5c5d-b5ab-e30ec4d103a0/1d379777-4b3e-5c5d-b5ab-e30ec4d103a0_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F756%252F097b2ef5e9b64154bea8387677408f6c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/756/097b2ef5e9b64154bea8387677408f6c/images/large/1.jpg saved to cache
2026-03-25 18:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1d379777-4b3e-5c5d-b5ab-e30ec4d103a0
2026-03-25 18:33:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1d379777-4b3e-5c5d-b5ab-e30ec4d103a0, skipping ID generation
2026-03-25 18:33:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d379777-4b3e-5c5d-b5ab-e30ec4d103a0 with scrape type 1
2026-03-25 18:33:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1d379777-4b3e-5c5d-b5ab-e30ec4d103a0 sending to next pipeline
2026-03-25 18:33:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1d379777-4b3e-5c5d-b5ab-e30ec4d103a0, identifier: 1983192
2026-03-25 18:33:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e5d1210>
2026-03-25 18:33:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88a36e0f-98a2-5add-9d09-adda15b51587/88a36e0f-98a2-5add-9d09-adda15b51587_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F387%252Fb8fcab621c5145d3aabf1b204bf3040c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/387/b8fcab621c5145d3aabf1b204bf3040c/images/large/1.jpg saved to cache
2026-03-25 18:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 88a36e0f-98a2-5add-9d09-adda15b51587
2026-03-25 18:33:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 88a36e0f-98a2-5add-9d09-adda15b51587, skipping ID generation
2026-03-25 18:33:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88a36e0f-98a2-5add-9d09-adda15b51587 with scrape type 1
2026-03-25 18:33:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 88a36e0f-98a2-5add-9d09-adda15b51587 sending to next pipeline
2026-03-25 18:33:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 88a36e0f-98a2-5add-9d09-adda15b51587, identifier: 1983195
2026-03-25 18:33:06 [ayvens.es] INFO: Found listing with ID: 1983205
2026-03-25 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983205%27 HTTP/1.1" 200 None
2026-03-25 18:33:06 [ayvens.es] INFO: Scrape type for 1983205: 1
2026-03-25 18:33:06 [ayvens.es] INFO: Extracting data for car ID: 1983205
2026-03-25 18:33:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4629a284-38c4-5756-9b8e-221ff331da09 with identifier: 1983205
2026-03-25 18:33:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4629a284-38c4-5756-9b8e-221ff331da09 with scrape type 1
2026-03-25 18:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4629a284-38c4-5756-9b8e-221ff331da09
2026-03-25 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F793%252Fa9b5bd987cdc40d79e428158199af32b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/793/a9b5bd987cdc40d79e428158199af32b/images/large/1.jpg not downloaded yet
2026-03-25 18:33:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1d379777-4b3e-5c5d-b5ab-e30ec4d103a0 with identifier: 1983192
2026-03-25 18:33:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1d379777-4b3e-5c5d-b5ab-e30ec4d103a0 with identifier: 1983192
2026-03-25 18:33:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1d379777-4b3e-5c5d-b5ab-e30ec4d103a0 with identifier: 1983192 to the API
2026-03-25 18:33:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/756/097b2ef5e9b64154bea8387677408f6c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'color': 'Mineral',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '1d379777-4b3e-5c5d-b5ab-e30ec4d103a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO',
 'odometer': 96856,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d379777-4b3e-5c5d-b5ab-e30ec4d103a0/1d379777-4b3e-5c5d-b5ab-e30ec4d103a0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 568857,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/756/097b2ef5e9b64154bea8387677408f6c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-10-13',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO L1 1.5 Blue dCi 70kW (95CV)',
 'transmission': 'manual',
 'trim': 'L1 1.5 Blue dCi 70kW (95CV)',
 'vin': None,
 'year': 2023}
2026-03-25 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983192%27 HTTP/1.1" 200 None
2026-03-25 18:33:06 [ayvens.es] INFO: Saving data for 1983192: {'created_time': 1774463586.68007, 'last_price_update_time': 1774463586.680081, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983192') HTTP/1.1" 204 0
2026-03-25 18:33:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 88a36e0f-98a2-5add-9d09-adda15b51587 with identifier: 1983195
2026-03-25 18:33:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 88a36e0f-98a2-5add-9d09-adda15b51587 with identifier: 1983195
2026-03-25 18:33:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 88a36e0f-98a2-5add-9d09-adda15b51587 with identifier: 1983195 to the API
2026-03-25 18:33:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/387/b8fcab621c5145d3aabf1b204bf3040c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Plata',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '88a36e0f-98a2-5add-9d09-adda15b51587',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'PUMA',
 'odometer': 45764,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88a36e0f-98a2-5add-9d09-adda15b51587/88a36e0f-98a2-5add-9d09-adda15b51587_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 333798,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/387/b8fcab621c5145d3aabf1b204bf3040c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD PUMA 1.0 EcoBoost 125cv ST-Line X MHEV',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost 125cv ST-Line X MHEV',
 'vin': None,
 'year': 2021}
2026-03-25 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983195%27 HTTP/1.1" 200 None
2026-03-25 18:33:07 [ayvens.es] INFO: Saving data for 1983195: {'created_time': 1774463587.065205, 'last_price_update_time': 1774463587.065216, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983195') HTTP/1.1" 204 0
2026-03-25 18:33:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ed1ec50>
2026-03-25 18:33:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94f665c6-b78e-5838-8359-c8f5f8d0b67b/94f665c6-b78e-5838-8359-c8f5f8d0b67b_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F357%252F22af575607fa4c40a90d6d0c41143201%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/357/22af575607fa4c40a90d6d0c41143201/images/large/1.jpg saved to cache
2026-03-25 18:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 94f665c6-b78e-5838-8359-c8f5f8d0b67b
2026-03-25 18:33:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 94f665c6-b78e-5838-8359-c8f5f8d0b67b, skipping ID generation
2026-03-25 18:33:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94f665c6-b78e-5838-8359-c8f5f8d0b67b with scrape type 1
2026-03-25 18:33:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 94f665c6-b78e-5838-8359-c8f5f8d0b67b sending to next pipeline
2026-03-25 18:33:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 94f665c6-b78e-5838-8359-c8f5f8d0b67b, identifier: 1983193
2026-03-25 18:33:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8eca71d0>
2026-03-25 18:33:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3631fe63-dd79-502f-8b45-9200fe82d920/3631fe63-dd79-502f-8b45-9200fe82d920_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F129%252F84be14b6208446839c711161e270f6f3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/129/84be14b6208446839c711161e270f6f3/images/large/1.jpg saved to cache
2026-03-25 18:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3631fe63-dd79-502f-8b45-9200fe82d920
2026-03-25 18:33:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3631fe63-dd79-502f-8b45-9200fe82d920, skipping ID generation
2026-03-25 18:33:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3631fe63-dd79-502f-8b45-9200fe82d920 with scrape type 1
2026-03-25 18:33:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3631fe63-dd79-502f-8b45-9200fe82d920 sending to next pipeline
2026-03-25 18:33:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3631fe63-dd79-502f-8b45-9200fe82d920, identifier: 1983194
2026-03-25 18:33:07 [ayvens.es] INFO: Found listing with ID: 1983206
2026-03-25 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983206%27 HTTP/1.1" 200 None
2026-03-25 18:33:07 [ayvens.es] INFO: Scrape type for 1983206: 1
2026-03-25 18:33:07 [ayvens.es] INFO: Extracting data for car ID: 1983206
2026-03-25 18:33:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4adcf44c-ddd1-5607-b6a9-fe2d84ebc40e with identifier: 1983206
2026-03-25 18:33:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4adcf44c-ddd1-5607-b6a9-fe2d84ebc40e with scrape type 1
2026-03-25 18:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4adcf44c-ddd1-5607-b6a9-fe2d84ebc40e
2026-03-25 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F116%252F08daf5b2e4664934b50828173a6bdadb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/116/08daf5b2e4664934b50828173a6bdadb/images/large/1.jpg not downloaded yet
2026-03-25 18:33:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 94f665c6-b78e-5838-8359-c8f5f8d0b67b with identifier: 1983193
2026-03-25 18:33:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 94f665c6-b78e-5838-8359-c8f5f8d0b67b with identifier: 1983193
2026-03-25 18:33:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 94f665c6-b78e-5838-8359-c8f5f8d0b67b with identifier: 1983193 to the API
2026-03-25 18:33:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/357/22af575607fa4c40a90d6d0c41143201/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 95,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '94f665c6-b78e-5838-8359-c8f5f8d0b67b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MEGANE',
 'odometer': 199444,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94f665c6-b78e-5838-8359-c8f5f8d0b67b/94f665c6-b78e-5838-8359-c8f5f8d0b67b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707069,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/357/22af575607fa4c40a90d6d0c41143201/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT MEGANE Sp. Tou. Limited Energy dCi 81kW (110CV)',
 'transmission': 'manual',
 'trim': 'Sp. Tou. Limited Energy dCi 81kW (110CV)',
 'vin': None,
 'year': 2018}
2026-03-25 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983193%27 HTTP/1.1" 200 None
2026-03-25 18:33:07 [ayvens.es] INFO: Saving data for 1983193: {'created_time': 1774463587.855394, 'last_price_update_time': 1774463587.855404, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983193') HTTP/1.1" 204 0
2026-03-25 18:33:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3631fe63-dd79-502f-8b45-9200fe82d920 with identifier: 1983194
2026-03-25 18:33:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3631fe63-dd79-502f-8b45-9200fe82d920 with identifier: 1983194
2026-03-25 18:33:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3631fe63-dd79-502f-8b45-9200fe82d920 with identifier: 1983194 to the API
2026-03-25 18:33:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/129/84be14b6208446839c711161e270f6f3/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '3631fe63-dd79-502f-8b45-9200fe82d920',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ALHAMBRA',
 'odometer': 90153,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3631fe63-dd79-502f-8b45-9200fe82d920/3631fe63-dd79-502f-8b45-9200fe82d920_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 503849,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/129/84be14b6208446839c711161e270f6f3/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ALHAMBRA 2.0 TDI 110kW (150CV) Eco S/S Xc Trav Ed',
 'transmission': 'manual',
 'trim': '2.0 TDI 110kW (150CV) Eco S/S Xc Trav Ed',
 'vin': None,
 'year': 2019}
2026-03-25 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983194%27 HTTP/1.1" 200 None
2026-03-25 18:33:08 [ayvens.es] INFO: Saving data for 1983194: {'created_time': 1774463588.18662, 'last_price_update_time': 1774463588.186645, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983194') HTTP/1.1" 204 0
2026-03-25 18:33:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/155/e75f2bf9cdfc4bfc8cdb76eafd6a8c56/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8f0e0f90>
2026-03-25 18:33:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fcfd416-b160-5f84-a56f-872cfad01d1c/3fcfd416-b160-5f84-a56f-872cfad01d1c_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F937%252Fc5ed7583f76c4ffa918507f6cf567c3a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/937/c5ed7583f76c4ffa918507f6cf567c3a/images/large/1.jpg saved to cache
2026-03-25 18:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3fcfd416-b160-5f84-a56f-872cfad01d1c
2026-03-25 18:33:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3fcfd416-b160-5f84-a56f-872cfad01d1c, skipping ID generation
2026-03-25 18:33:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fcfd416-b160-5f84-a56f-872cfad01d1c with scrape type 1
2026-03-25 18:33:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3fcfd416-b160-5f84-a56f-872cfad01d1c sending to next pipeline
2026-03-25 18:33:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3fcfd416-b160-5f84-a56f-872cfad01d1c, identifier: 1983197
2026-03-25 18:33:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e571250>
2026-03-25 18:33:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5acdde55-82d3-576b-b949-10d37fc6cd39/5acdde55-82d3-576b-b949-10d37fc6cd39_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F875%252F644c846228f04ce8a852ac9443e0cc32%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/875/644c846228f04ce8a852ac9443e0cc32/images/large/1.jpg saved to cache
2026-03-25 18:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5acdde55-82d3-576b-b949-10d37fc6cd39
2026-03-25 18:33:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5acdde55-82d3-576b-b949-10d37fc6cd39, skipping ID generation
2026-03-25 18:33:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5acdde55-82d3-576b-b949-10d37fc6cd39 with scrape type 1
2026-03-25 18:33:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5acdde55-82d3-576b-b949-10d37fc6cd39 sending to next pipeline
2026-03-25 18:33:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5acdde55-82d3-576b-b949-10d37fc6cd39, identifier: 1983196
2026-03-25 18:33:08 [ayvens.es] INFO: Found listing with ID: 1983207
2026-03-25 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983207%27 HTTP/1.1" 200 None
2026-03-25 18:33:08 [ayvens.es] INFO: Scrape type for 1983207: 1
2026-03-25 18:33:08 [ayvens.es] INFO: Extracting data for car ID: 1983207
2026-03-25 18:33:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eed4c71f-b770-548f-907e-cfc16b94855e with identifier: 1983207
2026-03-25 18:33:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eed4c71f-b770-548f-907e-cfc16b94855e with scrape type 1
2026-03-25 18:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item eed4c71f-b770-548f-907e-cfc16b94855e
2026-03-25 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F391%252Fbe0fee9fc6dc4cae8208c1cc979f8929%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/391/be0fee9fc6dc4cae8208c1cc979f8929/images/large/1.jpg not downloaded yet
2026-03-25 18:33:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3fcfd416-b160-5f84-a56f-872cfad01d1c with identifier: 1983197
2026-03-25 18:33:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3fcfd416-b160-5f84-a56f-872cfad01d1c with identifier: 1983197
2026-03-25 18:33:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3fcfd416-b160-5f84-a56f-872cfad01d1c with identifier: 1983197 to the API
2026-03-25 18:33:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/937/c5ed7583f76c4ffa918507f6cf567c3a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '3fcfd416-b160-5f84-a56f-872cfad01d1c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLA',
 'odometer': 152087,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fcfd416-b160-5f84-a56f-872cfad01d1c/3fcfd416-b160-5f84-a56f-872cfad01d1c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 384779,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/937/c5ed7583f76c4ffa918507f6cf567c3a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLA GLA 220 D 4MATIC',
 'transmission': 'manual',
 'trim': 'GLA 220 D 4MATIC',
 'vin': None,
 'year': 2021}
2026-03-25 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983197%27 HTTP/1.1" 200 None
2026-03-25 18:33:08 [ayvens.es] INFO: Saving data for 1983197: {'created_time': 1774463588.88928, 'last_price_update_time': 1774463588.889291, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983197') HTTP/1.1" 204 0
2026-03-25 18:33:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5acdde55-82d3-576b-b949-10d37fc6cd39 with identifier: 1983196
2026-03-25 18:33:08 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:33:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5acdde55-82d3-576b-b949-10d37fc6cd39 with identifier: 1983196
2026-03-25 18:33:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5acdde55-82d3-576b-b949-10d37fc6cd39 with identifier: 1983196 to the API
2026-03-25 18:33:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/875/644c846228f04ce8a852ac9443e0cc32/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'Aurora',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '5acdde55-82d3-576b-b949-10d37fc6cd39',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'PICANTO',
 'odometer': 104755,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5acdde55-82d3-576b-b949-10d37fc6cd39/5acdde55-82d3-576b-b949-10d37fc6cd39_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 349412,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/875/644c846228f04ce8a852ac9443e0cc32/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA PICANTO 1.0 DPi 49kW (67CV) Concept',
 'transmission': 'manual',
 'trim': '1.0 DPi 49kW (67CV) Concept',
 'vin': None,
 'year': 2022}
2026-03-25 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983196%27 HTTP/1.1" 200 None
2026-03-25 18:33:09 [ayvens.es] INFO: Saving data for 1983196: {'created_time': 1774463589.27613, 'last_price_update_time': 1774463589.27614, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983196') HTTP/1.1" 204 0
2026-03-25 18:33:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/960/931bc358219444b3b1c53f5ed8b32b56/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/735/97f0d1ec7b6e4049a83f83e4a4bf5c01/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/559/7e07d2329fbd431bbfb5130c4bfe1067/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:09 [ayvens.es] INFO: Found listing with ID: 1983208
2026-03-25 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983208%27 HTTP/1.1" 200 None
2026-03-25 18:33:09 [ayvens.es] INFO: Scrape type for 1983208: 1
2026-03-25 18:33:09 [ayvens.es] INFO: Extracting data for car ID: 1983208
2026-03-25 18:33:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42230679-5867-597c-952c-bea636d0fddb with identifier: 1983208
2026-03-25 18:33:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42230679-5867-597c-952c-bea636d0fddb with scrape type 1
2026-03-25 18:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 42230679-5867-597c-952c-bea636d0fddb
2026-03-25 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F786%252F089ba18f258e45858ef9b155da61eeb1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/786/089ba18f258e45858ef9b155da61eeb1/images/large/1.jpg not downloaded yet
2026-03-25 18:33:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/443/4c6346256f60482abaf799463a57444b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8d40fd50>
2026-03-25 18:33:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c17077e-6c33-5043-914a-587f09533b8d/0c17077e-6c33-5043-914a-587f09533b8d_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F155%252Fe75f2bf9cdfc4bfc8cdb76eafd6a8c56%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/155/e75f2bf9cdfc4bfc8cdb76eafd6a8c56/images/large/1.jpg saved to cache
2026-03-25 18:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0c17077e-6c33-5043-914a-587f09533b8d
2026-03-25 18:33:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0c17077e-6c33-5043-914a-587f09533b8d, skipping ID generation
2026-03-25 18:33:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c17077e-6c33-5043-914a-587f09533b8d with scrape type 1
2026-03-25 18:33:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0c17077e-6c33-5043-914a-587f09533b8d sending to next pipeline
2026-03-25 18:33:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0c17077e-6c33-5043-914a-587f09533b8d, identifier: 1983199
2026-03-25 18:33:09 [ayvens.es] INFO: Found listing with ID: 1983209
2026-03-25 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983209%27 HTTP/1.1" 200 None
2026-03-25 18:33:09 [ayvens.es] INFO: Scrape type for 1983209: 1
2026-03-25 18:33:09 [ayvens.es] INFO: Extracting data for car ID: 1983209
2026-03-25 18:33:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e2bc44e-1fa7-5616-bf26-4d366b43b87d with identifier: 1983209
2026-03-25 18:33:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e2bc44e-1fa7-5616-bf26-4d366b43b87d with scrape type 1
2026-03-25 18:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0e2bc44e-1fa7-5616-bf26-4d366b43b87d
2026-03-25 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F792%252F32b80352fa744794b404b8518cd70b0d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/792/32b80352fa744794b404b8518cd70b0d/images/large/1.jpg not downloaded yet
2026-03-25 18:33:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0c17077e-6c33-5043-914a-587f09533b8d with identifier: 1983199
2026-03-25 18:33:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0c17077e-6c33-5043-914a-587f09533b8d with identifier: 1983199
2026-03-25 18:33:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0c17077e-6c33-5043-914a-587f09533b8d with identifier: 1983199 to the API
2026-03-25 18:33:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/155/e75f2bf9cdfc4bfc8cdb76eafd6a8c56/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '0c17077e-6c33-5043-914a-587f09533b8d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CAPTUR',
 'odometer': 252334,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c17077e-6c33-5043-914a-587f09533b8d/0c17077e-6c33-5043-914a-587f09533b8d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 357025,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/155/e75f2bf9cdfc4bfc8cdb76eafd6a8c56/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CAPTUR Zen dCi 66kW (90CV) -18',
 'transmission': 'manual',
 'trim': 'Zen dCi 66kW (90CV) -18',
 'vin': None,
 'year': 2018}
2026-03-25 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983199%27 HTTP/1.1" 200 None
2026-03-25 18:33:09 [ayvens.es] INFO: Saving data for 1983199: {'created_time': 1774463589.900474, 'last_price_update_time': 1774463589.900485, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983199') HTTP/1.1" 204 0
2026-03-25 18:33:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/351/b0af05bb2f4c481e81b3b3298195bb82/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:09 [ayvens.es] INFO: Found listing with ID: 1983210
2026-03-25 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983210%27 HTTP/1.1" 200 None
2026-03-25 18:33:09 [ayvens.es] INFO: Scrape type for 1983210: 1
2026-03-25 18:33:09 [ayvens.es] INFO: Extracting data for car ID: 1983210
2026-03-25 18:33:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa330f10-1938-5527-8508-4fd8f6fa240f with identifier: 1983210
2026-03-25 18:33:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa330f10-1938-5527-8508-4fd8f6fa240f with scrape type 1
2026-03-25 18:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item aa330f10-1938-5527-8508-4fd8f6fa240f
2026-03-25 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F604%252Fd40d00b1e5d04110847bdc9e53879d07%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/604/d40d00b1e5d04110847bdc9e53879d07/images/large/1.jpg not downloaded yet
2026-03-25 18:33:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/540/65bc0817483441adbe827e0536eac6cc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ea1a290>
2026-03-25 18:33:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72bcfac5-765c-56a3-8f36-3234e82ae920/72bcfac5-765c-56a3-8f36-3234e82ae920_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F960%252F931bc358219444b3b1c53f5ed8b32b56%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/960/931bc358219444b3b1c53f5ed8b32b56/images/large/1.jpg saved to cache
2026-03-25 18:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 72bcfac5-765c-56a3-8f36-3234e82ae920
2026-03-25 18:33:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 72bcfac5-765c-56a3-8f36-3234e82ae920, skipping ID generation
2026-03-25 18:33:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72bcfac5-765c-56a3-8f36-3234e82ae920 with scrape type 1
2026-03-25 18:33:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 72bcfac5-765c-56a3-8f36-3234e82ae920 sending to next pipeline
2026-03-25 18:33:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 72bcfac5-765c-56a3-8f36-3234e82ae920, identifier: 1983198
2026-03-25 18:33:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e9f6350>
2026-03-25 18:33:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0707208e-e750-5e7c-bdfc-56e185672570/0707208e-e750-5e7c-bdfc-56e185672570_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F735%252F97f0d1ec7b6e4049a83f83e4a4bf5c01%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/735/97f0d1ec7b6e4049a83f83e4a4bf5c01/images/large/1.jpg saved to cache
2026-03-25 18:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0707208e-e750-5e7c-bdfc-56e185672570
2026-03-25 18:33:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0707208e-e750-5e7c-bdfc-56e185672570, skipping ID generation
2026-03-25 18:33:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0707208e-e750-5e7c-bdfc-56e185672570 with scrape type 1
2026-03-25 18:33:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0707208e-e750-5e7c-bdfc-56e185672570 sending to next pipeline
2026-03-25 18:33:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0707208e-e750-5e7c-bdfc-56e185672570, identifier: 1983200
2026-03-25 18:33:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ea3c590>
2026-03-25 18:33:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1c70fa3-a276-558c-be18-1af36f66d5b2/a1c70fa3-a276-558c-be18-1af36f66d5b2_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F559%252F7e07d2329fbd431bbfb5130c4bfe1067%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/559/7e07d2329fbd431bbfb5130c4bfe1067/images/large/1.jpg saved to cache
2026-03-25 18:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a1c70fa3-a276-558c-be18-1af36f66d5b2
2026-03-25 18:33:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a1c70fa3-a276-558c-be18-1af36f66d5b2, skipping ID generation
2026-03-25 18:33:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1c70fa3-a276-558c-be18-1af36f66d5b2 with scrape type 1
2026-03-25 18:33:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a1c70fa3-a276-558c-be18-1af36f66d5b2 sending to next pipeline
2026-03-25 18:33:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a1c70fa3-a276-558c-be18-1af36f66d5b2, identifier: 1983202
2026-03-25 18:33:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e5bb190>
2026-03-25 18:33:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2a80a91-70fc-54bc-b7db-58845acf0f80/c2a80a91-70fc-54bc-b7db-58845acf0f80_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F443%252F4c6346256f60482abaf799463a57444b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/443/4c6346256f60482abaf799463a57444b/images/large/1.jpg saved to cache
2026-03-25 18:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c2a80a91-70fc-54bc-b7db-58845acf0f80
2026-03-25 18:33:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c2a80a91-70fc-54bc-b7db-58845acf0f80, skipping ID generation
2026-03-25 18:33:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2a80a91-70fc-54bc-b7db-58845acf0f80 with scrape type 1
2026-03-25 18:33:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c2a80a91-70fc-54bc-b7db-58845acf0f80 sending to next pipeline
2026-03-25 18:33:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c2a80a91-70fc-54bc-b7db-58845acf0f80, identifier: 1983201
2026-03-25 18:33:10 [ayvens.es] INFO: Found listing with ID: 1983211
2026-03-25 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983211%27 HTTP/1.1" 200 None
2026-03-25 18:33:10 [ayvens.es] INFO: Scrape type for 1983211: 1
2026-03-25 18:33:10 [ayvens.es] INFO: Extracting data for car ID: 1983211
2026-03-25 18:33:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3da08d9-48ad-56ea-ac91-2f93d1c18b3f with identifier: 1983211
2026-03-25 18:33:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3da08d9-48ad-56ea-ac91-2f93d1c18b3f with scrape type 1
2026-03-25 18:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e3da08d9-48ad-56ea-ac91-2f93d1c18b3f
2026-03-25 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F816%252F3f1df8268a4a40adac7e8373ac021bc9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/816/3f1df8268a4a40adac7e8373ac021bc9/images/large/1.jpg not downloaded yet
2026-03-25 18:33:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 72bcfac5-765c-56a3-8f36-3234e82ae920 with identifier: 1983198
2026-03-25 18:33:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 72bcfac5-765c-56a3-8f36-3234e82ae920 with identifier: 1983198
2026-03-25 18:33:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 72bcfac5-765c-56a3-8f36-3234e82ae920 with identifier: 1983198 to the API
2026-03-25 18:33:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/960/931bc358219444b3b1c53f5ed8b32b56/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 241,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '3.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '72bcfac5-765c-56a3-8f36-3234e82ae920',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLE',
 'odometer': 66785,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72bcfac5-765c-56a3-8f36-3234e82ae920/72bcfac5-765c-56a3-8f36-3234e82ae920_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 452117,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/960/931bc358219444b3b1c53f5ed8b32b56/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLE AMG GLE 53 4MATIC+',
 'transmission': 'manual',
 'trim': 'AMG GLE 53 4MATIC+',
 'vin': None,
 'year': 2022}
2026-03-25 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983198%27 HTTP/1.1" 200 None
2026-03-25 18:33:11 [ayvens.es] INFO: Saving data for 1983198: {'created_time': 1774463591.228055, 'last_price_update_time': 1774463591.228065, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983198') HTTP/1.1" 204 0
2026-03-25 18:33:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0707208e-e750-5e7c-bdfc-56e185672570 with identifier: 1983200
2026-03-25 18:33:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0707208e-e750-5e7c-bdfc-56e185672570 with identifier: 1983200
2026-03-25 18:33:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0707208e-e750-5e7c-bdfc-56e185672570 with identifier: 1983200 to the API
2026-03-25 18:33:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/735/97f0d1ec7b6e4049a83f83e4a4bf5c01/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '0707208e-e750-5e7c-bdfc-56e185672570',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ATECA',
 'odometer': 41476,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0707208e-e750-5e7c-bdfc-56e185672570/0707208e-e750-5e7c-bdfc-56e185672570_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 349203,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/735/97f0d1ec7b6e4049a83f83e4a4bf5c01/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ATECA 2.0 TDI 85kW (115CV) S&S Style Go M',
 'transmission': 'manual',
 'trim': '2.0 TDI 85kW (115CV) S&S Style Go M',
 'vin': None,
 'year': 2021}
2026-03-25 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983200%27 HTTP/1.1" 200 None
2026-03-25 18:33:11 [ayvens.es] INFO: Saving data for 1983200: {'created_time': 1774463591.626888, 'last_price_update_time': 1774463591.626899, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983200') HTTP/1.1" 204 0
2026-03-25 18:33:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a1c70fa3-a276-558c-be18-1af36f66d5b2 with identifier: 1983202
2026-03-25 18:33:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a1c70fa3-a276-558c-be18-1af36f66d5b2 with identifier: 1983202
2026-03-25 18:33:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a1c70fa3-a276-558c-be18-1af36f66d5b2 with identifier: 1983202 to the API
2026-03-25 18:33:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/559/7e07d2329fbd431bbfb5130c4bfe1067/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Azul',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'a1c70fa3-a276-558c-be18-1af36f66d5b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A1',
 'odometer': 105977,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1c70fa3-a276-558c-be18-1af36f66d5b2/a1c70fa3-a276-558c-be18-1af36f66d5b2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 333331,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/559/7e07d2329fbd431bbfb5130c4bfe1067/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A1 Sportback Black line 30 TFSI 85kW S tron',
 'transmission': 'manual',
 'trim': 'Sportback Black line 30 TFSI 85kW S tron',
 'vin': None,
 'year': 2020}
2026-03-25 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983202%27 HTTP/1.1" 200 None
2026-03-25 18:33:11 [ayvens.es] INFO: Saving data for 1983202: {'created_time': 1774463591.972185, 'last_price_update_time': 1774463591.972198, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983202') HTTP/1.1" 204 0
2026-03-25 18:33:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c2a80a91-70fc-54bc-b7db-58845acf0f80 with identifier: 1983201
2026-03-25 18:33:11 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:33:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c2a80a91-70fc-54bc-b7db-58845acf0f80 with identifier: 1983201
2026-03-25 18:33:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c2a80a91-70fc-54bc-b7db-58845acf0f80 with identifier: 1983201 to the API
2026-03-25 18:33:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/443/4c6346256f60482abaf799463a57444b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 175,
 'color': 'Vulcano',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'c2a80a91-70fc-54bc-b7db-58845acf0f80',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'ALFA ROMEO',
 'model': 'STELVIO',
 'odometer': 91652,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2a80a91-70fc-54bc-b7db-58845acf0f80/c2a80a91-70fc-54bc-b7db-58845acf0f80_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 501079,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/443/4c6346256f60482abaf799463a57444b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'ALFA ROMEO STELVIO 2.0 Gasolina 206kW (280CV) Executive AWD',
 'transmission': 'manual',
 'trim': '2.0 Gasolina 206kW (280CV) Executive AWD',
 'vin': None,
 'year': 2019}
2026-03-25 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983201%27 HTTP/1.1" 200 None
2026-03-25 18:33:12 [ayvens.es] INFO: Saving data for 1983201: {'created_time': 1774463592.323264, 'last_price_update_time': 1774463592.323275, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983201') HTTP/1.1" 204 0
2026-03-25 18:33:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/793/a9b5bd987cdc40d79e428158199af32b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/116/08daf5b2e4664934b50828173a6bdadb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:12 [ayvens.es] INFO: Found listing with ID: 1983212
2026-03-25 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983212%27 HTTP/1.1" 200 None
2026-03-25 18:33:12 [ayvens.es] INFO: Scrape type for 1983212: 1
2026-03-25 18:33:12 [ayvens.es] INFO: Extracting data for car ID: 1983212
2026-03-25 18:33:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31daa97e-ea2c-521e-976b-56fce830e864 with identifier: 1983212
2026-03-25 18:33:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31daa97e-ea2c-521e-976b-56fce830e864 with scrape type 1
2026-03-25 18:33:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 31daa97e-ea2c-521e-976b-56fce830e864
2026-03-25 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F259%252F24fba156fa284347a864fabd6ebe5f43%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/259/24fba156fa284347a864fabd6ebe5f43/images/large/1.jpg not downloaded yet
2026-03-25 18:33:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/391/be0fee9fc6dc4cae8208c1cc979f8929/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ee597d0>
2026-03-25 18:33:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d7e63e0-d71e-572c-951c-1713543b4596/9d7e63e0-d71e-572c-951c-1713543b4596_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F351%252Fb0af05bb2f4c481e81b3b3298195bb82%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/351/b0af05bb2f4c481e81b3b3298195bb82/images/large/1.jpg saved to cache
2026-03-25 18:33:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9d7e63e0-d71e-572c-951c-1713543b4596
2026-03-25 18:33:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9d7e63e0-d71e-572c-951c-1713543b4596, skipping ID generation
2026-03-25 18:33:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d7e63e0-d71e-572c-951c-1713543b4596 with scrape type 1
2026-03-25 18:33:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9d7e63e0-d71e-572c-951c-1713543b4596 sending to next pipeline
2026-03-25 18:33:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9d7e63e0-d71e-572c-951c-1713543b4596, identifier: 1983204
2026-03-25 18:33:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8f0cbc90>
2026-03-25 18:33:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ba84f69-88a0-5c8c-9cc2-babced0981c0/7ba84f69-88a0-5c8c-9cc2-babced0981c0_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F540%252F65bc0817483441adbe827e0536eac6cc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/540/65bc0817483441adbe827e0536eac6cc/images/large/1.jpg saved to cache
2026-03-25 18:33:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7ba84f69-88a0-5c8c-9cc2-babced0981c0
2026-03-25 18:33:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7ba84f69-88a0-5c8c-9cc2-babced0981c0, skipping ID generation
2026-03-25 18:33:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ba84f69-88a0-5c8c-9cc2-babced0981c0 with scrape type 1
2026-03-25 18:33:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7ba84f69-88a0-5c8c-9cc2-babced0981c0 sending to next pipeline
2026-03-25 18:33:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7ba84f69-88a0-5c8c-9cc2-babced0981c0, identifier: 1983203
2026-03-25 18:33:12 [ayvens.es] INFO: Found listing with ID: 1983213
2026-03-25 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983213%27 HTTP/1.1" 200 None
2026-03-25 18:33:12 [ayvens.es] INFO: Scrape type for 1983213: 1
2026-03-25 18:33:12 [ayvens.es] INFO: Extracting data for car ID: 1983213
2026-03-25 18:33:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ad27d83-e323-5d18-8bde-e516e1a9c4a7 with identifier: 1983213
2026-03-25 18:33:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ad27d83-e323-5d18-8bde-e516e1a9c4a7 with scrape type 1
2026-03-25 18:33:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9ad27d83-e323-5d18-8bde-e516e1a9c4a7
2026-03-25 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F011%252Fac3a4caf32ce45a8bdf804a1ef99edfa%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/011/ac3a4caf32ce45a8bdf804a1ef99edfa/images/large/1.jpg not downloaded yet
2026-03-25 18:33:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9d7e63e0-d71e-572c-951c-1713543b4596 with identifier: 1983204
2026-03-25 18:33:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9d7e63e0-d71e-572c-951c-1713543b4596 with identifier: 1983204
2026-03-25 18:33:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9d7e63e0-d71e-572c-951c-1713543b4596 with identifier: 1983204 to the API
2026-03-25 18:33:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/351/b0af05bb2f4c481e81b3b3298195bb82/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '9d7e63e0-d71e-572c-951c-1713543b4596',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C4',
 'odometer': 172767,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d7e63e0-d71e-572c-951c-1713543b4596/9d7e63e0-d71e-572c-951c-1713543b4596_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 352638,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/351/b0af05bb2f4c481e81b3b3298195bb82/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C4 BlueHDi 130 S&S EAT8 Shine',
 'transmission': 'manual',
 'trim': 'BlueHDi 130 S&S EAT8 Shine',
 'vin': None,
 'year': 2022}
2026-03-25 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983204%27 HTTP/1.1" 200 None
2026-03-25 18:33:13 [ayvens.es] INFO: Saving data for 1983204: {'created_time': 1774463593.853785, 'last_price_update_time': 1774463593.853795, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983204') HTTP/1.1" 204 0
2026-03-25 18:33:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7ba84f69-88a0-5c8c-9cc2-babced0981c0 with identifier: 1983203
2026-03-25 18:33:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7ba84f69-88a0-5c8c-9cc2-babced0981c0 with identifier: 1983203
2026-03-25 18:33:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7ba84f69-88a0-5c8c-9cc2-babced0981c0 with identifier: 1983203 to the API
2026-03-25 18:33:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/540/65bc0817483441adbe827e0536eac6cc/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '7ba84f69-88a0-5c8c-9cc2-babced0981c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A6',
 'odometer': 46287,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ba84f69-88a0-5c8c-9cc2-babced0981c0/7ba84f69-88a0-5c8c-9cc2-babced0981c0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 627509,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/540/65bc0817483441adbe827e0536eac6cc/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A6 35 TDI 120kW (163CV) S tronic',
 'transmission': 'manual',
 'trim': '35 TDI 120kW (163CV) S tronic',
 'vin': None,
 'year': 2021}
2026-03-25 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983203%27 HTTP/1.1" 200 None
2026-03-25 18:33:14 [ayvens.es] INFO: Saving data for 1983203: {'created_time': 1774463594.349919, 'last_price_update_time': 1774463594.349931, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983203') HTTP/1.1" 204 0
2026-03-25 18:33:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/786/089ba18f258e45858ef9b155da61eeb1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:14 [ayvens.es] INFO: Found listing with ID: 1983214
2026-03-25 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983214%27 HTTP/1.1" 200 None
2026-03-25 18:33:14 [ayvens.es] INFO: Scrape type for 1983214: 1
2026-03-25 18:33:14 [ayvens.es] INFO: Extracting data for car ID: 1983214
2026-03-25 18:33:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff32e529-c514-538b-addf-149a77d97328 with identifier: 1983214
2026-03-25 18:33:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff32e529-c514-538b-addf-149a77d97328 with scrape type 1
2026-03-25 18:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ff32e529-c514-538b-addf-149a77d97328
2026-03-25 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F693%252Fc05f50600faf4f8c96b562778e4e562e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/693/c05f50600faf4f8c96b562778e4e562e/images/large/1.jpg not downloaded yet
2026-03-25 18:33:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/792/32b80352fa744794b404b8518cd70b0d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e55eb10>
2026-03-25 18:33:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4629a284-38c4-5756-9b8e-221ff331da09/4629a284-38c4-5756-9b8e-221ff331da09_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F793%252Fa9b5bd987cdc40d79e428158199af32b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/793/a9b5bd987cdc40d79e428158199af32b/images/large/1.jpg saved to cache
2026-03-25 18:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4629a284-38c4-5756-9b8e-221ff331da09
2026-03-25 18:33:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4629a284-38c4-5756-9b8e-221ff331da09, skipping ID generation
2026-03-25 18:33:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4629a284-38c4-5756-9b8e-221ff331da09 with scrape type 1
2026-03-25 18:33:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4629a284-38c4-5756-9b8e-221ff331da09 sending to next pipeline
2026-03-25 18:33:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4629a284-38c4-5756-9b8e-221ff331da09, identifier: 1983205
2026-03-25 18:33:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ee7a5d0>
2026-03-25 18:33:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4adcf44c-ddd1-5607-b6a9-fe2d84ebc40e/4adcf44c-ddd1-5607-b6a9-fe2d84ebc40e_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F116%252F08daf5b2e4664934b50828173a6bdadb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/116/08daf5b2e4664934b50828173a6bdadb/images/large/1.jpg saved to cache
2026-03-25 18:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4adcf44c-ddd1-5607-b6a9-fe2d84ebc40e
2026-03-25 18:33:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4adcf44c-ddd1-5607-b6a9-fe2d84ebc40e, skipping ID generation
2026-03-25 18:33:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4adcf44c-ddd1-5607-b6a9-fe2d84ebc40e with scrape type 1
2026-03-25 18:33:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4adcf44c-ddd1-5607-b6a9-fe2d84ebc40e sending to next pipeline
2026-03-25 18:33:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4adcf44c-ddd1-5607-b6a9-fe2d84ebc40e, identifier: 1983206
2026-03-25 18:33:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ea82410>
2026-03-25 18:33:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eed4c71f-b770-548f-907e-cfc16b94855e/eed4c71f-b770-548f-907e-cfc16b94855e_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F391%252Fbe0fee9fc6dc4cae8208c1cc979f8929%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/391/be0fee9fc6dc4cae8208c1cc979f8929/images/large/1.jpg saved to cache
2026-03-25 18:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eed4c71f-b770-548f-907e-cfc16b94855e
2026-03-25 18:33:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eed4c71f-b770-548f-907e-cfc16b94855e, skipping ID generation
2026-03-25 18:33:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eed4c71f-b770-548f-907e-cfc16b94855e with scrape type 1
2026-03-25 18:33:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eed4c71f-b770-548f-907e-cfc16b94855e sending to next pipeline
2026-03-25 18:33:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: eed4c71f-b770-548f-907e-cfc16b94855e, identifier: 1983207
2026-03-25 18:33:14 [ayvens.es] INFO: Found listing with ID: 1983215
2026-03-25 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983215%27 HTTP/1.1" 200 None
2026-03-25 18:33:14 [ayvens.es] INFO: Scrape type for 1983215: 1
2026-03-25 18:33:14 [ayvens.es] INFO: Extracting data for car ID: 1983215
2026-03-25 18:33:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40136e21-40ef-58c7-a992-ad6d1f49a7c2 with identifier: 1983215
2026-03-25 18:33:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40136e21-40ef-58c7-a992-ad6d1f49a7c2 with scrape type 1
2026-03-25 18:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 40136e21-40ef-58c7-a992-ad6d1f49a7c2
2026-03-25 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F386%252F1f9289bf6766428a96f56dc8d166e226%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/386/1f9289bf6766428a96f56dc8d166e226/images/large/1.jpg not downloaded yet
2026-03-25 18:33:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4629a284-38c4-5756-9b8e-221ff331da09 with identifier: 1983205
2026-03-25 18:33:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4629a284-38c4-5756-9b8e-221ff331da09 with identifier: 1983205
2026-03-25 18:33:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 4629a284-38c4-5756-9b8e-221ff331da09 with identifier: 1983205 to the API
2026-03-25 18:33:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/793/a9b5bd987cdc40d79e428158199af32b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '4629a284-38c4-5756-9b8e-221ff331da09',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C4 AIRCROSS',
 'odometer': 240862,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4629a284-38c4-5756-9b8e-221ff331da09/4629a284-38c4-5756-9b8e-221ff331da09_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 509501,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/793/a9b5bd987cdc40d79e428158199af32b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C4 AIRCROSS HDi 115 Stop & Start 6v 4WD Shine',
 'transmission': 'manual',
 'trim': 'HDi 115 Stop & Start 6v 4WD Shine',
 'vin': None,
 'year': 2017}
2026-03-25 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983205%27 HTTP/1.1" 200 None
2026-03-25 18:33:15 [ayvens.es] INFO: Saving data for 1983205: {'created_time': 1774463595.180826, 'last_price_update_time': 1774463595.180837, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983205') HTTP/1.1" 204 0
2026-03-25 18:33:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4adcf44c-ddd1-5607-b6a9-fe2d84ebc40e with identifier: 1983206
2026-03-25 18:33:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4adcf44c-ddd1-5607-b6a9-fe2d84ebc40e with identifier: 1983206
2026-03-25 18:33:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 4adcf44c-ddd1-5607-b6a9-fe2d84ebc40e with identifier: 1983206 to the API
2026-03-25 18:33:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/116/08daf5b2e4664934b50828173a6bdadb/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '4adcf44c-ddd1-5607-b6a9-fe2d84ebc40e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'S-MAX',
 'odometer': 130973,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4adcf44c-ddd1-5607-b6a9-fe2d84ebc40e/4adcf44c-ddd1-5607-b6a9-fe2d84ebc40e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347157,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/116/08daf5b2e4664934b50828173a6bdadb/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-29',
 'seats_number': 7,
 'seller_name': None,
 'title': 'FORD S-MAX 2.0 TDCi 132kW ST-Line PowerShift',
 'transmission': 'manual',
 'trim': '2.0 TDCi 132kW ST-Line PowerShift',
 'vin': None,
 'year': 2018}
2026-03-25 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983206%27 HTTP/1.1" 200 None
2026-03-25 18:33:15 [ayvens.es] INFO: Saving data for 1983206: {'created_time': 1774463595.557991, 'last_price_update_time': 1774463595.558, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983206') HTTP/1.1" 204 0
2026-03-25 18:33:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: eed4c71f-b770-548f-907e-cfc16b94855e with identifier: 1983207
2026-03-25 18:33:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: eed4c71f-b770-548f-907e-cfc16b94855e with identifier: 1983207
2026-03-25 18:33:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: eed4c71f-b770-548f-907e-cfc16b94855e with identifier: 1983207 to the API
2026-03-25 18:33:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/391/be0fee9fc6dc4cae8208c1cc979f8929/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 185,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'eed4c71f-b770-548f-907e-cfc16b94855e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT CUSTOM',
 'odometer': 87669,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eed4c71f-b770-548f-907e-cfc16b94855e/eed4c71f-b770-548f-907e-cfc16b94855e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329132,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/391/be0fee9fc6dc4cae8208c1cc979f8929/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-13',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT CUSTOM Van 2.0 TDCI 96kW 280 L1 MHEV Ambiente',
 'transmission': 'manual',
 'trim': 'Van 2.0 TDCI 96kW 280 L1 MHEV Ambiente',
 'vin': None,
 'year': 2021}
2026-03-25 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983207%27 HTTP/1.1" 200 None
2026-03-25 18:33:15 [ayvens.es] INFO: Saving data for 1983207: {'created_time': 1774463595.893728, 'last_price_update_time': 1774463595.893738, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983207') HTTP/1.1" 204 0
2026-03-25 18:33:15 [ayvens.es] INFO: Found listing with ID: 1983216
2026-03-25 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983216%27 HTTP/1.1" 200 None
2026-03-25 18:33:15 [ayvens.es] INFO: Scrape type for 1983216: 1
2026-03-25 18:33:15 [ayvens.es] INFO: Extracting data for car ID: 1983216
2026-03-25 18:33:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7a8b8e3-82ec-507f-8f26-d32f7e4193db with identifier: 1983216
2026-03-25 18:33:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7a8b8e3-82ec-507f-8f26-d32f7e4193db with scrape type 1
2026-03-25 18:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d7a8b8e3-82ec-507f-8f26-d32f7e4193db
2026-03-25 18:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F400%252F8ddda1b383624d1fbbe664f79b040ab3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/400/8ddda1b383624d1fbbe664f79b040ab3/images/large/1.jpg not downloaded yet
2026-03-25 18:33:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/816/3f1df8268a4a40adac7e8373ac021bc9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e55de50>
2026-03-25 18:33:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42230679-5867-597c-952c-bea636d0fddb/42230679-5867-597c-952c-bea636d0fddb_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F786%252F089ba18f258e45858ef9b155da61eeb1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/786/089ba18f258e45858ef9b155da61eeb1/images/large/1.jpg saved to cache
2026-03-25 18:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 42230679-5867-597c-952c-bea636d0fddb
2026-03-25 18:33:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 42230679-5867-597c-952c-bea636d0fddb, skipping ID generation
2026-03-25 18:33:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42230679-5867-597c-952c-bea636d0fddb with scrape type 1
2026-03-25 18:33:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 42230679-5867-597c-952c-bea636d0fddb sending to next pipeline
2026-03-25 18:33:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 42230679-5867-597c-952c-bea636d0fddb, identifier: 1983208
2026-03-25 18:33:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e5c88d0>
2026-03-25 18:33:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e2bc44e-1fa7-5616-bf26-4d366b43b87d/0e2bc44e-1fa7-5616-bf26-4d366b43b87d_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F792%252F32b80352fa744794b404b8518cd70b0d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/792/32b80352fa744794b404b8518cd70b0d/images/large/1.jpg saved to cache
2026-03-25 18:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0e2bc44e-1fa7-5616-bf26-4d366b43b87d
2026-03-25 18:33:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0e2bc44e-1fa7-5616-bf26-4d366b43b87d, skipping ID generation
2026-03-25 18:33:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e2bc44e-1fa7-5616-bf26-4d366b43b87d with scrape type 1
2026-03-25 18:33:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0e2bc44e-1fa7-5616-bf26-4d366b43b87d sending to next pipeline
2026-03-25 18:33:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0e2bc44e-1fa7-5616-bf26-4d366b43b87d, identifier: 1983209
2026-03-25 18:33:16 [ayvens.es] INFO: Found listing with ID: 1983217
2026-03-25 18:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983217%27 HTTP/1.1" 200 None
2026-03-25 18:33:16 [ayvens.es] INFO: Scrape type for 1983217: 1
2026-03-25 18:33:16 [ayvens.es] INFO: Extracting data for car ID: 1983217
2026-03-25 18:33:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab040a3c-a2ab-5335-abab-48cacb94932b with identifier: 1983217
2026-03-25 18:33:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab040a3c-a2ab-5335-abab-48cacb94932b with scrape type 1
2026-03-25 18:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ab040a3c-a2ab-5335-abab-48cacb94932b
2026-03-25 18:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F359%252F1f36f98624c24954b7528ba124116c9f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/359/1f36f98624c24954b7528ba124116c9f/images/large/1.jpg not downloaded yet
2026-03-25 18:33:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 42230679-5867-597c-952c-bea636d0fddb with identifier: 1983208
2026-03-25 18:33:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 42230679-5867-597c-952c-bea636d0fddb with identifier: 1983208
2026-03-25 18:33:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 42230679-5867-597c-952c-bea636d0fddb with identifier: 1983208 to the API
2026-03-25 18:33:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/786/089ba18f258e45858ef9b155da61eeb1/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.9L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '42230679-5867-597c-952c-bea636d0fddb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA',
 'odometer': 79949,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42230679-5867-597c-952c-bea636d0fddb/42230679-5867-597c-952c-bea636d0fddb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 349080,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/786/089ba18f258e45858ef9b155da61eeb1/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA CLA 200 D DCT',
 'transmission': 'manual',
 'trim': 'CLA 200 D DCT',
 'vin': None,
 'year': 2020}
2026-03-25 18:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983208%27 HTTP/1.1" 200 None
2026-03-25 18:33:16 [ayvens.es] INFO: Saving data for 1983208: {'created_time': 1774463596.748729, 'last_price_update_time': 1774463596.74874, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983208') HTTP/1.1" 204 0
2026-03-25 18:33:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0e2bc44e-1fa7-5616-bf26-4d366b43b87d with identifier: 1983209
2026-03-25 18:33:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0e2bc44e-1fa7-5616-bf26-4d366b43b87d with identifier: 1983209
2026-03-25 18:33:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0e2bc44e-1fa7-5616-bf26-4d366b43b87d with identifier: 1983209 to the API
2026-03-25 18:33:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/792/32b80352fa744794b404b8518cd70b0d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '0e2bc44e-1fa7-5616-bf26-4d366b43b87d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA',
 'odometer': 109094,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e2bc44e-1fa7-5616-bf26-4d366b43b87d/0e2bc44e-1fa7-5616-bf26-4d366b43b87d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342976,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/792/32b80352fa744794b404b8518cd70b0d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA CLA 200 Shooting Brake',
 'transmission': 'manual',
 'trim': 'CLA 200 Shooting Brake',
 'vin': None,
 'year': 2020}
2026-03-25 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983209%27 HTTP/1.1" 200 None
2026-03-25 18:33:17 [ayvens.es] INFO: Saving data for 1983209: {'created_time': 1774463597.087813, 'last_price_update_time': 1774463597.087824, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983209') HTTP/1.1" 204 0
2026-03-25 18:33:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/604/d40d00b1e5d04110847bdc9e53879d07/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:17 [ayvens.es] INFO: Found listing with ID: 1983218
2026-03-25 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983218%27 HTTP/1.1" 200 None
2026-03-25 18:33:17 [ayvens.es] INFO: Scrape type for 1983218: 1
2026-03-25 18:33:17 [ayvens.es] INFO: Extracting data for car ID: 1983218
2026-03-25 18:33:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5c5869c-9944-5f1b-acf7-d5d69776b825 with identifier: 1983218
2026-03-25 18:33:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5c5869c-9944-5f1b-acf7-d5d69776b825 with scrape type 1
2026-03-25 18:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f5c5869c-9944-5f1b-acf7-d5d69776b825
2026-03-25 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F305%252F8e0f922b5ac841f2b1092b2c5b46a0a7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/305/8e0f922b5ac841f2b1092b2c5b46a0a7/images/large/1.jpg not downloaded yet
2026-03-25 18:33:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/011/ac3a4caf32ce45a8bdf804a1ef99edfa/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ea640d0>
2026-03-25 18:33:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3da08d9-48ad-56ea-ac91-2f93d1c18b3f/e3da08d9-48ad-56ea-ac91-2f93d1c18b3f_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F816%252F3f1df8268a4a40adac7e8373ac021bc9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/816/3f1df8268a4a40adac7e8373ac021bc9/images/large/1.jpg saved to cache
2026-03-25 18:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e3da08d9-48ad-56ea-ac91-2f93d1c18b3f
2026-03-25 18:33:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e3da08d9-48ad-56ea-ac91-2f93d1c18b3f, skipping ID generation
2026-03-25 18:33:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3da08d9-48ad-56ea-ac91-2f93d1c18b3f with scrape type 1
2026-03-25 18:33:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e3da08d9-48ad-56ea-ac91-2f93d1c18b3f sending to next pipeline
2026-03-25 18:33:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e3da08d9-48ad-56ea-ac91-2f93d1c18b3f, identifier: 1983211
2026-03-25 18:33:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/259/24fba156fa284347a864fabd6ebe5f43/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:17 [ayvens.es] INFO: Found listing with ID: 1983219
2026-03-25 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983219%27 HTTP/1.1" 200 None
2026-03-25 18:33:17 [ayvens.es] INFO: Scrape type for 1983219: 1
2026-03-25 18:33:17 [ayvens.es] INFO: Extracting data for car ID: 1983219
2026-03-25 18:33:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36d238a8-ae20-5b4e-867a-b64a3670a6ad with identifier: 1983219
2026-03-25 18:33:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36d238a8-ae20-5b4e-867a-b64a3670a6ad with scrape type 1
2026-03-25 18:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 36d238a8-ae20-5b4e-867a-b64a3670a6ad
2026-03-25 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F463%252F5aa0212abd1242e2bd4a242102991f31%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/463/5aa0212abd1242e2bd4a242102991f31/images/large/1.jpg not downloaded yet
2026-03-25 18:33:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e3da08d9-48ad-56ea-ac91-2f93d1c18b3f with identifier: 1983211
2026-03-25 18:33:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e3da08d9-48ad-56ea-ac91-2f93d1c18b3f with identifier: 1983211
2026-03-25 18:33:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e3da08d9-48ad-56ea-ac91-2f93d1c18b3f with identifier: 1983211 to the API
2026-03-25 18:33:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/816/3f1df8268a4a40adac7e8373ac021bc9/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'e3da08d9-48ad-56ea-ac91-2f93d1c18b3f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'IBIZA',
 'odometer': 110811,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3da08d9-48ad-56ea-ac91-2f93d1c18b3f/e3da08d9-48ad-56ea-ac91-2f93d1c18b3f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 350952,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/816/3f1df8268a4a40adac7e8373ac021bc9/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT IBIZA 1.0 EcoTSI 70kW (95CV) Style',
 'transmission': 'manual',
 'trim': '1.0 EcoTSI 70kW (95CV) Style',
 'vin': None,
 'year': 2019}
2026-03-25 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983211%27 HTTP/1.1" 200 None
2026-03-25 18:33:17 [ayvens.es] INFO: Saving data for 1983211: {'created_time': 1774463597.841007, 'last_price_update_time': 1774463597.841021, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983211') HTTP/1.1" 204 0
2026-03-25 18:33:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/693/c05f50600faf4f8c96b562778e4e562e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:17 [ayvens.es] INFO: Found listing with ID: 1983220
2026-03-25 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983220%27 HTTP/1.1" 200 None
2026-03-25 18:33:17 [ayvens.es] INFO: Scrape type for 1983220: 1
2026-03-25 18:33:17 [ayvens.es] INFO: Extracting data for car ID: 1983220
2026-03-25 18:33:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c214ccc5-2dff-5f40-a3a6-052893e65fc4 with identifier: 1983220
2026-03-25 18:33:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c214ccc5-2dff-5f40-a3a6-052893e65fc4 with scrape type 1
2026-03-25 18:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c214ccc5-2dff-5f40-a3a6-052893e65fc4
2026-03-25 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F185%252F93bbf82498b644c486bb04cd251ddb29%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/185/93bbf82498b644c486bb04cd251ddb29/images/large/1.jpg not downloaded yet
2026-03-25 18:33:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/386/1f9289bf6766428a96f56dc8d166e226/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ea663d0>
2026-03-25 18:33:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa330f10-1938-5527-8508-4fd8f6fa240f/aa330f10-1938-5527-8508-4fd8f6fa240f_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F604%252Fd40d00b1e5d04110847bdc9e53879d07%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/604/d40d00b1e5d04110847bdc9e53879d07/images/large/1.jpg saved to cache
2026-03-25 18:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aa330f10-1938-5527-8508-4fd8f6fa240f
2026-03-25 18:33:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aa330f10-1938-5527-8508-4fd8f6fa240f, skipping ID generation
2026-03-25 18:33:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa330f10-1938-5527-8508-4fd8f6fa240f with scrape type 1
2026-03-25 18:33:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aa330f10-1938-5527-8508-4fd8f6fa240f sending to next pipeline
2026-03-25 18:33:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: aa330f10-1938-5527-8508-4fd8f6fa240f, identifier: 1983210
2026-03-25 18:33:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ec470d0>
2026-03-25 18:33:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ad27d83-e323-5d18-8bde-e516e1a9c4a7/9ad27d83-e323-5d18-8bde-e516e1a9c4a7_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F011%252Fac3a4caf32ce45a8bdf804a1ef99edfa%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/011/ac3a4caf32ce45a8bdf804a1ef99edfa/images/large/1.jpg saved to cache
2026-03-25 18:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9ad27d83-e323-5d18-8bde-e516e1a9c4a7
2026-03-25 18:33:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9ad27d83-e323-5d18-8bde-e516e1a9c4a7, skipping ID generation
2026-03-25 18:33:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ad27d83-e323-5d18-8bde-e516e1a9c4a7 with scrape type 1
2026-03-25 18:33:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9ad27d83-e323-5d18-8bde-e516e1a9c4a7 sending to next pipeline
2026-03-25 18:33:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9ad27d83-e323-5d18-8bde-e516e1a9c4a7, identifier: 1983213
2026-03-25 18:33:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e55f190>
2026-03-25 18:33:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31daa97e-ea2c-521e-976b-56fce830e864/31daa97e-ea2c-521e-976b-56fce830e864_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F259%252F24fba156fa284347a864fabd6ebe5f43%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/259/24fba156fa284347a864fabd6ebe5f43/images/large/1.jpg saved to cache
2026-03-25 18:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 31daa97e-ea2c-521e-976b-56fce830e864
2026-03-25 18:33:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 31daa97e-ea2c-521e-976b-56fce830e864, skipping ID generation
2026-03-25 18:33:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31daa97e-ea2c-521e-976b-56fce830e864 with scrape type 1
2026-03-25 18:33:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 31daa97e-ea2c-521e-976b-56fce830e864 sending to next pipeline
2026-03-25 18:33:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 31daa97e-ea2c-521e-976b-56fce830e864, identifier: 1983212
2026-03-25 18:33:18 [ayvens.es] INFO: Found listing with ID: 1983221
2026-03-25 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983221%27 HTTP/1.1" 200 None
2026-03-25 18:33:18 [ayvens.es] INFO: Scrape type for 1983221: 1
2026-03-25 18:33:18 [ayvens.es] INFO: Extracting data for car ID: 1983221
2026-03-25 18:33:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 425fa02c-e26d-5b74-89c7-fc7eab7a6670 with identifier: 1983221
2026-03-25 18:33:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 425fa02c-e26d-5b74-89c7-fc7eab7a6670 with scrape type 1
2026-03-25 18:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 425fa02c-e26d-5b74-89c7-fc7eab7a6670
2026-03-25 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F351%252F796c25f813ae4807b6a5b62b313eaadf%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/351/796c25f813ae4807b6a5b62b313eaadf/images/large/1.jpg not downloaded yet
2026-03-25 18:33:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: aa330f10-1938-5527-8508-4fd8f6fa240f with identifier: 1983210
2026-03-25 18:33:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: aa330f10-1938-5527-8508-4fd8f6fa240f with identifier: 1983210
2026-03-25 18:33:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: aa330f10-1938-5527-8508-4fd8f6fa240f with identifier: 1983210 to the API
2026-03-25 18:33:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/604/d40d00b1e5d04110847bdc9e53879d07/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Rojo',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'aa330f10-1938-5527-8508-4fd8f6fa240f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO',
 'odometer': 102217,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa330f10-1938-5527-8508-4fd8f6fa240f/aa330f10-1938-5527-8508-4fd8f6fa240f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 579966,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/604/d40d00b1e5d04110847bdc9e53879d07/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT KANGOO (O) Profes. M1-AF Blue dCi 59 kW (80 CV) -SS',
 'transmission': 'manual',
 'trim': '(O) Profes. M1-AF Blue dCi 59 kW (80 CV) -SS',
 'vin': None,
 'year': 2021}
2026-03-25 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983210%27 HTTP/1.1" 200 None
2026-03-25 18:33:18 [ayvens.es] INFO: Saving data for 1983210: {'created_time': 1774463598.634302, 'last_price_update_time': 1774463598.634315, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983210') HTTP/1.1" 204 0
2026-03-25 18:33:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9ad27d83-e323-5d18-8bde-e516e1a9c4a7 with identifier: 1983213
2026-03-25 18:33:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9ad27d83-e323-5d18-8bde-e516e1a9c4a7 with identifier: 1983213
2026-03-25 18:33:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9ad27d83-e323-5d18-8bde-e516e1a9c4a7 with identifier: 1983213 to the API
2026-03-25 18:33:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/011/ac3a4caf32ce45a8bdf804a1ef99edfa/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '9ad27d83-e323-5d18-8bde-e516e1a9c4a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C3',
 'odometer': 84802,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ad27d83-e323-5d18-8bde-e516e1a9c4a7/9ad27d83-e323-5d18-8bde-e516e1a9c4a7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 349073,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/011/ac3a4caf32ce45a8bdf804a1ef99edfa/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C3 PureTech 60KW (83CV) Feel Pack',
 'transmission': 'manual',
 'trim': 'PureTech 60KW (83CV) Feel Pack',
 'vin': None,
 'year': 2022}
2026-03-25 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983213%27 HTTP/1.1" 200 None
2026-03-25 18:33:18 [ayvens.es] INFO: Saving data for 1983213: {'created_time': 1774463598.977261, 'last_price_update_time': 1774463598.97727, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983213') HTTP/1.1" 204 0
2026-03-25 18:33:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 31daa97e-ea2c-521e-976b-56fce830e864 with identifier: 1983212
2026-03-25 18:33:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 31daa97e-ea2c-521e-976b-56fce830e864 with identifier: 1983212
2026-03-25 18:33:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 31daa97e-ea2c-521e-976b-56fce830e864 with identifier: 1983212 to the API
2026-03-25 18:33:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/259/24fba156fa284347a864fabd6ebe5f43/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '31daa97e-ea2c-521e-976b-56fce830e864',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3',
 'odometer': 90870,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31daa97e-ea2c-521e-976b-56fce830e864/31daa97e-ea2c-521e-976b-56fce830e864_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 476596,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/259/24fba156fa284347a864fabd6ebe5f43/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 Advanced 35 TDI 110kW (150CV) S tronic',
 'transmission': 'manual',
 'trim': 'Advanced 35 TDI 110kW (150CV) S tronic',
 'vin': None,
 'year': 2022}
2026-03-25 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983212%27 HTTP/1.1" 200 None
2026-03-25 18:33:19 [ayvens.es] INFO: Saving data for 1983212: {'created_time': 1774463599.438773, 'last_price_update_time': 1774463599.438783, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983212') HTTP/1.1" 204 0
2026-03-25 18:33:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/400/8ddda1b383624d1fbbe664f79b040ab3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:19 [ayvens.es] INFO: Found listing with ID: 1983222
2026-03-25 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983222%27 HTTP/1.1" 200 None
2026-03-25 18:33:19 [ayvens.es] INFO: Scrape type for 1983222: 1
2026-03-25 18:33:19 [ayvens.es] INFO: Extracting data for car ID: 1983222
2026-03-25 18:33:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcebbca7-75de-5a0c-9c82-265c0e311534 with identifier: 1983222
2026-03-25 18:33:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcebbca7-75de-5a0c-9c82-265c0e311534 with scrape type 1
2026-03-25 18:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item fcebbca7-75de-5a0c-9c82-265c0e311534
2026-03-25 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F041%252F2b6f81b325b64f06b7621b68e241234b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/041/2b6f81b325b64f06b7621b68e241234b/images/large/1.jpg not downloaded yet
2026-03-25 18:33:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/359/1f36f98624c24954b7528ba124116c9f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8d4147d0>
2026-03-25 18:33:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff32e529-c514-538b-addf-149a77d97328/ff32e529-c514-538b-addf-149a77d97328_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F693%252Fc05f50600faf4f8c96b562778e4e562e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/693/c05f50600faf4f8c96b562778e4e562e/images/large/1.jpg saved to cache
2026-03-25 18:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ff32e529-c514-538b-addf-149a77d97328
2026-03-25 18:33:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ff32e529-c514-538b-addf-149a77d97328, skipping ID generation
2026-03-25 18:33:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff32e529-c514-538b-addf-149a77d97328 with scrape type 1
2026-03-25 18:33:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ff32e529-c514-538b-addf-149a77d97328 sending to next pipeline
2026-03-25 18:33:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ff32e529-c514-538b-addf-149a77d97328, identifier: 1983214
2026-03-25 18:33:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae9091fb10>
2026-03-25 18:33:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40136e21-40ef-58c7-a992-ad6d1f49a7c2/40136e21-40ef-58c7-a992-ad6d1f49a7c2_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F386%252F1f9289bf6766428a96f56dc8d166e226%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/386/1f9289bf6766428a96f56dc8d166e226/images/large/1.jpg saved to cache
2026-03-25 18:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 40136e21-40ef-58c7-a992-ad6d1f49a7c2
2026-03-25 18:33:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 40136e21-40ef-58c7-a992-ad6d1f49a7c2, skipping ID generation
2026-03-25 18:33:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40136e21-40ef-58c7-a992-ad6d1f49a7c2 with scrape type 1
2026-03-25 18:33:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 40136e21-40ef-58c7-a992-ad6d1f49a7c2 sending to next pipeline
2026-03-25 18:33:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 40136e21-40ef-58c7-a992-ad6d1f49a7c2, identifier: 1983215
2026-03-25 18:33:19 [ayvens.es] INFO: Found listing with ID: 1983223
2026-03-25 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983223%27 HTTP/1.1" 200 None
2026-03-25 18:33:19 [ayvens.es] INFO: Scrape type for 1983223: 1
2026-03-25 18:33:19 [ayvens.es] INFO: Extracting data for car ID: 1983223
2026-03-25 18:33:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9daba332-e4fb-5c9e-90ec-db931433510e with identifier: 1983223
2026-03-25 18:33:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9daba332-e4fb-5c9e-90ec-db931433510e with scrape type 1
2026-03-25 18:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9daba332-e4fb-5c9e-90ec-db931433510e
2026-03-25 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F026%252Fb970b4c9962f4583ad7fbdd5af8dcf25%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/026/b970b4c9962f4583ad7fbdd5af8dcf25/images/large/1.jpg not downloaded yet
2026-03-25 18:33:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ff32e529-c514-538b-addf-149a77d97328 with identifier: 1983214
2026-03-25 18:33:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:33:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ff32e529-c514-538b-addf-149a77d97328 with identifier: 1983214
2026-03-25 18:33:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ff32e529-c514-538b-addf-149a77d97328 with identifier: 1983214 to the API
2026-03-25 18:33:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/693/c05f50600faf4f8c96b562778e4e562e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'Crystal',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ff32e529-c514-538b-addf-149a77d97328',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS 4',
 'odometer': 63527,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff32e529-c514-538b-addf-149a77d97328/ff32e529-c514-538b-addf-149a77d97328_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 320389,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/693/c05f50600faf4f8c96b562778e4e562e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS 4 BlueHDi 130 auto BASTILLE +',
 'transmission': 'manual',
 'trim': 'BlueHDi 130 auto BASTILLE +',
 'vin': None,
 'year': 2022}
2026-03-25 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983214%27 HTTP/1.1" 200 None
2026-03-25 18:33:20 [ayvens.es] INFO: Saving data for 1983214: {'created_time': 1774463600.239828, 'last_price_update_time': 1774463600.239842, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983214') HTTP/1.1" 204 0
2026-03-25 18:33:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 40136e21-40ef-58c7-a992-ad6d1f49a7c2 with identifier: 1983215
2026-03-25 18:33:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 40136e21-40ef-58c7-a992-ad6d1f49a7c2 with identifier: 1983215
2026-03-25 18:33:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 40136e21-40ef-58c7-a992-ad6d1f49a7c2 with identifier: 1983215 to the API
2026-03-25 18:33:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/386/1f9289bf6766428a96f56dc8d166e226/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 91,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '40136e21-40ef-58c7-a992-ad6d1f49a7c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'PANDA',
 'odometer': 52416,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40136e21-40ef-58c7-a992-ad6d1f49a7c2/40136e21-40ef-58c7-a992-ad6d1f49a7c2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329553,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/386/1f9289bf6766428a96f56dc8d166e226/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-26',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FIAT PANDA Van Hybrid 1.0 GSE 52kW (70 CV) 2 plazas',
 'transmission': 'manual',
 'trim': 'Van Hybrid 1.0 GSE 52kW (70 CV) 2 plazas',
 'vin': None,
 'year': 2021}
2026-03-25 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983215%27 HTTP/1.1" 200 None
2026-03-25 18:33:20 [ayvens.es] INFO: Saving data for 1983215: {'created_time': 1774463600.6382, 'last_price_update_time': 1774463600.638211, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983215') HTTP/1.1" 204 0
2026-03-25 18:33:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/305/8e0f922b5ac841f2b1092b2c5b46a0a7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:20 [ayvens.es] INFO: Found listing with ID: 1983224
2026-03-25 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983224%27 HTTP/1.1" 200 None
2026-03-25 18:33:20 [ayvens.es] INFO: Scrape type for 1983224: 1
2026-03-25 18:33:20 [ayvens.es] INFO: Extracting data for car ID: 1983224
2026-03-25 18:33:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88e5af8a-c5a4-5065-91bd-f9625fe9bba6 with identifier: 1983224
2026-03-25 18:33:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88e5af8a-c5a4-5065-91bd-f9625fe9bba6 with scrape type 1
2026-03-25 18:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 88e5af8a-c5a4-5065-91bd-f9625fe9bba6
2026-03-25 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F702%252F2e16183ad4b14a619af7088cbda2c01f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/702/2e16183ad4b14a619af7088cbda2c01f/images/large/1.jpg not downloaded yet
2026-03-25 18:33:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8f64aed0>
2026-03-25 18:33:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7a8b8e3-82ec-507f-8f26-d32f7e4193db/d7a8b8e3-82ec-507f-8f26-d32f7e4193db_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F400%252F8ddda1b383624d1fbbe664f79b040ab3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/400/8ddda1b383624d1fbbe664f79b040ab3/images/large/1.jpg saved to cache
2026-03-25 18:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d7a8b8e3-82ec-507f-8f26-d32f7e4193db
2026-03-25 18:33:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d7a8b8e3-82ec-507f-8f26-d32f7e4193db, skipping ID generation
2026-03-25 18:33:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7a8b8e3-82ec-507f-8f26-d32f7e4193db with scrape type 1
2026-03-25 18:33:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d7a8b8e3-82ec-507f-8f26-d32f7e4193db sending to next pipeline
2026-03-25 18:33:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d7a8b8e3-82ec-507f-8f26-d32f7e4193db, identifier: 1983216
2026-03-25 18:33:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8d447890>
2026-03-25 18:33:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab040a3c-a2ab-5335-abab-48cacb94932b/ab040a3c-a2ab-5335-abab-48cacb94932b_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F359%252F1f36f98624c24954b7528ba124116c9f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/359/1f36f98624c24954b7528ba124116c9f/images/large/1.jpg saved to cache
2026-03-25 18:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ab040a3c-a2ab-5335-abab-48cacb94932b
2026-03-25 18:33:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ab040a3c-a2ab-5335-abab-48cacb94932b, skipping ID generation
2026-03-25 18:33:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab040a3c-a2ab-5335-abab-48cacb94932b with scrape type 1
2026-03-25 18:33:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ab040a3c-a2ab-5335-abab-48cacb94932b sending to next pipeline
2026-03-25 18:33:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ab040a3c-a2ab-5335-abab-48cacb94932b, identifier: 1983217
2026-03-25 18:33:21 [ayvens.es] INFO: Found listing with ID: 1983225
2026-03-25 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983225%27 HTTP/1.1" 200 None
2026-03-25 18:33:21 [ayvens.es] INFO: Scrape type for 1983225: 1
2026-03-25 18:33:21 [ayvens.es] INFO: Extracting data for car ID: 1983225
2026-03-25 18:33:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd4d41d6-5421-5048-b19d-d79c0ff5c6a6 with identifier: 1983225
2026-03-25 18:33:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd4d41d6-5421-5048-b19d-d79c0ff5c6a6 with scrape type 1
2026-03-25 18:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item dd4d41d6-5421-5048-b19d-d79c0ff5c6a6
2026-03-25 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F948%252F8aa8f5b5ac1843cfba0349e569f7450d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/948/8aa8f5b5ac1843cfba0349e569f7450d/images/large/1.jpg not downloaded yet
2026-03-25 18:33:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d7a8b8e3-82ec-507f-8f26-d32f7e4193db with identifier: 1983216
2026-03-25 18:33:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:33:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d7a8b8e3-82ec-507f-8f26-d32f7e4193db with identifier: 1983216
2026-03-25 18:33:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d7a8b8e3-82ec-507f-8f26-d32f7e4193db with identifier: 1983216 to the API
2026-03-25 18:33:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/400/8ddda1b383624d1fbbe664f79b040ab3/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 171,
 'color': 'Seoul',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd7a8b8e3-82ec-507f-8f26-d32f7e4193db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER EVOQUE',
 'odometer': 61648,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7a8b8e3-82ec-507f-8f26-d32f7e4193db/d7a8b8e3-82ec-507f-8f26-d32f7e4193db_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353194,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/400/8ddda1b383624d1fbbe664f79b040ab3/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER RANGE ROVER EVOQUE 2.0 D163 R-Dynamic S AUTO 4WD MHEV',
 'transmission': 'manual',
 'trim': '2.0 D163 R-Dynamic S AUTO 4WD MHEV',
 'vin': None,
 'year': 2022}
2026-03-25 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983216%27 HTTP/1.1" 200 None
2026-03-25 18:33:21 [ayvens.es] INFO: Saving data for 1983216: {'created_time': 1774463601.505821, 'last_price_update_time': 1774463601.505833, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983216') HTTP/1.1" 204 0
2026-03-25 18:33:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ab040a3c-a2ab-5335-abab-48cacb94932b with identifier: 1983217
2026-03-25 18:33:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:33:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ab040a3c-a2ab-5335-abab-48cacb94932b with identifier: 1983217
2026-03-25 18:33:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ab040a3c-a2ab-5335-abab-48cacb94932b with identifier: 1983217 to the API
2026-03-25 18:33:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/359/1f36f98624c24954b7528ba124116c9f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Saphirschwarz',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ab040a3c-a2ab-5335-abab-48cacb94932b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'SERIES 1',
 'odometer': 82176,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab040a3c-a2ab-5335-abab-48cacb94932b/ab040a3c-a2ab-5335-abab-48cacb94932b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 360386,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/359/1f36f98624c24954b7528ba124116c9f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW SERIES 1 118d',
 'transmission': 'manual',
 'trim': '118d',
 'vin': None,
 'year': 2022}
2026-03-25 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983217%27 HTTP/1.1" 200 None
2026-03-25 18:33:21 [ayvens.es] INFO: Saving data for 1983217: {'created_time': 1774463601.849469, 'last_price_update_time': 1774463601.849479, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983217') HTTP/1.1" 204 0
2026-03-25 18:33:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/463/5aa0212abd1242e2bd4a242102991f31/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/185/93bbf82498b644c486bb04cd251ddb29/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:21 [ayvens.es] INFO: Found listing with ID: 1983226
2026-03-25 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983226%27 HTTP/1.1" 200 None
2026-03-25 18:33:21 [ayvens.es] INFO: Scrape type for 1983226: 1
2026-03-25 18:33:21 [ayvens.es] INFO: Extracting data for car ID: 1983226
2026-03-25 18:33:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e78caea-4347-54b9-9fca-42b45e2bdd81 with identifier: 1983226
2026-03-25 18:33:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e78caea-4347-54b9-9fca-42b45e2bdd81 with scrape type 1
2026-03-25 18:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3e78caea-4347-54b9-9fca-42b45e2bdd81
2026-03-25 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F974%252F54aacf9853184102881210cbe06cf32b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/974/54aacf9853184102881210cbe06cf32b/images/large/1.jpg not downloaded yet
2026-03-25 18:33:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8d3fe590>
2026-03-25 18:33:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5c5869c-9944-5f1b-acf7-d5d69776b825/f5c5869c-9944-5f1b-acf7-d5d69776b825_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F305%252F8e0f922b5ac841f2b1092b2c5b46a0a7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/305/8e0f922b5ac841f2b1092b2c5b46a0a7/images/large/1.jpg saved to cache
2026-03-25 18:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f5c5869c-9944-5f1b-acf7-d5d69776b825
2026-03-25 18:33:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f5c5869c-9944-5f1b-acf7-d5d69776b825, skipping ID generation
2026-03-25 18:33:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5c5869c-9944-5f1b-acf7-d5d69776b825 with scrape type 1
2026-03-25 18:33:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f5c5869c-9944-5f1b-acf7-d5d69776b825 sending to next pipeline
2026-03-25 18:33:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f5c5869c-9944-5f1b-acf7-d5d69776b825, identifier: 1983218
2026-03-25 18:33:22 [ayvens.es] INFO: Found listing with ID: 1983227
2026-03-25 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983227%27 HTTP/1.1" 200 None
2026-03-25 18:33:22 [ayvens.es] INFO: Scrape type for 1983227: 1
2026-03-25 18:33:22 [ayvens.es] INFO: Extracting data for car ID: 1983227
2026-03-25 18:33:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ae70232-6f01-57b8-8bc0-fe20e6c330a6 with identifier: 1983227
2026-03-25 18:33:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ae70232-6f01-57b8-8bc0-fe20e6c330a6 with scrape type 1
2026-03-25 18:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3ae70232-6f01-57b8-8bc0-fe20e6c330a6
2026-03-25 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F907%252Fc941a18ce98a4f0a8d331b49f13d5828%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/907/c941a18ce98a4f0a8d331b49f13d5828/images/large/1.jpg not downloaded yet
2026-03-25 18:33:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f5c5869c-9944-5f1b-acf7-d5d69776b825 with identifier: 1983218
2026-03-25 18:33:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f5c5869c-9944-5f1b-acf7-d5d69776b825 with identifier: 1983218
2026-03-25 18:33:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f5c5869c-9944-5f1b-acf7-d5d69776b825 with identifier: 1983218 to the API
2026-03-25 18:33:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/305/8e0f922b5ac841f2b1092b2c5b46a0a7/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'f5c5869c-9944-5f1b-acf7-d5d69776b825',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS 3 CROSSBACK',
 'odometer': 99783,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5c5869c-9944-5f1b-acf7-d5d69776b825/f5c5869c-9944-5f1b-acf7-d5d69776b825_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 326488,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/305/8e0f922b5ac841f2b1092b2c5b46a0a7/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS 3 CROSSBACK PureTech 73 kW Manual PERFORMANCE '
          'LINE',
 'transmission': 'manual',
 'trim': 'PureTech 73 kW Manual PERFORMANCE LINE',
 'vin': None,
 'year': 2021}
2026-03-25 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983218%27 HTTP/1.1" 200 None
2026-03-25 18:33:22 [ayvens.es] INFO: Saving data for 1983218: {'created_time': 1774463602.421458, 'last_price_update_time': 1774463602.42147, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983218') HTTP/1.1" 204 0
2026-03-25 18:33:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/351/796c25f813ae4807b6a5b62b313eaadf/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:22 [ayvens.es] INFO: Found listing with ID: 1983228
2026-03-25 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983228%27 HTTP/1.1" 200 None
2026-03-25 18:33:22 [ayvens.es] INFO: Scrape type for 1983228: 1
2026-03-25 18:33:22 [ayvens.es] INFO: Extracting data for car ID: 1983228
2026-03-25 18:33:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21885d57-3238-50eb-9785-950dafa1429e with identifier: 1983228
2026-03-25 18:33:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21885d57-3238-50eb-9785-950dafa1429e with scrape type 1
2026-03-25 18:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 21885d57-3238-50eb-9785-950dafa1429e
2026-03-25 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F362%252Ff804fe276ecb46e5b67eaec8ab38b099%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/362/f804fe276ecb46e5b67eaec8ab38b099/images/large/1.jpg not downloaded yet
2026-03-25 18:33:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/026/b970b4c9962f4583ad7fbdd5af8dcf25/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae9105ad10>
2026-03-25 18:33:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36d238a8-ae20-5b4e-867a-b64a3670a6ad/36d238a8-ae20-5b4e-867a-b64a3670a6ad_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F463%252F5aa0212abd1242e2bd4a242102991f31%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/463/5aa0212abd1242e2bd4a242102991f31/images/large/1.jpg saved to cache
2026-03-25 18:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 36d238a8-ae20-5b4e-867a-b64a3670a6ad
2026-03-25 18:33:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 36d238a8-ae20-5b4e-867a-b64a3670a6ad, skipping ID generation
2026-03-25 18:33:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36d238a8-ae20-5b4e-867a-b64a3670a6ad with scrape type 1
2026-03-25 18:33:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 36d238a8-ae20-5b4e-867a-b64a3670a6ad sending to next pipeline
2026-03-25 18:33:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 36d238a8-ae20-5b4e-867a-b64a3670a6ad, identifier: 1983219
2026-03-25 18:33:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ec56050>
2026-03-25 18:33:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c214ccc5-2dff-5f40-a3a6-052893e65fc4/c214ccc5-2dff-5f40-a3a6-052893e65fc4_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F185%252F93bbf82498b644c486bb04cd251ddb29%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/185/93bbf82498b644c486bb04cd251ddb29/images/large/1.jpg saved to cache
2026-03-25 18:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c214ccc5-2dff-5f40-a3a6-052893e65fc4
2026-03-25 18:33:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c214ccc5-2dff-5f40-a3a6-052893e65fc4, skipping ID generation
2026-03-25 18:33:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c214ccc5-2dff-5f40-a3a6-052893e65fc4 with scrape type 1
2026-03-25 18:33:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c214ccc5-2dff-5f40-a3a6-052893e65fc4 sending to next pipeline
2026-03-25 18:33:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c214ccc5-2dff-5f40-a3a6-052893e65fc4, identifier: 1983220
2026-03-25 18:33:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/041/2b6f81b325b64f06b7621b68e241234b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:22 [ayvens.es] INFO: Found listing with ID: 1983229
2026-03-25 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983229%27 HTTP/1.1" 200 None
2026-03-25 18:33:22 [ayvens.es] INFO: Scrape type for 1983229: 1
2026-03-25 18:33:22 [ayvens.es] INFO: Extracting data for car ID: 1983229
2026-03-25 18:33:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9e73e61-55a3-5ca0-99ad-ca0dc26c227f with identifier: 1983229
2026-03-25 18:33:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9e73e61-55a3-5ca0-99ad-ca0dc26c227f with scrape type 1
2026-03-25 18:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d9e73e61-55a3-5ca0-99ad-ca0dc26c227f
2026-03-25 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F381%252Fe0eeeca72bf04710a31ce16fb1ac0897%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/381/e0eeeca72bf04710a31ce16fb1ac0897/images/large/1.jpg not downloaded yet
2026-03-25 18:33:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 36d238a8-ae20-5b4e-867a-b64a3670a6ad with identifier: 1983219
2026-03-25 18:33:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 36d238a8-ae20-5b4e-867a-b64a3670a6ad with identifier: 1983219
2026-03-25 18:33:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 36d238a8-ae20-5b4e-867a-b64a3670a6ad with identifier: 1983219 to the API
2026-03-25 18:33:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/463/5aa0212abd1242e2bd4a242102991f31/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 22,
 'color': 'Rojo',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '36d238a8-ae20-5b4e-867a-b64a3670a6ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'KUGA',
 'odometer': 160419,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36d238a8-ae20-5b4e-867a-b64a3670a6ad/36d238a8-ae20-5b4e-867a-b64a3670a6ad_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 516392,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/463/5aa0212abd1242e2bd4a242102991f31/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD KUGA Titanium 2.5 Duratec PHEV 165kW Auto',
 'transmission': 'manual',
 'trim': 'Titanium 2.5 Duratec PHEV 165kW Auto',
 'vin': None,
 'year': 2022}
2026-03-25 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983219%27 HTTP/1.1" 200 None
2026-03-25 18:33:23 [ayvens.es] INFO: Saving data for 1983219: {'created_time': 1774463603.184723, 'last_price_update_time': 1774463603.184733, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983219') HTTP/1.1" 204 0
2026-03-25 18:33:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c214ccc5-2dff-5f40-a3a6-052893e65fc4 with identifier: 1983220
2026-03-25 18:33:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c214ccc5-2dff-5f40-a3a6-052893e65fc4 with identifier: 1983220
2026-03-25 18:33:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c214ccc5-2dff-5f40-a3a6-052893e65fc4 with identifier: 1983220 to the API
2026-03-25 18:33:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/185/93bbf82498b644c486bb04cd251ddb29/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 151,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c214ccc5-2dff-5f40-a3a6-052893e65fc4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLC-CLASS',
 'odometer': 172881,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c214ccc5-2dff-5f40-a3a6-052893e65fc4/c214ccc5-2dff-5f40-a3a6-052893e65fc4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 355456,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/185/93bbf82498b644c486bb04cd251ddb29/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLC-CLASS GLC 300 d 4MATIC',
 'transmission': 'manual',
 'trim': 'GLC 300 d 4MATIC',
 'vin': None,
 'year': 2020}
2026-03-25 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983220%27 HTTP/1.1" 200 None
2026-03-25 18:33:23 [ayvens.es] INFO: Saving data for 1983220: {'created_time': 1774463603.518681, 'last_price_update_time': 1774463603.518691, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983220') HTTP/1.1" 204 0
2026-03-25 18:33:23 [ayvens.es] INFO: Found listing with ID: 1983230
2026-03-25 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983230%27 HTTP/1.1" 200 None
2026-03-25 18:33:23 [ayvens.es] INFO: Scrape type for 1983230: 1
2026-03-25 18:33:23 [ayvens.es] INFO: Extracting data for car ID: 1983230
2026-03-25 18:33:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a178953-4b55-546a-87a4-7c98470d831f with identifier: 1983230
2026-03-25 18:33:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a178953-4b55-546a-87a4-7c98470d831f with scrape type 1
2026-03-25 18:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7a178953-4b55-546a-87a4-7c98470d831f
2026-03-25 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F156%252F578866c1858248f78de9f7caa79afafe%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/156/578866c1858248f78de9f7caa79afafe/images/large/1.jpg not downloaded yet
2026-03-25 18:33:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/702/2e16183ad4b14a619af7088cbda2c01f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae9091f490>
2026-03-25 18:33:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_425fa02c-e26d-5b74-89c7-fc7eab7a6670/425fa02c-e26d-5b74-89c7-fc7eab7a6670_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F351%252F796c25f813ae4807b6a5b62b313eaadf%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/351/796c25f813ae4807b6a5b62b313eaadf/images/large/1.jpg saved to cache
2026-03-25 18:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 425fa02c-e26d-5b74-89c7-fc7eab7a6670
2026-03-25 18:33:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 425fa02c-e26d-5b74-89c7-fc7eab7a6670, skipping ID generation
2026-03-25 18:33:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 425fa02c-e26d-5b74-89c7-fc7eab7a6670 with scrape type 1
2026-03-25 18:33:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 425fa02c-e26d-5b74-89c7-fc7eab7a6670 sending to next pipeline
2026-03-25 18:33:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 425fa02c-e26d-5b74-89c7-fc7eab7a6670, identifier: 1983221
2026-03-25 18:33:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e57c9d0>
2026-03-25 18:33:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9daba332-e4fb-5c9e-90ec-db931433510e/9daba332-e4fb-5c9e-90ec-db931433510e_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F026%252Fb970b4c9962f4583ad7fbdd5af8dcf25%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/026/b970b4c9962f4583ad7fbdd5af8dcf25/images/large/1.jpg saved to cache
2026-03-25 18:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9daba332-e4fb-5c9e-90ec-db931433510e
2026-03-25 18:33:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9daba332-e4fb-5c9e-90ec-db931433510e, skipping ID generation
2026-03-25 18:33:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9daba332-e4fb-5c9e-90ec-db931433510e with scrape type 1
2026-03-25 18:33:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9daba332-e4fb-5c9e-90ec-db931433510e sending to next pipeline
2026-03-25 18:33:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9daba332-e4fb-5c9e-90ec-db931433510e, identifier: 1983223
2026-03-25 18:33:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8f01ad10>
2026-03-25 18:33:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcebbca7-75de-5a0c-9c82-265c0e311534/fcebbca7-75de-5a0c-9c82-265c0e311534_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F041%252F2b6f81b325b64f06b7621b68e241234b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/041/2b6f81b325b64f06b7621b68e241234b/images/large/1.jpg saved to cache
2026-03-25 18:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fcebbca7-75de-5a0c-9c82-265c0e311534
2026-03-25 18:33:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fcebbca7-75de-5a0c-9c82-265c0e311534, skipping ID generation
2026-03-25 18:33:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcebbca7-75de-5a0c-9c82-265c0e311534 with scrape type 1
2026-03-25 18:33:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fcebbca7-75de-5a0c-9c82-265c0e311534 sending to next pipeline
2026-03-25 18:33:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: fcebbca7-75de-5a0c-9c82-265c0e311534, identifier: 1983222
2026-03-25 18:33:24 [ayvens.es] INFO: Found listing with ID: 1983231
2026-03-25 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983231%27 HTTP/1.1" 200 None
2026-03-25 18:33:24 [ayvens.es] INFO: Scrape type for 1983231: 1
2026-03-25 18:33:24 [ayvens.es] INFO: Extracting data for car ID: 1983231
2026-03-25 18:33:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3c1bc1c-cc0e-549c-9fb3-70e5dc26a296 with identifier: 1983231
2026-03-25 18:33:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3c1bc1c-cc0e-549c-9fb3-70e5dc26a296 with scrape type 1
2026-03-25 18:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e3c1bc1c-cc0e-549c-9fb3-70e5dc26a296
2026-03-25 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F861%252Feb54881f319040e1a2b0ca06e4698fa0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/861/eb54881f319040e1a2b0ca06e4698fa0/images/large/1.jpg not downloaded yet
2026-03-25 18:33:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 425fa02c-e26d-5b74-89c7-fc7eab7a6670 with identifier: 1983221
2026-03-25 18:33:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 425fa02c-e26d-5b74-89c7-fc7eab7a6670 with identifier: 1983221
2026-03-25 18:33:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 425fa02c-e26d-5b74-89c7-fc7eab7a6670 with identifier: 1983221 to the API
2026-03-25 18:33:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/351/796c25f813ae4807b6a5b62b313eaadf/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '425fa02c-e26d-5b74-89c7-fc7eab7a6670',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'COMBO',
 'odometer': 83262,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_425fa02c-e26d-5b74-89c7-fc7eab7a6670/425fa02c-e26d-5b74-89c7-fc7eab7a6670_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 522926,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/351/796c25f813ae4807b6a5b62b313eaadf/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL COMBO 1.5 TD 75kW (100CV) S/S Edition L',
 'transmission': 'manual',
 'trim': '1.5 TD 75kW (100CV) S/S Edition L',
 'vin': None,
 'year': 2021}
2026-03-25 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983221%27 HTTP/1.1" 200 None
2026-03-25 18:33:24 [ayvens.es] INFO: Saving data for 1983221: {'created_time': 1774463604.538077, 'last_price_update_time': 1774463604.538087, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983221') HTTP/1.1" 204 0
2026-03-25 18:33:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9daba332-e4fb-5c9e-90ec-db931433510e with identifier: 1983223
2026-03-25 18:33:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9daba332-e4fb-5c9e-90ec-db931433510e with identifier: 1983223
2026-03-25 18:33:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9daba332-e4fb-5c9e-90ec-db931433510e with identifier: 1983223 to the API
2026-03-25 18:33:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/026/b970b4c9962f4583ad7fbdd5af8dcf25/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '9daba332-e4fb-5c9e-90ec-db931433510e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ARONA',
 'odometer': 165462,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9daba332-e4fb-5c9e-90ec-db931433510e/9daba332-e4fb-5c9e-90ec-db931433510e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 334211,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/026/b970b4c9962f4583ad7fbdd5af8dcf25/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ARONA 1.0 TSI 81kW (110CV) Style Go Eco',
 'transmission': 'manual',
 'trim': '1.0 TSI 81kW (110CV) Style Go Eco',
 'vin': None,
 'year': 2020}
2026-03-25 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983223%27 HTTP/1.1" 200 None
2026-03-25 18:33:24 [ayvens.es] INFO: Saving data for 1983223: {'created_time': 1774463604.896733, 'last_price_update_time': 1774463604.896749, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983223') HTTP/1.1" 204 0
2026-03-25 18:33:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: fcebbca7-75de-5a0c-9c82-265c0e311534 with identifier: 1983222
2026-03-25 18:33:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: fcebbca7-75de-5a0c-9c82-265c0e311534 with identifier: 1983222
2026-03-25 18:33:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: fcebbca7-75de-5a0c-9c82-265c0e311534 with identifier: 1983222 to the API
2026-03-25 18:33:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/041/2b6f81b325b64f06b7621b68e241234b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'fcebbca7-75de-5a0c-9c82-265c0e311534',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO',
 'odometer': 143419,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcebbca7-75de-5a0c-9c82-265c0e311534/fcebbca7-75de-5a0c-9c82-265c0e311534_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 516368,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/041/2b6f81b325b64f06b7621b68e241234b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT KANGOO Profesional M1-AF Blue dCi 59 kW (80 CV)',
 'transmission': 'manual',
 'trim': 'Profesional M1-AF Blue dCi 59 kW (80 CV)',
 'vin': None,
 'year': 2020}
2026-03-25 18:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983222%27 HTTP/1.1" 200 None
2026-03-25 18:33:25 [ayvens.es] INFO: Saving data for 1983222: {'created_time': 1774463605.390479, 'last_price_update_time': 1774463605.390491, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983222') HTTP/1.1" 204 0
2026-03-25 18:33:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/974/54aacf9853184102881210cbe06cf32b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:25 [ayvens.es] INFO: Found listing with ID: 1983232
2026-03-25 18:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983232%27 HTTP/1.1" 200 None
2026-03-25 18:33:25 [ayvens.es] INFO: Scrape type for 1983232: 1
2026-03-25 18:33:25 [ayvens.es] INFO: Extracting data for car ID: 1983232
2026-03-25 18:33:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1e8f1fb-6fa9-52cb-bfaf-32e8a3b93394 with identifier: 1983232
2026-03-25 18:33:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1e8f1fb-6fa9-52cb-bfaf-32e8a3b93394 with scrape type 1
2026-03-25 18:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d1e8f1fb-6fa9-52cb-bfaf-32e8a3b93394
2026-03-25 18:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F487%252Fec98289a83eb4c5aaa1f8cce6cc2a432%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/487/ec98289a83eb4c5aaa1f8cce6cc2a432/images/large/1.jpg not downloaded yet
2026-03-25 18:33:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8d42ca10>
2026-03-25 18:33:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88e5af8a-c5a4-5065-91bd-f9625fe9bba6/88e5af8a-c5a4-5065-91bd-f9625fe9bba6_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F702%252F2e16183ad4b14a619af7088cbda2c01f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/702/2e16183ad4b14a619af7088cbda2c01f/images/large/1.jpg saved to cache
2026-03-25 18:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 88e5af8a-c5a4-5065-91bd-f9625fe9bba6
2026-03-25 18:33:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 88e5af8a-c5a4-5065-91bd-f9625fe9bba6, skipping ID generation
2026-03-25 18:33:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88e5af8a-c5a4-5065-91bd-f9625fe9bba6 with scrape type 1
2026-03-25 18:33:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 88e5af8a-c5a4-5065-91bd-f9625fe9bba6 sending to next pipeline
2026-03-25 18:33:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 88e5af8a-c5a4-5065-91bd-f9625fe9bba6, identifier: 1983224
2026-03-25 18:33:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/948/8aa8f5b5ac1843cfba0349e569f7450d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:25 [ayvens.es] INFO: Found listing with ID: 1983233
2026-03-25 18:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983233%27 HTTP/1.1" 200 None
2026-03-25 18:33:25 [ayvens.es] INFO: Scrape type for 1983233: 1
2026-03-25 18:33:25 [ayvens.es] INFO: Extracting data for car ID: 1983233
2026-03-25 18:33:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53a47d44-caf0-54a4-86a3-98f4981828bb with identifier: 1983233
2026-03-25 18:33:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53a47d44-caf0-54a4-86a3-98f4981828bb with scrape type 1
2026-03-25 18:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 53a47d44-caf0-54a4-86a3-98f4981828bb
2026-03-25 18:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F021%252Fcde3434ec9d94951b122d980a729948a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/021/cde3434ec9d94951b122d980a729948a/images/large/1.jpg not downloaded yet
2026-03-25 18:33:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 88e5af8a-c5a4-5065-91bd-f9625fe9bba6 with identifier: 1983224
2026-03-25 18:33:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:33:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 88e5af8a-c5a4-5065-91bd-f9625fe9bba6 with identifier: 1983224
2026-03-25 18:33:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 88e5af8a-c5a4-5065-91bd-f9625fe9bba6 with identifier: 1983224 to the API
2026-03-25 18:33:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/702/2e16183ad4b14a619af7088cbda2c01f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'color': 'Portimao',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '88e5af8a-c5a4-5065-91bd-f9625fe9bba6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'SERIES 4',
 'odometer': 95920,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88e5af8a-c5a4-5065-91bd-f9625fe9bba6/88e5af8a-c5a4-5065-91bd-f9625fe9bba6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 400166,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/702/2e16183ad4b14a619af7088cbda2c01f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-25',
 'seats_number': 4,
 'seller_name': None,
 'title': 'BMW SERIES 4 420d Gran Coupe',
 'transmission': 'manual',
 'trim': '420d Gran Coupe',
 'vin': None,
 'year': 2023}
2026-03-25 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983224%27 HTTP/1.1" 200 None
2026-03-25 18:33:26 [ayvens.es] INFO: Saving data for 1983224: {'created_time': 1774463606.023397, 'last_price_update_time': 1774463606.023406, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983224') HTTP/1.1" 204 0
2026-03-25 18:33:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/907/c941a18ce98a4f0a8d331b49f13d5828/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/362/f804fe276ecb46e5b67eaec8ab38b099/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:26 [ayvens.es] INFO: Found listing with ID: 1983234
2026-03-25 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983234%27 HTTP/1.1" 200 None
2026-03-25 18:33:26 [ayvens.es] INFO: Scrape type for 1983234: 1
2026-03-25 18:33:26 [ayvens.es] INFO: Extracting data for car ID: 1983234
2026-03-25 18:33:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1128460-8b3a-5381-9b4e-f6e6e11acdf7 with identifier: 1983234
2026-03-25 18:33:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1128460-8b3a-5381-9b4e-f6e6e11acdf7 with scrape type 1
2026-03-25 18:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b1128460-8b3a-5381-9b4e-f6e6e11acdf7
2026-03-25 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F056%252Fba9b7f11a3c74b46b24de7b5b9422adc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/056/ba9b7f11a3c74b46b24de7b5b9422adc/images/large/1.jpg not downloaded yet
2026-03-25 18:33:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ee8f790>
2026-03-25 18:33:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e78caea-4347-54b9-9fca-42b45e2bdd81/3e78caea-4347-54b9-9fca-42b45e2bdd81_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F974%252F54aacf9853184102881210cbe06cf32b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/974/54aacf9853184102881210cbe06cf32b/images/large/1.jpg saved to cache
2026-03-25 18:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3e78caea-4347-54b9-9fca-42b45e2bdd81
2026-03-25 18:33:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3e78caea-4347-54b9-9fca-42b45e2bdd81, skipping ID generation
2026-03-25 18:33:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e78caea-4347-54b9-9fca-42b45e2bdd81 with scrape type 1
2026-03-25 18:33:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3e78caea-4347-54b9-9fca-42b45e2bdd81 sending to next pipeline
2026-03-25 18:33:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3e78caea-4347-54b9-9fca-42b45e2bdd81, identifier: 1983226
2026-03-25 18:33:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ec466d0>
2026-03-25 18:33:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd4d41d6-5421-5048-b19d-d79c0ff5c6a6/dd4d41d6-5421-5048-b19d-d79c0ff5c6a6_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F948%252F8aa8f5b5ac1843cfba0349e569f7450d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/948/8aa8f5b5ac1843cfba0349e569f7450d/images/large/1.jpg saved to cache
2026-03-25 18:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dd4d41d6-5421-5048-b19d-d79c0ff5c6a6
2026-03-25 18:33:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dd4d41d6-5421-5048-b19d-d79c0ff5c6a6, skipping ID generation
2026-03-25 18:33:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd4d41d6-5421-5048-b19d-d79c0ff5c6a6 with scrape type 1
2026-03-25 18:33:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dd4d41d6-5421-5048-b19d-d79c0ff5c6a6 sending to next pipeline
2026-03-25 18:33:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: dd4d41d6-5421-5048-b19d-d79c0ff5c6a6, identifier: 1983225
2026-03-25 18:33:26 [ayvens.es] INFO: Found listing with ID: 1983235
2026-03-25 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983235%27 HTTP/1.1" 200 None
2026-03-25 18:33:26 [ayvens.es] INFO: Scrape type for 1983235: 1
2026-03-25 18:33:26 [ayvens.es] INFO: Extracting data for car ID: 1983235
2026-03-25 18:33:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8950396b-6249-5766-965d-1a65cefc07e2 with identifier: 1983235
2026-03-25 18:33:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8950396b-6249-5766-965d-1a65cefc07e2 with scrape type 1
2026-03-25 18:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8950396b-6249-5766-965d-1a65cefc07e2
2026-03-25 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F709%252Fdb41e4cceee94bbf9a70b01bbf751556%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/709/db41e4cceee94bbf9a70b01bbf751556/images/large/1.jpg not downloaded yet
2026-03-25 18:33:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3e78caea-4347-54b9-9fca-42b45e2bdd81 with identifier: 1983226
2026-03-25 18:33:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3e78caea-4347-54b9-9fca-42b45e2bdd81 with identifier: 1983226
2026-03-25 18:33:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3e78caea-4347-54b9-9fca-42b45e2bdd81 with identifier: 1983226 to the API
2026-03-25 18:33:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/974/54aacf9853184102881210cbe06cf32b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.9L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '3e78caea-4347-54b9-9fca-42b45e2bdd81',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS',
 'odometer': 183544,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e78caea-4347-54b9-9fca-42b45e2bdd81/3e78caea-4347-54b9-9fca-42b45e2bdd81_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 339514,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/974/54aacf9853184102881210cbe06cf32b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS Sedan A 200 d',
 'transmission': 'manual',
 'trim': 'Sedan A 200 d',
 'vin': None,
 'year': 2021}
2026-03-25 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983226%27 HTTP/1.1" 200 None
2026-03-25 18:33:26 [ayvens.es] INFO: Saving data for 1983226: {'created_time': 1774463606.840629, 'last_price_update_time': 1774463606.840643, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983226') HTTP/1.1" 204 0
2026-03-25 18:33:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: dd4d41d6-5421-5048-b19d-d79c0ff5c6a6 with identifier: 1983225
2026-03-25 18:33:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:33:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: dd4d41d6-5421-5048-b19d-d79c0ff5c6a6 with identifier: 1983225
2026-03-25 18:33:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: dd4d41d6-5421-5048-b19d-d79c0ff5c6a6 with identifier: 1983225 to the API
2026-03-25 18:33:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/948/8aa8f5b5ac1843cfba0349e569f7450d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 189,
 'color': 'Baltico',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'dd4d41d6-5421-5048-b19d-d79c0ff5c6a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT CUSTOM',
 'odometer': 58403,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd4d41d6-5421-5048-b19d-d79c0ff5c6a6/dd4d41d6-5421-5048-b19d-d79c0ff5c6a6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 514901,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/948/8aa8f5b5ac1843cfba0349e569f7450d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-01-11',
 'seats_number': 9,
 'seller_name': None,
 'title': 'FORD TRANSIT CUSTOM Kombi 2.0 EcoBlue 110kW 320 L1 Trend',
 'transmission': 'manual',
 'trim': 'Kombi 2.0 EcoBlue 110kW 320 L1 Trend',
 'vin': None,
 'year': 2024}
2026-03-25 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983225%27 HTTP/1.1" 200 None
2026-03-25 18:33:27 [ayvens.es] INFO: Saving data for 1983225: {'created_time': 1774463607.291281, 'last_price_update_time': 1774463607.291296, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983225') HTTP/1.1" 204 0
2026-03-25 18:33:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/381/e0eeeca72bf04710a31ce16fb1ac0897/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/156/578866c1858248f78de9f7caa79afafe/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:27 [ayvens.es] INFO: Found listing with ID: 1983236
2026-03-25 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983236%27 HTTP/1.1" 200 None
2026-03-25 18:33:27 [ayvens.es] INFO: Scrape type for 1983236: 1
2026-03-25 18:33:27 [ayvens.es] INFO: Extracting data for car ID: 1983236
2026-03-25 18:33:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e848f52-90f3-5169-93b5-0ad760c23dea with identifier: 1983236
2026-03-25 18:33:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e848f52-90f3-5169-93b5-0ad760c23dea with scrape type 1
2026-03-25 18:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7e848f52-90f3-5169-93b5-0ad760c23dea
2026-03-25 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F067%252Fdfda95e698e145419ea9808e41673816%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/067/dfda95e698e145419ea9808e41673816/images/large/1.jpg not downloaded yet
2026-03-25 18:33:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae91433010>
2026-03-25 18:33:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ae70232-6f01-57b8-8bc0-fe20e6c330a6/3ae70232-6f01-57b8-8bc0-fe20e6c330a6_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F907%252Fc941a18ce98a4f0a8d331b49f13d5828%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/907/c941a18ce98a4f0a8d331b49f13d5828/images/large/1.jpg saved to cache
2026-03-25 18:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3ae70232-6f01-57b8-8bc0-fe20e6c330a6
2026-03-25 18:33:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3ae70232-6f01-57b8-8bc0-fe20e6c330a6, skipping ID generation
2026-03-25 18:33:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ae70232-6f01-57b8-8bc0-fe20e6c330a6 with scrape type 1
2026-03-25 18:33:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3ae70232-6f01-57b8-8bc0-fe20e6c330a6 sending to next pipeline
2026-03-25 18:33:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3ae70232-6f01-57b8-8bc0-fe20e6c330a6, identifier: 1983227
2026-03-25 18:33:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8efe4d10>
2026-03-25 18:33:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21885d57-3238-50eb-9785-950dafa1429e/21885d57-3238-50eb-9785-950dafa1429e_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F362%252Ff804fe276ecb46e5b67eaec8ab38b099%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/362/f804fe276ecb46e5b67eaec8ab38b099/images/large/1.jpg saved to cache
2026-03-25 18:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 21885d57-3238-50eb-9785-950dafa1429e
2026-03-25 18:33:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 21885d57-3238-50eb-9785-950dafa1429e, skipping ID generation
2026-03-25 18:33:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21885d57-3238-50eb-9785-950dafa1429e with scrape type 1
2026-03-25 18:33:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 21885d57-3238-50eb-9785-950dafa1429e sending to next pipeline
2026-03-25 18:33:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 21885d57-3238-50eb-9785-950dafa1429e, identifier: 1983228
2026-03-25 18:33:27 [ayvens.es] INFO: Found listing with ID: 1983237
2026-03-25 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983237%27 HTTP/1.1" 200 None
2026-03-25 18:33:27 [ayvens.es] INFO: Scrape type for 1983237: 1
2026-03-25 18:33:27 [ayvens.es] INFO: Extracting data for car ID: 1983237
2026-03-25 18:33:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26b4b0b3-49a6-568d-9346-33b55b1182c6 with identifier: 1983237
2026-03-25 18:33:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26b4b0b3-49a6-568d-9346-33b55b1182c6 with scrape type 1
2026-03-25 18:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 26b4b0b3-49a6-568d-9346-33b55b1182c6
2026-03-25 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F005%252F7906621879fe4e83a03c325b8373e493%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/005/7906621879fe4e83a03c325b8373e493/images/large/1.jpg not downloaded yet
2026-03-25 18:33:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3ae70232-6f01-57b8-8bc0-fe20e6c330a6 with identifier: 1983227
2026-03-25 18:33:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:33:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3ae70232-6f01-57b8-8bc0-fe20e6c330a6 with identifier: 1983227
2026-03-25 18:33:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3ae70232-6f01-57b8-8bc0-fe20e6c330a6 with identifier: 1983227 to the API
2026-03-25 18:33:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/907/c941a18ce98a4f0a8d331b49f13d5828/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 169,
 'color': 'Daytona',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '3ae70232-6f01-57b8-8bc0-fe20e6c330a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q5',
 'odometer': 102581,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ae70232-6f01-57b8-8bc0-fe20e6c330a6/3ae70232-6f01-57b8-8bc0-fe20e6c330a6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 374881,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/907/c941a18ce98a4f0a8d331b49f13d5828/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q5 S line 40 TDI 150kW quattro-ultra',
 'transmission': 'manual',
 'trim': 'S line 40 TDI 150kW quattro-ultra',
 'vin': None,
 'year': 2021}
2026-03-25 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983227%27 HTTP/1.1" 200 None
2026-03-25 18:33:28 [ayvens.es] INFO: Saving data for 1983227: {'created_time': 1774463608.174589, 'last_price_update_time': 1774463608.174602, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983227') HTTP/1.1" 204 0
2026-03-25 18:33:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 21885d57-3238-50eb-9785-950dafa1429e with identifier: 1983228
2026-03-25 18:33:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:33:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 21885d57-3238-50eb-9785-950dafa1429e with identifier: 1983228
2026-03-25 18:33:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 21885d57-3238-50eb-9785-950dafa1429e with identifier: 1983228 to the API
2026-03-25 18:33:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/362/f804fe276ecb46e5b67eaec8ab38b099/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'color': 'Polar',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '21885d57-3238-50eb-9785-950dafa1429e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'TUCSON',
 'odometer': 141361,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21885d57-3238-50eb-9785-950dafa1429e/21885d57-3238-50eb-9785-950dafa1429e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 350994,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/362/f804fe276ecb46e5b67eaec8ab38b099/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI TUCSON 1.6 CRDI 100kW (136CV) 48V Tecno DCT 2C',
 'transmission': 'manual',
 'trim': '1.6 CRDI 100kW (136CV) 48V Tecno DCT 2C',
 'vin': None,
 'year': 2022}
2026-03-25 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983228%27 HTTP/1.1" 200 None
2026-03-25 18:33:28 [ayvens.es] INFO: Saving data for 1983228: {'created_time': 1774463608.524764, 'last_price_update_time': 1774463608.524777, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983228') HTTP/1.1" 204 0
2026-03-25 18:33:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/861/eb54881f319040e1a2b0ca06e4698fa0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:28 [ayvens.es] INFO: Found listing with ID: 1983238
2026-03-25 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983238%27 HTTP/1.1" 200 None
2026-03-25 18:33:28 [ayvens.es] INFO: Scrape type for 1983238: 1
2026-03-25 18:33:28 [ayvens.es] INFO: Extracting data for car ID: 1983238
2026-03-25 18:33:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35fbde2c-2b55-585d-8e4e-2547fa0e81b1 with identifier: 1983238
2026-03-25 18:33:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35fbde2c-2b55-585d-8e4e-2547fa0e81b1 with scrape type 1
2026-03-25 18:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 35fbde2c-2b55-585d-8e4e-2547fa0e81b1
2026-03-25 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F463%252F2a10783517af4135b607ff6257726357%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/463/2a10783517af4135b607ff6257726357/images/large/1.jpg not downloaded yet
2026-03-25 18:33:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8edb6c10>
2026-03-25 18:33:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9e73e61-55a3-5ca0-99ad-ca0dc26c227f/d9e73e61-55a3-5ca0-99ad-ca0dc26c227f_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F381%252Fe0eeeca72bf04710a31ce16fb1ac0897%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/381/e0eeeca72bf04710a31ce16fb1ac0897/images/large/1.jpg saved to cache
2026-03-25 18:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d9e73e61-55a3-5ca0-99ad-ca0dc26c227f
2026-03-25 18:33:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d9e73e61-55a3-5ca0-99ad-ca0dc26c227f, skipping ID generation
2026-03-25 18:33:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9e73e61-55a3-5ca0-99ad-ca0dc26c227f with scrape type 1
2026-03-25 18:33:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d9e73e61-55a3-5ca0-99ad-ca0dc26c227f sending to next pipeline
2026-03-25 18:33:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d9e73e61-55a3-5ca0-99ad-ca0dc26c227f, identifier: 1983229
2026-03-25 18:33:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e552790>
2026-03-25 18:33:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a178953-4b55-546a-87a4-7c98470d831f/7a178953-4b55-546a-87a4-7c98470d831f_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F156%252F578866c1858248f78de9f7caa79afafe%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/156/578866c1858248f78de9f7caa79afafe/images/large/1.jpg saved to cache
2026-03-25 18:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7a178953-4b55-546a-87a4-7c98470d831f
2026-03-25 18:33:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7a178953-4b55-546a-87a4-7c98470d831f, skipping ID generation
2026-03-25 18:33:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a178953-4b55-546a-87a4-7c98470d831f with scrape type 1
2026-03-25 18:33:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7a178953-4b55-546a-87a4-7c98470d831f sending to next pipeline
2026-03-25 18:33:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7a178953-4b55-546a-87a4-7c98470d831f, identifier: 1983230
2026-03-25 18:33:28 [ayvens.es] INFO: Found listing with ID: 1983239
2026-03-25 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983239%27 HTTP/1.1" 200 None
2026-03-25 18:33:28 [ayvens.es] INFO: Scrape type for 1983239: 1
2026-03-25 18:33:28 [ayvens.es] INFO: Extracting data for car ID: 1983239
2026-03-25 18:33:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af25f67a-be95-510a-811f-f5868b0ac36e with identifier: 1983239
2026-03-25 18:33:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af25f67a-be95-510a-811f-f5868b0ac36e with scrape type 1
2026-03-25 18:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item af25f67a-be95-510a-811f-f5868b0ac36e
2026-03-25 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F519%252F625b3113d5954fa38ec47b535d94b121%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/519/625b3113d5954fa38ec47b535d94b121/images/large/1.jpg not downloaded yet
2026-03-25 18:33:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d9e73e61-55a3-5ca0-99ad-ca0dc26c227f with identifier: 1983229
2026-03-25 18:33:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d9e73e61-55a3-5ca0-99ad-ca0dc26c227f with identifier: 1983229
2026-03-25 18:33:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d9e73e61-55a3-5ca0-99ad-ca0dc26c227f with identifier: 1983229 to the API
2026-03-25 18:33:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/381/e0eeeca72bf04710a31ce16fb1ac0897/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd9e73e61-55a3-5ca0-99ad-ca0dc26c227f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'B-CLASS',
 'odometer': 142250,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9e73e61-55a3-5ca0-99ad-ca0dc26c227f/d9e73e61-55a3-5ca0-99ad-ca0dc26c227f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 350875,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/381/e0eeeca72bf04710a31ce16fb1ac0897/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ B-CLASS B 180 d',
 'transmission': 'manual',
 'trim': 'B 180 d',
 'vin': None,
 'year': 2021}
2026-03-25 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983229%27 HTTP/1.1" 200 None
2026-03-25 18:33:29 [ayvens.es] INFO: Saving data for 1983229: {'created_time': 1774463609.268124, 'last_price_update_time': 1774463609.268134, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983229') HTTP/1.1" 204 0
2026-03-25 18:33:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7a178953-4b55-546a-87a4-7c98470d831f with identifier: 1983230
2026-03-25 18:33:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7a178953-4b55-546a-87a4-7c98470d831f with identifier: 1983230
2026-03-25 18:33:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7a178953-4b55-546a-87a4-7c98470d831f with identifier: 1983230 to the API
2026-03-25 18:33:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/156/578866c1858248f78de9f7caa79afafe/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '7a178953-4b55-546a-87a4-7c98470d831f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'C-CLASS',
 'odometer': 252431,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a178953-4b55-546a-87a4-7c98470d831f/7a178953-4b55-546a-87a4-7c98470d831f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 335953,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/156/578866c1858248f78de9f7caa79afafe/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ C-CLASS C 200 d',
 'transmission': 'manual',
 'trim': 'C 200 d',
 'vin': None,
 'year': 2022}
2026-03-25 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983230%27 HTTP/1.1" 200 None
2026-03-25 18:33:29 [ayvens.es] INFO: Saving data for 1983230: {'created_time': 1774463609.604895, 'last_price_update_time': 1774463609.604905, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983230') HTTP/1.1" 204 0
2026-03-25 18:33:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/487/ec98289a83eb4c5aaa1f8cce6cc2a432/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/021/cde3434ec9d94951b122d980a729948a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:29 [ayvens.es] INFO: Found listing with ID: 1983240
2026-03-25 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983240%27 HTTP/1.1" 200 None
2026-03-25 18:33:29 [ayvens.es] INFO: Scrape type for 1983240: 1
2026-03-25 18:33:29 [ayvens.es] INFO: Extracting data for car ID: 1983240
2026-03-25 18:33:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8cb915b7-c7a4-595a-89b9-96a16f454ad4 with identifier: 1983240
2026-03-25 18:33:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8cb915b7-c7a4-595a-89b9-96a16f454ad4 with scrape type 1
2026-03-25 18:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8cb915b7-c7a4-595a-89b9-96a16f454ad4
2026-03-25 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F150%252Fbde06b13f83a47cf8ccf51b951150f59%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/150/bde06b13f83a47cf8ccf51b951150f59/images/large/1.jpg not downloaded yet
2026-03-25 18:33:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e551c90>
2026-03-25 18:33:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3c1bc1c-cc0e-549c-9fb3-70e5dc26a296/e3c1bc1c-cc0e-549c-9fb3-70e5dc26a296_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F861%252Feb54881f319040e1a2b0ca06e4698fa0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/861/eb54881f319040e1a2b0ca06e4698fa0/images/large/1.jpg saved to cache
2026-03-25 18:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e3c1bc1c-cc0e-549c-9fb3-70e5dc26a296
2026-03-25 18:33:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e3c1bc1c-cc0e-549c-9fb3-70e5dc26a296, skipping ID generation
2026-03-25 18:33:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3c1bc1c-cc0e-549c-9fb3-70e5dc26a296 with scrape type 1
2026-03-25 18:33:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e3c1bc1c-cc0e-549c-9fb3-70e5dc26a296 sending to next pipeline
2026-03-25 18:33:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e3c1bc1c-cc0e-549c-9fb3-70e5dc26a296, identifier: 1983231
2026-03-25 18:33:29 [ayvens.es] INFO: Found listing with ID: 1983241
2026-03-25 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983241%27 HTTP/1.1" 200 None
2026-03-25 18:33:29 [ayvens.es] INFO: Scrape type for 1983241: 1
2026-03-25 18:33:29 [ayvens.es] INFO: Extracting data for car ID: 1983241
2026-03-25 18:33:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5f97a30-0ea4-5b16-83c1-68f40f220ecc with identifier: 1983241
2026-03-25 18:33:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5f97a30-0ea4-5b16-83c1-68f40f220ecc with scrape type 1
2026-03-25 18:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b5f97a30-0ea4-5b16-83c1-68f40f220ecc
2026-03-25 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F524%252Feb099a2f15f9451789d4132250a4fbf2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/524/eb099a2f15f9451789d4132250a4fbf2/images/large/1.jpg not downloaded yet
2026-03-25 18:33:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e3c1bc1c-cc0e-549c-9fb3-70e5dc26a296 with identifier: 1983231
2026-03-25 18:33:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e3c1bc1c-cc0e-549c-9fb3-70e5dc26a296 with identifier: 1983231
2026-03-25 18:33:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e3c1bc1c-cc0e-549c-9fb3-70e5dc26a296 with identifier: 1983231 to the API
2026-03-25 18:33:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/861/eb54881f319040e1a2b0ca06e4698fa0/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'Azul',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e3c1bc1c-cc0e-549c-9fb3-70e5dc26a296',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF',
 'odometer': 205046,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3c1bc1c-cc0e-549c-9fb3-70e5dc26a296/e3c1bc1c-cc0e-549c-9fb3-70e5dc26a296_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 370532,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/861/eb54881f319040e1a2b0ca06e4698fa0/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF Sport 1.6 TDI 85kW (115CV) DSG',
 'transmission': 'manual',
 'trim': 'Sport 1.6 TDI 85kW (115CV) DSG',
 'vin': None,
 'year': 2017}
2026-03-25 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983231%27 HTTP/1.1" 200 None
2026-03-25 18:33:30 [ayvens.es] INFO: Saving data for 1983231: {'created_time': 1774463610.242977, 'last_price_update_time': 1774463610.242987, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983231') HTTP/1.1" 204 0
2026-03-25 18:33:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/056/ba9b7f11a3c74b46b24de7b5b9422adc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/067/dfda95e698e145419ea9808e41673816/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/709/db41e4cceee94bbf9a70b01bbf751556/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:30 [ayvens.es] INFO: Found listing with ID: 1983242
2026-03-25 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983242%27 HTTP/1.1" 200 None
2026-03-25 18:33:30 [ayvens.es] INFO: Scrape type for 1983242: 1
2026-03-25 18:33:30 [ayvens.es] INFO: Extracting data for car ID: 1983242
2026-03-25 18:33:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1964f38e-7668-52d5-8f4e-a6779e2bc63b with identifier: 1983242
2026-03-25 18:33:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1964f38e-7668-52d5-8f4e-a6779e2bc63b with scrape type 1
2026-03-25 18:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1964f38e-7668-52d5-8f4e-a6779e2bc63b
2026-03-25 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F541%252F5e7339def4b14c0f90a5c480bb8f4c8f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/541/5e7339def4b14c0f90a5c480bb8f4c8f/images/large/1.jpg not downloaded yet
2026-03-25 18:33:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ed2a050>
2026-03-25 18:33:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1e8f1fb-6fa9-52cb-bfaf-32e8a3b93394/d1e8f1fb-6fa9-52cb-bfaf-32e8a3b93394_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F487%252Fec98289a83eb4c5aaa1f8cce6cc2a432%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/487/ec98289a83eb4c5aaa1f8cce6cc2a432/images/large/1.jpg saved to cache
2026-03-25 18:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d1e8f1fb-6fa9-52cb-bfaf-32e8a3b93394
2026-03-25 18:33:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d1e8f1fb-6fa9-52cb-bfaf-32e8a3b93394, skipping ID generation
2026-03-25 18:33:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1e8f1fb-6fa9-52cb-bfaf-32e8a3b93394 with scrape type 1
2026-03-25 18:33:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d1e8f1fb-6fa9-52cb-bfaf-32e8a3b93394 sending to next pipeline
2026-03-25 18:33:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d1e8f1fb-6fa9-52cb-bfaf-32e8a3b93394, identifier: 1983232
2026-03-25 18:33:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8d445c90>
2026-03-25 18:33:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53a47d44-caf0-54a4-86a3-98f4981828bb/53a47d44-caf0-54a4-86a3-98f4981828bb_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F021%252Fcde3434ec9d94951b122d980a729948a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/021/cde3434ec9d94951b122d980a729948a/images/large/1.jpg saved to cache
2026-03-25 18:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 53a47d44-caf0-54a4-86a3-98f4981828bb
2026-03-25 18:33:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 53a47d44-caf0-54a4-86a3-98f4981828bb, skipping ID generation
2026-03-25 18:33:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53a47d44-caf0-54a4-86a3-98f4981828bb with scrape type 1
2026-03-25 18:33:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 53a47d44-caf0-54a4-86a3-98f4981828bb sending to next pipeline
2026-03-25 18:33:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 53a47d44-caf0-54a4-86a3-98f4981828bb, identifier: 1983233
2026-03-25 18:33:30 [ayvens.es] INFO: Found listing with ID: 1983243
2026-03-25 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983243%27 HTTP/1.1" 200 None
2026-03-25 18:33:30 [ayvens.es] INFO: Scrape type for 1983243: 1
2026-03-25 18:33:30 [ayvens.es] INFO: Extracting data for car ID: 1983243
2026-03-25 18:33:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2709d8a2-f94e-5b07-9e35-de0db8174ce1 with identifier: 1983243
2026-03-25 18:33:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2709d8a2-f94e-5b07-9e35-de0db8174ce1 with scrape type 1
2026-03-25 18:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2709d8a2-f94e-5b07-9e35-de0db8174ce1
2026-03-25 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F514%252Ff4b2b240e6cd43d28a710d73000863b5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/514/f4b2b240e6cd43d28a710d73000863b5/images/large/1.jpg not downloaded yet
2026-03-25 18:33:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d1e8f1fb-6fa9-52cb-bfaf-32e8a3b93394 with identifier: 1983232
2026-03-25 18:33:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d1e8f1fb-6fa9-52cb-bfaf-32e8a3b93394 with identifier: 1983232
2026-03-25 18:33:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d1e8f1fb-6fa9-52cb-bfaf-32e8a3b93394 with identifier: 1983232 to the API
2026-03-25 18:33:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/487/ec98289a83eb4c5aaa1f8cce6cc2a432/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 86,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'd1e8f1fb-6fa9-52cb-bfaf-32e8a3b93394',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'C-HR',
 'odometer': 113408,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1e8f1fb-6fa9-52cb-bfaf-32e8a3b93394/d1e8f1fb-6fa9-52cb-bfaf-32e8a3b93394_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 537076,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/487/ec98289a83eb4c5aaa1f8cce6cc2a432/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA C-HR 1.8 125H Advance',
 'transmission': 'manual',
 'trim': '1.8 125H Advance',
 'vin': None,
 'year': 2019}
2026-03-25 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983232%27 HTTP/1.1" 200 None
2026-03-25 18:33:30 [ayvens.es] INFO: Saving data for 1983232: {'created_time': 1774463610.996273, 'last_price_update_time': 1774463610.996285, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983232') HTTP/1.1" 204 0
2026-03-25 18:33:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 53a47d44-caf0-54a4-86a3-98f4981828bb with identifier: 1983233
2026-03-25 18:33:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 53a47d44-caf0-54a4-86a3-98f4981828bb with identifier: 1983233
2026-03-25 18:33:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 53a47d44-caf0-54a4-86a3-98f4981828bb with identifier: 1983233 to the API
2026-03-25 18:33:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/021/cde3434ec9d94951b122d980a729948a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Plata',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '53a47d44-caf0-54a4-86a3-98f4981828bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT',
 'odometer': 148829,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53a47d44-caf0-54a4-86a3-98f4981828bb/53a47d44-caf0-54a4-86a3-98f4981828bb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 274250,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/021/cde3434ec9d94951b122d980a729948a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT Business 2.0 TDI 90kW (122CV) DSG',
 'transmission': 'manual',
 'trim': 'Business 2.0 TDI 90kW (122CV) DSG',
 'vin': None,
 'year': 2020}
2026-03-25 18:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983233%27 HTTP/1.1" 200 None
2026-03-25 18:33:31 [ayvens.es] INFO: Saving data for 1983233: {'created_time': 1774463611.593983, 'last_price_update_time': 1774463611.593994, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983233') HTTP/1.1" 204 0
2026-03-25 18:33:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/005/7906621879fe4e83a03c325b8373e493/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/463/2a10783517af4135b607ff6257726357/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:31 [ayvens.es] INFO: Found listing with ID: 1983244
2026-03-25 18:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983244%27 HTTP/1.1" 200 None
2026-03-25 18:33:31 [ayvens.es] INFO: Scrape type for 1983244: 1
2026-03-25 18:33:31 [ayvens.es] INFO: Extracting data for car ID: 1983244
2026-03-25 18:33:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2942e398-94ca-57af-af16-9e114a9cb64e with identifier: 1983244
2026-03-25 18:33:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2942e398-94ca-57af-af16-9e114a9cb64e with scrape type 1
2026-03-25 18:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2942e398-94ca-57af-af16-9e114a9cb64e
2026-03-25 18:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F260%252F06a44116970d415482276d980e23f045%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/260/06a44116970d415482276d980e23f045/images/large/1.jpg not downloaded yet
2026-03-25 18:33:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8eecead0>
2026-03-25 18:33:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1128460-8b3a-5381-9b4e-f6e6e11acdf7/b1128460-8b3a-5381-9b4e-f6e6e11acdf7_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F056%252Fba9b7f11a3c74b46b24de7b5b9422adc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/056/ba9b7f11a3c74b46b24de7b5b9422adc/images/large/1.jpg saved to cache
2026-03-25 18:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b1128460-8b3a-5381-9b4e-f6e6e11acdf7
2026-03-25 18:33:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b1128460-8b3a-5381-9b4e-f6e6e11acdf7, skipping ID generation
2026-03-25 18:33:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1128460-8b3a-5381-9b4e-f6e6e11acdf7 with scrape type 1
2026-03-25 18:33:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b1128460-8b3a-5381-9b4e-f6e6e11acdf7 sending to next pipeline
2026-03-25 18:33:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b1128460-8b3a-5381-9b4e-f6e6e11acdf7, identifier: 1983234
2026-03-25 18:33:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ea19a90>
2026-03-25 18:33:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e848f52-90f3-5169-93b5-0ad760c23dea/7e848f52-90f3-5169-93b5-0ad760c23dea_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F067%252Fdfda95e698e145419ea9808e41673816%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/067/dfda95e698e145419ea9808e41673816/images/large/1.jpg saved to cache
2026-03-25 18:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7e848f52-90f3-5169-93b5-0ad760c23dea
2026-03-25 18:33:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7e848f52-90f3-5169-93b5-0ad760c23dea, skipping ID generation
2026-03-25 18:33:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e848f52-90f3-5169-93b5-0ad760c23dea with scrape type 1
2026-03-25 18:33:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7e848f52-90f3-5169-93b5-0ad760c23dea sending to next pipeline
2026-03-25 18:33:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7e848f52-90f3-5169-93b5-0ad760c23dea, identifier: 1983236
2026-03-25 18:33:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ea1a4d0>
2026-03-25 18:33:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8950396b-6249-5766-965d-1a65cefc07e2/8950396b-6249-5766-965d-1a65cefc07e2_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F709%252Fdb41e4cceee94bbf9a70b01bbf751556%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/709/db41e4cceee94bbf9a70b01bbf751556/images/large/1.jpg saved to cache
2026-03-25 18:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8950396b-6249-5766-965d-1a65cefc07e2
2026-03-25 18:33:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8950396b-6249-5766-965d-1a65cefc07e2, skipping ID generation
2026-03-25 18:33:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8950396b-6249-5766-965d-1a65cefc07e2 with scrape type 1
2026-03-25 18:33:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8950396b-6249-5766-965d-1a65cefc07e2 sending to next pipeline
2026-03-25 18:33:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8950396b-6249-5766-965d-1a65cefc07e2, identifier: 1983235
2026-03-25 18:33:32 [ayvens.es] INFO: Found listing with ID: 1983245
2026-03-25 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983245%27 HTTP/1.1" 200 None
2026-03-25 18:33:32 [ayvens.es] INFO: Scrape type for 1983245: 1
2026-03-25 18:33:32 [ayvens.es] INFO: Extracting data for car ID: 1983245
2026-03-25 18:33:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4439e569-8c08-55c0-9067-18f9c9d8a041 with identifier: 1983245
2026-03-25 18:33:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4439e569-8c08-55c0-9067-18f9c9d8a041 with scrape type 1
2026-03-25 18:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4439e569-8c08-55c0-9067-18f9c9d8a041
2026-03-25 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F874%252F34c50b5a59714b17963a3a6c3b0e0bcb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/874/34c50b5a59714b17963a3a6c3b0e0bcb/images/large/1.jpg not downloaded yet
2026-03-25 18:33:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b1128460-8b3a-5381-9b4e-f6e6e11acdf7 with identifier: 1983234
2026-03-25 18:33:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b1128460-8b3a-5381-9b4e-f6e6e11acdf7 with identifier: 1983234
2026-03-25 18:33:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b1128460-8b3a-5381-9b4e-f6e6e11acdf7 with identifier: 1983234 to the API
2026-03-25 18:33:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/056/ba9b7f11a3c74b46b24de7b5b9422adc/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 76,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'b1128460-8b3a-5381-9b4e-f6e6e11acdf7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'COROLLA',
 'odometer': 33751,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1128460-8b3a-5381-9b4e-f6e6e11acdf7/b1128460-8b3a-5381-9b4e-f6e6e11acdf7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 537792,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/056/ba9b7f11a3c74b46b24de7b5b9422adc/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA COROLLA 1.8 125H ACTIVE TECH E-CVT TOU SPORT',
 'transmission': 'manual',
 'trim': '1.8 125H ACTIVE TECH E-CVT TOU SPORT',
 'vin': None,
 'year': 2019}
2026-03-25 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983234%27 HTTP/1.1" 200 None
2026-03-25 18:33:32 [ayvens.es] INFO: Saving data for 1983234: {'created_time': 1774463612.663803, 'last_price_update_time': 1774463612.663816, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983234') HTTP/1.1" 204 0
2026-03-25 18:33:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7e848f52-90f3-5169-93b5-0ad760c23dea with identifier: 1983236
2026-03-25 18:33:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7e848f52-90f3-5169-93b5-0ad760c23dea with identifier: 1983236
2026-03-25 18:33:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7e848f52-90f3-5169-93b5-0ad760c23dea with identifier: 1983236 to the API
2026-03-25 18:33:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/067/dfda95e698e145419ea9808e41673816/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '7e848f52-90f3-5169-93b5-0ad760c23dea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KAROQ',
 'odometer': 45025,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e848f52-90f3-5169-93b5-0ad760c23dea/7e848f52-90f3-5169-93b5-0ad760c23dea_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 334042,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/067/dfda95e698e145419ea9808e41673816/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-01-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA KAROQ 2.0 TDI 85kW (115CV) Ambition',
 'transmission': 'manual',
 'trim': '2.0 TDI 85kW (115CV) Ambition',
 'vin': None,
 'year': 2024}
2026-03-25 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983236%27 HTTP/1.1" 200 None
2026-03-25 18:33:33 [ayvens.es] INFO: Saving data for 1983236: {'created_time': 1774463613.067343, 'last_price_update_time': 1774463613.067354, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983236') HTTP/1.1" 204 0
2026-03-25 18:33:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8950396b-6249-5766-965d-1a65cefc07e2 with identifier: 1983235
2026-03-25 18:33:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8950396b-6249-5766-965d-1a65cefc07e2 with identifier: 1983235
2026-03-25 18:33:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8950396b-6249-5766-965d-1a65cefc07e2 with identifier: 1983235 to the API
2026-03-25 18:33:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/709/db41e4cceee94bbf9a70b01bbf751556/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '8950396b-6249-5766-965d-1a65cefc07e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KAROQ',
 'odometer': 105966,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8950396b-6249-5766-965d-1a65cefc07e2/8950396b-6249-5766-965d-1a65cefc07e2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 339577,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/709/db41e4cceee94bbf9a70b01bbf751556/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA KAROQ 2.0 TDI 110kW (150CV) DSG 4X4 Ambition',
 'transmission': 'manual',
 'trim': '2.0 TDI 110kW (150CV) DSG 4X4 Ambition',
 'vin': None,
 'year': 2022}
2026-03-25 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983235%27 HTTP/1.1" 200 None
2026-03-25 18:33:33 [ayvens.es] INFO: Saving data for 1983235: {'created_time': 1774463613.419094, 'last_price_update_time': 1774463613.419105, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983235') HTTP/1.1" 204 0
2026-03-25 18:33:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/150/bde06b13f83a47cf8ccf51b951150f59/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/519/625b3113d5954fa38ec47b535d94b121/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:33 [ayvens.es] INFO: Found listing with ID: 1983246
2026-03-25 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983246%27 HTTP/1.1" 200 None
2026-03-25 18:33:33 [ayvens.es] INFO: Scrape type for 1983246: 1
2026-03-25 18:33:33 [ayvens.es] INFO: Extracting data for car ID: 1983246
2026-03-25 18:33:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8292dfa-0823-5de9-83e5-00a7ff903a8e with identifier: 1983246
2026-03-25 18:33:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8292dfa-0823-5de9-83e5-00a7ff903a8e with scrape type 1
2026-03-25 18:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b8292dfa-0823-5de9-83e5-00a7ff903a8e
2026-03-25 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F167%252F5edf2532601748c4896b46957cadd254%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/167/5edf2532601748c4896b46957cadd254/images/large/1.jpg not downloaded yet
2026-03-25 18:33:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ea75010>
2026-03-25 18:33:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26b4b0b3-49a6-568d-9346-33b55b1182c6/26b4b0b3-49a6-568d-9346-33b55b1182c6_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F005%252F7906621879fe4e83a03c325b8373e493%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/005/7906621879fe4e83a03c325b8373e493/images/large/1.jpg saved to cache
2026-03-25 18:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 26b4b0b3-49a6-568d-9346-33b55b1182c6
2026-03-25 18:33:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 26b4b0b3-49a6-568d-9346-33b55b1182c6, skipping ID generation
2026-03-25 18:33:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26b4b0b3-49a6-568d-9346-33b55b1182c6 with scrape type 1
2026-03-25 18:33:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 26b4b0b3-49a6-568d-9346-33b55b1182c6 sending to next pipeline
2026-03-25 18:33:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 26b4b0b3-49a6-568d-9346-33b55b1182c6, identifier: 1983237
2026-03-25 18:33:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ed17810>
2026-03-25 18:33:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35fbde2c-2b55-585d-8e4e-2547fa0e81b1/35fbde2c-2b55-585d-8e4e-2547fa0e81b1_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F463%252F2a10783517af4135b607ff6257726357%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/463/2a10783517af4135b607ff6257726357/images/large/1.jpg saved to cache
2026-03-25 18:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 35fbde2c-2b55-585d-8e4e-2547fa0e81b1
2026-03-25 18:33:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 35fbde2c-2b55-585d-8e4e-2547fa0e81b1, skipping ID generation
2026-03-25 18:33:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35fbde2c-2b55-585d-8e4e-2547fa0e81b1 with scrape type 1
2026-03-25 18:33:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 35fbde2c-2b55-585d-8e4e-2547fa0e81b1 sending to next pipeline
2026-03-25 18:33:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 35fbde2c-2b55-585d-8e4e-2547fa0e81b1, identifier: 1983238
2026-03-25 18:33:33 [ayvens.es] INFO: Found listing with ID: 1983247
2026-03-25 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983247%27 HTTP/1.1" 200 None
2026-03-25 18:33:33 [ayvens.es] INFO: Scrape type for 1983247: 1
2026-03-25 18:33:33 [ayvens.es] INFO: Extracting data for car ID: 1983247
2026-03-25 18:33:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7801a149-0d64-5b78-b165-0a64a47ecc77 with identifier: 1983247
2026-03-25 18:33:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7801a149-0d64-5b78-b165-0a64a47ecc77 with scrape type 1
2026-03-25 18:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7801a149-0d64-5b78-b165-0a64a47ecc77
2026-03-25 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F029%252F1a99459eb8374619b7796deb7df9c55a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/029/1a99459eb8374619b7796deb7df9c55a/images/large/1.jpg not downloaded yet
2026-03-25 18:33:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 26b4b0b3-49a6-568d-9346-33b55b1182c6 with identifier: 1983237
2026-03-25 18:33:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 26b4b0b3-49a6-568d-9346-33b55b1182c6 with identifier: 1983237
2026-03-25 18:33:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 26b4b0b3-49a6-568d-9346-33b55b1182c6 with identifier: 1983237 to the API
2026-03-25 18:33:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/005/7906621879fe4e83a03c325b8373e493/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '26b4b0b3-49a6-568d-9346-33b55b1182c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 196809,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26b4b0b3-49a6-568d-9346-33b55b1182c6/26b4b0b3-49a6-568d-9346-33b55b1182c6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 321307,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/005/7906621879fe4e83a03c325b8373e493/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON 2.0 TDI 85kW S&S Style Go',
 'transmission': 'manual',
 'trim': '2.0 TDI 85kW S&S Style Go',
 'vin': None,
 'year': 2021}
2026-03-25 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983237%27 HTTP/1.1" 200 None
2026-03-25 18:33:34 [ayvens.es] INFO: Saving data for 1983237: {'created_time': 1774463614.12069, 'last_price_update_time': 1774463614.120701, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983237') HTTP/1.1" 204 0
2026-03-25 18:33:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 35fbde2c-2b55-585d-8e4e-2547fa0e81b1 with identifier: 1983238
2026-03-25 18:33:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 35fbde2c-2b55-585d-8e4e-2547fa0e81b1 with identifier: 1983238
2026-03-25 18:33:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 35fbde2c-2b55-585d-8e4e-2547fa0e81b1 with identifier: 1983238 to the API
2026-03-25 18:33:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/463/2a10783517af4135b607ff6257726357/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 216,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '3.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '35fbde2c-2b55-585d-8e4e-2547fa0e81b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TOUAREG',
 'odometer': 154642,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35fbde2c-2b55-585d-8e4e-2547fa0e81b1/35fbde2c-2b55-585d-8e4e-2547fa0e81b1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 355461,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/463/2a10783517af4135b607ff6257726357/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN TOUAREG R-Line 3.0 V6 TDI 210kW Tip 4M',
 'transmission': 'manual',
 'trim': 'R-Line 3.0 V6 TDI 210kW Tip 4M',
 'vin': None,
 'year': 2023}
2026-03-25 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983238%27 HTTP/1.1" 200 None
2026-03-25 18:33:34 [ayvens.es] INFO: Saving data for 1983238: {'created_time': 1774463614.545907, 'last_price_update_time': 1774463614.545918, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983238') HTTP/1.1" 204 0
2026-03-25 18:33:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/524/eb099a2f15f9451789d4132250a4fbf2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:34 [ayvens.es] INFO: Found listing with ID: 1983248
2026-03-25 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983248%27 HTTP/1.1" 200 None
2026-03-25 18:33:34 [ayvens.es] INFO: Scrape type for 1983248: 1
2026-03-25 18:33:34 [ayvens.es] INFO: Extracting data for car ID: 1983248
2026-03-25 18:33:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8512e37-a5d6-54c6-a350-8c9df7d34778 with identifier: 1983248
2026-03-25 18:33:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8512e37-a5d6-54c6-a350-8c9df7d34778 with scrape type 1
2026-03-25 18:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a8512e37-a5d6-54c6-a350-8c9df7d34778
2026-03-25 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F523%252Fa145651e70494b66ad46d543d05b0001%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/523/a145651e70494b66ad46d543d05b0001/images/large/1.jpg not downloaded yet
2026-03-25 18:33:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8eaa9f90>
2026-03-25 18:33:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cb915b7-c7a4-595a-89b9-96a16f454ad4/8cb915b7-c7a4-595a-89b9-96a16f454ad4_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F150%252Fbde06b13f83a47cf8ccf51b951150f59%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/150/bde06b13f83a47cf8ccf51b951150f59/images/large/1.jpg saved to cache
2026-03-25 18:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8cb915b7-c7a4-595a-89b9-96a16f454ad4
2026-03-25 18:33:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8cb915b7-c7a4-595a-89b9-96a16f454ad4, skipping ID generation
2026-03-25 18:33:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8cb915b7-c7a4-595a-89b9-96a16f454ad4 with scrape type 1
2026-03-25 18:33:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8cb915b7-c7a4-595a-89b9-96a16f454ad4 sending to next pipeline
2026-03-25 18:33:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8cb915b7-c7a4-595a-89b9-96a16f454ad4, identifier: 1983240
2026-03-25 18:33:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8eaa8b90>
2026-03-25 18:33:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af25f67a-be95-510a-811f-f5868b0ac36e/af25f67a-be95-510a-811f-f5868b0ac36e_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F519%252F625b3113d5954fa38ec47b535d94b121%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/519/625b3113d5954fa38ec47b535d94b121/images/large/1.jpg saved to cache
2026-03-25 18:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item af25f67a-be95-510a-811f-f5868b0ac36e
2026-03-25 18:33:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: af25f67a-be95-510a-811f-f5868b0ac36e, skipping ID generation
2026-03-25 18:33:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af25f67a-be95-510a-811f-f5868b0ac36e with scrape type 1
2026-03-25 18:33:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item af25f67a-be95-510a-811f-f5868b0ac36e sending to next pipeline
2026-03-25 18:33:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: af25f67a-be95-510a-811f-f5868b0ac36e, identifier: 1983239
2026-03-25 18:33:34 [ayvens.es] INFO: Found listing with ID: 1983249
2026-03-25 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983249%27 HTTP/1.1" 200 None
2026-03-25 18:33:34 [ayvens.es] INFO: Scrape type for 1983249: 1
2026-03-25 18:33:34 [ayvens.es] INFO: Extracting data for car ID: 1983249
2026-03-25 18:33:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14f60679-7eff-50fc-882c-1c1438c72c65 with identifier: 1983249
2026-03-25 18:33:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14f60679-7eff-50fc-882c-1c1438c72c65 with scrape type 1
2026-03-25 18:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 14f60679-7eff-50fc-882c-1c1438c72c65
2026-03-25 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F336%252F627b81478fb04f1dba365a32c68e63a6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/336/627b81478fb04f1dba365a32c68e63a6/images/large/1.jpg not downloaded yet
2026-03-25 18:33:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8cb915b7-c7a4-595a-89b9-96a16f454ad4 with identifier: 1983240
2026-03-25 18:33:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8cb915b7-c7a4-595a-89b9-96a16f454ad4 with identifier: 1983240
2026-03-25 18:33:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8cb915b7-c7a4-595a-89b9-96a16f454ad4 with identifier: 1983240 to the API
2026-03-25 18:33:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/150/bde06b13f83a47cf8ccf51b951150f59/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 185,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.4L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '8cb915b7-c7a4-595a-89b9-96a16f454ad4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'HILUX',
 'odometer': 172258,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cb915b7-c7a4-595a-89b9-96a16f454ad4/8cb915b7-c7a4-595a-89b9-96a16f454ad4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 313300,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/150/bde06b13f83a47cf8ccf51b951150f59/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA HILUX 2.4 D-4D Cabina Doble GX',
 'transmission': 'manual',
 'trim': '2.4 D-4D Cabina Doble GX',
 'vin': None,
 'year': 2018}
2026-03-25 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983240%27 HTTP/1.1" 200 None
2026-03-25 18:33:35 [ayvens.es] INFO: Saving data for 1983240: {'created_time': 1774463615.312153, 'last_price_update_time': 1774463615.312165, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983240') HTTP/1.1" 204 0
2026-03-25 18:33:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: af25f67a-be95-510a-811f-f5868b0ac36e with identifier: 1983239
2026-03-25 18:33:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: af25f67a-be95-510a-811f-f5868b0ac36e with identifier: 1983239
2026-03-25 18:33:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: af25f67a-be95-510a-811f-f5868b0ac36e with identifier: 1983239 to the API
2026-03-25 18:33:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/519/625b3113d5954fa38ec47b535d94b121/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'af25f67a-be95-510a-811f-f5868b0ac36e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KAROQ',
 'odometer': 136941,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af25f67a-be95-510a-811f-f5868b0ac36e/af25f67a-be95-510a-811f-f5868b0ac36e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329591,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/519/625b3113d5954fa38ec47b535d94b121/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA KAROQ 2.0 TDI 110kW (150CV) DSG 4X4 Ambition',
 'transmission': 'manual',
 'trim': '2.0 TDI 110kW (150CV) DSG 4X4 Ambition',
 'vin': None,
 'year': 2022}
2026-03-25 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983239%27 HTTP/1.1" 200 None
2026-03-25 18:33:35 [ayvens.es] INFO: Saving data for 1983239: {'created_time': 1774463615.637782, 'last_price_update_time': 1774463615.637793, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983239') HTTP/1.1" 204 0
2026-03-25 18:33:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/541/5e7339def4b14c0f90a5c480bb8f4c8f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/514/f4b2b240e6cd43d28a710d73000863b5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:35 [ayvens.es] INFO: Found listing with ID: 1983250
2026-03-25 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983250%27 HTTP/1.1" 200 None
2026-03-25 18:33:35 [ayvens.es] INFO: Scrape type for 1983250: 1
2026-03-25 18:33:35 [ayvens.es] INFO: Extracting data for car ID: 1983250
2026-03-25 18:33:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05cf7ec0-ac44-52fc-9e60-46e93c50aae5 with identifier: 1983250
2026-03-25 18:33:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05cf7ec0-ac44-52fc-9e60-46e93c50aae5 with scrape type 1
2026-03-25 18:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 05cf7ec0-ac44-52fc-9e60-46e93c50aae5
2026-03-25 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F402%252F90229e2454a1402b8981c98401f1ee36%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/402/90229e2454a1402b8981c98401f1ee36/images/large/1.jpg not downloaded yet
2026-03-25 18:33:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae9e436dd0>
2026-03-25 18:33:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5f97a30-0ea4-5b16-83c1-68f40f220ecc/b5f97a30-0ea4-5b16-83c1-68f40f220ecc_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F524%252Feb099a2f15f9451789d4132250a4fbf2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/524/eb099a2f15f9451789d4132250a4fbf2/images/large/1.jpg saved to cache
2026-03-25 18:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b5f97a30-0ea4-5b16-83c1-68f40f220ecc
2026-03-25 18:33:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b5f97a30-0ea4-5b16-83c1-68f40f220ecc, skipping ID generation
2026-03-25 18:33:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5f97a30-0ea4-5b16-83c1-68f40f220ecc with scrape type 1
2026-03-25 18:33:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b5f97a30-0ea4-5b16-83c1-68f40f220ecc sending to next pipeline
2026-03-25 18:33:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b5f97a30-0ea4-5b16-83c1-68f40f220ecc, identifier: 1983241
2026-03-25 18:33:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/260/06a44116970d415482276d980e23f045/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:35 [ayvens.es] INFO: Found listing with ID: 1983251
2026-03-25 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983251%27 HTTP/1.1" 200 None
2026-03-25 18:33:35 [ayvens.es] INFO: Scrape type for 1983251: 1
2026-03-25 18:33:35 [ayvens.es] INFO: Extracting data for car ID: 1983251
2026-03-25 18:33:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5586b617-d741-5a89-a4d6-c082e3fcffed with identifier: 1983251
2026-03-25 18:33:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5586b617-d741-5a89-a4d6-c082e3fcffed with scrape type 1
2026-03-25 18:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5586b617-d741-5a89-a4d6-c082e3fcffed
2026-03-25 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F644%252Fa55d7bbfeb724c5a8275fd06830c9c32%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/644/a55d7bbfeb724c5a8275fd06830c9c32/images/large/1.jpg not downloaded yet
2026-03-25 18:33:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b5f97a30-0ea4-5b16-83c1-68f40f220ecc with identifier: 1983241
2026-03-25 18:33:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b5f97a30-0ea4-5b16-83c1-68f40f220ecc with identifier: 1983241
2026-03-25 18:33:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b5f97a30-0ea4-5b16-83c1-68f40f220ecc with identifier: 1983241 to the API
2026-03-25 18:33:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/524/eb099a2f15f9451789d4132250a4fbf2/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'electric',
 'id': 'b5f97a30-0ea4-5b16-83c1-68f40f220ecc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'MODEL 3',
 'odometer': 148253,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5f97a30-0ea4-5b16-83c1-68f40f220ecc/b5f97a30-0ea4-5b16-83c1-68f40f220ecc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 341997,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/524/eb099a2f15f9451789d4132250a4fbf2/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA MODEL 3 Gran Autonomia AWD',
 'transmission': 'manual',
 'trim': 'Gran Autonomia AWD',
 'vin': None,
 'year': 2019}
2026-03-25 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983241%27 HTTP/1.1" 200 None
2026-03-25 18:33:36 [ayvens.es] INFO: Saving data for 1983241: {'created_time': 1774463616.274358, 'last_price_update_time': 1774463616.274372, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983241') HTTP/1.1" 204 0
2026-03-25 18:33:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/874/34c50b5a59714b17963a3a6c3b0e0bcb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:36 [ayvens.es] INFO: Found listing with ID: 1983252
2026-03-25 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983252%27 HTTP/1.1" 200 None
2026-03-25 18:33:36 [ayvens.es] INFO: Scrape type for 1983252: 1
2026-03-25 18:33:36 [ayvens.es] INFO: Extracting data for car ID: 1983252
2026-03-25 18:33:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ef9819a-fa8e-50ad-9ca8-389b4a896034 with identifier: 1983252
2026-03-25 18:33:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ef9819a-fa8e-50ad-9ca8-389b4a896034 with scrape type 1
2026-03-25 18:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4ef9819a-fa8e-50ad-9ca8-389b4a896034
2026-03-25 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F189%252F4dc036e1712142eda5f1a88323d96d21%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/189/4dc036e1712142eda5f1a88323d96d21/images/large/1.jpg not downloaded yet
2026-03-25 18:33:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e5d2e10>
2026-03-25 18:33:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1964f38e-7668-52d5-8f4e-a6779e2bc63b/1964f38e-7668-52d5-8f4e-a6779e2bc63b_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F541%252F5e7339def4b14c0f90a5c480bb8f4c8f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/541/5e7339def4b14c0f90a5c480bb8f4c8f/images/large/1.jpg saved to cache
2026-03-25 18:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1964f38e-7668-52d5-8f4e-a6779e2bc63b
2026-03-25 18:33:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1964f38e-7668-52d5-8f4e-a6779e2bc63b, skipping ID generation
2026-03-25 18:33:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1964f38e-7668-52d5-8f4e-a6779e2bc63b with scrape type 1
2026-03-25 18:33:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1964f38e-7668-52d5-8f4e-a6779e2bc63b sending to next pipeline
2026-03-25 18:33:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1964f38e-7668-52d5-8f4e-a6779e2bc63b, identifier: 1983242
2026-03-25 18:33:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e571250>
2026-03-25 18:33:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2709d8a2-f94e-5b07-9e35-de0db8174ce1/2709d8a2-f94e-5b07-9e35-de0db8174ce1_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F514%252Ff4b2b240e6cd43d28a710d73000863b5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/514/f4b2b240e6cd43d28a710d73000863b5/images/large/1.jpg saved to cache
2026-03-25 18:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2709d8a2-f94e-5b07-9e35-de0db8174ce1
2026-03-25 18:33:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2709d8a2-f94e-5b07-9e35-de0db8174ce1, skipping ID generation
2026-03-25 18:33:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2709d8a2-f94e-5b07-9e35-de0db8174ce1 with scrape type 1
2026-03-25 18:33:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2709d8a2-f94e-5b07-9e35-de0db8174ce1 sending to next pipeline
2026-03-25 18:33:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2709d8a2-f94e-5b07-9e35-de0db8174ce1, identifier: 1983243
2026-03-25 18:33:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ea31090>
2026-03-25 18:33:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2942e398-94ca-57af-af16-9e114a9cb64e/2942e398-94ca-57af-af16-9e114a9cb64e_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F260%252F06a44116970d415482276d980e23f045%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/260/06a44116970d415482276d980e23f045/images/large/1.jpg saved to cache
2026-03-25 18:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2942e398-94ca-57af-af16-9e114a9cb64e
2026-03-25 18:33:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2942e398-94ca-57af-af16-9e114a9cb64e, skipping ID generation
2026-03-25 18:33:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2942e398-94ca-57af-af16-9e114a9cb64e with scrape type 1
2026-03-25 18:33:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2942e398-94ca-57af-af16-9e114a9cb64e sending to next pipeline
2026-03-25 18:33:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2942e398-94ca-57af-af16-9e114a9cb64e, identifier: 1983244
2026-03-25 18:33:36 [ayvens.es] INFO: Found listing with ID: 1983253
2026-03-25 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983253%27 HTTP/1.1" 200 None
2026-03-25 18:33:36 [ayvens.es] INFO: Scrape type for 1983253: 1
2026-03-25 18:33:36 [ayvens.es] INFO: Extracting data for car ID: 1983253
2026-03-25 18:33:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9849e4ed-7d3d-5312-b37b-6e8071493b2b with identifier: 1983253
2026-03-25 18:33:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9849e4ed-7d3d-5312-b37b-6e8071493b2b with scrape type 1
2026-03-25 18:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9849e4ed-7d3d-5312-b37b-6e8071493b2b
2026-03-25 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F105%252F5430974912824780ad7d2133ba846c11%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/105/5430974912824780ad7d2133ba846c11/images/large/1.jpg not downloaded yet
2026-03-25 18:33:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1964f38e-7668-52d5-8f4e-a6779e2bc63b with identifier: 1983242
2026-03-25 18:33:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1964f38e-7668-52d5-8f4e-a6779e2bc63b with identifier: 1983242
2026-03-25 18:33:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1964f38e-7668-52d5-8f4e-a6779e2bc63b with identifier: 1983242 to the API
2026-03-25 18:33:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/541/5e7339def4b14c0f90a5c480bb8f4c8f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '1964f38e-7668-52d5-8f4e-a6779e2bc63b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'C-HR',
 'odometer': 68790,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1964f38e-7668-52d5-8f4e-a6779e2bc63b/1964f38e-7668-52d5-8f4e-a6779e2bc63b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 573751,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/541/5e7339def4b14c0f90a5c480bb8f4c8f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA C-HR (O) 2.0 180H Advance',
 'transmission': 'manual',
 'trim': '(O) 2.0 180H Advance',
 'vin': None,
 'year': 2023}
2026-03-25 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983242%27 HTTP/1.1" 200 None
2026-03-25 18:33:37 [ayvens.es] INFO: Saving data for 1983242: {'created_time': 1774463617.178713, 'last_price_update_time': 1774463617.178723, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983242') HTTP/1.1" 204 0
2026-03-25 18:33:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2709d8a2-f94e-5b07-9e35-de0db8174ce1 with identifier: 1983243
2026-03-25 18:33:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2709d8a2-f94e-5b07-9e35-de0db8174ce1 with identifier: 1983243
2026-03-25 18:33:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 2709d8a2-f94e-5b07-9e35-de0db8174ce1 with identifier: 1983243 to the API
2026-03-25 18:33:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/514/f4b2b240e6cd43d28a710d73000863b5/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 86,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '2709d8a2-f94e-5b07-9e35-de0db8174ce1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'C-HR',
 'odometer': 45156,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2709d8a2-f94e-5b07-9e35-de0db8174ce1/2709d8a2-f94e-5b07-9e35-de0db8174ce1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 375306,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/514/f4b2b240e6cd43d28a710d73000863b5/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA C-HR 1.8 125H Advance',
 'transmission': 'manual',
 'trim': '1.8 125H Advance',
 'vin': None,
 'year': 2019}
2026-03-25 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983243%27 HTTP/1.1" 200 None
2026-03-25 18:33:37 [ayvens.es] INFO: Saving data for 1983243: {'created_time': 1774463617.52071, 'last_price_update_time': 1774463617.520721, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983243') HTTP/1.1" 204 0
2026-03-25 18:33:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2942e398-94ca-57af-af16-9e114a9cb64e with identifier: 1983244
2026-03-25 18:33:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2942e398-94ca-57af-af16-9e114a9cb64e with identifier: 1983244
2026-03-25 18:33:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 2942e398-94ca-57af-af16-9e114a9cb64e with identifier: 1983244 to the API
2026-03-25 18:33:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/260/06a44116970d415482276d980e23f045/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 93,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '2942e398-94ca-57af-af16-9e114a9cb64e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'AYGO',
 'odometer': 35473,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2942e398-94ca-57af-af16-9e114a9cb64e/2942e398-94ca-57af-af16-9e114a9cb64e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 475535,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/260/06a44116970d415482276d980e23f045/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-24',
 'seats_number': 4,
 'seller_name': None,
 'title': 'TOYOTA AYGO 1.0 70 x-play',
 'transmission': 'manual',
 'trim': '1.0 70 x-play',
 'vin': None,
 'year': 2020}
2026-03-25 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983244%27 HTTP/1.1" 200 None
2026-03-25 18:33:37 [ayvens.es] INFO: Saving data for 1983244: {'created_time': 1774463617.849151, 'last_price_update_time': 1774463617.849163, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983244') HTTP/1.1" 204 0
2026-03-25 18:33:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/167/5edf2532601748c4896b46957cadd254/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:37 [ayvens.es] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 300
2026-03-25 18:33:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e5a8190>
2026-03-25 18:33:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4439e569-8c08-55c0-9067-18f9c9d8a041/4439e569-8c08-55c0-9067-18f9c9d8a041_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F874%252F34c50b5a59714b17963a3a6c3b0e0bcb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/874/34c50b5a59714b17963a3a6c3b0e0bcb/images/large/1.jpg saved to cache
2026-03-25 18:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4439e569-8c08-55c0-9067-18f9c9d8a041
2026-03-25 18:33:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4439e569-8c08-55c0-9067-18f9c9d8a041, skipping ID generation
2026-03-25 18:33:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4439e569-8c08-55c0-9067-18f9c9d8a041 with scrape type 1
2026-03-25 18:33:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4439e569-8c08-55c0-9067-18f9c9d8a041 sending to next pipeline
2026-03-25 18:33:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4439e569-8c08-55c0-9067-18f9c9d8a041, identifier: 1983245
2026-03-25 18:33:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/523/a145651e70494b66ad46d543d05b0001/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4439e569-8c08-55c0-9067-18f9c9d8a041 with identifier: 1983245
2026-03-25 18:33:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4439e569-8c08-55c0-9067-18f9c9d8a041 with identifier: 1983245
2026-03-25 18:33:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 4439e569-8c08-55c0-9067-18f9c9d8a041 with identifier: 1983245 to the API
2026-03-25 18:33:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/874/34c50b5a59714b17963a3a6c3b0e0bcb/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '4439e569-8c08-55c0-9067-18f9c9d8a041',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 186782,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4439e569-8c08-55c0-9067-18f9c9d8a041/4439e569-8c08-55c0-9067-18f9c9d8a041_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 321631,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/874/34c50b5a59714b17963a3a6c3b0e0bcb/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON 2.0 TDI 85kW S&S Style Go',
 'transmission': 'manual',
 'trim': '2.0 TDI 85kW S&S Style Go',
 'vin': None,
 'year': 2021}
2026-03-25 18:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983245%27 HTTP/1.1" 200 None
2026-03-25 18:33:38 [ayvens.es] INFO: Saving data for 1983245: {'created_time': 1774463618.330668, 'last_price_update_time': 1774463618.330681, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983245') HTTP/1.1" 204 0
2026-03-25 18:33:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 18:33:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/029/1a99459eb8374619b7796deb7df9c55a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/402/90229e2454a1402b8981c98401f1ee36/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e5abf10>
2026-03-25 18:33:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8292dfa-0823-5de9-83e5-00a7ff903a8e/b8292dfa-0823-5de9-83e5-00a7ff903a8e_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F167%252F5edf2532601748c4896b46957cadd254%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/167/5edf2532601748c4896b46957cadd254/images/large/1.jpg saved to cache
2026-03-25 18:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b8292dfa-0823-5de9-83e5-00a7ff903a8e
2026-03-25 18:33:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b8292dfa-0823-5de9-83e5-00a7ff903a8e, skipping ID generation
2026-03-25 18:33:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8292dfa-0823-5de9-83e5-00a7ff903a8e with scrape type 1
2026-03-25 18:33:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b8292dfa-0823-5de9-83e5-00a7ff903a8e sending to next pipeline
2026-03-25 18:33:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b8292dfa-0823-5de9-83e5-00a7ff903a8e, identifier: 1983246
2026-03-25 18:33:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b8292dfa-0823-5de9-83e5-00a7ff903a8e with identifier: 1983246
2026-03-25 18:33:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b8292dfa-0823-5de9-83e5-00a7ff903a8e with identifier: 1983246
2026-03-25 18:33:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b8292dfa-0823-5de9-83e5-00a7ff903a8e with identifier: 1983246 to the API
2026-03-25 18:33:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/167/5edf2532601748c4896b46957cadd254/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b8292dfa-0823-5de9-83e5-00a7ff903a8e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT',
 'odometer': 121017,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8292dfa-0823-5de9-83e5-00a7ff903a8e/b8292dfa-0823-5de9-83e5-00a7ff903a8e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 532409,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/167/5edf2532601748c4896b46957cadd254/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT Business 2.0 TDI 90kW (122CV) DSG',
 'transmission': 'manual',
 'trim': 'Business 2.0 TDI 90kW (122CV) DSG',
 'vin': None,
 'year': 2021}
2026-03-25 18:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983246%27 HTTP/1.1" 200 None
2026-03-25 18:33:38 [ayvens.es] INFO: Saving data for 1983246: {'created_time': 1774463618.928533, 'last_price_update_time': 1774463618.928548, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983246') HTTP/1.1" 204 0
2026-03-25 18:33:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/336/627b81478fb04f1dba365a32c68e63a6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ecd8b50>
2026-03-25 18:33:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8512e37-a5d6-54c6-a350-8c9df7d34778/a8512e37-a5d6-54c6-a350-8c9df7d34778_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F523%252Fa145651e70494b66ad46d543d05b0001%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/523/a145651e70494b66ad46d543d05b0001/images/large/1.jpg saved to cache
2026-03-25 18:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a8512e37-a5d6-54c6-a350-8c9df7d34778
2026-03-25 18:33:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a8512e37-a5d6-54c6-a350-8c9df7d34778, skipping ID generation
2026-03-25 18:33:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8512e37-a5d6-54c6-a350-8c9df7d34778 with scrape type 1
2026-03-25 18:33:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a8512e37-a5d6-54c6-a350-8c9df7d34778 sending to next pipeline
2026-03-25 18:33:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a8512e37-a5d6-54c6-a350-8c9df7d34778, identifier: 1983248
2026-03-25 18:33:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a8512e37-a5d6-54c6-a350-8c9df7d34778 with identifier: 1983248
2026-03-25 18:33:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a8512e37-a5d6-54c6-a350-8c9df7d34778 with identifier: 1983248
2026-03-25 18:33:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a8512e37-a5d6-54c6-a350-8c9df7d34778 with identifier: 1983248 to the API
2026-03-25 18:33:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/523/a145651e70494b66ad46d543d05b0001/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a8512e37-a5d6-54c6-a350-8c9df7d34778',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 194649,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8512e37-a5d6-54c6-a350-8c9df7d34778/a8512e37-a5d6-54c6-a350-8c9df7d34778_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 491087,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/523/a145651e70494b66ad46d543d05b0001/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON 1.6 TDI 85kW (115CV) St&Sp Style',
 'transmission': 'manual',
 'trim': '1.6 TDI 85kW (115CV) St&Sp Style',
 'vin': None,
 'year': 2019}
2026-03-25 18:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983248%27 HTTP/1.1" 200 None
2026-03-25 18:33:39 [ayvens.es] INFO: Saving data for 1983248: {'created_time': 1774463619.550894, 'last_price_update_time': 1774463619.550906, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983248') HTTP/1.1" 204 0
2026-03-25 18:33:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/189/4dc036e1712142eda5f1a88323d96d21/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae90f5b790>
2026-03-25 18:33:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7801a149-0d64-5b78-b165-0a64a47ecc77/7801a149-0d64-5b78-b165-0a64a47ecc77_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F029%252F1a99459eb8374619b7796deb7df9c55a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/029/1a99459eb8374619b7796deb7df9c55a/images/large/1.jpg saved to cache
2026-03-25 18:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7801a149-0d64-5b78-b165-0a64a47ecc77
2026-03-25 18:33:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7801a149-0d64-5b78-b165-0a64a47ecc77, skipping ID generation
2026-03-25 18:33:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7801a149-0d64-5b78-b165-0a64a47ecc77 with scrape type 1
2026-03-25 18:33:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7801a149-0d64-5b78-b165-0a64a47ecc77 sending to next pipeline
2026-03-25 18:33:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7801a149-0d64-5b78-b165-0a64a47ecc77, identifier: 1983247
2026-03-25 18:33:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8edad7d0>
2026-03-25 18:33:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05cf7ec0-ac44-52fc-9e60-46e93c50aae5/05cf7ec0-ac44-52fc-9e60-46e93c50aae5_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F402%252F90229e2454a1402b8981c98401f1ee36%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/402/90229e2454a1402b8981c98401f1ee36/images/large/1.jpg saved to cache
2026-03-25 18:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 05cf7ec0-ac44-52fc-9e60-46e93c50aae5
2026-03-25 18:33:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 05cf7ec0-ac44-52fc-9e60-46e93c50aae5, skipping ID generation
2026-03-25 18:33:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05cf7ec0-ac44-52fc-9e60-46e93c50aae5 with scrape type 1
2026-03-25 18:33:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 05cf7ec0-ac44-52fc-9e60-46e93c50aae5 sending to next pipeline
2026-03-25 18:33:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 05cf7ec0-ac44-52fc-9e60-46e93c50aae5, identifier: 1983250
2026-03-25 18:33:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7801a149-0d64-5b78-b165-0a64a47ecc77 with identifier: 1983247
2026-03-25 18:33:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7801a149-0d64-5b78-b165-0a64a47ecc77 with identifier: 1983247
2026-03-25 18:33:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7801a149-0d64-5b78-b165-0a64a47ecc77 with identifier: 1983247 to the API
2026-03-25 18:33:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/029/1a99459eb8374619b7796deb7df9c55a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'Rojo',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '7801a149-0d64-5b78-b165-0a64a47ecc77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'RAV4',
 'odometer': 102327,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7801a149-0d64-5b78-b165-0a64a47ecc77/7801a149-0d64-5b78-b165-0a64a47ecc77_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 530645,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/029/1a99459eb8374619b7796deb7df9c55a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA RAV4 2.5l 220H Advance',
 'transmission': 'manual',
 'trim': '2.5l 220H Advance',
 'vin': None,
 'year': 2022}
2026-03-25 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983247%27 HTTP/1.1" 200 None
2026-03-25 18:33:40 [ayvens.es] INFO: Saving data for 1983247: {'created_time': 1774463620.241708, 'last_price_update_time': 1774463620.24219, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983247') HTTP/1.1" 204 0
2026-03-25 18:33:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 05cf7ec0-ac44-52fc-9e60-46e93c50aae5 with identifier: 1983250
2026-03-25 18:33:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 05cf7ec0-ac44-52fc-9e60-46e93c50aae5 with identifier: 1983250
2026-03-25 18:33:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 05cf7ec0-ac44-52fc-9e60-46e93c50aae5 with identifier: 1983250 to the API
2026-03-25 18:33:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/402/90229e2454a1402b8981c98401f1ee36/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '05cf7ec0-ac44-52fc-9e60-46e93c50aae5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KODIAQ',
 'odometer': 152048,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05cf7ec0-ac44-52fc-9e60-46e93c50aae5/05cf7ec0-ac44-52fc-9e60-46e93c50aae5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 379421,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/402/90229e2454a1402b8981c98401f1ee36/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA KODIAQ 2.0 TDI 110KW (150cv) DSG 4x2 Ambition',
 'transmission': 'manual',
 'trim': '2.0 TDI 110KW (150cv) DSG 4x2 Ambition',
 'vin': None,
 'year': 2021}
2026-03-25 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983250%27 HTTP/1.1" 200 None
2026-03-25 18:33:40 [ayvens.es] INFO: Saving data for 1983250: {'created_time': 1774463620.747861, 'last_price_update_time': 1774463620.747872, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983250') HTTP/1.1" 204 0
2026-03-25 18:33:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae90f5b610>
2026-03-25 18:33:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14f60679-7eff-50fc-882c-1c1438c72c65/14f60679-7eff-50fc-882c-1c1438c72c65_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F336%252F627b81478fb04f1dba365a32c68e63a6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/336/627b81478fb04f1dba365a32c68e63a6/images/large/1.jpg saved to cache
2026-03-25 18:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 14f60679-7eff-50fc-882c-1c1438c72c65
2026-03-25 18:33:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 14f60679-7eff-50fc-882c-1c1438c72c65, skipping ID generation
2026-03-25 18:33:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14f60679-7eff-50fc-882c-1c1438c72c65 with scrape type 1
2026-03-25 18:33:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 14f60679-7eff-50fc-882c-1c1438c72c65 sending to next pipeline
2026-03-25 18:33:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 14f60679-7eff-50fc-882c-1c1438c72c65, identifier: 1983249
2026-03-25 18:33:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/644/a55d7bbfeb724c5a8275fd06830c9c32/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 14f60679-7eff-50fc-882c-1c1438c72c65 with identifier: 1983249
2026-03-25 18:33:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 14f60679-7eff-50fc-882c-1c1438c72c65 with identifier: 1983249
2026-03-25 18:33:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 14f60679-7eff-50fc-882c-1c1438c72c65 with identifier: 1983249 to the API
2026-03-25 18:33:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/336/627b81478fb04f1dba365a32c68e63a6/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'Azul',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '14f60679-7eff-50fc-882c-1c1438c72c65',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'RAV4',
 'odometer': 124383,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14f60679-7eff-50fc-882c-1c1438c72c65/14f60679-7eff-50fc-882c-1c1438c72c65_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 458226,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/336/627b81478fb04f1dba365a32c68e63a6/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA RAV4 2.5l 220H Advance Plus',
 'transmission': 'manual',
 'trim': '2.5l 220H Advance Plus',
 'vin': None,
 'year': 2020}
2026-03-25 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983249%27 HTTP/1.1" 200 None
2026-03-25 18:33:41 [ayvens.es] INFO: Saving data for 1983249: {'created_time': 1774463621.248259, 'last_price_update_time': 1774463621.248289, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983249') HTTP/1.1" 204 0
2026-03-25 18:33:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/105/5430974912824780ad7d2133ba846c11/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e5c22d0>
2026-03-25 18:33:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ef9819a-fa8e-50ad-9ca8-389b4a896034/4ef9819a-fa8e-50ad-9ca8-389b4a896034_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F189%252F4dc036e1712142eda5f1a88323d96d21%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/189/4dc036e1712142eda5f1a88323d96d21/images/large/1.jpg saved to cache
2026-03-25 18:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4ef9819a-fa8e-50ad-9ca8-389b4a896034
2026-03-25 18:33:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4ef9819a-fa8e-50ad-9ca8-389b4a896034, skipping ID generation
2026-03-25 18:33:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ef9819a-fa8e-50ad-9ca8-389b4a896034 with scrape type 1
2026-03-25 18:33:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4ef9819a-fa8e-50ad-9ca8-389b4a896034 sending to next pipeline
2026-03-25 18:33:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4ef9819a-fa8e-50ad-9ca8-389b4a896034, identifier: 1983252
2026-03-25 18:33:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4ef9819a-fa8e-50ad-9ca8-389b4a896034 with identifier: 1983252
2026-03-25 18:33:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4ef9819a-fa8e-50ad-9ca8-389b4a896034 with identifier: 1983252
2026-03-25 18:33:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 4ef9819a-fa8e-50ad-9ca8-389b4a896034 with identifier: 1983252 to the API
2026-03-25 18:33:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/189/4dc036e1712142eda5f1a88323d96d21/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 148,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '4ef9819a-fa8e-50ad-9ca8-389b4a896034',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN',
 'odometer': 36073,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ef9819a-fa8e-50ad-9ca8-389b4a896034/4ef9819a-fa8e-50ad-9ca8-389b4a896034_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 337668,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/189/4dc036e1712142eda5f1a88323d96d21/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN 2.0TDI 110KW CONNECT',
 'transmission': 'manual',
 'trim': '2.0TDI 110KW CONNECT',
 'vin': None,
 'year': 2021}
2026-03-25 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983252%27 HTTP/1.1" 200 None
2026-03-25 18:33:41 [ayvens.es] INFO: Saving data for 1983252: {'created_time': 1774463621.775251, 'last_price_update_time': 1774463621.775261, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983252') HTTP/1.1" 204 0
2026-03-25 18:33:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e5c0e10>
2026-03-25 18:33:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5586b617-d741-5a89-a4d6-c082e3fcffed/5586b617-d741-5a89-a4d6-c082e3fcffed_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F644%252Fa55d7bbfeb724c5a8275fd06830c9c32%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/644/a55d7bbfeb724c5a8275fd06830c9c32/images/large/1.jpg saved to cache
2026-03-25 18:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5586b617-d741-5a89-a4d6-c082e3fcffed
2026-03-25 18:33:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5586b617-d741-5a89-a4d6-c082e3fcffed, skipping ID generation
2026-03-25 18:33:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5586b617-d741-5a89-a4d6-c082e3fcffed with scrape type 1
2026-03-25 18:33:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5586b617-d741-5a89-a4d6-c082e3fcffed sending to next pipeline
2026-03-25 18:33:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5586b617-d741-5a89-a4d6-c082e3fcffed, identifier: 1983251
2026-03-25 18:33:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5586b617-d741-5a89-a4d6-c082e3fcffed with identifier: 1983251
2026-03-25 18:33:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5586b617-d741-5a89-a4d6-c082e3fcffed with identifier: 1983251
2026-03-25 18:33:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5586b617-d741-5a89-a4d6-c082e3fcffed with identifier: 1983251 to the API
2026-03-25 18:33:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/644/a55d7bbfeb724c5a8275fd06830c9c32/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '5586b617-d741-5a89-a4d6-c082e3fcffed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF',
 'odometer': 121924,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5586b617-d741-5a89-a4d6-c082e3fcffed/5586b617-d741-5a89-a4d6-c082e3fcffed_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 571757,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/644/a55d7bbfeb724c5a8275fd06830c9c32/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF 2.0 TDI 85kW (115CV) Variant',
 'transmission': 'manual',
 'trim': '2.0 TDI 85kW (115CV) Variant',
 'vin': None,
 'year': 2021}
2026-03-25 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983251%27 HTTP/1.1" 200 None
2026-03-25 18:33:42 [ayvens.es] INFO: Saving data for 1983251: {'created_time': 1774463622.227802, 'last_price_update_time': 1774463622.227814, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983251') HTTP/1.1" 204 0
2026-03-25 18:33:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae90743ad0>
2026-03-25 18:33:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9849e4ed-7d3d-5312-b37b-6e8071493b2b/9849e4ed-7d3d-5312-b37b-6e8071493b2b_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F105%252F5430974912824780ad7d2133ba846c11%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/105/5430974912824780ad7d2133ba846c11/images/large/1.jpg saved to cache
2026-03-25 18:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9849e4ed-7d3d-5312-b37b-6e8071493b2b
2026-03-25 18:33:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9849e4ed-7d3d-5312-b37b-6e8071493b2b, skipping ID generation
2026-03-25 18:33:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9849e4ed-7d3d-5312-b37b-6e8071493b2b with scrape type 1
2026-03-25 18:33:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9849e4ed-7d3d-5312-b37b-6e8071493b2b sending to next pipeline
2026-03-25 18:33:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9849e4ed-7d3d-5312-b37b-6e8071493b2b, identifier: 1983253
2026-03-25 18:33:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9849e4ed-7d3d-5312-b37b-6e8071493b2b with identifier: 1983253
2026-03-25 18:33:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9849e4ed-7d3d-5312-b37b-6e8071493b2b with identifier: 1983253
2026-03-25 18:33:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9849e4ed-7d3d-5312-b37b-6e8071493b2b with identifier: 1983253 to the API
2026-03-25 18:33:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/105/5430974912824780ad7d2133ba846c11/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '9849e4ed-7d3d-5312-b37b-6e8071493b2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 177833,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9849e4ed-7d3d-5312-b37b-6e8071493b2b/9849e4ed-7d3d-5312-b37b-6e8071493b2b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 499050,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/105/5430974912824780ad7d2133ba846c11/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON 1.6 TDI 85kW St&Sp Reference Plus',
 'transmission': 'manual',
 'trim': '1.6 TDI 85kW St&Sp Reference Plus',
 'vin': None,
 'year': 2017}
2026-03-25 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983253%27 HTTP/1.1" 200 None
2026-03-25 18:33:42 [ayvens.es] INFO: Saving data for 1983253: {'created_time': 1774463622.727856, 'last_price_update_time': 1774463622.727867, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983253') HTTP/1.1" 204 0
2026-03-25 18:33:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-25 18:33:53 [ayvens.es] INFO: Found listing with ID: 1983254
2026-03-25 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983254%27 HTTP/1.1" 200 None
2026-03-25 18:33:53 [ayvens.es] INFO: Scrape type for 1983254: 1
2026-03-25 18:33:53 [ayvens.es] INFO: Extracting data for car ID: 1983254
2026-03-25 18:33:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c868f7e0-13ed-58dd-8902-30aa2edbe80d with identifier: 1983254
2026-03-25 18:33:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c868f7e0-13ed-58dd-8902-30aa2edbe80d with scrape type 1
2026-03-25 18:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c868f7e0-13ed-58dd-8902-30aa2edbe80d
2026-03-25 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F538%252Ff9501d7df7db4995950354efe75ecac4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/538/f9501d7df7db4995950354efe75ecac4/images/large/1.jpg not downloaded yet
2026-03-25 18:33:53 [ayvens.es] INFO: Found listing with ID: 1983255
2026-03-25 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983255%27 HTTP/1.1" 200 None
2026-03-25 18:33:53 [ayvens.es] INFO: Scrape type for 1983255: 1
2026-03-25 18:33:53 [ayvens.es] INFO: Extracting data for car ID: 1983255
2026-03-25 18:33:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63966038-c529-5adb-9b16-777fbbeb3f6a with identifier: 1983255
2026-03-25 18:33:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63966038-c529-5adb-9b16-777fbbeb3f6a with scrape type 1
2026-03-25 18:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 63966038-c529-5adb-9b16-777fbbeb3f6a
2026-03-25 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F758%252F9888e7649fa840c2ad0c77203e33a8fb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/758/9888e7649fa840c2ad0c77203e33a8fb/images/large/1.jpg not downloaded yet
2026-03-25 18:33:53 [ayvens.es] INFO: Found listing with ID: 1983256
2026-03-25 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983256%27 HTTP/1.1" 200 None
2026-03-25 18:33:53 [ayvens.es] INFO: Scrape type for 1983256: 1
2026-03-25 18:33:53 [ayvens.es] INFO: Extracting data for car ID: 1983256
2026-03-25 18:33:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5487f55d-85bd-518e-ad3d-06870a462059 with identifier: 1983256
2026-03-25 18:33:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5487f55d-85bd-518e-ad3d-06870a462059 with scrape type 1
2026-03-25 18:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5487f55d-85bd-518e-ad3d-06870a462059
2026-03-25 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F684%252Fe5e6f37f30ab4e16852ddd6a9e41e043%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/684/e5e6f37f30ab4e16852ddd6a9e41e043/images/large/1.jpg not downloaded yet
2026-03-25 18:33:53 [ayvens.es] INFO: Found listing with ID: 1983257
2026-03-25 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983257%27 HTTP/1.1" 200 None
2026-03-25 18:33:53 [ayvens.es] INFO: Scrape type for 1983257: 1
2026-03-25 18:33:53 [ayvens.es] INFO: Extracting data for car ID: 1983257
2026-03-25 18:33:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1fc496f-bbc2-5723-99d5-50e07acb5704 with identifier: 1983257
2026-03-25 18:33:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1fc496f-bbc2-5723-99d5-50e07acb5704 with scrape type 1
2026-03-25 18:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b1fc496f-bbc2-5723-99d5-50e07acb5704
2026-03-25 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F847%252F15604f9bad62466bb55de8b451ee1a06%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/847/15604f9bad62466bb55de8b451ee1a06/images/large/1.jpg not downloaded yet
2026-03-25 18:33:53 [ayvens.es] INFO: Found listing with ID: 1983258
2026-03-25 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983258%27 HTTP/1.1" 200 None
2026-03-25 18:33:53 [ayvens.es] INFO: Scrape type for 1983258: 1
2026-03-25 18:33:53 [ayvens.es] INFO: Extracting data for car ID: 1983258
2026-03-25 18:33:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcdedda1-08dc-550b-8a05-c39fdc00c7e0 with identifier: 1983258
2026-03-25 18:33:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcdedda1-08dc-550b-8a05-c39fdc00c7e0 with scrape type 1
2026-03-25 18:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item dcdedda1-08dc-550b-8a05-c39fdc00c7e0
2026-03-25 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F610%252F07364446bcf84168aa293e39efd1aa8c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/610/07364446bcf84168aa293e39efd1aa8c/images/large/1.jpg not downloaded yet
2026-03-25 18:33:53 [ayvens.es] INFO: Found listing with ID: 1983259
2026-03-25 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983259%27 HTTP/1.1" 200 None
2026-03-25 18:33:53 [ayvens.es] INFO: Scrape type for 1983259: 1
2026-03-25 18:33:53 [ayvens.es] INFO: Extracting data for car ID: 1983259
2026-03-25 18:33:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a907e2fb-35cb-5e63-a532-e58b00773c39 with identifier: 1983259
2026-03-25 18:33:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a907e2fb-35cb-5e63-a532-e58b00773c39 with scrape type 1
2026-03-25 18:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a907e2fb-35cb-5e63-a532-e58b00773c39
2026-03-25 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F746%252F52e5e54971c74ee785017ec2e5f7d2ab%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/746/52e5e54971c74ee785017ec2e5f7d2ab/images/large/1.jpg not downloaded yet
2026-03-25 18:33:53 [ayvens.es] INFO: Found listing with ID: 1983260
2026-03-25 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983260%27 HTTP/1.1" 200 None
2026-03-25 18:33:53 [ayvens.es] INFO: Scrape type for 1983260: 1
2026-03-25 18:33:53 [ayvens.es] INFO: Extracting data for car ID: 1983260
2026-03-25 18:33:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84aa738e-2482-53a4-8d0f-e5663b79db4a with identifier: 1983260
2026-03-25 18:33:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84aa738e-2482-53a4-8d0f-e5663b79db4a with scrape type 1
2026-03-25 18:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 84aa738e-2482-53a4-8d0f-e5663b79db4a
2026-03-25 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F716%252F79e5104dc87f4a85a09e025d8aa53589%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/716/79e5104dc87f4a85a09e025d8aa53589/images/large/1.jpg not downloaded yet
2026-03-25 18:33:53 [ayvens.es] INFO: Found listing with ID: 1983261
2026-03-25 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983261%27 HTTP/1.1" 200 None
2026-03-25 18:33:53 [ayvens.es] INFO: Scrape type for 1983261: 1
2026-03-25 18:33:53 [ayvens.es] INFO: Extracting data for car ID: 1983261
2026-03-25 18:33:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79448ccd-cb64-50b9-ac74-027a510490ce with identifier: 1983261
2026-03-25 18:33:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79448ccd-cb64-50b9-ac74-027a510490ce with scrape type 1
2026-03-25 18:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 79448ccd-cb64-50b9-ac74-027a510490ce
2026-03-25 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F595%252F113685c3e295492f93c6ff099dc696eb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/595/113685c3e295492f93c6ff099dc696eb/images/large/1.jpg not downloaded yet
2026-03-25 18:33:53 [ayvens.es] INFO: Found listing with ID: 1983262
2026-03-25 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983262%27 HTTP/1.1" 200 None
2026-03-25 18:33:53 [ayvens.es] INFO: Scrape type for 1983262: 1
2026-03-25 18:33:53 [ayvens.es] INFO: Extracting data for car ID: 1983262
2026-03-25 18:33:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3966841-133d-5842-9d95-3d1587f2805f with identifier: 1983262
2026-03-25 18:33:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3966841-133d-5842-9d95-3d1587f2805f with scrape type 1
2026-03-25 18:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d3966841-133d-5842-9d95-3d1587f2805f
2026-03-25 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F559%252Fc5609db4a0e54439b716b239889ecff8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/559/c5609db4a0e54439b716b239889ecff8/images/large/1.jpg not downloaded yet
2026-03-25 18:33:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/538/f9501d7df7db4995950354efe75ecac4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:53 [ayvens.es] INFO: Found listing with ID: 1983263
2026-03-25 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983263%27 HTTP/1.1" 200 None
2026-03-25 18:33:53 [ayvens.es] INFO: Scrape type for 1983263: 1
2026-03-25 18:33:53 [ayvens.es] INFO: Extracting data for car ID: 1983263
2026-03-25 18:33:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7dff0bc6-1b5f-50bf-bde3-a44a7c85384b with identifier: 1983263
2026-03-25 18:33:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7dff0bc6-1b5f-50bf-bde3-a44a7c85384b with scrape type 1
2026-03-25 18:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7dff0bc6-1b5f-50bf-bde3-a44a7c85384b
2026-03-25 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F267%252F7285410f508c41bcbe2946b650eb04c2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/267/7285410f508c41bcbe2946b650eb04c2/images/large/1.jpg not downloaded yet
2026-03-25 18:33:53 [ayvens.es] INFO: Found listing with ID: 1983264
2026-03-25 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983264%27 HTTP/1.1" 200 None
2026-03-25 18:33:53 [ayvens.es] INFO: Scrape type for 1983264: 1
2026-03-25 18:33:53 [ayvens.es] INFO: Extracting data for car ID: 1983264
2026-03-25 18:33:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8846fd48-f524-54f4-bd33-46c2112e40d5 with identifier: 1983264
2026-03-25 18:33:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8846fd48-f524-54f4-bd33-46c2112e40d5 with scrape type 1
2026-03-25 18:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8846fd48-f524-54f4-bd33-46c2112e40d5
2026-03-25 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F913%252F933854fb07f54a1eb76554a0e460b36d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/913/933854fb07f54a1eb76554a0e460b36d/images/large/1.jpg not downloaded yet
2026-03-25 18:33:53 [ayvens.es] INFO: Found listing with ID: 1983265
2026-03-25 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983265%27 HTTP/1.1" 200 None
2026-03-25 18:33:53 [ayvens.es] INFO: Scrape type for 1983265: 1
2026-03-25 18:33:53 [ayvens.es] INFO: Extracting data for car ID: 1983265
2026-03-25 18:33:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b31943e-2546-5d4c-899e-a61577e4b52a with identifier: 1983265
2026-03-25 18:33:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b31943e-2546-5d4c-899e-a61577e4b52a with scrape type 1
2026-03-25 18:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5b31943e-2546-5d4c-899e-a61577e4b52a
2026-03-25 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F820%252F3511f2b926c04ffcb682f308b2bd8bde%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/820/3511f2b926c04ffcb682f308b2bd8bde/images/large/1.jpg not downloaded yet
2026-03-25 18:33:53 [ayvens.es] INFO: Found listing with ID: 1983266
2026-03-25 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983266%27 HTTP/1.1" 200 None
2026-03-25 18:33:53 [ayvens.es] INFO: Scrape type for 1983266: 1
2026-03-25 18:33:53 [ayvens.es] INFO: Extracting data for car ID: 1983266
2026-03-25 18:33:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 652e8fb7-1346-50d3-9895-f121f51893b8 with identifier: 1983266
2026-03-25 18:33:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 652e8fb7-1346-50d3-9895-f121f51893b8 with scrape type 1
2026-03-25 18:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 652e8fb7-1346-50d3-9895-f121f51893b8
2026-03-25 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F449%252F6fc3e434131b4e12bfb6d47c3477e948%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/449/6fc3e434131b4e12bfb6d47c3477e948/images/large/1.jpg not downloaded yet
2026-03-25 18:33:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ed16c50>
2026-03-25 18:33:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c868f7e0-13ed-58dd-8902-30aa2edbe80d/c868f7e0-13ed-58dd-8902-30aa2edbe80d_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F538%252Ff9501d7df7db4995950354efe75ecac4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/538/f9501d7df7db4995950354efe75ecac4/images/large/1.jpg saved to cache
2026-03-25 18:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c868f7e0-13ed-58dd-8902-30aa2edbe80d
2026-03-25 18:33:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c868f7e0-13ed-58dd-8902-30aa2edbe80d, skipping ID generation
2026-03-25 18:33:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c868f7e0-13ed-58dd-8902-30aa2edbe80d with scrape type 1
2026-03-25 18:33:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c868f7e0-13ed-58dd-8902-30aa2edbe80d sending to next pipeline
2026-03-25 18:33:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c868f7e0-13ed-58dd-8902-30aa2edbe80d, identifier: 1983254
2026-03-25 18:33:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/684/e5e6f37f30ab4e16852ddd6a9e41e043/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:53 [ayvens.es] INFO: Found listing with ID: 1983267
2026-03-25 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983267%27 HTTP/1.1" 200 None
2026-03-25 18:33:53 [ayvens.es] INFO: Scrape type for 1983267: 1
2026-03-25 18:33:53 [ayvens.es] INFO: Extracting data for car ID: 1983267
2026-03-25 18:33:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e7f61ff-e6bc-59e0-8eb9-af773161399e with identifier: 1983267
2026-03-25 18:33:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e7f61ff-e6bc-59e0-8eb9-af773161399e with scrape type 1
2026-03-25 18:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3e7f61ff-e6bc-59e0-8eb9-af773161399e
2026-03-25 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F521%252F1de2e54f70da4fd3a7093559d58a8a7b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/521/1de2e54f70da4fd3a7093559d58a8a7b/images/large/1.jpg not downloaded yet
2026-03-25 18:33:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c868f7e0-13ed-58dd-8902-30aa2edbe80d with identifier: 1983254
2026-03-25 18:33:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c868f7e0-13ed-58dd-8902-30aa2edbe80d with identifier: 1983254
2026-03-25 18:33:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c868f7e0-13ed-58dd-8902-30aa2edbe80d with identifier: 1983254 to the API
2026-03-25 18:33:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/538/f9501d7df7db4995950354efe75ecac4/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'c868f7e0-13ed-58dd-8902-30aa2edbe80d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'POLO',
 'odometer': 52059,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c868f7e0-13ed-58dd-8902-30aa2edbe80d/c868f7e0-13ed-58dd-8902-30aa2edbe80d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344968,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/538/f9501d7df7db4995950354efe75ecac4/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN POLO Life 1.0 TSI 70kW (95CV)',
 'transmission': 'manual',
 'trim': 'Life 1.0 TSI 70kW (95CV)',
 'vin': None,
 'year': 2021}
2026-03-25 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983254%27 HTTP/1.1" 200 None
2026-03-25 18:33:54 [ayvens.es] INFO: Saving data for 1983254: {'created_time': 1774463634.212031, 'last_price_update_time': 1774463634.212043, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983254') HTTP/1.1" 204 0
2026-03-25 18:33:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/746/52e5e54971c74ee785017ec2e5f7d2ab/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/847/15604f9bad62466bb55de8b451ee1a06/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:54 [ayvens.es] INFO: Found listing with ID: 1983268
2026-03-25 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983268%27 HTTP/1.1" 200 None
2026-03-25 18:33:54 [ayvens.es] INFO: Scrape type for 1983268: 1
2026-03-25 18:33:54 [ayvens.es] INFO: Extracting data for car ID: 1983268
2026-03-25 18:33:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 358cecdc-c39f-5175-a713-7ddc9d28db76 with identifier: 1983268
2026-03-25 18:33:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 358cecdc-c39f-5175-a713-7ddc9d28db76 with scrape type 1
2026-03-25 18:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 358cecdc-c39f-5175-a713-7ddc9d28db76
2026-03-25 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F654%252F8f9f170e51d840499c543ecd1dfdc3c1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/654/8f9f170e51d840499c543ecd1dfdc3c1/images/large/1.jpg not downloaded yet
2026-03-25 18:33:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/758/9888e7649fa840c2ad0c77203e33a8fb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ecdb890>
2026-03-25 18:33:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5487f55d-85bd-518e-ad3d-06870a462059/5487f55d-85bd-518e-ad3d-06870a462059_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F684%252Fe5e6f37f30ab4e16852ddd6a9e41e043%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/684/e5e6f37f30ab4e16852ddd6a9e41e043/images/large/1.jpg saved to cache
2026-03-25 18:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5487f55d-85bd-518e-ad3d-06870a462059
2026-03-25 18:33:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5487f55d-85bd-518e-ad3d-06870a462059, skipping ID generation
2026-03-25 18:33:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5487f55d-85bd-518e-ad3d-06870a462059 with scrape type 1
2026-03-25 18:33:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5487f55d-85bd-518e-ad3d-06870a462059 sending to next pipeline
2026-03-25 18:33:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5487f55d-85bd-518e-ad3d-06870a462059, identifier: 1983256
2026-03-25 18:33:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/610/07364446bcf84168aa293e39efd1aa8c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/559/c5609db4a0e54439b716b239889ecff8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:54 [ayvens.es] INFO: Found listing with ID: 1983269
2026-03-25 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983269%27 HTTP/1.1" 200 None
2026-03-25 18:33:54 [ayvens.es] INFO: Scrape type for 1983269: 1
2026-03-25 18:33:54 [ayvens.es] INFO: Extracting data for car ID: 1983269
2026-03-25 18:33:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b04894bc-51ed-550f-ab01-faa49b2d9012 with identifier: 1983269
2026-03-25 18:33:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b04894bc-51ed-550f-ab01-faa49b2d9012 with scrape type 1
2026-03-25 18:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b04894bc-51ed-550f-ab01-faa49b2d9012
2026-03-25 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F498%252Fcab42031c14a49448e91681f9bd076aa%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/498/cab42031c14a49448e91681f9bd076aa/images/large/1.jpg not downloaded yet
2026-03-25 18:33:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5487f55d-85bd-518e-ad3d-06870a462059 with identifier: 1983256
2026-03-25 18:33:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5487f55d-85bd-518e-ad3d-06870a462059 with identifier: 1983256
2026-03-25 18:33:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5487f55d-85bd-518e-ad3d-06870a462059 with identifier: 1983256 to the API
2026-03-25 18:33:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/684/e5e6f37f30ab4e16852ddd6a9e41e043/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '5487f55d-85bd-518e-ad3d-06870a462059',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-CROSS',
 'odometer': 61625,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5487f55d-85bd-518e-ad3d-06870a462059/5487f55d-85bd-518e-ad3d-06870a462059_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 497545,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/684/e5e6f37f30ab4e16852ddd6a9e41e043/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-CROSS Edition 1.0 TSI 70kW (95CV)',
 'transmission': 'manual',
 'trim': 'Edition 1.0 TSI 70kW (95CV)',
 'vin': None,
 'year': 2021}
2026-03-25 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983256%27 HTTP/1.1" 200 None
2026-03-25 18:33:54 [ayvens.es] INFO: Saving data for 1983256: {'created_time': 1774463634.935545, 'last_price_update_time': 1774463634.935554, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983256') HTTP/1.1" 204 0
2026-03-25 18:33:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/716/79e5104dc87f4a85a09e025d8aa53589/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:55 [ayvens.es] INFO: Found listing with ID: 1983270
2026-03-25 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983270%27 HTTP/1.1" 200 None
2026-03-25 18:33:55 [ayvens.es] INFO: Scrape type for 1983270: 1
2026-03-25 18:33:55 [ayvens.es] INFO: Extracting data for car ID: 1983270
2026-03-25 18:33:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 734cdb07-26e5-50e3-a626-1d3e22697190 with identifier: 1983270
2026-03-25 18:33:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 734cdb07-26e5-50e3-a626-1d3e22697190 with scrape type 1
2026-03-25 18:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 734cdb07-26e5-50e3-a626-1d3e22697190
2026-03-25 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F275%252F1b35ffb397ec44638a09a24c99b25b95%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/275/1b35ffb397ec44638a09a24c99b25b95/images/large/1.jpg not downloaded yet
2026-03-25 18:33:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8d4173d0>
2026-03-25 18:33:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a907e2fb-35cb-5e63-a532-e58b00773c39/a907e2fb-35cb-5e63-a532-e58b00773c39_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F746%252F52e5e54971c74ee785017ec2e5f7d2ab%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/746/52e5e54971c74ee785017ec2e5f7d2ab/images/large/1.jpg saved to cache
2026-03-25 18:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a907e2fb-35cb-5e63-a532-e58b00773c39
2026-03-25 18:33:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a907e2fb-35cb-5e63-a532-e58b00773c39, skipping ID generation
2026-03-25 18:33:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a907e2fb-35cb-5e63-a532-e58b00773c39 with scrape type 1
2026-03-25 18:33:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a907e2fb-35cb-5e63-a532-e58b00773c39 sending to next pipeline
2026-03-25 18:33:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a907e2fb-35cb-5e63-a532-e58b00773c39, identifier: 1983259
2026-03-25 18:33:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ec54390>
2026-03-25 18:33:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1fc496f-bbc2-5723-99d5-50e07acb5704/b1fc496f-bbc2-5723-99d5-50e07acb5704_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F847%252F15604f9bad62466bb55de8b451ee1a06%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/847/15604f9bad62466bb55de8b451ee1a06/images/large/1.jpg saved to cache
2026-03-25 18:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b1fc496f-bbc2-5723-99d5-50e07acb5704
2026-03-25 18:33:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b1fc496f-bbc2-5723-99d5-50e07acb5704, skipping ID generation
2026-03-25 18:33:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1fc496f-bbc2-5723-99d5-50e07acb5704 with scrape type 1
2026-03-25 18:33:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b1fc496f-bbc2-5723-99d5-50e07acb5704 sending to next pipeline
2026-03-25 18:33:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b1fc496f-bbc2-5723-99d5-50e07acb5704, identifier: 1983257
2026-03-25 18:33:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ea1b110>
2026-03-25 18:33:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63966038-c529-5adb-9b16-777fbbeb3f6a/63966038-c529-5adb-9b16-777fbbeb3f6a_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F758%252F9888e7649fa840c2ad0c77203e33a8fb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/758/9888e7649fa840c2ad0c77203e33a8fb/images/large/1.jpg saved to cache
2026-03-25 18:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 63966038-c529-5adb-9b16-777fbbeb3f6a
2026-03-25 18:33:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 63966038-c529-5adb-9b16-777fbbeb3f6a, skipping ID generation
2026-03-25 18:33:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63966038-c529-5adb-9b16-777fbbeb3f6a with scrape type 1
2026-03-25 18:33:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 63966038-c529-5adb-9b16-777fbbeb3f6a sending to next pipeline
2026-03-25 18:33:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 63966038-c529-5adb-9b16-777fbbeb3f6a, identifier: 1983255
2026-03-25 18:33:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e59ca50>
2026-03-25 18:33:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcdedda1-08dc-550b-8a05-c39fdc00c7e0/dcdedda1-08dc-550b-8a05-c39fdc00c7e0_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F610%252F07364446bcf84168aa293e39efd1aa8c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/610/07364446bcf84168aa293e39efd1aa8c/images/large/1.jpg saved to cache
2026-03-25 18:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dcdedda1-08dc-550b-8a05-c39fdc00c7e0
2026-03-25 18:33:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dcdedda1-08dc-550b-8a05-c39fdc00c7e0, skipping ID generation
2026-03-25 18:33:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcdedda1-08dc-550b-8a05-c39fdc00c7e0 with scrape type 1
2026-03-25 18:33:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dcdedda1-08dc-550b-8a05-c39fdc00c7e0 sending to next pipeline
2026-03-25 18:33:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: dcdedda1-08dc-550b-8a05-c39fdc00c7e0, identifier: 1983258
2026-03-25 18:33:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8eeada90>
2026-03-25 18:33:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3966841-133d-5842-9d95-3d1587f2805f/d3966841-133d-5842-9d95-3d1587f2805f_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F559%252Fc5609db4a0e54439b716b239889ecff8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/559/c5609db4a0e54439b716b239889ecff8/images/large/1.jpg saved to cache
2026-03-25 18:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d3966841-133d-5842-9d95-3d1587f2805f
2026-03-25 18:33:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d3966841-133d-5842-9d95-3d1587f2805f, skipping ID generation
2026-03-25 18:33:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3966841-133d-5842-9d95-3d1587f2805f with scrape type 1
2026-03-25 18:33:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d3966841-133d-5842-9d95-3d1587f2805f sending to next pipeline
2026-03-25 18:33:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d3966841-133d-5842-9d95-3d1587f2805f, identifier: 1983262
2026-03-25 18:33:55 [ayvens.es] INFO: Found listing with ID: 1983271
2026-03-25 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983271%27 HTTP/1.1" 200 None
2026-03-25 18:33:55 [ayvens.es] INFO: Scrape type for 1983271: 1
2026-03-25 18:33:55 [ayvens.es] INFO: Extracting data for car ID: 1983271
2026-03-25 18:33:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4da8f32a-e1f2-59ca-b1df-811b16a0de96 with identifier: 1983271
2026-03-25 18:33:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4da8f32a-e1f2-59ca-b1df-811b16a0de96 with scrape type 1
2026-03-25 18:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4da8f32a-e1f2-59ca-b1df-811b16a0de96
2026-03-25 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F328%252Fe88552399a4543f3b62fd05e990c0543%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/328/e88552399a4543f3b62fd05e990c0543/images/large/1.jpg not downloaded yet
2026-03-25 18:33:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a907e2fb-35cb-5e63-a532-e58b00773c39 with identifier: 1983259
2026-03-25 18:33:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a907e2fb-35cb-5e63-a532-e58b00773c39 with identifier: 1983259
2026-03-25 18:33:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a907e2fb-35cb-5e63-a532-e58b00773c39 with identifier: 1983259 to the API
2026-03-25 18:33:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/746/52e5e54971c74ee785017ec2e5f7d2ab/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'a907e2fb-35cb-5e63-a532-e58b00773c39',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'COROLLA',
 'odometer': 124457,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a907e2fb-35cb-5e63-a532-e58b00773c39/a907e2fb-35cb-5e63-a532-e58b00773c39_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 476713,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/746/52e5e54971c74ee785017ec2e5f7d2ab/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA COROLLA 1.8 125H STYLE E-CVT TOURING SPORT',
 'transmission': 'manual',
 'trim': '1.8 125H STYLE E-CVT TOURING SPORT',
 'vin': None,
 'year': 2021}
2026-03-25 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983259%27 HTTP/1.1" 200 None
2026-03-25 18:33:56 [ayvens.es] INFO: Saving data for 1983259: {'created_time': 1774463636.226141, 'last_price_update_time': 1774463636.226152, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983259') HTTP/1.1" 204 0
2026-03-25 18:33:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b1fc496f-bbc2-5723-99d5-50e07acb5704 with identifier: 1983257
2026-03-25 18:33:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b1fc496f-bbc2-5723-99d5-50e07acb5704 with identifier: 1983257
2026-03-25 18:33:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b1fc496f-bbc2-5723-99d5-50e07acb5704 with identifier: 1983257 to the API
2026-03-25 18:33:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/847/15604f9bad62466bb55de8b451ee1a06/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'b1fc496f-bbc2-5723-99d5-50e07acb5704',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'COROLLA',
 'odometer': 76052,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1fc496f-bbc2-5723-99d5-50e07acb5704/b1fc496f-bbc2-5723-99d5-50e07acb5704_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 343120,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/847/15604f9bad62466bb55de8b451ee1a06/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA COROLLA 1.8 125H ACTIVE TECH E-CVT TOU SPORT',
 'transmission': 'manual',
 'trim': '1.8 125H ACTIVE TECH E-CVT TOU SPORT',
 'vin': None,
 'year': 2021}
2026-03-25 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983257%27 HTTP/1.1" 200 None
2026-03-25 18:33:56 [ayvens.es] INFO: Saving data for 1983257: {'created_time': 1774463636.554458, 'last_price_update_time': 1774463636.554468, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983257') HTTP/1.1" 204 0
2026-03-25 18:33:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 63966038-c529-5adb-9b16-777fbbeb3f6a with identifier: 1983255
2026-03-25 18:33:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 63966038-c529-5adb-9b16-777fbbeb3f6a with identifier: 1983255
2026-03-25 18:33:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 63966038-c529-5adb-9b16-777fbbeb3f6a with identifier: 1983255 to the API
2026-03-25 18:33:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/758/9888e7649fa840c2ad0c77203e33a8fb/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'color': 'Rojo',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '63966038-c529-5adb-9b16-777fbbeb3f6a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-ROC',
 'odometer': 110687,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63966038-c529-5adb-9b16-777fbbeb3f6a/63966038-c529-5adb-9b16-777fbbeb3f6a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 514681,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/758/9888e7649fa840c2ad0c77203e33a8fb/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-ROC Advance R-Line 1.0 TSI 81kW (110CV)',
 'transmission': 'manual',
 'trim': 'Advance R-Line 1.0 TSI 81kW (110CV)',
 'vin': None,
 'year': 2021}
2026-03-25 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983255%27 HTTP/1.1" 200 None
2026-03-25 18:33:56 [ayvens.es] INFO: Saving data for 1983255: {'created_time': 1774463636.908916, 'last_price_update_time': 1774463636.908928, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983255') HTTP/1.1" 204 0
2026-03-25 18:33:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: dcdedda1-08dc-550b-8a05-c39fdc00c7e0 with identifier: 1983258
2026-03-25 18:33:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: dcdedda1-08dc-550b-8a05-c39fdc00c7e0 with identifier: 1983258
2026-03-25 18:33:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: dcdedda1-08dc-550b-8a05-c39fdc00c7e0 with identifier: 1983258 to the API
2026-03-25 18:33:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/610/07364446bcf84168aa293e39efd1aa8c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'dcdedda1-08dc-550b-8a05-c39fdc00c7e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'COROLLA',
 'odometer': 78501,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcdedda1-08dc-550b-8a05-c39fdc00c7e0/dcdedda1-08dc-550b-8a05-c39fdc00c7e0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 539256,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/610/07364446bcf84168aa293e39efd1aa8c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA COROLLA 1.8 125H ACTIVE TECH E-CVT TOU SPORT',
 'transmission': 'manual',
 'trim': '1.8 125H ACTIVE TECH E-CVT TOU SPORT',
 'vin': None,
 'year': 2021}
2026-03-25 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983258%27 HTTP/1.1" 200 None
2026-03-25 18:33:57 [ayvens.es] INFO: Saving data for 1983258: {'created_time': 1774463637.267189, 'last_price_update_time': 1774463637.2672, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983258') HTTP/1.1" 204 0
2026-03-25 18:33:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d3966841-133d-5842-9d95-3d1587f2805f with identifier: 1983262
2026-03-25 18:33:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d3966841-133d-5842-9d95-3d1587f2805f with identifier: 1983262
2026-03-25 18:33:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d3966841-133d-5842-9d95-3d1587f2805f with identifier: 1983262 to the API
2026-03-25 18:33:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/559/c5609db4a0e54439b716b239889ecff8/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 101,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd3966841-133d-5842-9d95-3d1587f2805f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF',
 'odometer': 178422,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3966841-133d-5842-9d95-3d1587f2805f/d3966841-133d-5842-9d95-3d1587f2805f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 320204,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/559/c5609db4a0e54439b716b239889ecff8/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF Sport 1.6 TDI 110CV BMT',
 'transmission': 'manual',
 'trim': 'Sport 1.6 TDI 110CV BMT',
 'vin': None,
 'year': 2015}
2026-03-25 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983262%27 HTTP/1.1" 200 None
2026-03-25 18:33:57 [ayvens.es] INFO: Saving data for 1983262: {'created_time': 1774463637.598562, 'last_price_update_time': 1774463637.598573, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983262') HTTP/1.1" 204 0
2026-03-25 18:33:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/595/113685c3e295492f93c6ff099dc696eb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/913/933854fb07f54a1eb76554a0e460b36d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/267/7285410f508c41bcbe2946b650eb04c2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:57 [ayvens.es] INFO: Found listing with ID: 1983272
2026-03-25 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983272%27 HTTP/1.1" 200 None
2026-03-25 18:33:57 [ayvens.es] INFO: Scrape type for 1983272: 1
2026-03-25 18:33:57 [ayvens.es] INFO: Extracting data for car ID: 1983272
2026-03-25 18:33:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 628a28f9-0e65-5f98-8b4b-d9da2e07329e with identifier: 1983272
2026-03-25 18:33:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 628a28f9-0e65-5f98-8b4b-d9da2e07329e with scrape type 1
2026-03-25 18:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 628a28f9-0e65-5f98-8b4b-d9da2e07329e
2026-03-25 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F669%252F6e0d059d64414d45a0b70b1186a50ee2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/669/6e0d059d64414d45a0b70b1186a50ee2/images/large/1.jpg not downloaded yet
2026-03-25 18:33:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/820/3511f2b926c04ffcb682f308b2bd8bde/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e5c8850>
2026-03-25 18:33:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84aa738e-2482-53a4-8d0f-e5663b79db4a/84aa738e-2482-53a4-8d0f-e5663b79db4a_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F716%252F79e5104dc87f4a85a09e025d8aa53589%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/716/79e5104dc87f4a85a09e025d8aa53589/images/large/1.jpg saved to cache
2026-03-25 18:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 84aa738e-2482-53a4-8d0f-e5663b79db4a
2026-03-25 18:33:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 84aa738e-2482-53a4-8d0f-e5663b79db4a, skipping ID generation
2026-03-25 18:33:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84aa738e-2482-53a4-8d0f-e5663b79db4a with scrape type 1
2026-03-25 18:33:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 84aa738e-2482-53a4-8d0f-e5663b79db4a sending to next pipeline
2026-03-25 18:33:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 84aa738e-2482-53a4-8d0f-e5663b79db4a, identifier: 1983260
2026-03-25 18:33:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/521/1de2e54f70da4fd3a7093559d58a8a7b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:57 [ayvens.es] INFO: Found listing with ID: 1983273
2026-03-25 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983273%27 HTTP/1.1" 200 None
2026-03-25 18:33:57 [ayvens.es] INFO: Scrape type for 1983273: 1
2026-03-25 18:33:57 [ayvens.es] INFO: Extracting data for car ID: 1983273
2026-03-25 18:33:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63f9e6d2-1ae0-5b38-8cde-1c8eca61f576 with identifier: 1983273
2026-03-25 18:33:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63f9e6d2-1ae0-5b38-8cde-1c8eca61f576 with scrape type 1
2026-03-25 18:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 63f9e6d2-1ae0-5b38-8cde-1c8eca61f576
2026-03-25 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F746%252Fa34b57a05b884231a63c77ab41b460f1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/746/a34b57a05b884231a63c77ab41b460f1/images/large/1.jpg not downloaded yet
2026-03-25 18:33:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 84aa738e-2482-53a4-8d0f-e5663b79db4a with identifier: 1983260
2026-03-25 18:33:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 84aa738e-2482-53a4-8d0f-e5663b79db4a with identifier: 1983260
2026-03-25 18:33:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 84aa738e-2482-53a4-8d0f-e5663b79db4a with identifier: 1983260 to the API
2026-03-25 18:33:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/716/79e5104dc87f4a85a09e025d8aa53589/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '84aa738e-2482-53a4-8d0f-e5663b79db4a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF',
 'odometer': 111359,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84aa738e-2482-53a4-8d0f-e5663b79db4a/84aa738e-2482-53a4-8d0f-e5663b79db4a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 474340,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/716/79e5104dc87f4a85a09e025d8aa53589/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF Edition 1.6 TDI 85kW (115CV)',
 'transmission': 'manual',
 'trim': 'Edition 1.6 TDI 85kW (115CV)',
 'vin': None,
 'year': 2017}
2026-03-25 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983260%27 HTTP/1.1" 200 None
2026-03-25 18:33:58 [ayvens.es] INFO: Saving data for 1983260: {'created_time': 1774463638.30241, 'last_price_update_time': 1774463638.302421, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983260') HTTP/1.1" 204 0
2026-03-25 18:33:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/449/6fc3e434131b4e12bfb6d47c3477e948/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/654/8f9f170e51d840499c543ecd1dfdc3c1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:33:58 [ayvens.es] INFO: Found listing with ID: 1983274
2026-03-25 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983274%27 HTTP/1.1" 200 None
2026-03-25 18:33:58 [ayvens.es] INFO: Scrape type for 1983274: 1
2026-03-25 18:33:58 [ayvens.es] INFO: Extracting data for car ID: 1983274
2026-03-25 18:33:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e8725c0-aeb6-5342-9fe9-5d241a6eda91 with identifier: 1983274
2026-03-25 18:33:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e8725c0-aeb6-5342-9fe9-5d241a6eda91 with scrape type 1
2026-03-25 18:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3e8725c0-aeb6-5342-9fe9-5d241a6eda91
2026-03-25 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F353%252F35dcc5c9a4ef43b58b7f213fd0974323%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/353/35dcc5c9a4ef43b58b7f213fd0974323/images/large/1.jpg not downloaded yet
2026-03-25 18:33:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ea6d090>
2026-03-25 18:33:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79448ccd-cb64-50b9-ac74-027a510490ce/79448ccd-cb64-50b9-ac74-027a510490ce_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F595%252F113685c3e295492f93c6ff099dc696eb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/595/113685c3e295492f93c6ff099dc696eb/images/large/1.jpg saved to cache
2026-03-25 18:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 79448ccd-cb64-50b9-ac74-027a510490ce
2026-03-25 18:33:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 79448ccd-cb64-50b9-ac74-027a510490ce, skipping ID generation
2026-03-25 18:33:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79448ccd-cb64-50b9-ac74-027a510490ce with scrape type 1
2026-03-25 18:33:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 79448ccd-cb64-50b9-ac74-027a510490ce sending to next pipeline
2026-03-25 18:33:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 79448ccd-cb64-50b9-ac74-027a510490ce, identifier: 1983261
2026-03-25 18:33:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae9e434650>
2026-03-25 18:33:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8846fd48-f524-54f4-bd33-46c2112e40d5/8846fd48-f524-54f4-bd33-46c2112e40d5_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F913%252F933854fb07f54a1eb76554a0e460b36d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/913/933854fb07f54a1eb76554a0e460b36d/images/large/1.jpg saved to cache
2026-03-25 18:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8846fd48-f524-54f4-bd33-46c2112e40d5
2026-03-25 18:33:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8846fd48-f524-54f4-bd33-46c2112e40d5, skipping ID generation
2026-03-25 18:33:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8846fd48-f524-54f4-bd33-46c2112e40d5 with scrape type 1
2026-03-25 18:33:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8846fd48-f524-54f4-bd33-46c2112e40d5 sending to next pipeline
2026-03-25 18:33:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8846fd48-f524-54f4-bd33-46c2112e40d5, identifier: 1983264
2026-03-25 18:33:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8eeadb90>
2026-03-25 18:33:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dff0bc6-1b5f-50bf-bde3-a44a7c85384b/7dff0bc6-1b5f-50bf-bde3-a44a7c85384b_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F267%252F7285410f508c41bcbe2946b650eb04c2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/267/7285410f508c41bcbe2946b650eb04c2/images/large/1.jpg saved to cache
2026-03-25 18:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7dff0bc6-1b5f-50bf-bde3-a44a7c85384b
2026-03-25 18:33:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7dff0bc6-1b5f-50bf-bde3-a44a7c85384b, skipping ID generation
2026-03-25 18:33:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7dff0bc6-1b5f-50bf-bde3-a44a7c85384b with scrape type 1
2026-03-25 18:33:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7dff0bc6-1b5f-50bf-bde3-a44a7c85384b sending to next pipeline
2026-03-25 18:33:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7dff0bc6-1b5f-50bf-bde3-a44a7c85384b, identifier: 1983263
2026-03-25 18:33:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8eed5450>
2026-03-25 18:33:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b31943e-2546-5d4c-899e-a61577e4b52a/5b31943e-2546-5d4c-899e-a61577e4b52a_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F820%252F3511f2b926c04ffcb682f308b2bd8bde%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/820/3511f2b926c04ffcb682f308b2bd8bde/images/large/1.jpg saved to cache
2026-03-25 18:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5b31943e-2546-5d4c-899e-a61577e4b52a
2026-03-25 18:33:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5b31943e-2546-5d4c-899e-a61577e4b52a, skipping ID generation
2026-03-25 18:33:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b31943e-2546-5d4c-899e-a61577e4b52a with scrape type 1
2026-03-25 18:33:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5b31943e-2546-5d4c-899e-a61577e4b52a sending to next pipeline
2026-03-25 18:33:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5b31943e-2546-5d4c-899e-a61577e4b52a, identifier: 1983265
2026-03-25 18:33:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:33:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8eda3190>
2026-03-25 18:33:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:33:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:33:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:33:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e7f61ff-e6bc-59e0-8eb9-af773161399e/3e7f61ff-e6bc-59e0-8eb9-af773161399e_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F521%252F1de2e54f70da4fd3a7093559d58a8a7b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/521/1de2e54f70da4fd3a7093559d58a8a7b/images/large/1.jpg saved to cache
2026-03-25 18:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3e7f61ff-e6bc-59e0-8eb9-af773161399e
2026-03-25 18:33:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3e7f61ff-e6bc-59e0-8eb9-af773161399e, skipping ID generation
2026-03-25 18:33:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e7f61ff-e6bc-59e0-8eb9-af773161399e with scrape type 1
2026-03-25 18:33:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3e7f61ff-e6bc-59e0-8eb9-af773161399e sending to next pipeline
2026-03-25 18:33:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3e7f61ff-e6bc-59e0-8eb9-af773161399e, identifier: 1983267
2026-03-25 18:33:59 [ayvens.es] INFO: Found listing with ID: 1983275
2026-03-25 18:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983275%27 HTTP/1.1" 200 None
2026-03-25 18:33:59 [ayvens.es] INFO: Scrape type for 1983275: 1
2026-03-25 18:33:59 [ayvens.es] INFO: Extracting data for car ID: 1983275
2026-03-25 18:33:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5984e4a-4180-5f12-8e47-3f31f8e1aeb0 with identifier: 1983275
2026-03-25 18:33:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5984e4a-4180-5f12-8e47-3f31f8e1aeb0 with scrape type 1
2026-03-25 18:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e5984e4a-4180-5f12-8e47-3f31f8e1aeb0
2026-03-25 18:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F350%252F43e4b65331b448e1a7a74f481a928053%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/350/43e4b65331b448e1a7a74f481a928053/images/large/1.jpg not downloaded yet
2026-03-25 18:33:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 79448ccd-cb64-50b9-ac74-027a510490ce with identifier: 1983261
2026-03-25 18:33:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 79448ccd-cb64-50b9-ac74-027a510490ce with identifier: 1983261
2026-03-25 18:33:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 79448ccd-cb64-50b9-ac74-027a510490ce with identifier: 1983261 to the API
2026-03-25 18:33:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/595/113685c3e295492f93c6ff099dc696eb/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 76,
 'color': 'Azul',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '79448ccd-cb64-50b9-ac74-027a510490ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'COROLLA',
 'odometer': 59585,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79448ccd-cb64-50b9-ac74-027a510490ce/79448ccd-cb64-50b9-ac74-027a510490ce_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617707,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/595/113685c3e295492f93c6ff099dc696eb/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA COROLLA 1.8 125H ACTIVE TECH E-CVT',
 'transmission': 'manual',
 'trim': '1.8 125H ACTIVE TECH E-CVT',
 'vin': None,
 'year': 2022}
2026-03-25 18:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983261%27 HTTP/1.1" 200 None
2026-03-25 18:33:59 [ayvens.es] INFO: Saving data for 1983261: {'created_time': 1774463639.510298, 'last_price_update_time': 1774463639.510307, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983261') HTTP/1.1" 204 0
2026-03-25 18:33:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8846fd48-f524-54f4-bd33-46c2112e40d5 with identifier: 1983264
2026-03-25 18:33:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8846fd48-f524-54f4-bd33-46c2112e40d5 with identifier: 1983264
2026-03-25 18:33:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8846fd48-f524-54f4-bd33-46c2112e40d5 with identifier: 1983264 to the API
2026-03-25 18:33:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:33:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:33:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/913/933854fb07f54a1eb76554a0e460b36d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '8846fd48-f524-54f4-bd33-46c2112e40d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 93423,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8846fd48-f524-54f4-bd33-46c2112e40d5/8846fd48-f524-54f4-bd33-46c2112e40d5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 323672,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/913/933854fb07f54a1eb76554a0e460b36d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON 2.0 TDI 85kW S&S Style Go',
 'transmission': 'manual',
 'trim': '2.0 TDI 85kW S&S Style Go',
 'vin': None,
 'year': 2021}
2026-03-25 18:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983264%27 HTTP/1.1" 200 None
2026-03-25 18:33:59 [ayvens.es] INFO: Saving data for 1983264: {'created_time': 1774463639.902524, 'last_price_update_time': 1774463639.902535, 'auction_closing_time': 1774526400.0}
2026-03-25 18:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983264') HTTP/1.1" 204 0
2026-03-25 18:33:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7dff0bc6-1b5f-50bf-bde3-a44a7c85384b with identifier: 1983263
2026-03-25 18:33:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7dff0bc6-1b5f-50bf-bde3-a44a7c85384b with identifier: 1983263
2026-03-25 18:33:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7dff0bc6-1b5f-50bf-bde3-a44a7c85384b with identifier: 1983263 to the API
2026-03-25 18:34:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/267/7285410f508c41bcbe2946b650eb04c2/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '7dff0bc6-1b5f-50bf-bde3-a44a7c85384b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 85378,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dff0bc6-1b5f-50bf-bde3-a44a7c85384b/7dff0bc6-1b5f-50bf-bde3-a44a7c85384b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 341379,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/267/7285410f508c41bcbe2946b650eb04c2/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON 2.0 TDI 85kW S&S Style Go',
 'transmission': 'manual',
 'trim': '2.0 TDI 85kW S&S Style Go',
 'vin': None,
 'year': 2021}
2026-03-25 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983263%27 HTTP/1.1" 200 None
2026-03-25 18:34:00 [ayvens.es] INFO: Saving data for 1983263: {'created_time': 1774463640.335141, 'last_price_update_time': 1774463640.335153, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983263') HTTP/1.1" 204 0
2026-03-25 18:34:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5b31943e-2546-5d4c-899e-a61577e4b52a with identifier: 1983265
2026-03-25 18:34:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5b31943e-2546-5d4c-899e-a61577e4b52a with identifier: 1983265
2026-03-25 18:34:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5b31943e-2546-5d4c-899e-a61577e4b52a with identifier: 1983265 to the API
2026-03-25 18:34:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/820/3511f2b926c04ffcb682f308b2bd8bde/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '5b31943e-2546-5d4c-899e-a61577e4b52a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'COROLLA',
 'odometer': 137934,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b31943e-2546-5d4c-899e-a61577e4b52a/5b31943e-2546-5d4c-899e-a61577e4b52a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 345159,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/820/3511f2b926c04ffcb682f308b2bd8bde/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA COROLLA 1.8 125H STYLE E-CVT TOURING SPORT',
 'transmission': 'manual',
 'trim': '1.8 125H STYLE E-CVT TOURING SPORT',
 'vin': None,
 'year': 2021}
2026-03-25 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983265%27 HTTP/1.1" 200 None
2026-03-25 18:34:00 [ayvens.es] INFO: Saving data for 1983265: {'created_time': 1774463640.680054, 'last_price_update_time': 1774463640.680071, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983265') HTTP/1.1" 204 0
2026-03-25 18:34:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3e7f61ff-e6bc-59e0-8eb9-af773161399e with identifier: 1983267
2026-03-25 18:34:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3e7f61ff-e6bc-59e0-8eb9-af773161399e with identifier: 1983267
2026-03-25 18:34:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3e7f61ff-e6bc-59e0-8eb9-af773161399e with identifier: 1983267 to the API
2026-03-25 18:34:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/521/1de2e54f70da4fd3a7093559d58a8a7b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'color': 'Plata',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '3e7f61ff-e6bc-59e0-8eb9-af773161399e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'COROLLA',
 'odometer': 33232,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e7f61ff-e6bc-59e0-8eb9-af773161399e/3e7f61ff-e6bc-59e0-8eb9-af773161399e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 307360,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/521/1de2e54f70da4fd3a7093559d58a8a7b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA COROLLA 1.8 125H ACTIVE TECH E-CVT',
 'transmission': 'manual',
 'trim': '1.8 125H ACTIVE TECH E-CVT',
 'vin': None,
 'year': 2022}
2026-03-25 18:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983267%27 HTTP/1.1" 200 None
2026-03-25 18:34:01 [ayvens.es] INFO: Saving data for 1983267: {'created_time': 1774463641.037938, 'last_price_update_time': 1774463641.037949, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983267') HTTP/1.1" 204 0
2026-03-25 18:34:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/498/cab42031c14a49448e91681f9bd076aa/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:01 [ayvens.es] INFO: Found listing with ID: 1983276
2026-03-25 18:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983276%27 HTTP/1.1" 200 None
2026-03-25 18:34:01 [ayvens.es] INFO: Scrape type for 1983276: 1
2026-03-25 18:34:01 [ayvens.es] INFO: Extracting data for car ID: 1983276
2026-03-25 18:34:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4dbf1192-e5fe-5cf2-8c90-4a60dfd1c3a2 with identifier: 1983276
2026-03-25 18:34:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4dbf1192-e5fe-5cf2-8c90-4a60dfd1c3a2 with scrape type 1
2026-03-25 18:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4dbf1192-e5fe-5cf2-8c90-4a60dfd1c3a2
2026-03-25 18:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F212%252F553c2c3d3b0d4e34906f54ab0398eef5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/212/553c2c3d3b0d4e34906f54ab0398eef5/images/large/1.jpg not downloaded yet
2026-03-25 18:34:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ec466d0>
2026-03-25 18:34:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_652e8fb7-1346-50d3-9895-f121f51893b8/652e8fb7-1346-50d3-9895-f121f51893b8_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F449%252F6fc3e434131b4e12bfb6d47c3477e948%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/449/6fc3e434131b4e12bfb6d47c3477e948/images/large/1.jpg saved to cache
2026-03-25 18:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 652e8fb7-1346-50d3-9895-f121f51893b8
2026-03-25 18:34:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 652e8fb7-1346-50d3-9895-f121f51893b8, skipping ID generation
2026-03-25 18:34:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 652e8fb7-1346-50d3-9895-f121f51893b8 with scrape type 1
2026-03-25 18:34:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 652e8fb7-1346-50d3-9895-f121f51893b8 sending to next pipeline
2026-03-25 18:34:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 652e8fb7-1346-50d3-9895-f121f51893b8, identifier: 1983266
2026-03-25 18:34:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8efa5710>
2026-03-25 18:34:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_358cecdc-c39f-5175-a713-7ddc9d28db76/358cecdc-c39f-5175-a713-7ddc9d28db76_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F654%252F8f9f170e51d840499c543ecd1dfdc3c1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/654/8f9f170e51d840499c543ecd1dfdc3c1/images/large/1.jpg saved to cache
2026-03-25 18:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 358cecdc-c39f-5175-a713-7ddc9d28db76
2026-03-25 18:34:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 358cecdc-c39f-5175-a713-7ddc9d28db76, skipping ID generation
2026-03-25 18:34:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 358cecdc-c39f-5175-a713-7ddc9d28db76 with scrape type 1
2026-03-25 18:34:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 358cecdc-c39f-5175-a713-7ddc9d28db76 sending to next pipeline
2026-03-25 18:34:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 358cecdc-c39f-5175-a713-7ddc9d28db76, identifier: 1983268
2026-03-25 18:34:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/275/1b35ffb397ec44638a09a24c99b25b95/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:01 [ayvens.es] INFO: Found listing with ID: 1983277
2026-03-25 18:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983277%27 HTTP/1.1" 200 None
2026-03-25 18:34:01 [ayvens.es] INFO: Scrape type for 1983277: 1
2026-03-25 18:34:01 [ayvens.es] INFO: Extracting data for car ID: 1983277
2026-03-25 18:34:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72f06b61-42a3-5344-9b88-a26e125e9b83 with identifier: 1983277
2026-03-25 18:34:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72f06b61-42a3-5344-9b88-a26e125e9b83 with scrape type 1
2026-03-25 18:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 72f06b61-42a3-5344-9b88-a26e125e9b83
2026-03-25 18:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F784%252Ffa61e2853b1e446fa9df73a3a7738f85%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/784/fa61e2853b1e446fa9df73a3a7738f85/images/large/1.jpg not downloaded yet
2026-03-25 18:34:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 652e8fb7-1346-50d3-9895-f121f51893b8 with identifier: 1983266
2026-03-25 18:34:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 652e8fb7-1346-50d3-9895-f121f51893b8 with identifier: 1983266
2026-03-25 18:34:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 652e8fb7-1346-50d3-9895-f121f51893b8 with identifier: 1983266 to the API
2026-03-25 18:34:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/449/6fc3e434131b4e12bfb6d47c3477e948/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '652e8fb7-1346-50d3-9895-f121f51893b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'COROLLA',
 'odometer': 58774,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_652e8fb7-1346-50d3-9895-f121f51893b8/652e8fb7-1346-50d3-9895-f121f51893b8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 488967,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/449/6fc3e434131b4e12bfb6d47c3477e948/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA COROLLA 1.8 125H ACTIVE TECH E-CVT',
 'transmission': 'manual',
 'trim': '1.8 125H ACTIVE TECH E-CVT',
 'vin': None,
 'year': 2021}
2026-03-25 18:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983266%27 HTTP/1.1" 200 None
2026-03-25 18:34:01 [ayvens.es] INFO: Saving data for 1983266: {'created_time': 1774463641.891606, 'last_price_update_time': 1774463641.89162, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983266') HTTP/1.1" 204 0
2026-03-25 18:34:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 358cecdc-c39f-5175-a713-7ddc9d28db76 with identifier: 1983268
2026-03-25 18:34:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 358cecdc-c39f-5175-a713-7ddc9d28db76 with identifier: 1983268
2026-03-25 18:34:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 358cecdc-c39f-5175-a713-7ddc9d28db76 with identifier: 1983268 to the API
2026-03-25 18:34:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/654/8f9f170e51d840499c543ecd1dfdc3c1/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '358cecdc-c39f-5175-a713-7ddc9d28db76',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-ROC',
 'odometer': 72021,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_358cecdc-c39f-5175-a713-7ddc9d28db76/358cecdc-c39f-5175-a713-7ddc9d28db76_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 323367,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/654/8f9f170e51d840499c543ecd1dfdc3c1/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-ROC (O) Advance R-Line 1.0 TSI 81kW (110CV)',
 'transmission': 'manual',
 'trim': '(O) Advance R-Line 1.0 TSI 81kW (110CV)',
 'vin': None,
 'year': 2022}
2026-03-25 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983268%27 HTTP/1.1" 200 None
2026-03-25 18:34:02 [ayvens.es] INFO: Saving data for 1983268: {'created_time': 1774463642.229313, 'last_price_update_time': 1774463642.229323, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983268') HTTP/1.1" 204 0
2026-03-25 18:34:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/328/e88552399a4543f3b62fd05e990c0543/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/669/6e0d059d64414d45a0b70b1186a50ee2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:02 [ayvens.es] INFO: Found listing with ID: 1983278
2026-03-25 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983278%27 HTTP/1.1" 200 None
2026-03-25 18:34:02 [ayvens.es] INFO: Scrape type for 1983278: 1
2026-03-25 18:34:02 [ayvens.es] INFO: Extracting data for car ID: 1983278
2026-03-25 18:34:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd1e36ce-c2fb-592c-bf9c-c9d1be04dfe5 with identifier: 1983278
2026-03-25 18:34:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd1e36ce-c2fb-592c-bf9c-c9d1be04dfe5 with scrape type 1
2026-03-25 18:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item cd1e36ce-c2fb-592c-bf9c-c9d1be04dfe5
2026-03-25 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F202%252Fee53b50539e745749f16e446aee465c2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/202/ee53b50539e745749f16e446aee465c2/images/large/1.jpg not downloaded yet
2026-03-25 18:34:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8edd12d0>
2026-03-25 18:34:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b04894bc-51ed-550f-ab01-faa49b2d9012/b04894bc-51ed-550f-ab01-faa49b2d9012_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F498%252Fcab42031c14a49448e91681f9bd076aa%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/498/cab42031c14a49448e91681f9bd076aa/images/large/1.jpg saved to cache
2026-03-25 18:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b04894bc-51ed-550f-ab01-faa49b2d9012
2026-03-25 18:34:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b04894bc-51ed-550f-ab01-faa49b2d9012, skipping ID generation
2026-03-25 18:34:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b04894bc-51ed-550f-ab01-faa49b2d9012 with scrape type 1
2026-03-25 18:34:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b04894bc-51ed-550f-ab01-faa49b2d9012 sending to next pipeline
2026-03-25 18:34:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b04894bc-51ed-550f-ab01-faa49b2d9012, identifier: 1983269
2026-03-25 18:34:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ea67ad0>
2026-03-25 18:34:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_734cdb07-26e5-50e3-a626-1d3e22697190/734cdb07-26e5-50e3-a626-1d3e22697190_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F275%252F1b35ffb397ec44638a09a24c99b25b95%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/275/1b35ffb397ec44638a09a24c99b25b95/images/large/1.jpg saved to cache
2026-03-25 18:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 734cdb07-26e5-50e3-a626-1d3e22697190
2026-03-25 18:34:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 734cdb07-26e5-50e3-a626-1d3e22697190, skipping ID generation
2026-03-25 18:34:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 734cdb07-26e5-50e3-a626-1d3e22697190 with scrape type 1
2026-03-25 18:34:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 734cdb07-26e5-50e3-a626-1d3e22697190 sending to next pipeline
2026-03-25 18:34:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 734cdb07-26e5-50e3-a626-1d3e22697190, identifier: 1983270
2026-03-25 18:34:02 [ayvens.es] INFO: Found listing with ID: 1983279
2026-03-25 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983279%27 HTTP/1.1" 200 None
2026-03-25 18:34:02 [ayvens.es] INFO: Scrape type for 1983279: 1
2026-03-25 18:34:02 [ayvens.es] INFO: Extracting data for car ID: 1983279
2026-03-25 18:34:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84aa2360-a90f-593d-93b5-95252524816f with identifier: 1983279
2026-03-25 18:34:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84aa2360-a90f-593d-93b5-95252524816f with scrape type 1
2026-03-25 18:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 84aa2360-a90f-593d-93b5-95252524816f
2026-03-25 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F080%252Fcceb8d2b48694dd09a46eb38fcd02527%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/080/cceb8d2b48694dd09a46eb38fcd02527/images/large/1.jpg not downloaded yet
2026-03-25 18:34:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b04894bc-51ed-550f-ab01-faa49b2d9012 with identifier: 1983269
2026-03-25 18:34:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b04894bc-51ed-550f-ab01-faa49b2d9012 with identifier: 1983269
2026-03-25 18:34:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b04894bc-51ed-550f-ab01-faa49b2d9012 with identifier: 1983269 to the API
2026-03-25 18:34:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/498/cab42031c14a49448e91681f9bd076aa/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b04894bc-51ed-550f-ab01-faa49b2d9012',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN',
 'odometer': 167273,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b04894bc-51ed-550f-ab01-faa49b2d9012/b04894bc-51ed-550f-ab01-faa49b2d9012_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 388313,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/498/cab42031c14a49448e91681f9bd076aa/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN R-Line 2.0 TDI 110kW (150CV) DSG',
 'transmission': 'manual',
 'trim': 'R-Line 2.0 TDI 110kW (150CV) DSG',
 'vin': None,
 'year': 2021}
2026-03-25 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983269%27 HTTP/1.1" 200 None
2026-03-25 18:34:03 [ayvens.es] INFO: Saving data for 1983269: {'created_time': 1774463643.016101, 'last_price_update_time': 1774463643.016112, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983269') HTTP/1.1" 204 0
2026-03-25 18:34:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 734cdb07-26e5-50e3-a626-1d3e22697190 with identifier: 1983270
2026-03-25 18:34:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 734cdb07-26e5-50e3-a626-1d3e22697190 with identifier: 1983270
2026-03-25 18:34:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 734cdb07-26e5-50e3-a626-1d3e22697190 with identifier: 1983270 to the API
2026-03-25 18:34:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/275/1b35ffb397ec44638a09a24c99b25b95/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 180,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '734cdb07-26e5-50e3-a626-1d3e22697190',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC90',
 'odometer': 112386,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_734cdb07-26e5-50e3-a626-1d3e22697190/734cdb07-26e5-50e3-a626-1d3e22697190_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 567087,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/275/1b35ffb397ec44638a09a24c99b25b95/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-27',
 'seats_number': 7,
 'seller_name': None,
 'title': 'VOLVO XC90 2.0 B5 D AWD Momentum Pro Auto',
 'transmission': 'manual',
 'trim': '2.0 B5 D AWD Momentum Pro Auto',
 'vin': None,
 'year': 2021}
2026-03-25 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983270%27 HTTP/1.1" 200 None
2026-03-25 18:34:03 [ayvens.es] INFO: Saving data for 1983270: {'created_time': 1774463643.398809, 'last_price_update_time': 1774463643.398819, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983270') HTTP/1.1" 204 0
2026-03-25 18:34:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/353/35dcc5c9a4ef43b58b7f213fd0974323/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:03 [ayvens.es] INFO: Found listing with ID: 1983280
2026-03-25 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983280%27 HTTP/1.1" 200 None
2026-03-25 18:34:03 [ayvens.es] INFO: Scrape type for 1983280: 1
2026-03-25 18:34:03 [ayvens.es] INFO: Extracting data for car ID: 1983280
2026-03-25 18:34:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b093631a-ef8f-5ba9-bc7f-012893408b30 with identifier: 1983280
2026-03-25 18:34:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b093631a-ef8f-5ba9-bc7f-012893408b30 with scrape type 1
2026-03-25 18:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b093631a-ef8f-5ba9-bc7f-012893408b30
2026-03-25 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F376%252Fe35e560b949e49c7bcdfb5fa200865b0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/376/e35e560b949e49c7bcdfb5fa200865b0/images/large/1.jpg not downloaded yet
2026-03-25 18:34:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ece99d0>
2026-03-25 18:34:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4da8f32a-e1f2-59ca-b1df-811b16a0de96/4da8f32a-e1f2-59ca-b1df-811b16a0de96_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F328%252Fe88552399a4543f3b62fd05e990c0543%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/328/e88552399a4543f3b62fd05e990c0543/images/large/1.jpg saved to cache
2026-03-25 18:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4da8f32a-e1f2-59ca-b1df-811b16a0de96
2026-03-25 18:34:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4da8f32a-e1f2-59ca-b1df-811b16a0de96, skipping ID generation
2026-03-25 18:34:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4da8f32a-e1f2-59ca-b1df-811b16a0de96 with scrape type 1
2026-03-25 18:34:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4da8f32a-e1f2-59ca-b1df-811b16a0de96 sending to next pipeline
2026-03-25 18:34:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4da8f32a-e1f2-59ca-b1df-811b16a0de96, identifier: 1983271
2026-03-25 18:34:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ee58b90>
2026-03-25 18:34:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_628a28f9-0e65-5f98-8b4b-d9da2e07329e/628a28f9-0e65-5f98-8b4b-d9da2e07329e_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F669%252F6e0d059d64414d45a0b70b1186a50ee2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/669/6e0d059d64414d45a0b70b1186a50ee2/images/large/1.jpg saved to cache
2026-03-25 18:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 628a28f9-0e65-5f98-8b4b-d9da2e07329e
2026-03-25 18:34:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 628a28f9-0e65-5f98-8b4b-d9da2e07329e, skipping ID generation
2026-03-25 18:34:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 628a28f9-0e65-5f98-8b4b-d9da2e07329e with scrape type 1
2026-03-25 18:34:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 628a28f9-0e65-5f98-8b4b-d9da2e07329e sending to next pipeline
2026-03-25 18:34:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 628a28f9-0e65-5f98-8b4b-d9da2e07329e, identifier: 1983272
2026-03-25 18:34:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/746/a34b57a05b884231a63c77ab41b460f1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:03 [ayvens.es] INFO: Found listing with ID: 1983281
2026-03-25 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983281%27 HTTP/1.1" 200 None
2026-03-25 18:34:03 [ayvens.es] INFO: Scrape type for 1983281: 1
2026-03-25 18:34:03 [ayvens.es] INFO: Extracting data for car ID: 1983281
2026-03-25 18:34:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8180b4c1-375e-5501-a739-ff54596e5bfb with identifier: 1983281
2026-03-25 18:34:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8180b4c1-375e-5501-a739-ff54596e5bfb with scrape type 1
2026-03-25 18:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8180b4c1-375e-5501-a739-ff54596e5bfb
2026-03-25 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F393%252Fc0ea72caad664d79b59fbde0d32d1beb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/393/c0ea72caad664d79b59fbde0d32d1beb/images/large/1.jpg not downloaded yet
2026-03-25 18:34:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4da8f32a-e1f2-59ca-b1df-811b16a0de96 with identifier: 1983271
2026-03-25 18:34:03 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:34:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4da8f32a-e1f2-59ca-b1df-811b16a0de96 with identifier: 1983271
2026-03-25 18:34:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 4da8f32a-e1f2-59ca-b1df-811b16a0de96 with identifier: 1983271 to the API
2026-03-25 18:34:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/328/e88552399a4543f3b62fd05e990c0543/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 28,
 'color': 'Denim',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '4da8f32a-e1f2-59ca-b1df-811b16a0de96',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC90',
 'odometer': 100840,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4da8f32a-e1f2-59ca-b1df-811b16a0de96/4da8f32a-e1f2-59ca-b1df-811b16a0de96_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 375534,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/328/e88552399a4543f3b62fd05e990c0543/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-10',
 'seats_number': 7,
 'seller_name': None,
 'title': 'VOLVO XC90 2.0 T8 AWD Recharge Inscription Exp Auto',
 'transmission': 'manual',
 'trim': '2.0 T8 AWD Recharge Inscription Exp Auto',
 'vin': None,
 'year': 2022}
2026-03-25 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983271%27 HTTP/1.1" 200 None
2026-03-25 18:34:04 [ayvens.es] INFO: Saving data for 1983271: {'created_time': 1774463644.12553, 'last_price_update_time': 1774463644.125542, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983271') HTTP/1.1" 204 0
2026-03-25 18:34:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 628a28f9-0e65-5f98-8b4b-d9da2e07329e with identifier: 1983272
2026-03-25 18:34:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 628a28f9-0e65-5f98-8b4b-d9da2e07329e with identifier: 1983272
2026-03-25 18:34:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 628a28f9-0e65-5f98-8b4b-d9da2e07329e with identifier: 1983272 to the API
2026-03-25 18:34:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/669/6e0d059d64414d45a0b70b1186a50ee2/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '628a28f9-0e65-5f98-8b4b-d9da2e07329e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 179432,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_628a28f9-0e65-5f98-8b4b-d9da2e07329e/628a28f9-0e65-5f98-8b4b-d9da2e07329e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 339385,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/669/6e0d059d64414d45a0b70b1186a50ee2/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON 2.0 TDI 110kW DSG-7 Style Go',
 'transmission': 'manual',
 'trim': '2.0 TDI 110kW DSG-7 Style Go',
 'vin': None,
 'year': 2022}
2026-03-25 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983272%27 HTTP/1.1" 200 None
2026-03-25 18:34:04 [ayvens.es] INFO: Saving data for 1983272: {'created_time': 1774463644.464685, 'last_price_update_time': 1774463644.464694, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983272') HTTP/1.1" 204 0
2026-03-25 18:34:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/212/553c2c3d3b0d4e34906f54ab0398eef5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/350/43e4b65331b448e1a7a74f481a928053/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:04 [ayvens.es] INFO: Found listing with ID: 1983282
2026-03-25 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983282%27 HTTP/1.1" 200 None
2026-03-25 18:34:04 [ayvens.es] INFO: Scrape type for 1983282: 1
2026-03-25 18:34:04 [ayvens.es] INFO: Extracting data for car ID: 1983282
2026-03-25 18:34:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48c1d9e6-087f-5731-a89e-3e6681f7811c with identifier: 1983282
2026-03-25 18:34:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48c1d9e6-087f-5731-a89e-3e6681f7811c with scrape type 1
2026-03-25 18:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 48c1d9e6-087f-5731-a89e-3e6681f7811c
2026-03-25 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F236%252F76fedd10cd1144719562e749f8b56221%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/236/76fedd10cd1144719562e749f8b56221/images/large/1.jpg not downloaded yet
2026-03-25 18:34:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8f42cb90>
2026-03-25 18:34:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e8725c0-aeb6-5342-9fe9-5d241a6eda91/3e8725c0-aeb6-5342-9fe9-5d241a6eda91_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F353%252F35dcc5c9a4ef43b58b7f213fd0974323%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/353/35dcc5c9a4ef43b58b7f213fd0974323/images/large/1.jpg saved to cache
2026-03-25 18:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3e8725c0-aeb6-5342-9fe9-5d241a6eda91
2026-03-25 18:34:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3e8725c0-aeb6-5342-9fe9-5d241a6eda91, skipping ID generation
2026-03-25 18:34:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e8725c0-aeb6-5342-9fe9-5d241a6eda91 with scrape type 1
2026-03-25 18:34:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3e8725c0-aeb6-5342-9fe9-5d241a6eda91 sending to next pipeline
2026-03-25 18:34:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3e8725c0-aeb6-5342-9fe9-5d241a6eda91, identifier: 1983274
2026-03-25 18:34:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8f42f610>
2026-03-25 18:34:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63f9e6d2-1ae0-5b38-8cde-1c8eca61f576/63f9e6d2-1ae0-5b38-8cde-1c8eca61f576_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F746%252Fa34b57a05b884231a63c77ab41b460f1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/746/a34b57a05b884231a63c77ab41b460f1/images/large/1.jpg saved to cache
2026-03-25 18:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 63f9e6d2-1ae0-5b38-8cde-1c8eca61f576
2026-03-25 18:34:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 63f9e6d2-1ae0-5b38-8cde-1c8eca61f576, skipping ID generation
2026-03-25 18:34:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63f9e6d2-1ae0-5b38-8cde-1c8eca61f576 with scrape type 1
2026-03-25 18:34:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 63f9e6d2-1ae0-5b38-8cde-1c8eca61f576 sending to next pipeline
2026-03-25 18:34:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 63f9e6d2-1ae0-5b38-8cde-1c8eca61f576, identifier: 1983273
2026-03-25 18:34:04 [ayvens.es] INFO: Found listing with ID: 1983283
2026-03-25 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983283%27 HTTP/1.1" 200 None
2026-03-25 18:34:04 [ayvens.es] INFO: Scrape type for 1983283: 1
2026-03-25 18:34:04 [ayvens.es] INFO: Extracting data for car ID: 1983283
2026-03-25 18:34:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 717f1914-4a18-5578-b2f4-4ed59b0084be with identifier: 1983283
2026-03-25 18:34:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 717f1914-4a18-5578-b2f4-4ed59b0084be with scrape type 1
2026-03-25 18:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 717f1914-4a18-5578-b2f4-4ed59b0084be
2026-03-25 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F010%252Fa1c98b08391d4d07922c88a2d035e06e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/010/a1c98b08391d4d07922c88a2d035e06e/images/large/1.jpg not downloaded yet
2026-03-25 18:34:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3e8725c0-aeb6-5342-9fe9-5d241a6eda91 with identifier: 1983274
2026-03-25 18:34:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3e8725c0-aeb6-5342-9fe9-5d241a6eda91 with identifier: 1983274
2026-03-25 18:34:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3e8725c0-aeb6-5342-9fe9-5d241a6eda91 with identifier: 1983274 to the API
2026-03-25 18:34:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/353/35dcc5c9a4ef43b58b7f213fd0974323/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Azul',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '3e8725c0-aeb6-5342-9fe9-5d241a6eda91',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT',
 'odometer': 169980,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e8725c0-aeb6-5342-9fe9-5d241a6eda91/3e8725c0-aeb6-5342-9fe9-5d241a6eda91_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 382903,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/353/35dcc5c9a4ef43b58b7f213fd0974323/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT Business 2.0 TDI 90kW (122CV) DSG',
 'transmission': 'manual',
 'trim': 'Business 2.0 TDI 90kW (122CV) DSG',
 'vin': None,
 'year': 2021}
2026-03-25 18:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983274%27 HTTP/1.1" 200 None
2026-03-25 18:34:05 [ayvens.es] INFO: Saving data for 1983274: {'created_time': 1774463645.378111, 'last_price_update_time': 1774463645.378122, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983274') HTTP/1.1" 204 0
2026-03-25 18:34:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 63f9e6d2-1ae0-5b38-8cde-1c8eca61f576 with identifier: 1983273
2026-03-25 18:34:05 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:34:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 63f9e6d2-1ae0-5b38-8cde-1c8eca61f576 with identifier: 1983273
2026-03-25 18:34:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 63f9e6d2-1ae0-5b38-8cde-1c8eca61f576 with identifier: 1983273 to the API
2026-03-25 18:34:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/746/a34b57a05b884231a63c77ab41b460f1/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'color': 'Candy',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '63f9e6d2-1ae0-5b38-8cde-1c8eca61f576',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CADDY',
 'odometer': 120687,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63f9e6d2-1ae0-5b38-8cde-1c8eca61f576/63f9e6d2-1ae0-5b38-8cde-1c8eca61f576_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 499662,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/746/a34b57a05b884231a63c77ab41b460f1/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-22',
 'seats_number': 2,
 'seller_name': None,
 'title': 'VOLKSWAGEN CADDY (E) Business 2.0 TDI 90kW (122CV) BMT 4M',
 'transmission': 'manual',
 'trim': '(E) Business 2.0 TDI 90kW (122CV) BMT 4M',
 'vin': None,
 'year': 2019}
2026-03-25 18:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983273%27 HTTP/1.1" 200 None
2026-03-25 18:34:05 [ayvens.es] INFO: Saving data for 1983273: {'created_time': 1774463645.751515, 'last_price_update_time': 1774463645.751526, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983273') HTTP/1.1" 204 0
2026-03-25 18:34:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/784/fa61e2853b1e446fa9df73a3a7738f85/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:05 [scrapy.extensions.logstats] INFO: Crawled 8 pages (at 3 pages/min), scraped 321 items (at 83 items/min)
2026-03-25 18:34:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 174MiB
2026-03-25 18:34:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/202/ee53b50539e745749f16e446aee465c2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:05 [ayvens.es] INFO: Found listing with ID: 1983284
2026-03-25 18:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983284%27 HTTP/1.1" 200 None
2026-03-25 18:34:05 [ayvens.es] INFO: Scrape type for 1983284: 1
2026-03-25 18:34:05 [ayvens.es] INFO: Extracting data for car ID: 1983284
2026-03-25 18:34:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f1ef51d-b6fc-5257-a545-f1e039c58f41 with identifier: 1983284
2026-03-25 18:34:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f1ef51d-b6fc-5257-a545-f1e039c58f41 with scrape type 1
2026-03-25 18:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3f1ef51d-b6fc-5257-a545-f1e039c58f41
2026-03-25 18:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F805%252F77e4bb091e00428980ecf4bcbce08985%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/805/77e4bb091e00428980ecf4bcbce08985/images/large/1.jpg not downloaded yet
2026-03-25 18:34:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8f42f710>
2026-03-25 18:34:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4dbf1192-e5fe-5cf2-8c90-4a60dfd1c3a2/4dbf1192-e5fe-5cf2-8c90-4a60dfd1c3a2_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F212%252F553c2c3d3b0d4e34906f54ab0398eef5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/212/553c2c3d3b0d4e34906f54ab0398eef5/images/large/1.jpg saved to cache
2026-03-25 18:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4dbf1192-e5fe-5cf2-8c90-4a60dfd1c3a2
2026-03-25 18:34:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4dbf1192-e5fe-5cf2-8c90-4a60dfd1c3a2, skipping ID generation
2026-03-25 18:34:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4dbf1192-e5fe-5cf2-8c90-4a60dfd1c3a2 with scrape type 1
2026-03-25 18:34:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4dbf1192-e5fe-5cf2-8c90-4a60dfd1c3a2 sending to next pipeline
2026-03-25 18:34:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4dbf1192-e5fe-5cf2-8c90-4a60dfd1c3a2, identifier: 1983276
2026-03-25 18:34:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ef2b9d0>
2026-03-25 18:34:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5984e4a-4180-5f12-8e47-3f31f8e1aeb0/e5984e4a-4180-5f12-8e47-3f31f8e1aeb0_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F350%252F43e4b65331b448e1a7a74f481a928053%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/350/43e4b65331b448e1a7a74f481a928053/images/large/1.jpg saved to cache
2026-03-25 18:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e5984e4a-4180-5f12-8e47-3f31f8e1aeb0
2026-03-25 18:34:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e5984e4a-4180-5f12-8e47-3f31f8e1aeb0, skipping ID generation
2026-03-25 18:34:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5984e4a-4180-5f12-8e47-3f31f8e1aeb0 with scrape type 1
2026-03-25 18:34:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e5984e4a-4180-5f12-8e47-3f31f8e1aeb0 sending to next pipeline
2026-03-25 18:34:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e5984e4a-4180-5f12-8e47-3f31f8e1aeb0, identifier: 1983275
2026-03-25 18:34:06 [ayvens.es] INFO: Found listing with ID: 1983285
2026-03-25 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983285%27 HTTP/1.1" 200 None
2026-03-25 18:34:06 [ayvens.es] INFO: Scrape type for 1983285: 1
2026-03-25 18:34:06 [ayvens.es] INFO: Extracting data for car ID: 1983285
2026-03-25 18:34:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d97561f-4fff-5701-8b42-77663783f265 with identifier: 1983285
2026-03-25 18:34:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d97561f-4fff-5701-8b42-77663783f265 with scrape type 1
2026-03-25 18:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9d97561f-4fff-5701-8b42-77663783f265
2026-03-25 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F389%252F8948e61f9a1a4b4ab1d1f08261b241bc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/389/8948e61f9a1a4b4ab1d1f08261b241bc/images/large/1.jpg not downloaded yet
2026-03-25 18:34:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4dbf1192-e5fe-5cf2-8c90-4a60dfd1c3a2 with identifier: 1983276
2026-03-25 18:34:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4dbf1192-e5fe-5cf2-8c90-4a60dfd1c3a2 with identifier: 1983276
2026-03-25 18:34:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 4dbf1192-e5fe-5cf2-8c90-4a60dfd1c3a2 with identifier: 1983276 to the API
2026-03-25 18:34:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/212/553c2c3d3b0d4e34906f54ab0398eef5/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '4dbf1192-e5fe-5cf2-8c90-4a60dfd1c3a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-CROSS',
 'odometer': 62689,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4dbf1192-e5fe-5cf2-8c90-4a60dfd1c3a2/4dbf1192-e5fe-5cf2-8c90-4a60dfd1c3a2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 331598,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/212/553c2c3d3b0d4e34906f54ab0398eef5/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-CROSS Advance 1.0 TSI 81kW (110CV)',
 'transmission': 'manual',
 'trim': 'Advance 1.0 TSI 81kW (110CV)',
 'vin': None,
 'year': 2023}
2026-03-25 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983276%27 HTTP/1.1" 200 None
2026-03-25 18:34:06 [ayvens.es] INFO: Saving data for 1983276: {'created_time': 1774463646.461488, 'last_price_update_time': 1774463646.461501, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983276') HTTP/1.1" 204 0
2026-03-25 18:34:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e5984e4a-4180-5f12-8e47-3f31f8e1aeb0 with identifier: 1983275
2026-03-25 18:34:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e5984e4a-4180-5f12-8e47-3f31f8e1aeb0 with identifier: 1983275
2026-03-25 18:34:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e5984e4a-4180-5f12-8e47-3f31f8e1aeb0 with identifier: 1983275 to the API
2026-03-25 18:34:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/350/43e4b65331b448e1a7a74f481a928053/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e5984e4a-4180-5f12-8e47-3f31f8e1aeb0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-ROC',
 'odometer': 92566,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5984e4a-4180-5f12-8e47-3f31f8e1aeb0/e5984e4a-4180-5f12-8e47-3f31f8e1aeb0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 351287,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/350/43e4b65331b448e1a7a74f481a928053/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-ROC Edition 1.6 TDI 85kW (115CV)',
 'transmission': 'manual',
 'trim': 'Edition 1.6 TDI 85kW (115CV)',
 'vin': None,
 'year': 2020}
2026-03-25 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983275%27 HTTP/1.1" 200 None
2026-03-25 18:34:06 [ayvens.es] INFO: Saving data for 1983275: {'created_time': 1774463646.852871, 'last_price_update_time': 1774463646.852885, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983275') HTTP/1.1" 204 0
2026-03-25 18:34:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/080/cceb8d2b48694dd09a46eb38fcd02527/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/376/e35e560b949e49c7bcdfb5fa200865b0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:06 [ayvens.es] INFO: Found listing with ID: 1983286
2026-03-25 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983286%27 HTTP/1.1" 200 None
2026-03-25 18:34:06 [ayvens.es] INFO: Scrape type for 1983286: 1
2026-03-25 18:34:06 [ayvens.es] INFO: Extracting data for car ID: 1983286
2026-03-25 18:34:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5756c549-4444-53cd-833b-f9cc09a21fe8 with identifier: 1983286
2026-03-25 18:34:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5756c549-4444-53cd-833b-f9cc09a21fe8 with scrape type 1
2026-03-25 18:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5756c549-4444-53cd-833b-f9cc09a21fe8
2026-03-25 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F963%252Fc97ea768f1ca423f94891418a1e98a5f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/963/c97ea768f1ca423f94891418a1e98a5f/images/large/1.jpg not downloaded yet
2026-03-25 18:34:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ecdc3d0>
2026-03-25 18:34:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72f06b61-42a3-5344-9b88-a26e125e9b83/72f06b61-42a3-5344-9b88-a26e125e9b83_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F784%252Ffa61e2853b1e446fa9df73a3a7738f85%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/784/fa61e2853b1e446fa9df73a3a7738f85/images/large/1.jpg saved to cache
2026-03-25 18:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 72f06b61-42a3-5344-9b88-a26e125e9b83
2026-03-25 18:34:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 72f06b61-42a3-5344-9b88-a26e125e9b83, skipping ID generation
2026-03-25 18:34:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72f06b61-42a3-5344-9b88-a26e125e9b83 with scrape type 1
2026-03-25 18:34:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 72f06b61-42a3-5344-9b88-a26e125e9b83 sending to next pipeline
2026-03-25 18:34:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 72f06b61-42a3-5344-9b88-a26e125e9b83, identifier: 1983277
2026-03-25 18:34:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ed71310>
2026-03-25 18:34:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd1e36ce-c2fb-592c-bf9c-c9d1be04dfe5/cd1e36ce-c2fb-592c-bf9c-c9d1be04dfe5_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F202%252Fee53b50539e745749f16e446aee465c2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/202/ee53b50539e745749f16e446aee465c2/images/large/1.jpg saved to cache
2026-03-25 18:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cd1e36ce-c2fb-592c-bf9c-c9d1be04dfe5
2026-03-25 18:34:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cd1e36ce-c2fb-592c-bf9c-c9d1be04dfe5, skipping ID generation
2026-03-25 18:34:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd1e36ce-c2fb-592c-bf9c-c9d1be04dfe5 with scrape type 1
2026-03-25 18:34:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cd1e36ce-c2fb-592c-bf9c-c9d1be04dfe5 sending to next pipeline
2026-03-25 18:34:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: cd1e36ce-c2fb-592c-bf9c-c9d1be04dfe5, identifier: 1983278
2026-03-25 18:34:07 [ayvens.es] INFO: Found listing with ID: 1983287
2026-03-25 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983287%27 HTTP/1.1" 200 None
2026-03-25 18:34:07 [ayvens.es] INFO: Scrape type for 1983287: 1
2026-03-25 18:34:07 [ayvens.es] INFO: Extracting data for car ID: 1983287
2026-03-25 18:34:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5334d7e2-baaa-5a15-9687-98e0a3f88573 with identifier: 1983287
2026-03-25 18:34:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5334d7e2-baaa-5a15-9687-98e0a3f88573 with scrape type 1
2026-03-25 18:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5334d7e2-baaa-5a15-9687-98e0a3f88573
2026-03-25 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F280%252Ff388bc0b8c8643aba3c5d55972ab87bb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/280/f388bc0b8c8643aba3c5d55972ab87bb/images/large/1.jpg not downloaded yet
2026-03-25 18:34:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 72f06b61-42a3-5344-9b88-a26e125e9b83 with identifier: 1983277
2026-03-25 18:34:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 72f06b61-42a3-5344-9b88-a26e125e9b83 with identifier: 1983277
2026-03-25 18:34:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 72f06b61-42a3-5344-9b88-a26e125e9b83 with identifier: 1983277 to the API
2026-03-25 18:34:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/784/fa61e2853b1e446fa9df73a3a7738f85/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 153,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '72f06b61-42a3-5344-9b88-a26e125e9b83',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KODIAQ',
 'odometer': 69759,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72f06b61-42a3-5344-9b88-a26e125e9b83/72f06b61-42a3-5344-9b88-a26e125e9b83_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347956,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/784/fa61e2853b1e446fa9df73a3a7738f85/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA KODIAQ 2.0 TDI 110KW (150cv) DSG 4x4 Ambition',
 'transmission': 'manual',
 'trim': '2.0 TDI 110KW (150cv) DSG 4x4 Ambition',
 'vin': None,
 'year': 2022}
2026-03-25 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983277%27 HTTP/1.1" 200 None
2026-03-25 18:34:07 [ayvens.es] INFO: Saving data for 1983277: {'created_time': 1774463647.618531, 'last_price_update_time': 1774463647.618541, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983277') HTTP/1.1" 204 0
2026-03-25 18:34:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: cd1e36ce-c2fb-592c-bf9c-c9d1be04dfe5 with identifier: 1983278
2026-03-25 18:34:07 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:34:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: cd1e36ce-c2fb-592c-bf9c-c9d1be04dfe5 with identifier: 1983278
2026-03-25 18:34:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: cd1e36ce-c2fb-592c-bf9c-c9d1be04dfe5 with identifier: 1983278 to the API
2026-03-25 18:34:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/202/ee53b50539e745749f16e446aee465c2/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 225,
 'color': 'Grand',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.2L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'cd1e36ce-c2fb-592c-bf9c-c9d1be04dfe5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'SSANGYONG',
 'model': 'MUSSO',
 'odometer': 57551,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd1e36ce-c2fb-592c-bf9c-c9d1be04dfe5/cd1e36ce-c2fb-592c-bf9c-c9d1be04dfe5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 335935,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/202/ee53b50539e745749f16e446aee465c2/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-03',
 'seats_number': 7,
 'seller_name': None,
 'title': 'SSANGYONG MUSSO (E) D22DTR 4x4 Pro',
 'transmission': 'manual',
 'trim': '(E) D22DTR 4x4 Pro',
 'vin': None,
 'year': 2023}
2026-03-25 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983278%27 HTTP/1.1" 200 None
2026-03-25 18:34:07 [ayvens.es] INFO: Saving data for 1983278: {'created_time': 1774463647.971766, 'last_price_update_time': 1774463647.971778, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983278') HTTP/1.1" 204 0
2026-03-25 18:34:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/393/c0ea72caad664d79b59fbde0d32d1beb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/236/76fedd10cd1144719562e749f8b56221/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:07 [ayvens.es] INFO: Found listing with ID: 1983288
2026-03-25 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983288%27 HTTP/1.1" 200 None
2026-03-25 18:34:08 [ayvens.es] INFO: Scrape type for 1983288: 1
2026-03-25 18:34:08 [ayvens.es] INFO: Extracting data for car ID: 1983288
2026-03-25 18:34:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf4165ae-1ff8-599b-b9c8-92aee9f90525 with identifier: 1983288
2026-03-25 18:34:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf4165ae-1ff8-599b-b9c8-92aee9f90525 with scrape type 1
2026-03-25 18:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item bf4165ae-1ff8-599b-b9c8-92aee9f90525
2026-03-25 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F170%252Fad40c743cd634c76a1805fe270f9576b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/170/ad40c743cd634c76a1805fe270f9576b/images/large/1.jpg not downloaded yet
2026-03-25 18:34:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ea5ac50>
2026-03-25 18:34:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84aa2360-a90f-593d-93b5-95252524816f/84aa2360-a90f-593d-93b5-95252524816f_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F080%252Fcceb8d2b48694dd09a46eb38fcd02527%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/080/cceb8d2b48694dd09a46eb38fcd02527/images/large/1.jpg saved to cache
2026-03-25 18:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 84aa2360-a90f-593d-93b5-95252524816f
2026-03-25 18:34:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 84aa2360-a90f-593d-93b5-95252524816f, skipping ID generation
2026-03-25 18:34:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84aa2360-a90f-593d-93b5-95252524816f with scrape type 1
2026-03-25 18:34:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 84aa2360-a90f-593d-93b5-95252524816f sending to next pipeline
2026-03-25 18:34:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 84aa2360-a90f-593d-93b5-95252524816f, identifier: 1983279
2026-03-25 18:34:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ea5b750>
2026-03-25 18:34:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b093631a-ef8f-5ba9-bc7f-012893408b30/b093631a-ef8f-5ba9-bc7f-012893408b30_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F376%252Fe35e560b949e49c7bcdfb5fa200865b0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/376/e35e560b949e49c7bcdfb5fa200865b0/images/large/1.jpg saved to cache
2026-03-25 18:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b093631a-ef8f-5ba9-bc7f-012893408b30
2026-03-25 18:34:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b093631a-ef8f-5ba9-bc7f-012893408b30, skipping ID generation
2026-03-25 18:34:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b093631a-ef8f-5ba9-bc7f-012893408b30 with scrape type 1
2026-03-25 18:34:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b093631a-ef8f-5ba9-bc7f-012893408b30 sending to next pipeline
2026-03-25 18:34:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b093631a-ef8f-5ba9-bc7f-012893408b30, identifier: 1983280
2026-03-25 18:34:08 [ayvens.es] INFO: Found listing with ID: 1983289
2026-03-25 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983289%27 HTTP/1.1" 200 None
2026-03-25 18:34:08 [ayvens.es] INFO: Scrape type for 1983289: 1
2026-03-25 18:34:08 [ayvens.es] INFO: Extracting data for car ID: 1983289
2026-03-25 18:34:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc503e9f-481e-5b5b-9752-7f42330407c1 with identifier: 1983289
2026-03-25 18:34:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc503e9f-481e-5b5b-9752-7f42330407c1 with scrape type 1
2026-03-25 18:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item dc503e9f-481e-5b5b-9752-7f42330407c1
2026-03-25 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F928%252F4ade4b1823494f2589e8477b22f2771a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/928/4ade4b1823494f2589e8477b22f2771a/images/large/1.jpg not downloaded yet
2026-03-25 18:34:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 84aa2360-a90f-593d-93b5-95252524816f with identifier: 1983279
2026-03-25 18:34:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 84aa2360-a90f-593d-93b5-95252524816f with identifier: 1983279
2026-03-25 18:34:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 84aa2360-a90f-593d-93b5-95252524816f with identifier: 1983279 to the API
2026-03-25 18:34:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/080/cceb8d2b48694dd09a46eb38fcd02527/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 179,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.4L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '84aa2360-a90f-593d-93b5-95252524816f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'HILUX',
 'odometer': 130919,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84aa2360-a90f-593d-93b5-95252524816f/84aa2360-a90f-593d-93b5-95252524816f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 315216,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/080/cceb8d2b48694dd09a46eb38fcd02527/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA HILUX 2.4 D-4D Cabina Doble GX',
 'transmission': 'manual',
 'trim': '2.4 D-4D Cabina Doble GX',
 'vin': None,
 'year': 2021}
2026-03-25 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983279%27 HTTP/1.1" 200 None
2026-03-25 18:34:08 [ayvens.es] INFO: Saving data for 1983279: {'created_time': 1774463648.640467, 'last_price_update_time': 1774463648.640481, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983279') HTTP/1.1" 204 0
2026-03-25 18:34:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b093631a-ef8f-5ba9-bc7f-012893408b30 with identifier: 1983280
2026-03-25 18:34:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b093631a-ef8f-5ba9-bc7f-012893408b30 with identifier: 1983280
2026-03-25 18:34:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b093631a-ef8f-5ba9-bc7f-012893408b30 with identifier: 1983280 to the API
2026-03-25 18:34:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/376/e35e560b949e49c7bcdfb5fa200865b0/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b093631a-ef8f-5ba9-bc7f-012893408b30',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'PROACE CITY',
 'odometer': 170874,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b093631a-ef8f-5ba9-bc7f-012893408b30/b093631a-ef8f-5ba9-bc7f-012893408b30_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 334423,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/376/e35e560b949e49c7bcdfb5fa200865b0/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA PROACE CITY 1.5D 75kW (100CV) VX L1',
 'transmission': 'manual',
 'trim': '1.5D 75kW (100CV) VX L1',
 'vin': None,
 'year': 2021}
2026-03-25 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983280%27 HTTP/1.1" 200 None
2026-03-25 18:34:09 [ayvens.es] INFO: Saving data for 1983280: {'created_time': 1774463649.007459, 'last_price_update_time': 1774463649.007471, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983280') HTTP/1.1" 204 0
2026-03-25 18:34:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/805/77e4bb091e00428980ecf4bcbce08985/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:09 [ayvens.es] INFO: Found listing with ID: 1983290
2026-03-25 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983290%27 HTTP/1.1" 200 None
2026-03-25 18:34:09 [ayvens.es] INFO: Scrape type for 1983290: 1
2026-03-25 18:34:09 [ayvens.es] INFO: Extracting data for car ID: 1983290
2026-03-25 18:34:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 510105e1-a844-5c66-bf48-789803c8ea14 with identifier: 1983290
2026-03-25 18:34:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 510105e1-a844-5c66-bf48-789803c8ea14 with scrape type 1
2026-03-25 18:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 510105e1-a844-5c66-bf48-789803c8ea14
2026-03-25 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F532%252F1fa0c9e396a64a83bc87b5d97fd07d86%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/532/1fa0c9e396a64a83bc87b5d97fd07d86/images/large/1.jpg not downloaded yet
2026-03-25 18:34:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e57d890>
2026-03-25 18:34:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8180b4c1-375e-5501-a739-ff54596e5bfb/8180b4c1-375e-5501-a739-ff54596e5bfb_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F393%252Fc0ea72caad664d79b59fbde0d32d1beb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/393/c0ea72caad664d79b59fbde0d32d1beb/images/large/1.jpg saved to cache
2026-03-25 18:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8180b4c1-375e-5501-a739-ff54596e5bfb
2026-03-25 18:34:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8180b4c1-375e-5501-a739-ff54596e5bfb, skipping ID generation
2026-03-25 18:34:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8180b4c1-375e-5501-a739-ff54596e5bfb with scrape type 1
2026-03-25 18:34:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8180b4c1-375e-5501-a739-ff54596e5bfb sending to next pipeline
2026-03-25 18:34:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8180b4c1-375e-5501-a739-ff54596e5bfb, identifier: 1983281
2026-03-25 18:34:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ee9de90>
2026-03-25 18:34:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48c1d9e6-087f-5731-a89e-3e6681f7811c/48c1d9e6-087f-5731-a89e-3e6681f7811c_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F236%252F76fedd10cd1144719562e749f8b56221%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/236/76fedd10cd1144719562e749f8b56221/images/large/1.jpg saved to cache
2026-03-25 18:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 48c1d9e6-087f-5731-a89e-3e6681f7811c
2026-03-25 18:34:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 48c1d9e6-087f-5731-a89e-3e6681f7811c, skipping ID generation
2026-03-25 18:34:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48c1d9e6-087f-5731-a89e-3e6681f7811c with scrape type 1
2026-03-25 18:34:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 48c1d9e6-087f-5731-a89e-3e6681f7811c sending to next pipeline
2026-03-25 18:34:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 48c1d9e6-087f-5731-a89e-3e6681f7811c, identifier: 1983282
2026-03-25 18:34:09 [ayvens.es] INFO: Found listing with ID: 1983291
2026-03-25 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983291%27 HTTP/1.1" 200 None
2026-03-25 18:34:09 [ayvens.es] INFO: Scrape type for 1983291: 1
2026-03-25 18:34:09 [ayvens.es] INFO: Extracting data for car ID: 1983291
2026-03-25 18:34:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba7dea1a-9890-5bd5-a678-b4130d913dae with identifier: 1983291
2026-03-25 18:34:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba7dea1a-9890-5bd5-a678-b4130d913dae with scrape type 1
2026-03-25 18:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ba7dea1a-9890-5bd5-a678-b4130d913dae
2026-03-25 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F716%252Fbab09bbdfe654f77a8c6c13f67972a61%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/716/bab09bbdfe654f77a8c6c13f67972a61/images/large/1.jpg not downloaded yet
2026-03-25 18:34:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8180b4c1-375e-5501-a739-ff54596e5bfb with identifier: 1983281
2026-03-25 18:34:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8180b4c1-375e-5501-a739-ff54596e5bfb with identifier: 1983281
2026-03-25 18:34:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8180b4c1-375e-5501-a739-ff54596e5bfb with identifier: 1983281 to the API
2026-03-25 18:34:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/393/c0ea72caad664d79b59fbde0d32d1beb/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 97,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '8180b4c1-375e-5501-a739-ff54596e5bfb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'POLO',
 'odometer': 90012,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8180b4c1-375e-5501-a739-ff54596e5bfb/8180b4c1-375e-5501-a739-ff54596e5bfb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 317081,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/393/c0ea72caad664d79b59fbde0d32d1beb/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN POLO Edition 1.6 TDI 59kW (80CV)',
 'transmission': 'manual',
 'trim': 'Edition 1.6 TDI 59kW (80CV)',
 'vin': None,
 'year': 2019}
2026-03-25 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983281%27 HTTP/1.1" 200 None
2026-03-25 18:34:09 [ayvens.es] INFO: Saving data for 1983281: {'created_time': 1774463649.855732, 'last_price_update_time': 1774463649.855744, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983281') HTTP/1.1" 204 0
2026-03-25 18:34:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 48c1d9e6-087f-5731-a89e-3e6681f7811c with identifier: 1983282
2026-03-25 18:34:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 48c1d9e6-087f-5731-a89e-3e6681f7811c with identifier: 1983282
2026-03-25 18:34:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 48c1d9e6-087f-5731-a89e-3e6681f7811c with identifier: 1983282 to the API
2026-03-25 18:34:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/236/76fedd10cd1144719562e749f8b56221/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'electric',
 'id': '48c1d9e6-087f-5731-a89e-3e6681f7811c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'ID.4',
 'odometer': 162174,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48c1d9e6-087f-5731-a89e-3e6681f7811c/48c1d9e6-087f-5731-a89e-3e6681f7811c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 381975,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/236/76fedd10cd1144719562e749f8b56221/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN ID.4 Pro 128kW (174CV) Automatico',
 'transmission': 'manual',
 'trim': 'Pro 128kW (174CV) Automatico',
 'vin': None,
 'year': 2022}
2026-03-25 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983282%27 HTTP/1.1" 200 None
2026-03-25 18:34:10 [ayvens.es] INFO: Saving data for 1983282: {'created_time': 1774463650.275639, 'last_price_update_time': 1774463650.275648, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983282') HTTP/1.1" 204 0
2026-03-25 18:34:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/010/a1c98b08391d4d07922c88a2d035e06e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/389/8948e61f9a1a4b4ab1d1f08261b241bc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:10 [ayvens.es] INFO: Found listing with ID: 1983292
2026-03-25 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983292%27 HTTP/1.1" 200 None
2026-03-25 18:34:10 [ayvens.es] INFO: Scrape type for 1983292: 1
2026-03-25 18:34:10 [ayvens.es] INFO: Extracting data for car ID: 1983292
2026-03-25 18:34:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7404a694-59d3-5193-98a7-8eba4137d669 with identifier: 1983292
2026-03-25 18:34:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7404a694-59d3-5193-98a7-8eba4137d669 with scrape type 1
2026-03-25 18:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7404a694-59d3-5193-98a7-8eba4137d669
2026-03-25 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F062%252Fb536ec8c82d9474c9d98688358cdf395%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/062/b536ec8c82d9474c9d98688358cdf395/images/large/1.jpg not downloaded yet
2026-03-25 18:34:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8f0e2b50>
2026-03-25 18:34:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f1ef51d-b6fc-5257-a545-f1e039c58f41/3f1ef51d-b6fc-5257-a545-f1e039c58f41_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F805%252F77e4bb091e00428980ecf4bcbce08985%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/805/77e4bb091e00428980ecf4bcbce08985/images/large/1.jpg saved to cache
2026-03-25 18:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3f1ef51d-b6fc-5257-a545-f1e039c58f41
2026-03-25 18:34:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3f1ef51d-b6fc-5257-a545-f1e039c58f41, skipping ID generation
2026-03-25 18:34:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f1ef51d-b6fc-5257-a545-f1e039c58f41 with scrape type 1
2026-03-25 18:34:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3f1ef51d-b6fc-5257-a545-f1e039c58f41 sending to next pipeline
2026-03-25 18:34:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3f1ef51d-b6fc-5257-a545-f1e039c58f41, identifier: 1983284
2026-03-25 18:34:10 [ayvens.es] INFO: Found listing with ID: 1983293
2026-03-25 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983293%27 HTTP/1.1" 200 None
2026-03-25 18:34:10 [ayvens.es] INFO: Scrape type for 1983293: 1
2026-03-25 18:34:10 [ayvens.es] INFO: Extracting data for car ID: 1983293
2026-03-25 18:34:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41c3e584-e391-51f7-8b9a-5e437dd6287b with identifier: 1983293
2026-03-25 18:34:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41c3e584-e391-51f7-8b9a-5e437dd6287b with scrape type 1
2026-03-25 18:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 41c3e584-e391-51f7-8b9a-5e437dd6287b
2026-03-25 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F796%252F0df1bbbe8ed146c0955c55d7e3186d7f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/796/0df1bbbe8ed146c0955c55d7e3186d7f/images/large/1.jpg not downloaded yet
2026-03-25 18:34:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3f1ef51d-b6fc-5257-a545-f1e039c58f41 with identifier: 1983284
2026-03-25 18:34:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3f1ef51d-b6fc-5257-a545-f1e039c58f41 with identifier: 1983284
2026-03-25 18:34:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3f1ef51d-b6fc-5257-a545-f1e039c58f41 with identifier: 1983284 to the API
2026-03-25 18:34:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/805/77e4bb091e00428980ecf4bcbce08985/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '3f1ef51d-b6fc-5257-a545-f1e039c58f41',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'RAV4',
 'odometer': 172325,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f1ef51d-b6fc-5257-a545-f1e039c58f41/3f1ef51d-b6fc-5257-a545-f1e039c58f41_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 349389,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/805/77e4bb091e00428980ecf4bcbce08985/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA RAV4 2.5l 220H Advance',
 'transmission': 'manual',
 'trim': '2.5l 220H Advance',
 'vin': None,
 'year': 2022}
2026-03-25 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983284%27 HTTP/1.1" 200 None
2026-03-25 18:34:10 [ayvens.es] INFO: Saving data for 1983284: {'created_time': 1774463650.82488, 'last_price_update_time': 1774463650.824895, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983284') HTTP/1.1" 204 0
2026-03-25 18:34:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/280/f388bc0b8c8643aba3c5d55972ab87bb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:10 [ayvens.es] INFO: Found listing with ID: 1983294
2026-03-25 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983294%27 HTTP/1.1" 200 None
2026-03-25 18:34:10 [ayvens.es] INFO: Scrape type for 1983294: 1
2026-03-25 18:34:10 [ayvens.es] INFO: Extracting data for car ID: 1983294
2026-03-25 18:34:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e65eec8e-1a6f-5986-b18e-d7aa598be65d with identifier: 1983294
2026-03-25 18:34:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e65eec8e-1a6f-5986-b18e-d7aa598be65d with scrape type 1
2026-03-25 18:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e65eec8e-1a6f-5986-b18e-d7aa598be65d
2026-03-25 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F435%252F1e826a179d764948a8fc854bfff2a266%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/435/1e826a179d764948a8fc854bfff2a266/images/large/1.jpg not downloaded yet
2026-03-25 18:34:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ee79e50>
2026-03-25 18:34:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_717f1914-4a18-5578-b2f4-4ed59b0084be/717f1914-4a18-5578-b2f4-4ed59b0084be_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F010%252Fa1c98b08391d4d07922c88a2d035e06e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/010/a1c98b08391d4d07922c88a2d035e06e/images/large/1.jpg saved to cache
2026-03-25 18:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 717f1914-4a18-5578-b2f4-4ed59b0084be
2026-03-25 18:34:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 717f1914-4a18-5578-b2f4-4ed59b0084be, skipping ID generation
2026-03-25 18:34:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 717f1914-4a18-5578-b2f4-4ed59b0084be with scrape type 1
2026-03-25 18:34:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 717f1914-4a18-5578-b2f4-4ed59b0084be sending to next pipeline
2026-03-25 18:34:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 717f1914-4a18-5578-b2f4-4ed59b0084be, identifier: 1983283
2026-03-25 18:34:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ecfa490>
2026-03-25 18:34:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d97561f-4fff-5701-8b42-77663783f265/9d97561f-4fff-5701-8b42-77663783f265_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F389%252F8948e61f9a1a4b4ab1d1f08261b241bc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/389/8948e61f9a1a4b4ab1d1f08261b241bc/images/large/1.jpg saved to cache
2026-03-25 18:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9d97561f-4fff-5701-8b42-77663783f265
2026-03-25 18:34:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9d97561f-4fff-5701-8b42-77663783f265, skipping ID generation
2026-03-25 18:34:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d97561f-4fff-5701-8b42-77663783f265 with scrape type 1
2026-03-25 18:34:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9d97561f-4fff-5701-8b42-77663783f265 sending to next pipeline
2026-03-25 18:34:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9d97561f-4fff-5701-8b42-77663783f265, identifier: 1983285
2026-03-25 18:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/963/c97ea768f1ca423f94891418a1e98a5f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 717f1914-4a18-5578-b2f4-4ed59b0084be with identifier: 1983283
2026-03-25 18:34:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 717f1914-4a18-5578-b2f4-4ed59b0084be with identifier: 1983283
2026-03-25 18:34:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 717f1914-4a18-5578-b2f4-4ed59b0084be with identifier: 1983283 to the API
2026-03-25 18:34:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/010/a1c98b08391d4d07922c88a2d035e06e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Gris',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '717f1914-4a18-5578-b2f4-4ed59b0084be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-ROC',
 'odometer': 83083,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_717f1914-4a18-5578-b2f4-4ed59b0084be/717f1914-4a18-5578-b2f4-4ed59b0084be_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 583353,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/010/a1c98b08391d4d07922c88a2d035e06e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-ROC Sport 2.0 TDI 110kW (150CV) 4 Motion DSG',
 'transmission': 'manual',
 'trim': 'Sport 2.0 TDI 110kW (150CV) 4 Motion DSG',
 'vin': None,
 'year': 2021}
2026-03-25 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983283%27 HTTP/1.1" 200 None
2026-03-25 18:34:11 [ayvens.es] INFO: Saving data for 1983283: {'created_time': 1774463651.555718, 'last_price_update_time': 1774463651.555728, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983283') HTTP/1.1" 204 0
2026-03-25 18:34:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9d97561f-4fff-5701-8b42-77663783f265 with identifier: 1983285
2026-03-25 18:34:11 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:34:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9d97561f-4fff-5701-8b42-77663783f265 with identifier: 1983285
2026-03-25 18:34:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9d97561f-4fff-5701-8b42-77663783f265 with identifier: 1983285 to the API
2026-03-25 18:34:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/389/8948e61f9a1a4b4ab1d1f08261b241bc/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 24,
 'color': 'Onyx',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '9d97561f-4fff-5701-8b42-77663783f265',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC60',
 'odometer': 74486,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d97561f-4fff-5701-8b42-77663783f265/9d97561f-4fff-5701-8b42-77663783f265_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 380470,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/389/8948e61f9a1a4b4ab1d1f08261b241bc/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC60 2.0 T6 AWD Recharge Inscription Exp Auto',
 'transmission': 'manual',
 'trim': '2.0 T6 AWD Recharge Inscription Exp Auto',
 'vin': None,
 'year': 2022}
2026-03-25 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983285%27 HTTP/1.1" 200 None
2026-03-25 18:34:11 [ayvens.es] INFO: Saving data for 1983285: {'created_time': 1774463651.896917, 'last_price_update_time': 1774463651.896927, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983285') HTTP/1.1" 204 0
2026-03-25 18:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/170/ad40c743cd634c76a1805fe270f9576b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:11 [ayvens.es] INFO: Found listing with ID: 1983295
2026-03-25 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983295%27 HTTP/1.1" 200 None
2026-03-25 18:34:11 [ayvens.es] INFO: Scrape type for 1983295: 1
2026-03-25 18:34:11 [ayvens.es] INFO: Extracting data for car ID: 1983295
2026-03-25 18:34:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3490a709-b684-599f-847b-34ef86fc2efb with identifier: 1983295
2026-03-25 18:34:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3490a709-b684-599f-847b-34ef86fc2efb with scrape type 1
2026-03-25 18:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3490a709-b684-599f-847b-34ef86fc2efb
2026-03-25 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F826%252F8c7717e3e4b94a94a6e12004ea708589%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/826/8c7717e3e4b94a94a6e12004ea708589/images/large/1.jpg not downloaded yet
2026-03-25 18:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/928/4ade4b1823494f2589e8477b22f2771a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ecfae90>
2026-03-25 18:34:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5334d7e2-baaa-5a15-9687-98e0a3f88573/5334d7e2-baaa-5a15-9687-98e0a3f88573_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F280%252Ff388bc0b8c8643aba3c5d55972ab87bb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/280/f388bc0b8c8643aba3c5d55972ab87bb/images/large/1.jpg saved to cache
2026-03-25 18:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5334d7e2-baaa-5a15-9687-98e0a3f88573
2026-03-25 18:34:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5334d7e2-baaa-5a15-9687-98e0a3f88573, skipping ID generation
2026-03-25 18:34:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5334d7e2-baaa-5a15-9687-98e0a3f88573 with scrape type 1
2026-03-25 18:34:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5334d7e2-baaa-5a15-9687-98e0a3f88573 sending to next pipeline
2026-03-25 18:34:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5334d7e2-baaa-5a15-9687-98e0a3f88573, identifier: 1983287
2026-03-25 18:34:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/532/1fa0c9e396a64a83bc87b5d97fd07d86/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:12 [ayvens.es] INFO: Found listing with ID: 1983296
2026-03-25 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983296%27 HTTP/1.1" 200 None
2026-03-25 18:34:12 [ayvens.es] INFO: Scrape type for 1983296: 1
2026-03-25 18:34:12 [ayvens.es] INFO: Extracting data for car ID: 1983296
2026-03-25 18:34:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c77997f-fc37-57d6-a9a0-b24b62507912 with identifier: 1983296
2026-03-25 18:34:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c77997f-fc37-57d6-a9a0-b24b62507912 with scrape type 1
2026-03-25 18:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1c77997f-fc37-57d6-a9a0-b24b62507912
2026-03-25 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F615%252F26652770e6ac464e83c9338ff332f8ae%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/615/26652770e6ac464e83c9338ff332f8ae/images/large/1.jpg not downloaded yet
2026-03-25 18:34:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5334d7e2-baaa-5a15-9687-98e0a3f88573 with identifier: 1983287
2026-03-25 18:34:12 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:34:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5334d7e2-baaa-5a15-9687-98e0a3f88573 with identifier: 1983287
2026-03-25 18:34:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5334d7e2-baaa-5a15-9687-98e0a3f88573 with identifier: 1983287 to the API
2026-03-25 18:34:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/280/f388bc0b8c8643aba3c5d55972ab87bb/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Scale',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'electric',
 'id': '5334d7e2-baaa-5a15-9687-98e0a3f88573',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'ID.4',
 'odometer': 58515,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5334d7e2-baaa-5a15-9687-98e0a3f88573/5334d7e2-baaa-5a15-9687-98e0a3f88573_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354821,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/280/f388bc0b8c8643aba3c5d55972ab87bb/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN ID.4 Pro 128kW (174CV) Automatico',
 'transmission': 'manual',
 'trim': 'Pro 128kW (174CV) Automatico',
 'vin': None,
 'year': 2023}
2026-03-25 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983287%27 HTTP/1.1" 200 None
2026-03-25 18:34:12 [ayvens.es] INFO: Saving data for 1983287: {'created_time': 1774463652.527603, 'last_price_update_time': 1774463652.527613, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983287') HTTP/1.1" 204 0
2026-03-25 18:34:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8efa40d0>
2026-03-25 18:34:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5756c549-4444-53cd-833b-f9cc09a21fe8/5756c549-4444-53cd-833b-f9cc09a21fe8_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F963%252Fc97ea768f1ca423f94891418a1e98a5f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/963/c97ea768f1ca423f94891418a1e98a5f/images/large/1.jpg saved to cache
2026-03-25 18:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5756c549-4444-53cd-833b-f9cc09a21fe8
2026-03-25 18:34:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5756c549-4444-53cd-833b-f9cc09a21fe8, skipping ID generation
2026-03-25 18:34:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5756c549-4444-53cd-833b-f9cc09a21fe8 with scrape type 1
2026-03-25 18:34:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5756c549-4444-53cd-833b-f9cc09a21fe8 sending to next pipeline
2026-03-25 18:34:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5756c549-4444-53cd-833b-f9cc09a21fe8, identifier: 1983286
2026-03-25 18:34:12 [ayvens.es] INFO: Found listing with ID: 1983297
2026-03-25 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983297%27 HTTP/1.1" 200 None
2026-03-25 18:34:12 [ayvens.es] INFO: Scrape type for 1983297: 1
2026-03-25 18:34:12 [ayvens.es] INFO: Extracting data for car ID: 1983297
2026-03-25 18:34:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d89d30b9-b104-5c61-935e-9b0ee8d502de with identifier: 1983297
2026-03-25 18:34:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d89d30b9-b104-5c61-935e-9b0ee8d502de with scrape type 1
2026-03-25 18:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d89d30b9-b104-5c61-935e-9b0ee8d502de
2026-03-25 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F402%252Fd3e3b911b66444cbbbb21fd486d4dcc1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/402/d3e3b911b66444cbbbb21fd486d4dcc1/images/large/1.jpg not downloaded yet
2026-03-25 18:34:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5756c549-4444-53cd-833b-f9cc09a21fe8 with identifier: 1983286
2026-03-25 18:34:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5756c549-4444-53cd-833b-f9cc09a21fe8 with identifier: 1983286
2026-03-25 18:34:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5756c549-4444-53cd-833b-f9cc09a21fe8 with identifier: 1983286 to the API
2026-03-25 18:34:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/963/c97ea768f1ca423f94891418a1e98a5f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '5756c549-4444-53cd-833b-f9cc09a21fe8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'RAV4',
 'odometer': 121230,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5756c549-4444-53cd-833b-f9cc09a21fe8/5756c549-4444-53cd-833b-f9cc09a21fe8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 702037,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/963/c97ea768f1ca423f94891418a1e98a5f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA RAV4 2.5l 220H Advance',
 'transmission': 'manual',
 'trim': '2.5l 220H Advance',
 'vin': None,
 'year': 2021}
2026-03-25 18:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983286%27 HTTP/1.1" 200 None
2026-03-25 18:34:13 [ayvens.es] INFO: Saving data for 1983286: {'created_time': 1774463653.064902, 'last_price_update_time': 1774463653.064913, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983286') HTTP/1.1" 204 0
2026-03-25 18:34:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8edd0a10>
2026-03-25 18:34:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf4165ae-1ff8-599b-b9c8-92aee9f90525/bf4165ae-1ff8-599b-b9c8-92aee9f90525_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F170%252Fad40c743cd634c76a1805fe270f9576b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/170/ad40c743cd634c76a1805fe270f9576b/images/large/1.jpg saved to cache
2026-03-25 18:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bf4165ae-1ff8-599b-b9c8-92aee9f90525
2026-03-25 18:34:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bf4165ae-1ff8-599b-b9c8-92aee9f90525, skipping ID generation
2026-03-25 18:34:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf4165ae-1ff8-599b-b9c8-92aee9f90525 with scrape type 1
2026-03-25 18:34:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bf4165ae-1ff8-599b-b9c8-92aee9f90525 sending to next pipeline
2026-03-25 18:34:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: bf4165ae-1ff8-599b-b9c8-92aee9f90525, identifier: 1983288
2026-03-25 18:34:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ecf8bd0>
2026-03-25 18:34:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc503e9f-481e-5b5b-9752-7f42330407c1/dc503e9f-481e-5b5b-9752-7f42330407c1_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F928%252F4ade4b1823494f2589e8477b22f2771a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/928/4ade4b1823494f2589e8477b22f2771a/images/large/1.jpg saved to cache
2026-03-25 18:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dc503e9f-481e-5b5b-9752-7f42330407c1
2026-03-25 18:34:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dc503e9f-481e-5b5b-9752-7f42330407c1, skipping ID generation
2026-03-25 18:34:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc503e9f-481e-5b5b-9752-7f42330407c1 with scrape type 1
2026-03-25 18:34:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dc503e9f-481e-5b5b-9752-7f42330407c1 sending to next pipeline
2026-03-25 18:34:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: dc503e9f-481e-5b5b-9752-7f42330407c1, identifier: 1983289
2026-03-25 18:34:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e5d1890>
2026-03-25 18:34:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_510105e1-a844-5c66-bf48-789803c8ea14/510105e1-a844-5c66-bf48-789803c8ea14_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F532%252F1fa0c9e396a64a83bc87b5d97fd07d86%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/532/1fa0c9e396a64a83bc87b5d97fd07d86/images/large/1.jpg saved to cache
2026-03-25 18:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 510105e1-a844-5c66-bf48-789803c8ea14
2026-03-25 18:34:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 510105e1-a844-5c66-bf48-789803c8ea14, skipping ID generation
2026-03-25 18:34:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 510105e1-a844-5c66-bf48-789803c8ea14 with scrape type 1
2026-03-25 18:34:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 510105e1-a844-5c66-bf48-789803c8ea14 sending to next pipeline
2026-03-25 18:34:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 510105e1-a844-5c66-bf48-789803c8ea14, identifier: 1983290
2026-03-25 18:34:13 [ayvens.es] INFO: Found listing with ID: 1983298
2026-03-25 18:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983298%27 HTTP/1.1" 200 None
2026-03-25 18:34:13 [ayvens.es] INFO: Scrape type for 1983298: 1
2026-03-25 18:34:13 [ayvens.es] INFO: Extracting data for car ID: 1983298
2026-03-25 18:34:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45e17fe0-75c2-550e-be79-2d22dc08d37f with identifier: 1983298
2026-03-25 18:34:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45e17fe0-75c2-550e-be79-2d22dc08d37f with scrape type 1
2026-03-25 18:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 45e17fe0-75c2-550e-be79-2d22dc08d37f
2026-03-25 18:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F574%252Fdc4b7b1a36da4aadba33760ee8f77602%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/574/dc4b7b1a36da4aadba33760ee8f77602/images/large/1.jpg not downloaded yet
2026-03-25 18:34:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: bf4165ae-1ff8-599b-b9c8-92aee9f90525 with identifier: 1983288
2026-03-25 18:34:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: bf4165ae-1ff8-599b-b9c8-92aee9f90525 with identifier: 1983288
2026-03-25 18:34:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: bf4165ae-1ff8-599b-b9c8-92aee9f90525 with identifier: 1983288 to the API
2026-03-25 18:34:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/170/ad40c743cd634c76a1805fe270f9576b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'bf4165ae-1ff8-599b-b9c8-92aee9f90525',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'ARTEON',
 'odometer': 91761,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf4165ae-1ff8-599b-b9c8-92aee9f90525/bf4165ae-1ff8-599b-b9c8-92aee9f90525_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 484290,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/170/ad40c743cd634c76a1805fe270f9576b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN ARTEON R-Line 2.0 TDI 110kW (150CV) DSG S Brake',
 'transmission': 'manual',
 'trim': 'R-Line 2.0 TDI 110kW (150CV) DSG S Brake',
 'vin': None,
 'year': 2022}
2026-03-25 18:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983288%27 HTTP/1.1" 200 None
2026-03-25 18:34:14 [ayvens.es] INFO: Saving data for 1983288: {'created_time': 1774463654.002401, 'last_price_update_time': 1774463654.002411, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983288') HTTP/1.1" 204 0
2026-03-25 18:34:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: dc503e9f-481e-5b5b-9752-7f42330407c1 with identifier: 1983289
2026-03-25 18:34:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: dc503e9f-481e-5b5b-9752-7f42330407c1 with identifier: 1983289
2026-03-25 18:34:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: dc503e9f-481e-5b5b-9752-7f42330407c1 with identifier: 1983289 to the API
2026-03-25 18:34:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/928/4ade4b1823494f2589e8477b22f2771a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 176,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'dc503e9f-481e-5b5b-9752-7f42330407c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN ALLSPACE',
 'odometer': 97400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc503e9f-481e-5b5b-9752-7f42330407c1/dc503e9f-481e-5b5b-9752-7f42330407c1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 299651,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/928/4ade4b1823494f2589e8477b22f2771a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-16',
 'seats_number': 7,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN ALLSPACE Advance 2.0 TDI 110kW (150CV) 4Mot DSG',
 'transmission': 'manual',
 'trim': 'Advance 2.0 TDI 110kW (150CV) 4Mot DSG',
 'vin': None,
 'year': 2021}
2026-03-25 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983289%27 HTTP/1.1" 200 None
2026-03-25 18:34:14 [ayvens.es] INFO: Saving data for 1983289: {'created_time': 1774463654.336306, 'last_price_update_time': 1774463654.336318, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983289') HTTP/1.1" 204 0
2026-03-25 18:34:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 510105e1-a844-5c66-bf48-789803c8ea14 with identifier: 1983290
2026-03-25 18:34:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 510105e1-a844-5c66-bf48-789803c8ea14 with identifier: 1983290
2026-03-25 18:34:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 510105e1-a844-5c66-bf48-789803c8ea14 with identifier: 1983290 to the API
2026-03-25 18:34:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/532/1fa0c9e396a64a83bc87b5d97fd07d86/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '510105e1-a844-5c66-bf48-789803c8ea14',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ARONA',
 'odometer': 110424,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_510105e1-a844-5c66-bf48-789803c8ea14/510105e1-a844-5c66-bf48-789803c8ea14_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 345414,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/532/1fa0c9e396a64a83bc87b5d97fd07d86/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ARONA 1.0 TSI 70kW (95CV) Reference',
 'transmission': 'manual',
 'trim': '1.0 TSI 70kW (95CV) Reference',
 'vin': None,
 'year': 2022}
2026-03-25 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983290%27 HTTP/1.1" 200 None
2026-03-25 18:34:14 [ayvens.es] INFO: Saving data for 1983290: {'created_time': 1774463654.614287, 'last_price_update_time': 1774463654.614298, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983290') HTTP/1.1" 204 0
2026-03-25 18:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/062/b536ec8c82d9474c9d98688358cdf395/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/716/bab09bbdfe654f77a8c6c13f67972a61/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:14 [ayvens.es] INFO: Found listing with ID: 1983299
2026-03-25 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983299%27 HTTP/1.1" 200 None
2026-03-25 18:34:14 [ayvens.es] INFO: Scrape type for 1983299: 1
2026-03-25 18:34:14 [ayvens.es] INFO: Extracting data for car ID: 1983299
2026-03-25 18:34:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bba0b351-2eab-540f-a6ff-b3a13e45483b with identifier: 1983299
2026-03-25 18:34:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bba0b351-2eab-540f-a6ff-b3a13e45483b with scrape type 1
2026-03-25 18:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item bba0b351-2eab-540f-a6ff-b3a13e45483b
2026-03-25 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F939%252Faedaa7c15ced4bfb824941eabee71a19%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/939/aedaa7c15ced4bfb824941eabee71a19/images/large/1.jpg not downloaded yet
2026-03-25 18:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/435/1e826a179d764948a8fc854bfff2a266/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:14 [ayvens.es] INFO: Found listing with ID: 1983300
2026-03-25 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983300%27 HTTP/1.1" 200 None
2026-03-25 18:34:14 [ayvens.es] INFO: Scrape type for 1983300: 1
2026-03-25 18:34:14 [ayvens.es] INFO: Extracting data for car ID: 1983300
2026-03-25 18:34:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0dda9a4a-03b8-5115-a60e-05286b371793 with identifier: 1983300
2026-03-25 18:34:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0dda9a4a-03b8-5115-a60e-05286b371793 with scrape type 1
2026-03-25 18:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0dda9a4a-03b8-5115-a60e-05286b371793
2026-03-25 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F013%252Fdff393c24a2643839043e5773dfd5a06%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/013/dff393c24a2643839043e5773dfd5a06/images/large/1.jpg not downloaded yet
2026-03-25 18:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/796/0df1bbbe8ed146c0955c55d7e3186d7f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/826/8c7717e3e4b94a94a6e12004ea708589/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:14 [ayvens.es] INFO: Found listing with ID: 1983301
2026-03-25 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983301%27 HTTP/1.1" 200 None
2026-03-25 18:34:14 [ayvens.es] INFO: Scrape type for 1983301: 1
2026-03-25 18:34:14 [ayvens.es] INFO: Extracting data for car ID: 1983301
2026-03-25 18:34:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c886edea-7978-5147-afdd-903f52e461a4 with identifier: 1983301
2026-03-25 18:34:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c886edea-7978-5147-afdd-903f52e461a4 with scrape type 1
2026-03-25 18:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c886edea-7978-5147-afdd-903f52e461a4
2026-03-25 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F685%252F866cb5dffe8b4b0cbcb6ab770c7af81e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/685/866cb5dffe8b4b0cbcb6ab770c7af81e/images/large/1.jpg not downloaded yet
2026-03-25 18:34:14 [ayvens.es] INFO: Found listing with ID: 1983302
2026-03-25 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983302%27 HTTP/1.1" 200 None
2026-03-25 18:34:14 [ayvens.es] INFO: Scrape type for 1983302: 1
2026-03-25 18:34:14 [ayvens.es] INFO: Extracting data for car ID: 1983302
2026-03-25 18:34:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0f44f11-66e4-5079-a78d-841a7bf587d1 with identifier: 1983302
2026-03-25 18:34:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0f44f11-66e4-5079-a78d-841a7bf587d1 with scrape type 1
2026-03-25 18:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f0f44f11-66e4-5079-a78d-841a7bf587d1
2026-03-25 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F405%252F4783dc1eec414513b345868b9eb31ea3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/405/4783dc1eec414513b345868b9eb31ea3/images/large/1.jpg not downloaded yet
2026-03-25 18:34:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8d4163d0>
2026-03-25 18:34:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7404a694-59d3-5193-98a7-8eba4137d669/7404a694-59d3-5193-98a7-8eba4137d669_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F062%252Fb536ec8c82d9474c9d98688358cdf395%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/062/b536ec8c82d9474c9d98688358cdf395/images/large/1.jpg saved to cache
2026-03-25 18:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7404a694-59d3-5193-98a7-8eba4137d669
2026-03-25 18:34:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7404a694-59d3-5193-98a7-8eba4137d669, skipping ID generation
2026-03-25 18:34:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7404a694-59d3-5193-98a7-8eba4137d669 with scrape type 1
2026-03-25 18:34:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7404a694-59d3-5193-98a7-8eba4137d669 sending to next pipeline
2026-03-25 18:34:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7404a694-59d3-5193-98a7-8eba4137d669, identifier: 1983292
2026-03-25 18:34:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e5aa610>
2026-03-25 18:34:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba7dea1a-9890-5bd5-a678-b4130d913dae/ba7dea1a-9890-5bd5-a678-b4130d913dae_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F716%252Fbab09bbdfe654f77a8c6c13f67972a61%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/716/bab09bbdfe654f77a8c6c13f67972a61/images/large/1.jpg saved to cache
2026-03-25 18:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ba7dea1a-9890-5bd5-a678-b4130d913dae
2026-03-25 18:34:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ba7dea1a-9890-5bd5-a678-b4130d913dae, skipping ID generation
2026-03-25 18:34:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba7dea1a-9890-5bd5-a678-b4130d913dae with scrape type 1
2026-03-25 18:34:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ba7dea1a-9890-5bd5-a678-b4130d913dae sending to next pipeline
2026-03-25 18:34:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ba7dea1a-9890-5bd5-a678-b4130d913dae, identifier: 1983291
2026-03-25 18:34:15 [ayvens.es] INFO: Found listing with ID: 1983303
2026-03-25 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983303%27 HTTP/1.1" 200 None
2026-03-25 18:34:15 [ayvens.es] INFO: Scrape type for 1983303: 1
2026-03-25 18:34:15 [ayvens.es] INFO: Extracting data for car ID: 1983303
2026-03-25 18:34:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 582ff400-364d-5655-815d-2900c71a2a5d with identifier: 1983303
2026-03-25 18:34:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 582ff400-364d-5655-815d-2900c71a2a5d with scrape type 1
2026-03-25 18:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 582ff400-364d-5655-815d-2900c71a2a5d
2026-03-25 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F381%252F35ec2cf81ad846fcaaf10c3346f35db5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/381/35ec2cf81ad846fcaaf10c3346f35db5/images/large/1.jpg not downloaded yet
2026-03-25 18:34:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7404a694-59d3-5193-98a7-8eba4137d669 with identifier: 1983292
2026-03-25 18:34:15 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:34:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7404a694-59d3-5193-98a7-8eba4137d669 with identifier: 1983292
2026-03-25 18:34:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7404a694-59d3-5193-98a7-8eba4137d669 with identifier: 1983292 to the API
2026-03-25 18:34:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/062/b536ec8c82d9474c9d98688358cdf395/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'color': 'Eiger grey',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '7404a694-59d3-5193-98a7-8eba4137d669',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER EVOQUE',
 'odometer': 57749,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7404a694-59d3-5193-98a7-8eba4137d669/7404a694-59d3-5193-98a7-8eba4137d669_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 472186,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/062/b536ec8c82d9474c9d98688358cdf395/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER RANGE ROVER EVOQUE 2.0 D150 AUTO 4WD MHEV',
 'transmission': 'manual',
 'trim': '2.0 D150 AUTO 4WD MHEV',
 'vin': None,
 'year': 2020}
2026-03-25 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983292%27 HTTP/1.1" 200 None
2026-03-25 18:34:15 [ayvens.es] INFO: Saving data for 1983292: {'created_time': 1774463655.408138, 'last_price_update_time': 1774463655.408149, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983292') HTTP/1.1" 204 0
2026-03-25 18:34:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ba7dea1a-9890-5bd5-a678-b4130d913dae with identifier: 1983291
2026-03-25 18:34:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ba7dea1a-9890-5bd5-a678-b4130d913dae with identifier: 1983291
2026-03-25 18:34:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ba7dea1a-9890-5bd5-a678-b4130d913dae with identifier: 1983291 to the API
2026-03-25 18:34:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/716/bab09bbdfe654f77a8c6c13f67972a61/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ba7dea1a-9890-5bd5-a678-b4130d913dae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'B-CLASS',
 'odometer': 140822,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba7dea1a-9890-5bd5-a678-b4130d913dae/ba7dea1a-9890-5bd5-a678-b4130d913dae_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 473589,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/716/bab09bbdfe654f77a8c6c13f67972a61/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ B-CLASS B 180 d',
 'transmission': 'manual',
 'trim': 'B 180 d',
 'vin': None,
 'year': 2020}
2026-03-25 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983291%27 HTTP/1.1" 200 None
2026-03-25 18:34:15 [ayvens.es] INFO: Saving data for 1983291: {'created_time': 1774463655.790551, 'last_price_update_time': 1774463655.790561, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983291') HTTP/1.1" 204 0
2026-03-25 18:34:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae9e4356d0>
2026-03-25 18:34:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e65eec8e-1a6f-5986-b18e-d7aa598be65d/e65eec8e-1a6f-5986-b18e-d7aa598be65d_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F435%252F1e826a179d764948a8fc854bfff2a266%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/435/1e826a179d764948a8fc854bfff2a266/images/large/1.jpg saved to cache
2026-03-25 18:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e65eec8e-1a6f-5986-b18e-d7aa598be65d
2026-03-25 18:34:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e65eec8e-1a6f-5986-b18e-d7aa598be65d, skipping ID generation
2026-03-25 18:34:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e65eec8e-1a6f-5986-b18e-d7aa598be65d with scrape type 1
2026-03-25 18:34:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e65eec8e-1a6f-5986-b18e-d7aa598be65d sending to next pipeline
2026-03-25 18:34:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e65eec8e-1a6f-5986-b18e-d7aa598be65d, identifier: 1983294
2026-03-25 18:34:15 [ayvens.es] INFO: Found listing with ID: 1983304
2026-03-25 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983304%27 HTTP/1.1" 200 None
2026-03-25 18:34:15 [ayvens.es] INFO: Scrape type for 1983304: 1
2026-03-25 18:34:15 [ayvens.es] INFO: Extracting data for car ID: 1983304
2026-03-25 18:34:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52188a04-d8f3-5400-8eab-54b7aa3b8492 with identifier: 1983304
2026-03-25 18:34:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52188a04-d8f3-5400-8eab-54b7aa3b8492 with scrape type 1
2026-03-25 18:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 52188a04-d8f3-5400-8eab-54b7aa3b8492
2026-03-25 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F565%252F8175cfdef1f54333bc14ee8bc601c755%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/565/8175cfdef1f54333bc14ee8bc601c755/images/large/1.jpg not downloaded yet
2026-03-25 18:34:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e65eec8e-1a6f-5986-b18e-d7aa598be65d with identifier: 1983294
2026-03-25 18:34:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e65eec8e-1a6f-5986-b18e-d7aa598be65d with identifier: 1983294
2026-03-25 18:34:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e65eec8e-1a6f-5986-b18e-d7aa598be65d with identifier: 1983294 to the API
2026-03-25 18:34:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/435/1e826a179d764948a8fc854bfff2a266/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 199,
 'color': 'Blanco polar',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '2.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e65eec8e-1a6f-5986-b18e-d7aa598be65d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'MITSUBISHI',
 'model': 'L200',
 'odometer': 125523,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e65eec8e-1a6f-5986-b18e-d7aa598be65d/e65eec8e-1a6f-5986-b18e-d7aa598be65d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 312820,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/435/1e826a179d764948a8fc854bfff2a266/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-29',
 'seats_number': 2,
 'seller_name': None,
 'title': 'MITSUBISHI L200 2.5 DI-D Single Cab M-Pro',
 'transmission': 'manual',
 'trim': '2.5 DI-D Single Cab M-Pro',
 'vin': None,
 'year': 2015}
2026-03-25 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983294%27 HTTP/1.1" 200 None
2026-03-25 18:34:16 [ayvens.es] INFO: Saving data for 1983294: {'created_time': 1774463656.283288, 'last_price_update_time': 1774463656.283305, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983294') HTTP/1.1" 204 0
2026-03-25 18:34:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e5db410>
2026-03-25 18:34:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41c3e584-e391-51f7-8b9a-5e437dd6287b/41c3e584-e391-51f7-8b9a-5e437dd6287b_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F796%252F0df1bbbe8ed146c0955c55d7e3186d7f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/796/0df1bbbe8ed146c0955c55d7e3186d7f/images/large/1.jpg saved to cache
2026-03-25 18:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 41c3e584-e391-51f7-8b9a-5e437dd6287b
2026-03-25 18:34:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 41c3e584-e391-51f7-8b9a-5e437dd6287b, skipping ID generation
2026-03-25 18:34:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41c3e584-e391-51f7-8b9a-5e437dd6287b with scrape type 1
2026-03-25 18:34:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 41c3e584-e391-51f7-8b9a-5e437dd6287b sending to next pipeline
2026-03-25 18:34:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 41c3e584-e391-51f7-8b9a-5e437dd6287b, identifier: 1983293
2026-03-25 18:34:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8eca7350>
2026-03-25 18:34:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3490a709-b684-599f-847b-34ef86fc2efb/3490a709-b684-599f-847b-34ef86fc2efb_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F826%252F8c7717e3e4b94a94a6e12004ea708589%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/826/8c7717e3e4b94a94a6e12004ea708589/images/large/1.jpg saved to cache
2026-03-25 18:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3490a709-b684-599f-847b-34ef86fc2efb
2026-03-25 18:34:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3490a709-b684-599f-847b-34ef86fc2efb, skipping ID generation
2026-03-25 18:34:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3490a709-b684-599f-847b-34ef86fc2efb with scrape type 1
2026-03-25 18:34:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3490a709-b684-599f-847b-34ef86fc2efb sending to next pipeline
2026-03-25 18:34:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3490a709-b684-599f-847b-34ef86fc2efb, identifier: 1983295
2026-03-25 18:34:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/574/dc4b7b1a36da4aadba33760ee8f77602/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:16 [ayvens.es] INFO: Found listing with ID: 1983305
2026-03-25 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983305%27 HTTP/1.1" 200 None
2026-03-25 18:34:16 [ayvens.es] INFO: Scrape type for 1983305: 1
2026-03-25 18:34:16 [ayvens.es] INFO: Extracting data for car ID: 1983305
2026-03-25 18:34:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3afd809-0b3a-59e2-8c9d-b6843022bb13 with identifier: 1983305
2026-03-25 18:34:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3afd809-0b3a-59e2-8c9d-b6843022bb13 with scrape type 1
2026-03-25 18:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c3afd809-0b3a-59e2-8c9d-b6843022bb13
2026-03-25 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F142%252F271005b4a01941819894eb032319762b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/142/271005b4a01941819894eb032319762b/images/large/1.jpg not downloaded yet
2026-03-25 18:34:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 41c3e584-e391-51f7-8b9a-5e437dd6287b with identifier: 1983293
2026-03-25 18:34:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:34:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 41c3e584-e391-51f7-8b9a-5e437dd6287b with identifier: 1983293
2026-03-25 18:34:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 41c3e584-e391-51f7-8b9a-5e437dd6287b with identifier: 1983293 to the API
2026-03-25 18:34:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/796/0df1bbbe8ed146c0955c55d7e3186d7f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'color': 'Gris artenso',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '41c3e584-e391-51f7-8b9a-5e437dd6287b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS 7 CROSSBACK',
 'odometer': 155045,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41c3e584-e391-51f7-8b9a-5e437dd6287b/41c3e584-e391-51f7-8b9a-5e437dd6287b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 569801,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/796/0df1bbbe8ed146c0955c55d7e3186d7f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS 7 CROSSBACK BlueHDi DE 96kW (130CV) AT Bastille +',
 'transmission': 'manual',
 'trim': 'BlueHDi DE 96kW (130CV) AT Bastille +',
 'vin': None,
 'year': 2021}
2026-03-25 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983293%27 HTTP/1.1" 200 None
2026-03-25 18:34:17 [ayvens.es] INFO: Saving data for 1983293: {'created_time': 1774463657.00628, 'last_price_update_time': 1774463657.006291, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983293') HTTP/1.1" 204 0
2026-03-25 18:34:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3490a709-b684-599f-847b-34ef86fc2efb with identifier: 1983295
2026-03-25 18:34:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3490a709-b684-599f-847b-34ef86fc2efb with identifier: 1983295
2026-03-25 18:34:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3490a709-b684-599f-847b-34ef86fc2efb with identifier: 1983295 to the API
2026-03-25 18:34:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/826/8c7717e3e4b94a94a6e12004ea708589/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '3490a709-b684-599f-847b-34ef86fc2efb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'DOBLO CARGO',
 'odometer': 40928,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3490a709-b684-599f-847b-34ef86fc2efb/3490a709-b684-599f-847b-34ef86fc2efb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328880,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/826/8c7717e3e4b94a94a6e12004ea708589/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-20',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FIAT DOBLO CARGO (O) Cargo SX 1.6 Mjet 77kW (105CV)',
 'transmission': 'manual',
 'trim': '(O) Cargo SX 1.6 Mjet 77kW (105CV)',
 'vin': None,
 'year': 2022}
2026-03-25 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983295%27 HTTP/1.1" 200 None
2026-03-25 18:34:17 [ayvens.es] INFO: Saving data for 1983295: {'created_time': 1774463657.310354, 'last_price_update_time': 1774463657.310368, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983295') HTTP/1.1" 204 0
2026-03-25 18:34:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/402/d3e3b911b66444cbbbb21fd486d4dcc1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/013/dff393c24a2643839043e5773dfd5a06/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/615/26652770e6ac464e83c9338ff332f8ae/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/939/aedaa7c15ced4bfb824941eabee71a19/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/685/866cb5dffe8b4b0cbcb6ab770c7af81e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:17 [ayvens.es] INFO: Found listing with ID: 1983306
2026-03-25 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983306%27 HTTP/1.1" 200 None
2026-03-25 18:34:17 [ayvens.es] INFO: Scrape type for 1983306: 1
2026-03-25 18:34:17 [ayvens.es] INFO: Extracting data for car ID: 1983306
2026-03-25 18:34:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad1bd37e-78ab-5aec-a03a-6008ed125947 with identifier: 1983306
2026-03-25 18:34:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad1bd37e-78ab-5aec-a03a-6008ed125947 with scrape type 1
2026-03-25 18:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ad1bd37e-78ab-5aec-a03a-6008ed125947
2026-03-25 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F793%252F8ea7ca46c0d94bbebfd8dede683b9e92%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/793/8ea7ca46c0d94bbebfd8dede683b9e92/images/large/1.jpg not downloaded yet
2026-03-25 18:34:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8eaaae10>
2026-03-25 18:34:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45e17fe0-75c2-550e-be79-2d22dc08d37f/45e17fe0-75c2-550e-be79-2d22dc08d37f_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F574%252Fdc4b7b1a36da4aadba33760ee8f77602%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/574/dc4b7b1a36da4aadba33760ee8f77602/images/large/1.jpg saved to cache
2026-03-25 18:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 45e17fe0-75c2-550e-be79-2d22dc08d37f
2026-03-25 18:34:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 45e17fe0-75c2-550e-be79-2d22dc08d37f, skipping ID generation
2026-03-25 18:34:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45e17fe0-75c2-550e-be79-2d22dc08d37f with scrape type 1
2026-03-25 18:34:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 45e17fe0-75c2-550e-be79-2d22dc08d37f sending to next pipeline
2026-03-25 18:34:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 45e17fe0-75c2-550e-be79-2d22dc08d37f, identifier: 1983298
2026-03-25 18:34:17 [ayvens.es] INFO: Found listing with ID: 1983307
2026-03-25 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983307%27 HTTP/1.1" 200 None
2026-03-25 18:34:17 [ayvens.es] INFO: Scrape type for 1983307: 1
2026-03-25 18:34:17 [ayvens.es] INFO: Extracting data for car ID: 1983307
2026-03-25 18:34:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6d1f119-fbfd-5b25-ae53-f8d5e16ad2e9 with identifier: 1983307
2026-03-25 18:34:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6d1f119-fbfd-5b25-ae53-f8d5e16ad2e9 with scrape type 1
2026-03-25 18:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d6d1f119-fbfd-5b25-ae53-f8d5e16ad2e9
2026-03-25 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F353%252Fcb88d04013b24d96a3b90d83490d0fb9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/353/cb88d04013b24d96a3b90d83490d0fb9/images/large/1.jpg not downloaded yet
2026-03-25 18:34:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 45e17fe0-75c2-550e-be79-2d22dc08d37f with identifier: 1983298
2026-03-25 18:34:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 45e17fe0-75c2-550e-be79-2d22dc08d37f with identifier: 1983298
2026-03-25 18:34:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 45e17fe0-75c2-550e-be79-2d22dc08d37f with identifier: 1983298 to the API
2026-03-25 18:34:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/574/dc4b7b1a36da4aadba33760ee8f77602/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 160,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '45e17fe0-75c2-550e-be79-2d22dc08d37f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'VIVARO',
 'odometer': 152588,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45e17fe0-75c2-550e-be79-2d22dc08d37f/45e17fe0-75c2-550e-be79-2d22dc08d37f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 310728,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/574/dc4b7b1a36da4aadba33760ee8f77602/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-04',
 'seats_number': 2,
 'seller_name': None,
 'title': 'OPEL VIVARO 1.5 Diesel 88kW (120CV) M Std Express',
 'transmission': 'manual',
 'trim': '1.5 Diesel 88kW (120CV) M Std Express',
 'vin': None,
 'year': 2021}
2026-03-25 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983298%27 HTTP/1.1" 200 None
2026-03-25 18:34:17 [ayvens.es] INFO: Saving data for 1983298: {'created_time': 1774463657.859767, 'last_price_update_time': 1774463657.859777, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983298') HTTP/1.1" 204 0
2026-03-25 18:34:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/405/4783dc1eec414513b345868b9eb31ea3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:17 [ayvens.es] INFO: Found listing with ID: 1983308
2026-03-25 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983308%27 HTTP/1.1" 200 None
2026-03-25 18:34:17 [ayvens.es] INFO: Scrape type for 1983308: 1
2026-03-25 18:34:17 [ayvens.es] INFO: Extracting data for car ID: 1983308
2026-03-25 18:34:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 977023ea-1da6-5abc-86cb-e6c42e762e20 with identifier: 1983308
2026-03-25 18:34:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 977023ea-1da6-5abc-86cb-e6c42e762e20 with scrape type 1
2026-03-25 18:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 977023ea-1da6-5abc-86cb-e6c42e762e20
2026-03-25 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F491%252F7f29efcd7e064bcda4114a6c303263cc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/491/7f29efcd7e064bcda4114a6c303263cc/images/large/1.jpg not downloaded yet
2026-03-25 18:34:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ea76650>
2026-03-25 18:34:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d89d30b9-b104-5c61-935e-9b0ee8d502de/d89d30b9-b104-5c61-935e-9b0ee8d502de_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F402%252Fd3e3b911b66444cbbbb21fd486d4dcc1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/402/d3e3b911b66444cbbbb21fd486d4dcc1/images/large/1.jpg saved to cache
2026-03-25 18:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d89d30b9-b104-5c61-935e-9b0ee8d502de
2026-03-25 18:34:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d89d30b9-b104-5c61-935e-9b0ee8d502de, skipping ID generation
2026-03-25 18:34:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d89d30b9-b104-5c61-935e-9b0ee8d502de with scrape type 1
2026-03-25 18:34:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d89d30b9-b104-5c61-935e-9b0ee8d502de sending to next pipeline
2026-03-25 18:34:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d89d30b9-b104-5c61-935e-9b0ee8d502de, identifier: 1983297
2026-03-25 18:34:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e5d3290>
2026-03-25 18:34:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dda9a4a-03b8-5115-a60e-05286b371793/0dda9a4a-03b8-5115-a60e-05286b371793_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F013%252Fdff393c24a2643839043e5773dfd5a06%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/013/dff393c24a2643839043e5773dfd5a06/images/large/1.jpg saved to cache
2026-03-25 18:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0dda9a4a-03b8-5115-a60e-05286b371793
2026-03-25 18:34:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0dda9a4a-03b8-5115-a60e-05286b371793, skipping ID generation
2026-03-25 18:34:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0dda9a4a-03b8-5115-a60e-05286b371793 with scrape type 1
2026-03-25 18:34:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0dda9a4a-03b8-5115-a60e-05286b371793 sending to next pipeline
2026-03-25 18:34:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0dda9a4a-03b8-5115-a60e-05286b371793, identifier: 1983300
2026-03-25 18:34:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ecf6350>
2026-03-25 18:34:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c77997f-fc37-57d6-a9a0-b24b62507912/1c77997f-fc37-57d6-a9a0-b24b62507912_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F615%252F26652770e6ac464e83c9338ff332f8ae%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/615/26652770e6ac464e83c9338ff332f8ae/images/large/1.jpg saved to cache
2026-03-25 18:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1c77997f-fc37-57d6-a9a0-b24b62507912
2026-03-25 18:34:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1c77997f-fc37-57d6-a9a0-b24b62507912, skipping ID generation
2026-03-25 18:34:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c77997f-fc37-57d6-a9a0-b24b62507912 with scrape type 1
2026-03-25 18:34:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1c77997f-fc37-57d6-a9a0-b24b62507912 sending to next pipeline
2026-03-25 18:34:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1c77997f-fc37-57d6-a9a0-b24b62507912, identifier: 1983296
2026-03-25 18:34:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8eab4450>
2026-03-25 18:34:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bba0b351-2eab-540f-a6ff-b3a13e45483b/bba0b351-2eab-540f-a6ff-b3a13e45483b_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F939%252Faedaa7c15ced4bfb824941eabee71a19%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/939/aedaa7c15ced4bfb824941eabee71a19/images/large/1.jpg saved to cache
2026-03-25 18:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bba0b351-2eab-540f-a6ff-b3a13e45483b
2026-03-25 18:34:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bba0b351-2eab-540f-a6ff-b3a13e45483b, skipping ID generation
2026-03-25 18:34:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bba0b351-2eab-540f-a6ff-b3a13e45483b with scrape type 1
2026-03-25 18:34:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bba0b351-2eab-540f-a6ff-b3a13e45483b sending to next pipeline
2026-03-25 18:34:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: bba0b351-2eab-540f-a6ff-b3a13e45483b, identifier: 1983299
2026-03-25 18:34:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8d417f50>
2026-03-25 18:34:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c886edea-7978-5147-afdd-903f52e461a4/c886edea-7978-5147-afdd-903f52e461a4_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F685%252F866cb5dffe8b4b0cbcb6ab770c7af81e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/685/866cb5dffe8b4b0cbcb6ab770c7af81e/images/large/1.jpg saved to cache
2026-03-25 18:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c886edea-7978-5147-afdd-903f52e461a4
2026-03-25 18:34:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c886edea-7978-5147-afdd-903f52e461a4, skipping ID generation
2026-03-25 18:34:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c886edea-7978-5147-afdd-903f52e461a4 with scrape type 1
2026-03-25 18:34:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c886edea-7978-5147-afdd-903f52e461a4 sending to next pipeline
2026-03-25 18:34:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c886edea-7978-5147-afdd-903f52e461a4, identifier: 1983301
2026-03-25 18:34:18 [ayvens.es] INFO: Found listing with ID: 1983309
2026-03-25 18:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983309%27 HTTP/1.1" 200 None
2026-03-25 18:34:18 [ayvens.es] INFO: Scrape type for 1983309: 1
2026-03-25 18:34:18 [ayvens.es] INFO: Extracting data for car ID: 1983309
2026-03-25 18:34:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b185c614-bf5d-5c4f-9917-f5cf3e6a9b67 with identifier: 1983309
2026-03-25 18:34:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b185c614-bf5d-5c4f-9917-f5cf3e6a9b67 with scrape type 1
2026-03-25 18:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b185c614-bf5d-5c4f-9917-f5cf3e6a9b67
2026-03-25 18:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F766%252F5b5992b2fb934191bb8a780392b487c4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/766/5b5992b2fb934191bb8a780392b487c4/images/large/1.jpg not downloaded yet
2026-03-25 18:34:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d89d30b9-b104-5c61-935e-9b0ee8d502de with identifier: 1983297
2026-03-25 18:34:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:34:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d89d30b9-b104-5c61-935e-9b0ee8d502de with identifier: 1983297
2026-03-25 18:34:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d89d30b9-b104-5c61-935e-9b0ee8d502de with identifier: 1983297 to the API
2026-03-25 18:34:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/402/d3e3b911b66444cbbbb21fd486d4dcc1/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'color': 'Polar white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd89d30b9-b104-5c61-935e-9b0ee8d502de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'TUCSON',
 'odometer': 106779,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d89d30b9-b104-5c61-935e-9b0ee8d502de/d89d30b9-b104-5c61-935e-9b0ee8d502de_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 345184,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/402/d3e3b911b66444cbbbb21fd486d4dcc1/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI TUCSON 1.6 CRDI 100kW (136CV) 48V Tecno Sky DCT',
 'transmission': 'manual',
 'trim': '1.6 CRDI 100kW (136CV) 48V Tecno Sky DCT',
 'vin': None,
 'year': 2021}
2026-03-25 18:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983297%27 HTTP/1.1" 200 None
2026-03-25 18:34:18 [ayvens.es] INFO: Saving data for 1983297: {'created_time': 1774463658.968503, 'last_price_update_time': 1774463658.968513, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983297') HTTP/1.1" 204 0
2026-03-25 18:34:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0dda9a4a-03b8-5115-a60e-05286b371793 with identifier: 1983300
2026-03-25 18:34:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0dda9a4a-03b8-5115-a60e-05286b371793 with identifier: 1983300
2026-03-25 18:34:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0dda9a4a-03b8-5115-a60e-05286b371793 with identifier: 1983300 to the API
2026-03-25 18:34:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/013/dff393c24a2643839043e5773dfd5a06/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '0dda9a4a-03b8-5115-a60e-05286b371793',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 39991,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dda9a4a-03b8-5115-a60e-05286b371793/0dda9a4a-03b8-5115-a60e-05286b371793_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 316122,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/013/dff393c24a2643839043e5773dfd5a06/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-26',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS Profesional dCi 66kW (90CV) Euro 6',
 'transmission': 'manual',
 'trim': 'Profesional dCi 66kW (90CV) Euro 6',
 'vin': None,
 'year': 2018}
2026-03-25 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983300%27 HTTP/1.1" 200 None
2026-03-25 18:34:19 [ayvens.es] INFO: Saving data for 1983300: {'created_time': 1774463659.332777, 'last_price_update_time': 1774463659.332788, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983300') HTTP/1.1" 204 0
2026-03-25 18:34:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1c77997f-fc37-57d6-a9a0-b24b62507912 with identifier: 1983296
2026-03-25 18:34:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:34:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1c77997f-fc37-57d6-a9a0-b24b62507912 with identifier: 1983296
2026-03-25 18:34:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1c77997f-fc37-57d6-a9a0-b24b62507912 with identifier: 1983296 to the API
2026-03-25 18:34:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/615/26652770e6ac464e83c9338ff332f8ae/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Blanco jade',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '1c77997f-fc37-57d6-a9a0-b24b62507912',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'COMBO',
 'odometer': 54008,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c77997f-fc37-57d6-a9a0-b24b62507912/1c77997f-fc37-57d6-a9a0-b24b62507912_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 454050,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/615/26652770e6ac464e83c9338ff332f8ae/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-30',
 'seats_number': 2,
 'seller_name': None,
 'title': 'OPEL COMBO 1.5 TD 75kW (100CV) Select L H1 1000kg',
 'transmission': 'manual',
 'trim': '1.5 TD 75kW (100CV) Select L H1 1000kg',
 'vin': None,
 'year': 2021}
2026-03-25 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983296%27 HTTP/1.1" 200 None
2026-03-25 18:34:19 [ayvens.es] INFO: Saving data for 1983296: {'created_time': 1774463659.673543, 'last_price_update_time': 1774463659.673554, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983296') HTTP/1.1" 204 0
2026-03-25 18:34:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: bba0b351-2eab-540f-a6ff-b3a13e45483b with identifier: 1983299
2026-03-25 18:34:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: bba0b351-2eab-540f-a6ff-b3a13e45483b with identifier: 1983299
2026-03-25 18:34:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: bba0b351-2eab-540f-a6ff-b3a13e45483b with identifier: 1983299 to the API
2026-03-25 18:34:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/939/aedaa7c15ced4bfb824941eabee71a19/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'bba0b351-2eab-540f-a6ff-b3a13e45483b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 39625,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bba0b351-2eab-540f-a6ff-b3a13e45483b/bba0b351-2eab-540f-a6ff-b3a13e45483b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354162,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/939/aedaa7c15ced4bfb824941eabee71a19/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.5 BlueHDi 96kW (130CV) S&S Active Pack',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi 96kW (130CV) S&S Active Pack',
 'vin': None,
 'year': 2022}
2026-03-25 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983299%27 HTTP/1.1" 200 None
2026-03-25 18:34:19 [ayvens.es] INFO: Saving data for 1983299: {'created_time': 1774463659.961915, 'last_price_update_time': 1774463659.961926, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983299') HTTP/1.1" 204 0
2026-03-25 18:34:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c886edea-7978-5147-afdd-903f52e461a4 with identifier: 1983301
2026-03-25 18:34:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c886edea-7978-5147-afdd-903f52e461a4 with identifier: 1983301
2026-03-25 18:34:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c886edea-7978-5147-afdd-903f52e461a4 with identifier: 1983301 to the API
2026-03-25 18:34:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/685/866cb5dffe8b4b0cbcb6ab770c7af81e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 230,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.3L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c886edea-7978-5147-afdd-903f52e461a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MASTER',
 'odometer': 98339,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c886edea-7978-5147-afdd-903f52e461a4/c886edea-7978-5147-afdd-903f52e461a4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 319330,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/685/866cb5dffe8b4b0cbcb6ab770c7af81e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-14',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT MASTER Furgon T L2H2 3500 B dCi E 110kW (150CV)',
 'transmission': 'manual',
 'trim': 'Furgon T L2H2 3500 B dCi E 110kW (150CV)',
 'vin': None,
 'year': 2020}
2026-03-25 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983301%27 HTTP/1.1" 200 None
2026-03-25 18:34:20 [ayvens.es] INFO: Saving data for 1983301: {'created_time': 1774463660.268878, 'last_price_update_time': 1774463660.268889, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983301') HTTP/1.1" 204 0
2026-03-25 18:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/381/35ec2cf81ad846fcaaf10c3346f35db5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:20 [ayvens.es] INFO: Found listing with ID: 1983310
2026-03-25 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983310%27 HTTP/1.1" 200 None
2026-03-25 18:34:20 [ayvens.es] INFO: Scrape type for 1983310: 1
2026-03-25 18:34:20 [ayvens.es] INFO: Extracting data for car ID: 1983310
2026-03-25 18:34:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c60d103d-49fc-5eff-b9f0-8a32a4968810 with identifier: 1983310
2026-03-25 18:34:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c60d103d-49fc-5eff-b9f0-8a32a4968810 with scrape type 1
2026-03-25 18:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c60d103d-49fc-5eff-b9f0-8a32a4968810
2026-03-25 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F463%252F80c2aecfe1954646aea0d4853e7955c7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/463/80c2aecfe1954646aea0d4853e7955c7/images/large/1.jpg not downloaded yet
2026-03-25 18:34:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae90b3ce90>
2026-03-25 18:34:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0f44f11-66e4-5079-a78d-841a7bf587d1/f0f44f11-66e4-5079-a78d-841a7bf587d1_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F405%252F4783dc1eec414513b345868b9eb31ea3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/405/4783dc1eec414513b345868b9eb31ea3/images/large/1.jpg saved to cache
2026-03-25 18:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f0f44f11-66e4-5079-a78d-841a7bf587d1
2026-03-25 18:34:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f0f44f11-66e4-5079-a78d-841a7bf587d1, skipping ID generation
2026-03-25 18:34:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0f44f11-66e4-5079-a78d-841a7bf587d1 with scrape type 1
2026-03-25 18:34:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f0f44f11-66e4-5079-a78d-841a7bf587d1 sending to next pipeline
2026-03-25 18:34:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f0f44f11-66e4-5079-a78d-841a7bf587d1, identifier: 1983302
2026-03-25 18:34:20 [ayvens.es] INFO: Found listing with ID: 1983311
2026-03-25 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983311%27 HTTP/1.1" 200 None
2026-03-25 18:34:20 [ayvens.es] INFO: Scrape type for 1983311: 1
2026-03-25 18:34:20 [ayvens.es] INFO: Extracting data for car ID: 1983311
2026-03-25 18:34:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de9e8777-f999-5aeb-b707-da654c85dc04 with identifier: 1983311
2026-03-25 18:34:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de9e8777-f999-5aeb-b707-da654c85dc04 with scrape type 1
2026-03-25 18:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item de9e8777-f999-5aeb-b707-da654c85dc04
2026-03-25 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F143%252Feaff1cf38fc84f7e945365016cd4f2f8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/143/eaff1cf38fc84f7e945365016cd4f2f8/images/large/1.jpg not downloaded yet
2026-03-25 18:34:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f0f44f11-66e4-5079-a78d-841a7bf587d1 with identifier: 1983302
2026-03-25 18:34:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f0f44f11-66e4-5079-a78d-841a7bf587d1 with identifier: 1983302
2026-03-25 18:34:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f0f44f11-66e4-5079-a78d-841a7bf587d1 with identifier: 1983302 to the API
2026-03-25 18:34:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/405/4783dc1eec414513b345868b9eb31ea3/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f0f44f11-66e4-5079-a78d-841a7bf587d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 57904,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0f44f11-66e4-5079-a78d-841a7bf587d1/f0f44f11-66e4-5079-a78d-841a7bf587d1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344899,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/405/4783dc1eec414513b345868b9eb31ea3/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 Active Pack BlueHDI 81kW (110CV)',
 'transmission': 'manual',
 'trim': 'Active Pack BlueHDI 81kW (110CV)',
 'vin': None,
 'year': 2021}
2026-03-25 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983302%27 HTTP/1.1" 200 None
2026-03-25 18:34:20 [ayvens.es] INFO: Saving data for 1983302: {'created_time': 1774463660.799508, 'last_price_update_time': 1774463660.799519, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983302') HTTP/1.1" 204 0
2026-03-25 18:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/565/8175cfdef1f54333bc14ee8bc601c755/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:20 [ayvens.es] INFO: Found listing with ID: 1983312
2026-03-25 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983312%27 HTTP/1.1" 200 None
2026-03-25 18:34:20 [ayvens.es] INFO: Scrape type for 1983312: 1
2026-03-25 18:34:20 [ayvens.es] INFO: Extracting data for car ID: 1983312
2026-03-25 18:34:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e13b18a-3b28-5586-a231-32743ab97511 with identifier: 1983312
2026-03-25 18:34:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e13b18a-3b28-5586-a231-32743ab97511 with scrape type 1
2026-03-25 18:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8e13b18a-3b28-5586-a231-32743ab97511
2026-03-25 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F357%252Ffd9a56b67ab54517b91c7d0ce35ccba6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/357/fd9a56b67ab54517b91c7d0ce35ccba6/images/large/1.jpg not downloaded yet
2026-03-25 18:34:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ea32a10>
2026-03-25 18:34:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_582ff400-364d-5655-815d-2900c71a2a5d/582ff400-364d-5655-815d-2900c71a2a5d_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F381%252F35ec2cf81ad846fcaaf10c3346f35db5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/381/35ec2cf81ad846fcaaf10c3346f35db5/images/large/1.jpg saved to cache
2026-03-25 18:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 582ff400-364d-5655-815d-2900c71a2a5d
2026-03-25 18:34:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 582ff400-364d-5655-815d-2900c71a2a5d, skipping ID generation
2026-03-25 18:34:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 582ff400-364d-5655-815d-2900c71a2a5d with scrape type 1
2026-03-25 18:34:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 582ff400-364d-5655-815d-2900c71a2a5d sending to next pipeline
2026-03-25 18:34:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 582ff400-364d-5655-815d-2900c71a2a5d, identifier: 1983303
2026-03-25 18:34:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/142/271005b4a01941819894eb032319762b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 582ff400-364d-5655-815d-2900c71a2a5d with identifier: 1983303
2026-03-25 18:34:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 582ff400-364d-5655-815d-2900c71a2a5d with identifier: 1983303
2026-03-25 18:34:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 582ff400-364d-5655-815d-2900c71a2a5d with identifier: 1983303 to the API
2026-03-25 18:34:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/381/35ec2cf81ad846fcaaf10c3346f35db5/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 165,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '582ff400-364d-5655-815d-2900c71a2a5d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'VIVARO',
 'odometer': 32078,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_582ff400-364d-5655-815d-2900c71a2a5d/582ff400-364d-5655-815d-2900c71a2a5d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 477370,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/381/35ec2cf81ad846fcaaf10c3346f35db5/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-07',
 'seats_number': 9,
 'seller_name': None,
 'title': 'OPEL VIVARO 1.5 Diesel 88kW (120CV) M Std Express',
 'transmission': 'manual',
 'trim': '1.5 Diesel 88kW (120CV) M Std Express',
 'vin': None,
 'year': 2021}
2026-03-25 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983303%27 HTTP/1.1" 200 None
2026-03-25 18:34:21 [ayvens.es] INFO: Saving data for 1983303: {'created_time': 1774463661.346966, 'last_price_update_time': 1774463661.346978, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983303') HTTP/1.1" 204 0
2026-03-25 18:34:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/793/8ea7ca46c0d94bbebfd8dede683b9e92/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:21 [ayvens.es] INFO: Found listing with ID: 1983313
2026-03-25 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983313%27 HTTP/1.1" 200 None
2026-03-25 18:34:21 [ayvens.es] INFO: Scrape type for 1983313: 1
2026-03-25 18:34:21 [ayvens.es] INFO: Extracting data for car ID: 1983313
2026-03-25 18:34:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5664218e-3dc0-56c9-91b6-ec8566feff53 with identifier: 1983313
2026-03-25 18:34:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5664218e-3dc0-56c9-91b6-ec8566feff53 with scrape type 1
2026-03-25 18:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5664218e-3dc0-56c9-91b6-ec8566feff53
2026-03-25 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F256%252Fdc4aaf36acd4494c8563c6b597886c72%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/256/dc4aaf36acd4494c8563c6b597886c72/images/large/1.jpg not downloaded yet
2026-03-25 18:34:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ec45ad0>
2026-03-25 18:34:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52188a04-d8f3-5400-8eab-54b7aa3b8492/52188a04-d8f3-5400-8eab-54b7aa3b8492_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F565%252F8175cfdef1f54333bc14ee8bc601c755%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/565/8175cfdef1f54333bc14ee8bc601c755/images/large/1.jpg saved to cache
2026-03-25 18:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 52188a04-d8f3-5400-8eab-54b7aa3b8492
2026-03-25 18:34:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 52188a04-d8f3-5400-8eab-54b7aa3b8492, skipping ID generation
2026-03-25 18:34:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52188a04-d8f3-5400-8eab-54b7aa3b8492 with scrape type 1
2026-03-25 18:34:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 52188a04-d8f3-5400-8eab-54b7aa3b8492 sending to next pipeline
2026-03-25 18:34:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 52188a04-d8f3-5400-8eab-54b7aa3b8492, identifier: 1983304
2026-03-25 18:34:21 [ayvens.es] INFO: Found listing with ID: 1983314
2026-03-25 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983314%27 HTTP/1.1" 200 None
2026-03-25 18:34:21 [ayvens.es] INFO: Scrape type for 1983314: 1
2026-03-25 18:34:21 [ayvens.es] INFO: Extracting data for car ID: 1983314
2026-03-25 18:34:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9e3101d-8740-5a5e-915c-19446c936c20 with identifier: 1983314
2026-03-25 18:34:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9e3101d-8740-5a5e-915c-19446c936c20 with scrape type 1
2026-03-25 18:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f9e3101d-8740-5a5e-915c-19446c936c20
2026-03-25 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F616%252F7146e3136ab2408ab21450c354c3136b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/616/7146e3136ab2408ab21450c354c3136b/images/large/1.jpg not downloaded yet
2026-03-25 18:34:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 52188a04-d8f3-5400-8eab-54b7aa3b8492 with identifier: 1983304
2026-03-25 18:34:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:34:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 52188a04-d8f3-5400-8eab-54b7aa3b8492 with identifier: 1983304
2026-03-25 18:34:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 52188a04-d8f3-5400-8eab-54b7aa3b8492 with identifier: 1983304 to the API
2026-03-25 18:34:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/565/8175cfdef1f54333bc14ee8bc601c755/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'Silicon silver premi',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '52188a04-d8f3-5400-8eab-54b7aa3b8492',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'JAGUAR',
 'model': 'XF',
 'odometer': 98826,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52188a04-d8f3-5400-8eab-54b7aa3b8492/52188a04-d8f3-5400-8eab-54b7aa3b8492_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643166,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/565/8175cfdef1f54333bc14ee8bc601c755/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'JAGUAR XF 2.0D I4 132kW (180CV) Prestige Auto',
 'transmission': 'manual',
 'trim': '2.0D I4 132kW (180CV) Prestige Auto',
 'vin': None,
 'year': 2020}
2026-03-25 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983304%27 HTTP/1.1" 200 None
2026-03-25 18:34:21 [ayvens.es] INFO: Saving data for 1983304: {'created_time': 1774463661.993062, 'last_price_update_time': 1774463661.993071, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983304') HTTP/1.1" 204 0
2026-03-25 18:34:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ed01210>
2026-03-25 18:34:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3afd809-0b3a-59e2-8c9d-b6843022bb13/c3afd809-0b3a-59e2-8c9d-b6843022bb13_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F142%252F271005b4a01941819894eb032319762b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/142/271005b4a01941819894eb032319762b/images/large/1.jpg saved to cache
2026-03-25 18:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c3afd809-0b3a-59e2-8c9d-b6843022bb13
2026-03-25 18:34:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c3afd809-0b3a-59e2-8c9d-b6843022bb13, skipping ID generation
2026-03-25 18:34:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3afd809-0b3a-59e2-8c9d-b6843022bb13 with scrape type 1
2026-03-25 18:34:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c3afd809-0b3a-59e2-8c9d-b6843022bb13 sending to next pipeline
2026-03-25 18:34:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c3afd809-0b3a-59e2-8c9d-b6843022bb13, identifier: 1983305
2026-03-25 18:34:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/353/cb88d04013b24d96a3b90d83490d0fb9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:22 [ayvens.es] INFO: Found listing with ID: 1983315
2026-03-25 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983315%27 HTTP/1.1" 200 None
2026-03-25 18:34:22 [ayvens.es] INFO: Scrape type for 1983315: 1
2026-03-25 18:34:22 [ayvens.es] INFO: Extracting data for car ID: 1983315
2026-03-25 18:34:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49b96472-e2b1-547b-ab12-0f619693a258 with identifier: 1983315
2026-03-25 18:34:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49b96472-e2b1-547b-ab12-0f619693a258 with scrape type 1
2026-03-25 18:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 49b96472-e2b1-547b-ab12-0f619693a258
2026-03-25 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F106%252F716f2a526a3d45478e4e0de7cc50001a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/106/716f2a526a3d45478e4e0de7cc50001a/images/large/1.jpg not downloaded yet
2026-03-25 18:34:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c3afd809-0b3a-59e2-8c9d-b6843022bb13 with identifier: 1983305
2026-03-25 18:34:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:34:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c3afd809-0b3a-59e2-8c9d-b6843022bb13 with identifier: 1983305
2026-03-25 18:34:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c3afd809-0b3a-59e2-8c9d-b6843022bb13 with identifier: 1983305 to the API
2026-03-25 18:34:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/142/271005b4a01941819894eb032319762b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'Blanco artic',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c3afd809-0b3a-59e2-8c9d-b6843022bb13',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'PROACE CITY',
 'odometer': 42359,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3afd809-0b3a-59e2-8c9d-b6843022bb13/c3afd809-0b3a-59e2-8c9d-b6843022bb13_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 454082,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/142/271005b4a01941819894eb032319762b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-08',
 'seats_number': 2,
 'seller_name': None,
 'title': 'TOYOTA PROACE CITY 1.5D 75kW (100CV) GX 650kg Media',
 'transmission': 'manual',
 'trim': '1.5D 75kW (100CV) GX 650kg Media',
 'vin': None,
 'year': 2022}
2026-03-25 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983305%27 HTTP/1.1" 200 None
2026-03-25 18:34:22 [ayvens.es] INFO: Saving data for 1983305: {'created_time': 1774463662.559331, 'last_price_update_time': 1774463662.559341, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983305') HTTP/1.1" 204 0
2026-03-25 18:34:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/491/7f29efcd7e064bcda4114a6c303263cc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/766/5b5992b2fb934191bb8a780392b487c4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e554ad0>
2026-03-25 18:34:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad1bd37e-78ab-5aec-a03a-6008ed125947/ad1bd37e-78ab-5aec-a03a-6008ed125947_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F793%252F8ea7ca46c0d94bbebfd8dede683b9e92%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/793/8ea7ca46c0d94bbebfd8dede683b9e92/images/large/1.jpg saved to cache
2026-03-25 18:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ad1bd37e-78ab-5aec-a03a-6008ed125947
2026-03-25 18:34:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ad1bd37e-78ab-5aec-a03a-6008ed125947, skipping ID generation
2026-03-25 18:34:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad1bd37e-78ab-5aec-a03a-6008ed125947 with scrape type 1
2026-03-25 18:34:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ad1bd37e-78ab-5aec-a03a-6008ed125947 sending to next pipeline
2026-03-25 18:34:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ad1bd37e-78ab-5aec-a03a-6008ed125947, identifier: 1983306
2026-03-25 18:34:22 [ayvens.es] INFO: Found listing with ID: 1983316
2026-03-25 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983316%27 HTTP/1.1" 200 None
2026-03-25 18:34:22 [ayvens.es] INFO: Scrape type for 1983316: 1
2026-03-25 18:34:22 [ayvens.es] INFO: Extracting data for car ID: 1983316
2026-03-25 18:34:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1dad53d7-35fd-5e3d-82fe-c754cab59d67 with identifier: 1983316
2026-03-25 18:34:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1dad53d7-35fd-5e3d-82fe-c754cab59d67 with scrape type 1
2026-03-25 18:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1dad53d7-35fd-5e3d-82fe-c754cab59d67
2026-03-25 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F901%252F96f52bcc9afa4eccb5dc0c85c7c1fc52%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/901/96f52bcc9afa4eccb5dc0c85c7c1fc52/images/large/1.jpg not downloaded yet
2026-03-25 18:34:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ad1bd37e-78ab-5aec-a03a-6008ed125947 with identifier: 1983306
2026-03-25 18:34:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ad1bd37e-78ab-5aec-a03a-6008ed125947 with identifier: 1983306
2026-03-25 18:34:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ad1bd37e-78ab-5aec-a03a-6008ed125947 with identifier: 1983306 to the API
2026-03-25 18:34:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/793/8ea7ca46c0d94bbebfd8dede683b9e92/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ad1bd37e-78ab-5aec-a03a-6008ed125947',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'COMBO',
 'odometer': 103771,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad1bd37e-78ab-5aec-a03a-6008ed125947/ad1bd37e-78ab-5aec-a03a-6008ed125947_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 465602,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/793/8ea7ca46c0d94bbebfd8dede683b9e92/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-29',
 'seats_number': 2,
 'seller_name': None,
 'title': 'OPEL COMBO 1.5 TD S/S 75kW (100CV) Express L H1 650',
 'transmission': 'manual',
 'trim': '1.5 TD S/S 75kW (100CV) Express L H1 650',
 'vin': None,
 'year': 2020}
2026-03-25 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983306%27 HTTP/1.1" 200 None
2026-03-25 18:34:23 [ayvens.es] INFO: Saving data for 1983306: {'created_time': 1774463663.08603, 'last_price_update_time': 1774463663.086047, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983306') HTTP/1.1" 204 0
2026-03-25 18:34:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ed71b90>
2026-03-25 18:34:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6d1f119-fbfd-5b25-ae53-f8d5e16ad2e9/d6d1f119-fbfd-5b25-ae53-f8d5e16ad2e9_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F353%252Fcb88d04013b24d96a3b90d83490d0fb9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/353/cb88d04013b24d96a3b90d83490d0fb9/images/large/1.jpg saved to cache
2026-03-25 18:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d6d1f119-fbfd-5b25-ae53-f8d5e16ad2e9
2026-03-25 18:34:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d6d1f119-fbfd-5b25-ae53-f8d5e16ad2e9, skipping ID generation
2026-03-25 18:34:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6d1f119-fbfd-5b25-ae53-f8d5e16ad2e9 with scrape type 1
2026-03-25 18:34:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d6d1f119-fbfd-5b25-ae53-f8d5e16ad2e9 sending to next pipeline
2026-03-25 18:34:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d6d1f119-fbfd-5b25-ae53-f8d5e16ad2e9, identifier: 1983307
2026-03-25 18:34:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/463/80c2aecfe1954646aea0d4853e7955c7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:23 [ayvens.es] INFO: Found listing with ID: 1983317
2026-03-25 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983317%27 HTTP/1.1" 200 None
2026-03-25 18:34:23 [ayvens.es] INFO: Scrape type for 1983317: 1
2026-03-25 18:34:23 [ayvens.es] INFO: Extracting data for car ID: 1983317
2026-03-25 18:34:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ea8abb0-c903-5900-89b4-0efc5b16ddbc with identifier: 1983317
2026-03-25 18:34:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ea8abb0-c903-5900-89b4-0efc5b16ddbc with scrape type 1
2026-03-25 18:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3ea8abb0-c903-5900-89b4-0efc5b16ddbc
2026-03-25 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F108%252F4127712ed37a4b06a197da6a1be8c4fa%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/108/4127712ed37a4b06a197da6a1be8c4fa/images/large/1.jpg not downloaded yet
2026-03-25 18:34:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d6d1f119-fbfd-5b25-ae53-f8d5e16ad2e9 with identifier: 1983307
2026-03-25 18:34:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d6d1f119-fbfd-5b25-ae53-f8d5e16ad2e9 with identifier: 1983307
2026-03-25 18:34:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d6d1f119-fbfd-5b25-ae53-f8d5e16ad2e9 with identifier: 1983307 to the API
2026-03-25 18:34:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/353/cb88d04013b24d96a3b90d83490d0fb9/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 219,
 'color': 'Blanco s',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd6d1f119-fbfd-5b25-ae53-f8d5e16ad2e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT',
 'odometer': 129278,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6d1f119-fbfd-5b25-ae53-f8d5e16ad2e9/d6d1f119-fbfd-5b25-ae53-f8d5e16ad2e9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 497530,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/353/cb88d04013b24d96a3b90d83490d0fb9/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-28',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 350 96kW L3H2 Van Trend FWD',
 'transmission': 'manual',
 'trim': '350 96kW L3H2 Van Trend FWD',
 'vin': None,
 'year': 2023}
2026-03-25 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983307%27 HTTP/1.1" 200 None
2026-03-25 18:34:23 [ayvens.es] INFO: Saving data for 1983307: {'created_time': 1774463663.676056, 'last_price_update_time': 1774463663.676068, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983307') HTTP/1.1" 204 0
2026-03-25 18:34:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ed29c90>
2026-03-25 18:34:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_977023ea-1da6-5abc-86cb-e6c42e762e20/977023ea-1da6-5abc-86cb-e6c42e762e20_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F491%252F7f29efcd7e064bcda4114a6c303263cc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/491/7f29efcd7e064bcda4114a6c303263cc/images/large/1.jpg saved to cache
2026-03-25 18:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 977023ea-1da6-5abc-86cb-e6c42e762e20
2026-03-25 18:34:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 977023ea-1da6-5abc-86cb-e6c42e762e20, skipping ID generation
2026-03-25 18:34:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 977023ea-1da6-5abc-86cb-e6c42e762e20 with scrape type 1
2026-03-25 18:34:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 977023ea-1da6-5abc-86cb-e6c42e762e20 sending to next pipeline
2026-03-25 18:34:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 977023ea-1da6-5abc-86cb-e6c42e762e20, identifier: 1983308
2026-03-25 18:34:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ef2ab10>
2026-03-25 18:34:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b185c614-bf5d-5c4f-9917-f5cf3e6a9b67/b185c614-bf5d-5c4f-9917-f5cf3e6a9b67_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F766%252F5b5992b2fb934191bb8a780392b487c4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/766/5b5992b2fb934191bb8a780392b487c4/images/large/1.jpg saved to cache
2026-03-25 18:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b185c614-bf5d-5c4f-9917-f5cf3e6a9b67
2026-03-25 18:34:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b185c614-bf5d-5c4f-9917-f5cf3e6a9b67, skipping ID generation
2026-03-25 18:34:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b185c614-bf5d-5c4f-9917-f5cf3e6a9b67 with scrape type 1
2026-03-25 18:34:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b185c614-bf5d-5c4f-9917-f5cf3e6a9b67 sending to next pipeline
2026-03-25 18:34:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b185c614-bf5d-5c4f-9917-f5cf3e6a9b67, identifier: 1983309
2026-03-25 18:34:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 977023ea-1da6-5abc-86cb-e6c42e762e20 with identifier: 1983308
2026-03-25 18:34:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 977023ea-1da6-5abc-86cb-e6c42e762e20 with identifier: 1983308
2026-03-25 18:34:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 977023ea-1da6-5abc-86cb-e6c42e762e20 with identifier: 1983308 to the API
2026-03-25 18:34:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/491/7f29efcd7e064bcda4114a6c303263cc/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'color': 'Rojo',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '977023ea-1da6-5abc-86cb-e6c42e762e20',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'PROACE CITY VERSO',
 'odometer': 116928,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_977023ea-1da6-5abc-86cb-e6c42e762e20/977023ea-1da6-5abc-86cb-e6c42e762e20_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 531312,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/491/7f29efcd7e064bcda4114a6c303263cc/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA PROACE CITY VERSO 1.5D 96kW (130CV) Combi GX Plus L1',
 'transmission': 'manual',
 'trim': '1.5D 96kW (130CV) Combi GX Plus L1',
 'vin': None,
 'year': 2023}
2026-03-25 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983308%27 HTTP/1.1" 200 None
2026-03-25 18:34:24 [ayvens.es] INFO: Saving data for 1983308: {'created_time': 1774463664.233351, 'last_price_update_time': 1774463664.233365, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983308') HTTP/1.1" 204 0
2026-03-25 18:34:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b185c614-bf5d-5c4f-9917-f5cf3e6a9b67 with identifier: 1983309
2026-03-25 18:34:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b185c614-bf5d-5c4f-9917-f5cf3e6a9b67 with identifier: 1983309
2026-03-25 18:34:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b185c614-bf5d-5c4f-9917-f5cf3e6a9b67 with identifier: 1983309 to the API
2026-03-25 18:34:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/766/5b5992b2fb934191bb8a780392b487c4/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'Blanco puro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b185c614-bf5d-5c4f-9917-f5cf3e6a9b67',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF',
 'odometer': 230253,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b185c614-bf5d-5c4f-9917-f5cf3e6a9b67/b185c614-bf5d-5c4f-9917-f5cf3e6a9b67_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 349938,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/766/5b5992b2fb934191bb8a780392b487c4/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF Last Edition 1.6 TDI 85kW (115CV)',
 'transmission': 'manual',
 'trim': 'Last Edition 1.6 TDI 85kW (115CV)',
 'vin': None,
 'year': 2020}
2026-03-25 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983309%27 HTTP/1.1" 200 None
2026-03-25 18:34:24 [ayvens.es] INFO: Saving data for 1983309: {'created_time': 1774463664.520583, 'last_price_update_time': 1774463664.520594, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983309') HTTP/1.1" 204 0
2026-03-25 18:34:24 [ayvens.es] INFO: Found listing with ID: 1983318
2026-03-25 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983318%27 HTTP/1.1" 200 None
2026-03-25 18:34:24 [ayvens.es] INFO: Scrape type for 1983318: 1
2026-03-25 18:34:24 [ayvens.es] INFO: Extracting data for car ID: 1983318
2026-03-25 18:34:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d2f06c6-2d97-5c0f-aaf1-1fcbe6c13fe8 with identifier: 1983318
2026-03-25 18:34:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d2f06c6-2d97-5c0f-aaf1-1fcbe6c13fe8 with scrape type 1
2026-03-25 18:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3d2f06c6-2d97-5c0f-aaf1-1fcbe6c13fe8
2026-03-25 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F789%252F3d9c3fd7baee44b8b76ed50599f8ad6d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/789/3d9c3fd7baee44b8b76ed50599f8ad6d/images/large/1.jpg not downloaded yet
2026-03-25 18:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/143/eaff1cf38fc84f7e945365016cd4f2f8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/256/dc4aaf36acd4494c8563c6b597886c72/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8d40e990>
2026-03-25 18:34:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c60d103d-49fc-5eff-b9f0-8a32a4968810/c60d103d-49fc-5eff-b9f0-8a32a4968810_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F463%252F80c2aecfe1954646aea0d4853e7955c7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/463/80c2aecfe1954646aea0d4853e7955c7/images/large/1.jpg saved to cache
2026-03-25 18:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c60d103d-49fc-5eff-b9f0-8a32a4968810
2026-03-25 18:34:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c60d103d-49fc-5eff-b9f0-8a32a4968810, skipping ID generation
2026-03-25 18:34:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c60d103d-49fc-5eff-b9f0-8a32a4968810 with scrape type 1
2026-03-25 18:34:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c60d103d-49fc-5eff-b9f0-8a32a4968810 sending to next pipeline
2026-03-25 18:34:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c60d103d-49fc-5eff-b9f0-8a32a4968810, identifier: 1983310
2026-03-25 18:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/357/fd9a56b67ab54517b91c7d0ce35ccba6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:24 [ayvens.es] INFO: Found listing with ID: 1983319
2026-03-25 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983319%27 HTTP/1.1" 200 None
2026-03-25 18:34:24 [ayvens.es] INFO: Scrape type for 1983319: 1
2026-03-25 18:34:24 [ayvens.es] INFO: Extracting data for car ID: 1983319
2026-03-25 18:34:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d93e0f19-d8db-52ce-a378-2dbab0d12488 with identifier: 1983319
2026-03-25 18:34:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d93e0f19-d8db-52ce-a378-2dbab0d12488 with scrape type 1
2026-03-25 18:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d93e0f19-d8db-52ce-a378-2dbab0d12488
2026-03-25 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F911%252F2dd85567f5114d29bc1f6591ddf5a222%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/911/2dd85567f5114d29bc1f6591ddf5a222/images/large/1.jpg not downloaded yet
2026-03-25 18:34:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c60d103d-49fc-5eff-b9f0-8a32a4968810 with identifier: 1983310
2026-03-25 18:34:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:34:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c60d103d-49fc-5eff-b9f0-8a32a4968810 with identifier: 1983310
2026-03-25 18:34:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c60d103d-49fc-5eff-b9f0-8a32a4968810 with identifier: 1983310 to the API
2026-03-25 18:34:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/463/80c2aecfe1954646aea0d4853e7955c7/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'British green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'c60d103d-49fc-5eff-b9f0-8a32a4968810',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'COUNTRYMAN',
 'odometer': 61437,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c60d103d-49fc-5eff-b9f0-8a32a4968810/c60d103d-49fc-5eff-b9f0-8a32a4968810_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 548701,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/463/80c2aecfe1954646aea0d4853e7955c7/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI COUNTRYMAN Cooper',
 'transmission': 'manual',
 'trim': 'Cooper',
 'vin': None,
 'year': 2022}
2026-03-25 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983310%27 HTTP/1.1" 200 None
2026-03-25 18:34:25 [ayvens.es] INFO: Saving data for 1983310: {'created_time': 1774463665.151381, 'last_price_update_time': 1774463665.151393, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983310') HTTP/1.1" 204 0
2026-03-25 18:34:25 [ayvens.es] INFO: Found listing with ID: 1983320
2026-03-25 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983320%27 HTTP/1.1" 200 None
2026-03-25 18:34:25 [ayvens.es] INFO: Scrape type for 1983320: 1
2026-03-25 18:34:25 [ayvens.es] INFO: Extracting data for car ID: 1983320
2026-03-25 18:34:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f900d456-c116-5f99-a8ee-1bc7759b9265 with identifier: 1983320
2026-03-25 18:34:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f900d456-c116-5f99-a8ee-1bc7759b9265 with scrape type 1
2026-03-25 18:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f900d456-c116-5f99-a8ee-1bc7759b9265
2026-03-25 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F692%252F125582d156714850a45bb9a03d75e665%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/692/125582d156714850a45bb9a03d75e665/images/large/1.jpg not downloaded yet
2026-03-25 18:34:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/106/716f2a526a3d45478e4e0de7cc50001a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e59dc50>
2026-03-25 18:34:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de9e8777-f999-5aeb-b707-da654c85dc04/de9e8777-f999-5aeb-b707-da654c85dc04_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F143%252Feaff1cf38fc84f7e945365016cd4f2f8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/143/eaff1cf38fc84f7e945365016cd4f2f8/images/large/1.jpg saved to cache
2026-03-25 18:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item de9e8777-f999-5aeb-b707-da654c85dc04
2026-03-25 18:34:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: de9e8777-f999-5aeb-b707-da654c85dc04, skipping ID generation
2026-03-25 18:34:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de9e8777-f999-5aeb-b707-da654c85dc04 with scrape type 1
2026-03-25 18:34:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item de9e8777-f999-5aeb-b707-da654c85dc04 sending to next pipeline
2026-03-25 18:34:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: de9e8777-f999-5aeb-b707-da654c85dc04, identifier: 1983311
2026-03-25 18:34:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8eaa39d0>
2026-03-25 18:34:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5664218e-3dc0-56c9-91b6-ec8566feff53/5664218e-3dc0-56c9-91b6-ec8566feff53_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F256%252Fdc4aaf36acd4494c8563c6b597886c72%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/256/dc4aaf36acd4494c8563c6b597886c72/images/large/1.jpg saved to cache
2026-03-25 18:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5664218e-3dc0-56c9-91b6-ec8566feff53
2026-03-25 18:34:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5664218e-3dc0-56c9-91b6-ec8566feff53, skipping ID generation
2026-03-25 18:34:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5664218e-3dc0-56c9-91b6-ec8566feff53 with scrape type 1
2026-03-25 18:34:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5664218e-3dc0-56c9-91b6-ec8566feff53 sending to next pipeline
2026-03-25 18:34:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5664218e-3dc0-56c9-91b6-ec8566feff53, identifier: 1983313
2026-03-25 18:34:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ee3cbd0>
2026-03-25 18:34:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e13b18a-3b28-5586-a231-32743ab97511/8e13b18a-3b28-5586-a231-32743ab97511_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F357%252Ffd9a56b67ab54517b91c7d0ce35ccba6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/357/fd9a56b67ab54517b91c7d0ce35ccba6/images/large/1.jpg saved to cache
2026-03-25 18:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8e13b18a-3b28-5586-a231-32743ab97511
2026-03-25 18:34:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8e13b18a-3b28-5586-a231-32743ab97511, skipping ID generation
2026-03-25 18:34:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e13b18a-3b28-5586-a231-32743ab97511 with scrape type 1
2026-03-25 18:34:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8e13b18a-3b28-5586-a231-32743ab97511 sending to next pipeline
2026-03-25 18:34:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8e13b18a-3b28-5586-a231-32743ab97511, identifier: 1983312
2026-03-25 18:34:25 [ayvens.es] INFO: Found listing with ID: 1983321
2026-03-25 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983321%27 HTTP/1.1" 200 None
2026-03-25 18:34:25 [ayvens.es] INFO: Scrape type for 1983321: 1
2026-03-25 18:34:25 [ayvens.es] INFO: Extracting data for car ID: 1983321
2026-03-25 18:34:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 392216bc-b60b-5196-bc1e-cdb83a6226b6 with identifier: 1983321
2026-03-25 18:34:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 392216bc-b60b-5196-bc1e-cdb83a6226b6 with scrape type 1
2026-03-25 18:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 392216bc-b60b-5196-bc1e-cdb83a6226b6
2026-03-25 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F757%252F382eaf0188b749e783205a0f33f5b10c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/757/382eaf0188b749e783205a0f33f5b10c/images/large/1.jpg not downloaded yet
2026-03-25 18:34:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: de9e8777-f999-5aeb-b707-da654c85dc04 with identifier: 1983311
2026-03-25 18:34:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:34:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: de9e8777-f999-5aeb-b707-da654c85dc04 with identifier: 1983311
2026-03-25 18:34:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: de9e8777-f999-5aeb-b707-da654c85dc04 with identifier: 1983311 to the API
2026-03-25 18:34:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/143/eaff1cf38fc84f7e945365016cd4f2f8/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'Gris daytona',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'de9e8777-f999-5aeb-b707-da654c85dc04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3',
 'odometer': 121821,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de9e8777-f999-5aeb-b707-da654c85dc04/de9e8777-f999-5aeb-b707-da654c85dc04_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 537892,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/143/eaff1cf38fc84f7e945365016cd4f2f8/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 Sedan S line 35 TDI 110kW (150CV)',
 'transmission': 'manual',
 'trim': 'Sedan S line 35 TDI 110kW (150CV)',
 'vin': None,
 'year': 2021}
2026-03-25 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983311%27 HTTP/1.1" 200 None
2026-03-25 18:34:26 [ayvens.es] INFO: Saving data for 1983311: {'created_time': 1774463666.104483, 'last_price_update_time': 1774463666.104498, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983311') HTTP/1.1" 204 0
2026-03-25 18:34:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5664218e-3dc0-56c9-91b6-ec8566feff53 with identifier: 1983313
2026-03-25 18:34:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:34:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5664218e-3dc0-56c9-91b6-ec8566feff53 with identifier: 1983313
2026-03-25 18:34:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5664218e-3dc0-56c9-91b6-ec8566feff53 with identifier: 1983313 to the API
2026-03-25 18:34:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/256/dc4aaf36acd4494c8563c6b597886c72/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 172,
 'color': 'Eiger grey',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '5664218e-3dc0-56c9-91b6-ec8566feff53',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'JAGUAR',
 'model': 'E-PACE',
 'odometer': 41485,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5664218e-3dc0-56c9-91b6-ec8566feff53/5664218e-3dc0-56c9-91b6-ec8566feff53_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 374779,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/256/dc4aaf36acd4494c8563c6b597886c72/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'JAGUAR E-PACE 2.0D 163PS MHEV SE 4WD Auto',
 'transmission': 'manual',
 'trim': '2.0D 163PS MHEV SE 4WD Auto',
 'vin': None,
 'year': 2022}
2026-03-25 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983313%27 HTTP/1.1" 200 None
2026-03-25 18:34:26 [ayvens.es] INFO: Saving data for 1983313: {'created_time': 1774463666.442717, 'last_price_update_time': 1774463666.442729, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983313') HTTP/1.1" 204 0
2026-03-25 18:34:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8e13b18a-3b28-5586-a231-32743ab97511 with identifier: 1983312
2026-03-25 18:34:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:34:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8e13b18a-3b28-5586-a231-32743ab97511 with identifier: 1983312
2026-03-25 18:34:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8e13b18a-3b28-5586-a231-32743ab97511 with identifier: 1983312 to the API
2026-03-25 18:34:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/357/fd9a56b67ab54517b91c7d0ce35ccba6/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 202,
 'color': 'Fujy white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '8e13b18a-3b28-5586-a231-32743ab97511',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'JAGUAR',
 'model': 'E-PACE',
 'odometer': 143575,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e13b18a-3b28-5586-a231-32743ab97511/8e13b18a-3b28-5586-a231-32743ab97511_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 480500,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/357/fd9a56b67ab54517b91c7d0ce35ccba6/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'JAGUAR E-PACE 2.0P 250PS MHEV R-Dynamic S 4WD Auto',
 'transmission': 'manual',
 'trim': '2.0P 250PS MHEV R-Dynamic S 4WD Auto',
 'vin': None,
 'year': 2022}
2026-03-25 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983312%27 HTTP/1.1" 200 None
2026-03-25 18:34:26 [ayvens.es] INFO: Saving data for 1983312: {'created_time': 1774463666.772316, 'last_price_update_time': 1774463666.772327, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983312') HTTP/1.1" 204 0
2026-03-25 18:34:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/616/7146e3136ab2408ab21450c354c3136b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:26 [ayvens.es] INFO: Found listing with ID: 1983322
2026-03-25 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983322%27 HTTP/1.1" 200 None
2026-03-25 18:34:26 [ayvens.es] INFO: Scrape type for 1983322: 1
2026-03-25 18:34:26 [ayvens.es] INFO: Extracting data for car ID: 1983322
2026-03-25 18:34:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0e500a4-ca05-58c2-a6bf-e53d03655c5f with identifier: 1983322
2026-03-25 18:34:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0e500a4-ca05-58c2-a6bf-e53d03655c5f with scrape type 1
2026-03-25 18:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c0e500a4-ca05-58c2-a6bf-e53d03655c5f
2026-03-25 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F613%252Fa3248a2e1eb34d2b83f78402b2c74efc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/613/a3248a2e1eb34d2b83f78402b2c74efc/images/large/1.jpg not downloaded yet
2026-03-25 18:34:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8f253910>
2026-03-25 18:34:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49b96472-e2b1-547b-ab12-0f619693a258/49b96472-e2b1-547b-ab12-0f619693a258_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F106%252F716f2a526a3d45478e4e0de7cc50001a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/106/716f2a526a3d45478e4e0de7cc50001a/images/large/1.jpg saved to cache
2026-03-25 18:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 49b96472-e2b1-547b-ab12-0f619693a258
2026-03-25 18:34:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 49b96472-e2b1-547b-ab12-0f619693a258, skipping ID generation
2026-03-25 18:34:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49b96472-e2b1-547b-ab12-0f619693a258 with scrape type 1
2026-03-25 18:34:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 49b96472-e2b1-547b-ab12-0f619693a258 sending to next pipeline
2026-03-25 18:34:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 49b96472-e2b1-547b-ab12-0f619693a258, identifier: 1983315
2026-03-25 18:34:27 [ayvens.es] INFO: Found listing with ID: 1983323
2026-03-25 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983323%27 HTTP/1.1" 200 None
2026-03-25 18:34:27 [ayvens.es] INFO: Scrape type for 1983323: 1
2026-03-25 18:34:27 [ayvens.es] INFO: Extracting data for car ID: 1983323
2026-03-25 18:34:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92d14cfe-c682-5eb9-b393-ac34774fffe6 with identifier: 1983323
2026-03-25 18:34:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92d14cfe-c682-5eb9-b393-ac34774fffe6 with scrape type 1
2026-03-25 18:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 92d14cfe-c682-5eb9-b393-ac34774fffe6
2026-03-25 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F869%252F4f9990536a324b7b9ba9ee21e5b5629d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/869/4f9990536a324b7b9ba9ee21e5b5629d/images/large/1.jpg not downloaded yet
2026-03-25 18:34:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 49b96472-e2b1-547b-ab12-0f619693a258 with identifier: 1983315
2026-03-25 18:34:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 49b96472-e2b1-547b-ab12-0f619693a258 with identifier: 1983315
2026-03-25 18:34:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 49b96472-e2b1-547b-ab12-0f619693a258 with identifier: 1983315 to the API
2026-03-25 18:34:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/106/716f2a526a3d45478e4e0de7cc50001a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 163,
 'color': 'Blanco candy s',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '49b96472-e2b1-547b-ab12-0f619693a258',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CADDY',
 'odometer': 183774,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49b96472-e2b1-547b-ab12-0f619693a258/49b96472-e2b1-547b-ab12-0f619693a258_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 339893,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/106/716f2a526a3d45478e4e0de7cc50001a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-10',
 'seats_number': 2,
 'seller_name': None,
 'title': 'VOLKSWAGEN CADDY Prof Maxi Furgon 2.0 TDI 90kW BMT 4Mot',
 'transmission': 'manual',
 'trim': 'Prof Maxi Furgon 2.0 TDI 90kW BMT 4Mot',
 'vin': None,
 'year': 2020}
2026-03-25 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983315%27 HTTP/1.1" 200 None
2026-03-25 18:34:27 [ayvens.es] INFO: Saving data for 1983315: {'created_time': 1774463667.477041, 'last_price_update_time': 1774463667.477052, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983315') HTTP/1.1" 204 0
2026-03-25 18:34:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/901/96f52bcc9afa4eccb5dc0c85c7c1fc52/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/108/4127712ed37a4b06a197da6a1be8c4fa/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/789/3d9c3fd7baee44b8b76ed50599f8ad6d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:27 [ayvens.es] INFO: Found listing with ID: 1983324
2026-03-25 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983324%27 HTTP/1.1" 200 None
2026-03-25 18:34:27 [ayvens.es] INFO: Scrape type for 1983324: 1
2026-03-25 18:34:27 [ayvens.es] INFO: Extracting data for car ID: 1983324
2026-03-25 18:34:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3d43fd3-b12d-5401-9120-592e44bf005b with identifier: 1983324
2026-03-25 18:34:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3d43fd3-b12d-5401-9120-592e44bf005b with scrape type 1
2026-03-25 18:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d3d43fd3-b12d-5401-9120-592e44bf005b
2026-03-25 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F535%252F2187cd30e6694e47a8a286c151f47b0f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/535/2187cd30e6694e47a8a286c151f47b0f/images/large/1.jpg not downloaded yet
2026-03-25 18:34:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/911/2dd85567f5114d29bc1f6591ddf5a222/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae90c2da50>
2026-03-25 18:34:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9e3101d-8740-5a5e-915c-19446c936c20/f9e3101d-8740-5a5e-915c-19446c936c20_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F616%252F7146e3136ab2408ab21450c354c3136b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/616/7146e3136ab2408ab21450c354c3136b/images/large/1.jpg saved to cache
2026-03-25 18:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f9e3101d-8740-5a5e-915c-19446c936c20
2026-03-25 18:34:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f9e3101d-8740-5a5e-915c-19446c936c20, skipping ID generation
2026-03-25 18:34:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9e3101d-8740-5a5e-915c-19446c936c20 with scrape type 1
2026-03-25 18:34:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f9e3101d-8740-5a5e-915c-19446c936c20 sending to next pipeline
2026-03-25 18:34:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f9e3101d-8740-5a5e-915c-19446c936c20, identifier: 1983314
2026-03-25 18:34:27 [ayvens.es] INFO: Found listing with ID: 1983325
2026-03-25 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983325%27 HTTP/1.1" 200 None
2026-03-25 18:34:27 [ayvens.es] INFO: Scrape type for 1983325: 1
2026-03-25 18:34:27 [ayvens.es] INFO: Extracting data for car ID: 1983325
2026-03-25 18:34:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e869898-566d-5835-bddc-5c3bfc4d44be with identifier: 1983325
2026-03-25 18:34:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e869898-566d-5835-bddc-5c3bfc4d44be with scrape type 1
2026-03-25 18:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3e869898-566d-5835-bddc-5c3bfc4d44be
2026-03-25 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F682%252F88146a334dc848829edae5a4898bde2f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/682/88146a334dc848829edae5a4898bde2f/images/large/1.jpg not downloaded yet
2026-03-25 18:34:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f9e3101d-8740-5a5e-915c-19446c936c20 with identifier: 1983314
2026-03-25 18:34:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f9e3101d-8740-5a5e-915c-19446c936c20 with identifier: 1983314
2026-03-25 18:34:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f9e3101d-8740-5a5e-915c-19446c936c20 with identifier: 1983314 to the API
2026-03-25 18:34:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/616/7146e3136ab2408ab21450c354c3136b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'f9e3101d-8740-5a5e-915c-19446c936c20',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'COUNTRYMAN',
 'odometer': 100563,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9e3101d-8740-5a5e-915c-19446c936c20/f9e3101d-8740-5a5e-915c-19446c936c20_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617434,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/616/7146e3136ab2408ab21450c354c3136b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI COUNTRYMAN Cooper',
 'transmission': 'manual',
 'trim': 'Cooper',
 'vin': None,
 'year': 2021}
2026-03-25 18:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983314%27 HTTP/1.1" 200 None
2026-03-25 18:34:28 [ayvens.es] INFO: Saving data for 1983314: {'created_time': 1774463668.122825, 'last_price_update_time': 1774463668.122835, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983314') HTTP/1.1" 204 0
2026-03-25 18:34:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/692/125582d156714850a45bb9a03d75e665/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:28 [ayvens.es] INFO: Found listing with ID: 1983326
2026-03-25 18:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983326%27 HTTP/1.1" 200 None
2026-03-25 18:34:28 [ayvens.es] INFO: Scrape type for 1983326: 1
2026-03-25 18:34:28 [ayvens.es] INFO: Extracting data for car ID: 1983326
2026-03-25 18:34:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17ccb512-4720-52b4-be43-d9cf1ba1e427 with identifier: 1983326
2026-03-25 18:34:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17ccb512-4720-52b4-be43-d9cf1ba1e427 with scrape type 1
2026-03-25 18:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 17ccb512-4720-52b4-be43-d9cf1ba1e427
2026-03-25 18:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F458%252Ff622846b5bc44bf7a3db724f24eb092d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/458/f622846b5bc44bf7a3db724f24eb092d/images/large/1.jpg not downloaded yet
2026-03-25 18:34:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/757/382eaf0188b749e783205a0f33f5b10c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae90a38550>
2026-03-25 18:34:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1dad53d7-35fd-5e3d-82fe-c754cab59d67/1dad53d7-35fd-5e3d-82fe-c754cab59d67_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F901%252F96f52bcc9afa4eccb5dc0c85c7c1fc52%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/901/96f52bcc9afa4eccb5dc0c85c7c1fc52/images/large/1.jpg saved to cache
2026-03-25 18:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1dad53d7-35fd-5e3d-82fe-c754cab59d67
2026-03-25 18:34:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1dad53d7-35fd-5e3d-82fe-c754cab59d67, skipping ID generation
2026-03-25 18:34:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1dad53d7-35fd-5e3d-82fe-c754cab59d67 with scrape type 1
2026-03-25 18:34:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1dad53d7-35fd-5e3d-82fe-c754cab59d67 sending to next pipeline
2026-03-25 18:34:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1dad53d7-35fd-5e3d-82fe-c754cab59d67, identifier: 1983316
2026-03-25 18:34:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ea185d0>
2026-03-25 18:34:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ea8abb0-c903-5900-89b4-0efc5b16ddbc/3ea8abb0-c903-5900-89b4-0efc5b16ddbc_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F108%252F4127712ed37a4b06a197da6a1be8c4fa%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/108/4127712ed37a4b06a197da6a1be8c4fa/images/large/1.jpg saved to cache
2026-03-25 18:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3ea8abb0-c903-5900-89b4-0efc5b16ddbc
2026-03-25 18:34:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3ea8abb0-c903-5900-89b4-0efc5b16ddbc, skipping ID generation
2026-03-25 18:34:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ea8abb0-c903-5900-89b4-0efc5b16ddbc with scrape type 1
2026-03-25 18:34:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3ea8abb0-c903-5900-89b4-0efc5b16ddbc sending to next pipeline
2026-03-25 18:34:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3ea8abb0-c903-5900-89b4-0efc5b16ddbc, identifier: 1983317
2026-03-25 18:34:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8f252650>
2026-03-25 18:34:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d2f06c6-2d97-5c0f-aaf1-1fcbe6c13fe8/3d2f06c6-2d97-5c0f-aaf1-1fcbe6c13fe8_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F789%252F3d9c3fd7baee44b8b76ed50599f8ad6d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/789/3d9c3fd7baee44b8b76ed50599f8ad6d/images/large/1.jpg saved to cache
2026-03-25 18:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3d2f06c6-2d97-5c0f-aaf1-1fcbe6c13fe8
2026-03-25 18:34:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3d2f06c6-2d97-5c0f-aaf1-1fcbe6c13fe8, skipping ID generation
2026-03-25 18:34:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d2f06c6-2d97-5c0f-aaf1-1fcbe6c13fe8 with scrape type 1
2026-03-25 18:34:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3d2f06c6-2d97-5c0f-aaf1-1fcbe6c13fe8 sending to next pipeline
2026-03-25 18:34:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3d2f06c6-2d97-5c0f-aaf1-1fcbe6c13fe8, identifier: 1983318
2026-03-25 18:34:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ee7ba50>
2026-03-25 18:34:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d93e0f19-d8db-52ce-a378-2dbab0d12488/d93e0f19-d8db-52ce-a378-2dbab0d12488_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F911%252F2dd85567f5114d29bc1f6591ddf5a222%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/911/2dd85567f5114d29bc1f6591ddf5a222/images/large/1.jpg saved to cache
2026-03-25 18:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d93e0f19-d8db-52ce-a378-2dbab0d12488
2026-03-25 18:34:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d93e0f19-d8db-52ce-a378-2dbab0d12488, skipping ID generation
2026-03-25 18:34:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d93e0f19-d8db-52ce-a378-2dbab0d12488 with scrape type 1
2026-03-25 18:34:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d93e0f19-d8db-52ce-a378-2dbab0d12488 sending to next pipeline
2026-03-25 18:34:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d93e0f19-d8db-52ce-a378-2dbab0d12488, identifier: 1983319
2026-03-25 18:34:28 [ayvens.es] INFO: Found listing with ID: 1983327
2026-03-25 18:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983327%27 HTTP/1.1" 200 None
2026-03-25 18:34:29 [ayvens.es] INFO: Scrape type for 1983327: 1
2026-03-25 18:34:29 [ayvens.es] INFO: Extracting data for car ID: 1983327
2026-03-25 18:34:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ab0d626-9af5-5ad6-9789-cfe0d63a83b0 with identifier: 1983327
2026-03-25 18:34:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ab0d626-9af5-5ad6-9789-cfe0d63a83b0 with scrape type 1
2026-03-25 18:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4ab0d626-9af5-5ad6-9789-cfe0d63a83b0
2026-03-25 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F623%252F34951740387349f7904e4f147b28f09f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/623/34951740387349f7904e4f147b28f09f/images/large/1.jpg not downloaded yet
2026-03-25 18:34:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1dad53d7-35fd-5e3d-82fe-c754cab59d67 with identifier: 1983316
2026-03-25 18:34:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:34:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1dad53d7-35fd-5e3d-82fe-c754cab59d67 with identifier: 1983316
2026-03-25 18:34:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1dad53d7-35fd-5e3d-82fe-c754cab59d67 with identifier: 1983316 to the API
2026-03-25 18:34:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/901/96f52bcc9afa4eccb5dc0c85c7c1fc52/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'color': 'Negro profundo efect',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '1dad53d7-35fd-5e3d-82fe-c754cab59d67',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN',
 'odometer': 68278,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dad53d7-35fd-5e3d-82fe-c754cab59d67/1dad53d7-35fd-5e3d-82fe-c754cab59d67_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 592832,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/901/96f52bcc9afa4eccb5dc0c85c7c1fc52/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN R-Line 2.0 TDI 110kW (150CV) DSG',
 'transmission': 'manual',
 'trim': 'R-Line 2.0 TDI 110kW (150CV) DSG',
 'vin': None,
 'year': 2021}
2026-03-25 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983316%27 HTTP/1.1" 200 None
2026-03-25 18:34:29 [ayvens.es] INFO: Saving data for 1983316: {'created_time': 1774463669.297501, 'last_price_update_time': 1774463669.297512, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983316') HTTP/1.1" 204 0
2026-03-25 18:34:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3ea8abb0-c903-5900-89b4-0efc5b16ddbc with identifier: 1983317
2026-03-25 18:34:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3ea8abb0-c903-5900-89b4-0efc5b16ddbc with identifier: 1983317
2026-03-25 18:34:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3ea8abb0-c903-5900-89b4-0efc5b16ddbc with identifier: 1983317 to the API
2026-03-25 18:34:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/108/4127712ed37a4b06a197da6a1be8c4fa/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'Azul',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '3ea8abb0-c903-5900-89b4-0efc5b16ddbc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'IBIZA',
 'odometer': 70729,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ea8abb0-c903-5900-89b4-0efc5b16ddbc/3ea8abb0-c903-5900-89b4-0efc5b16ddbc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 561216,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/108/4127712ed37a4b06a197da6a1be8c4fa/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT IBIZA 1.0 EcoTSI 70kW (95CV) Reference Plus',
 'transmission': 'manual',
 'trim': '1.0 EcoTSI 70kW (95CV) Reference Plus',
 'vin': None,
 'year': 2019}
2026-03-25 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983317%27 HTTP/1.1" 200 None
2026-03-25 18:34:29 [ayvens.es] INFO: Saving data for 1983317: {'created_time': 1774463669.603373, 'last_price_update_time': 1774463669.603387, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983317') HTTP/1.1" 204 0
2026-03-25 18:34:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3d2f06c6-2d97-5c0f-aaf1-1fcbe6c13fe8 with identifier: 1983318
2026-03-25 18:34:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:34:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3d2f06c6-2d97-5c0f-aaf1-1fcbe6c13fe8 with identifier: 1983318
2026-03-25 18:34:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3d2f06c6-2d97-5c0f-aaf1-1fcbe6c13fe8 with identifier: 1983318 to the API
2026-03-25 18:34:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/789/3d9c3fd7baee44b8b76ed50599f8ad6d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Mineral blanco opaca',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '3d2f06c6-2d97-5c0f-aaf1-1fcbe6c13fe8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 121983,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d2f06c6-2d97-5c0f-aaf1-1fcbe6c13fe8/3d2f06c6-2d97-5c0f-aaf1-1fcbe6c13fe8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 338739,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/789/3d9c3fd7baee44b8b76ed50599f8ad6d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-30',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS (O) Profesional dCi 55 kW (75 CV)',
 'transmission': 'manual',
 'trim': '(O) Profesional dCi 55 kW (75 CV)',
 'vin': None,
 'year': 2020}
2026-03-25 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983318%27 HTTP/1.1" 200 None
2026-03-25 18:34:29 [ayvens.es] INFO: Saving data for 1983318: {'created_time': 1774463669.936198, 'last_price_update_time': 1774463669.93621, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983318') HTTP/1.1" 204 0
2026-03-25 18:34:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d93e0f19-d8db-52ce-a378-2dbab0d12488 with identifier: 1983319
2026-03-25 18:34:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d93e0f19-d8db-52ce-a378-2dbab0d12488 with identifier: 1983319
2026-03-25 18:34:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d93e0f19-d8db-52ce-a378-2dbab0d12488 with identifier: 1983319 to the API
2026-03-25 18:34:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/911/2dd85567f5114d29bc1f6591ddf5a222/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 179,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.4L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd93e0f19-d8db-52ce-a378-2dbab0d12488',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'HILUX',
 'odometer': 147505,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d93e0f19-d8db-52ce-a378-2dbab0d12488/d93e0f19-d8db-52ce-a378-2dbab0d12488_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330808,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/911/2dd85567f5114d29bc1f6591ddf5a222/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA HILUX 2.4 D-4D Cabina Doble GX',
 'transmission': 'manual',
 'trim': '2.4 D-4D Cabina Doble GX',
 'vin': None,
 'year': 2020}
2026-03-25 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983319%27 HTTP/1.1" 200 None
2026-03-25 18:34:30 [ayvens.es] INFO: Saving data for 1983319: {'created_time': 1774463670.243509, 'last_price_update_time': 1774463670.243523, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983319') HTTP/1.1" 204 0
2026-03-25 18:34:30 [ayvens.es] INFO: Found listing with ID: 1983328
2026-03-25 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983328%27 HTTP/1.1" 200 None
2026-03-25 18:34:30 [ayvens.es] INFO: Scrape type for 1983328: 1
2026-03-25 18:34:30 [ayvens.es] INFO: Extracting data for car ID: 1983328
2026-03-25 18:34:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0eea1f09-c08e-5a39-83a6-59729f41dfce with identifier: 1983328
2026-03-25 18:34:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0eea1f09-c08e-5a39-83a6-59729f41dfce with scrape type 1
2026-03-25 18:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0eea1f09-c08e-5a39-83a6-59729f41dfce
2026-03-25 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F597%252Fff80183bc47643d582d842764e4b9a38%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/597/ff80183bc47643d582d842764e4b9a38/images/large/1.jpg not downloaded yet
2026-03-25 18:34:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8efa7590>
2026-03-25 18:34:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f900d456-c116-5f99-a8ee-1bc7759b9265/f900d456-c116-5f99-a8ee-1bc7759b9265_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F692%252F125582d156714850a45bb9a03d75e665%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/692/125582d156714850a45bb9a03d75e665/images/large/1.jpg saved to cache
2026-03-25 18:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f900d456-c116-5f99-a8ee-1bc7759b9265
2026-03-25 18:34:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f900d456-c116-5f99-a8ee-1bc7759b9265, skipping ID generation
2026-03-25 18:34:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f900d456-c116-5f99-a8ee-1bc7759b9265 with scrape type 1
2026-03-25 18:34:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f900d456-c116-5f99-a8ee-1bc7759b9265 sending to next pipeline
2026-03-25 18:34:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f900d456-c116-5f99-a8ee-1bc7759b9265, identifier: 1983320
2026-03-25 18:34:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ed163d0>
2026-03-25 18:34:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_392216bc-b60b-5196-bc1e-cdb83a6226b6/392216bc-b60b-5196-bc1e-cdb83a6226b6_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F757%252F382eaf0188b749e783205a0f33f5b10c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/757/382eaf0188b749e783205a0f33f5b10c/images/large/1.jpg saved to cache
2026-03-25 18:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 392216bc-b60b-5196-bc1e-cdb83a6226b6
2026-03-25 18:34:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 392216bc-b60b-5196-bc1e-cdb83a6226b6, skipping ID generation
2026-03-25 18:34:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 392216bc-b60b-5196-bc1e-cdb83a6226b6 with scrape type 1
2026-03-25 18:34:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 392216bc-b60b-5196-bc1e-cdb83a6226b6 sending to next pipeline
2026-03-25 18:34:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 392216bc-b60b-5196-bc1e-cdb83a6226b6, identifier: 1983321
2026-03-25 18:34:30 [ayvens.es] INFO: Found listing with ID: 1983329
2026-03-25 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983329%27 HTTP/1.1" 200 None
2026-03-25 18:34:30 [ayvens.es] INFO: Scrape type for 1983329: 1
2026-03-25 18:34:30 [ayvens.es] INFO: Extracting data for car ID: 1983329
2026-03-25 18:34:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b12d1ca-d21b-505c-b88d-a924bc36cf17 with identifier: 1983329
2026-03-25 18:34:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b12d1ca-d21b-505c-b88d-a924bc36cf17 with scrape type 1
2026-03-25 18:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9b12d1ca-d21b-505c-b88d-a924bc36cf17
2026-03-25 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F648%252F4079f3de9cdf4efea4c723b47bb705fc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/648/4079f3de9cdf4efea4c723b47bb705fc/images/large/1.jpg not downloaded yet
2026-03-25 18:34:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f900d456-c116-5f99-a8ee-1bc7759b9265 with identifier: 1983320
2026-03-25 18:34:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f900d456-c116-5f99-a8ee-1bc7759b9265 with identifier: 1983320
2026-03-25 18:34:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f900d456-c116-5f99-a8ee-1bc7759b9265 with identifier: 1983320 to the API
2026-03-25 18:34:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/692/125582d156714850a45bb9a03d75e665/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'color': 'Blanco s',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.2L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f900d456-c116-5f99-a8ee-1bc7759b9265',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'FIORINO',
 'odometer': 97086,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f900d456-c116-5f99-a8ee-1bc7759b9265/f900d456-c116-5f99-a8ee-1bc7759b9265_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 337026,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/692/125582d156714850a45bb9a03d75e665/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-27',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FIAT FIORINO Cargo SX N1 1.3 MJet 59 kW (80 CV)',
 'transmission': 'manual',
 'trim': 'Cargo SX N1 1.3 MJet 59 kW (80 CV)',
 'vin': None,
 'year': 2020}
2026-03-25 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983320%27 HTTP/1.1" 200 None
2026-03-25 18:34:31 [ayvens.es] INFO: Saving data for 1983320: {'created_time': 1774463671.29727, 'last_price_update_time': 1774463671.297281, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983320') HTTP/1.1" 204 0
2026-03-25 18:34:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 392216bc-b60b-5196-bc1e-cdb83a6226b6 with identifier: 1983321
2026-03-25 18:34:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 392216bc-b60b-5196-bc1e-cdb83a6226b6 with identifier: 1983321
2026-03-25 18:34:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 392216bc-b60b-5196-bc1e-cdb83a6226b6 with identifier: 1983321 to the API
2026-03-25 18:34:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/757/382eaf0188b749e783205a0f33f5b10c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'color': 'Blanco s',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.2L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '392216bc-b60b-5196-bc1e-cdb83a6226b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'FIORINO',
 'odometer': 72185,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_392216bc-b60b-5196-bc1e-cdb83a6226b6/392216bc-b60b-5196-bc1e-cdb83a6226b6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 348874,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/757/382eaf0188b749e783205a0f33f5b10c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-27',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FIAT FIORINO Cargo SX N1 1.3 MJet 59 kW (80 CV)',
 'transmission': 'manual',
 'trim': 'Cargo SX N1 1.3 MJet 59 kW (80 CV)',
 'vin': None,
 'year': 2020}
2026-03-25 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983321%27 HTTP/1.1" 200 None
2026-03-25 18:34:31 [ayvens.es] INFO: Saving data for 1983321: {'created_time': 1774463671.620634, 'last_price_update_time': 1774463671.620644, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983321') HTTP/1.1" 204 0
2026-03-25 18:34:31 [ayvens.es] INFO: Found listing with ID: 1983330
2026-03-25 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983330%27 HTTP/1.1" 200 None
2026-03-25 18:34:31 [ayvens.es] INFO: Scrape type for 1983330: 1
2026-03-25 18:34:31 [ayvens.es] INFO: Extracting data for car ID: 1983330
2026-03-25 18:34:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a54d8eaf-eb50-57a5-bac4-67196a4c5bf2 with identifier: 1983330
2026-03-25 18:34:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a54d8eaf-eb50-57a5-bac4-67196a4c5bf2 with scrape type 1
2026-03-25 18:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a54d8eaf-eb50-57a5-bac4-67196a4c5bf2
2026-03-25 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F108%252Ff25c052cc541443db19ef827c7aee310%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/108/f25c052cc541443db19ef827c7aee310/images/large/1.jpg not downloaded yet
2026-03-25 18:34:31 [ayvens.es] INFO: Found listing with ID: 1983331
2026-03-25 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983331%27 HTTP/1.1" 200 None
2026-03-25 18:34:31 [ayvens.es] INFO: Scrape type for 1983331: 1
2026-03-25 18:34:31 [ayvens.es] INFO: Extracting data for car ID: 1983331
2026-03-25 18:34:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 561a301c-a18b-5d87-a76c-3bcd19e08bf4 with identifier: 1983331
2026-03-25 18:34:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 561a301c-a18b-5d87-a76c-3bcd19e08bf4 with scrape type 1
2026-03-25 18:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 561a301c-a18b-5d87-a76c-3bcd19e08bf4
2026-03-25 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F217%252F80701d02fd764560a43229be313481d7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/217/80701d02fd764560a43229be313481d7/images/large/1.jpg not downloaded yet
2026-03-25 18:34:31 [ayvens.es] INFO: Found listing with ID: 1983332
2026-03-25 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983332%27 HTTP/1.1" 200 None
2026-03-25 18:34:31 [ayvens.es] INFO: Scrape type for 1983332: 1
2026-03-25 18:34:31 [ayvens.es] INFO: Extracting data for car ID: 1983332
2026-03-25 18:34:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6481a1d-4cbf-5930-8bdd-b162c36ff6e3 with identifier: 1983332
2026-03-25 18:34:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6481a1d-4cbf-5930-8bdd-b162c36ff6e3 with scrape type 1
2026-03-25 18:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f6481a1d-4cbf-5930-8bdd-b162c36ff6e3
2026-03-25 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F316%252Fab67115dea144516a162e9cd4b422e43%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/316/ab67115dea144516a162e9cd4b422e43/images/large/1.jpg not downloaded yet
2026-03-25 18:34:31 [ayvens.es] INFO: Found listing with ID: 1983333
2026-03-25 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983333%27 HTTP/1.1" 200 None
2026-03-25 18:34:31 [ayvens.es] INFO: Scrape type for 1983333: 1
2026-03-25 18:34:31 [ayvens.es] INFO: Extracting data for car ID: 1983333
2026-03-25 18:34:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2ec4c0a-319a-53b9-b8f8-4d1b33c4ef40 with identifier: 1983333
2026-03-25 18:34:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2ec4c0a-319a-53b9-b8f8-4d1b33c4ef40 with scrape type 1
2026-03-25 18:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b2ec4c0a-319a-53b9-b8f8-4d1b33c4ef40
2026-03-25 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F177%252F129e3b922cd94e819179a2fbe3596566%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/177/129e3b922cd94e819179a2fbe3596566/images/large/1.jpg not downloaded yet
2026-03-25 18:34:31 [ayvens.es] INFO: Found listing with ID: 1983334
2026-03-25 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983334%27 HTTP/1.1" 200 None
2026-03-25 18:34:31 [ayvens.es] INFO: Scrape type for 1983334: 1
2026-03-25 18:34:31 [ayvens.es] INFO: Extracting data for car ID: 1983334
2026-03-25 18:34:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5434c540-9d70-5196-8914-8fd8308d0bde with identifier: 1983334
2026-03-25 18:34:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5434c540-9d70-5196-8914-8fd8308d0bde with scrape type 1
2026-03-25 18:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5434c540-9d70-5196-8914-8fd8308d0bde
2026-03-25 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F525%252F145406586c674a329870640eb1ae95ff%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/525/145406586c674a329870640eb1ae95ff/images/large/1.jpg not downloaded yet
2026-03-25 18:34:31 [ayvens.es] INFO: Found listing with ID: 1983335
2026-03-25 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983335%27 HTTP/1.1" 200 None
2026-03-25 18:34:31 [ayvens.es] INFO: Scrape type for 1983335: 1
2026-03-25 18:34:31 [ayvens.es] INFO: Extracting data for car ID: 1983335
2026-03-25 18:34:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58503a43-efc7-5192-b461-17a58e20af74 with identifier: 1983335
2026-03-25 18:34:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58503a43-efc7-5192-b461-17a58e20af74 with scrape type 1
2026-03-25 18:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 58503a43-efc7-5192-b461-17a58e20af74
2026-03-25 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F597%252F58fc2c612df74c80b5e54f61a941b527%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/597/58fc2c612df74c80b5e54f61a941b527/images/large/1.jpg not downloaded yet
2026-03-25 18:34:31 [ayvens.es] INFO: Found listing with ID: 1983336
2026-03-25 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983336%27 HTTP/1.1" 200 None
2026-03-25 18:34:31 [ayvens.es] INFO: Scrape type for 1983336: 1
2026-03-25 18:34:31 [ayvens.es] INFO: Extracting data for car ID: 1983336
2026-03-25 18:34:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef84855c-a0e7-5547-a2b9-d5799e30c11a with identifier: 1983336
2026-03-25 18:34:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef84855c-a0e7-5547-a2b9-d5799e30c11a with scrape type 1
2026-03-25 18:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ef84855c-a0e7-5547-a2b9-d5799e30c11a
2026-03-25 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F885%252Fbd9d356170f94c86ae62cf52853d777e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/885/bd9d356170f94c86ae62cf52853d777e/images/large/1.jpg not downloaded yet
2026-03-25 18:34:31 [ayvens.es] INFO: Found listing with ID: 1983337
2026-03-25 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983337%27 HTTP/1.1" 200 None
2026-03-25 18:34:31 [ayvens.es] INFO: Scrape type for 1983337: 1
2026-03-25 18:34:31 [ayvens.es] INFO: Extracting data for car ID: 1983337
2026-03-25 18:34:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf1ee3fe-6a58-5722-9221-3e396fdd98e2 with identifier: 1983337
2026-03-25 18:34:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf1ee3fe-6a58-5722-9221-3e396fdd98e2 with scrape type 1
2026-03-25 18:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item bf1ee3fe-6a58-5722-9221-3e396fdd98e2
2026-03-25 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F911%252F3143149f9afd43d881fa1f3b28f46467%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/911/3143149f9afd43d881fa1f3b28f46467/images/large/1.jpg not downloaded yet
2026-03-25 18:34:31 [ayvens.es] INFO: Found listing with ID: 1983338
2026-03-25 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983338%27 HTTP/1.1" 200 None
2026-03-25 18:34:31 [ayvens.es] INFO: Scrape type for 1983338: 1
2026-03-25 18:34:31 [ayvens.es] INFO: Extracting data for car ID: 1983338
2026-03-25 18:34:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d46d0f53-3f53-5d65-9a71-dca27c218565 with identifier: 1983338
2026-03-25 18:34:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d46d0f53-3f53-5d65-9a71-dca27c218565 with scrape type 1
2026-03-25 18:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d46d0f53-3f53-5d65-9a71-dca27c218565
2026-03-25 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F819%252Fdb6fd6488d2644bba9cef1cf5a8f696a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/819/db6fd6488d2644bba9cef1cf5a8f696a/images/large/1.jpg not downloaded yet
2026-03-25 18:34:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/613/a3248a2e1eb34d2b83f78402b2c74efc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:32 [ayvens.es] INFO: Found listing with ID: 1983339
2026-03-25 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983339%27 HTTP/1.1" 200 None
2026-03-25 18:34:32 [ayvens.es] INFO: Scrape type for 1983339: 1
2026-03-25 18:34:32 [ayvens.es] INFO: Extracting data for car ID: 1983339
2026-03-25 18:34:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a8e7637-a87f-5ea7-8633-57101f65215e with identifier: 1983339
2026-03-25 18:34:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a8e7637-a87f-5ea7-8633-57101f65215e with scrape type 1
2026-03-25 18:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0a8e7637-a87f-5ea7-8633-57101f65215e
2026-03-25 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F363%252Fb84b29bd3e4b4fedaf6063b46d02d194%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/363/b84b29bd3e4b4fedaf6063b46d02d194/images/large/1.jpg not downloaded yet
2026-03-25 18:34:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/869/4f9990536a324b7b9ba9ee21e5b5629d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:32 [ayvens.es] INFO: Found listing with ID: 1983340
2026-03-25 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983340%27 HTTP/1.1" 200 None
2026-03-25 18:34:32 [ayvens.es] INFO: Scrape type for 1983340: 1
2026-03-25 18:34:32 [ayvens.es] INFO: Extracting data for car ID: 1983340
2026-03-25 18:34:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b61dfe9-0f8d-5667-abf6-7f517d0ca3ec with identifier: 1983340
2026-03-25 18:34:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b61dfe9-0f8d-5667-abf6-7f517d0ca3ec with scrape type 1
2026-03-25 18:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5b61dfe9-0f8d-5667-abf6-7f517d0ca3ec
2026-03-25 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F516%252F3256688c7a634536ab80e1b0e5892e9f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/516/3256688c7a634536ab80e1b0e5892e9f/images/large/1.jpg not downloaded yet
2026-03-25 18:34:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/682/88146a334dc848829edae5a4898bde2f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:32 [ayvens.es] INFO: Found listing with ID: 1983341
2026-03-25 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983341%27 HTTP/1.1" 200 None
2026-03-25 18:34:32 [ayvens.es] INFO: Scrape type for 1983341: 1
2026-03-25 18:34:32 [ayvens.es] INFO: Extracting data for car ID: 1983341
2026-03-25 18:34:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 167a4e15-afcd-5752-bf5e-435dae7e3122 with identifier: 1983341
2026-03-25 18:34:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 167a4e15-afcd-5752-bf5e-435dae7e3122 with scrape type 1
2026-03-25 18:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 167a4e15-afcd-5752-bf5e-435dae7e3122
2026-03-25 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F490%252F478656d86c5247028ee6bc57f8636a4b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/490/478656d86c5247028ee6bc57f8636a4b/images/large/1.jpg not downloaded yet
2026-03-25 18:34:32 [ayvens.es] INFO: Found listing with ID: 1983342
2026-03-25 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983342%27 HTTP/1.1" 200 None
2026-03-25 18:34:32 [ayvens.es] INFO: Scrape type for 1983342: 1
2026-03-25 18:34:32 [ayvens.es] INFO: Extracting data for car ID: 1983342
2026-03-25 18:34:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad9009e4-2d8c-5067-a595-70871e06c7c5 with identifier: 1983342
2026-03-25 18:34:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad9009e4-2d8c-5067-a595-70871e06c7c5 with scrape type 1
2026-03-25 18:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ad9009e4-2d8c-5067-a595-70871e06c7c5
2026-03-25 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F338%252Fb204408395b543c6893a985781469aa1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/338/b204408395b543c6893a985781469aa1/images/large/1.jpg not downloaded yet
2026-03-25 18:34:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8efa7c50>
2026-03-25 18:34:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0e500a4-ca05-58c2-a6bf-e53d03655c5f/c0e500a4-ca05-58c2-a6bf-e53d03655c5f_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F613%252Fa3248a2e1eb34d2b83f78402b2c74efc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/613/a3248a2e1eb34d2b83f78402b2c74efc/images/large/1.jpg saved to cache
2026-03-25 18:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c0e500a4-ca05-58c2-a6bf-e53d03655c5f
2026-03-25 18:34:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c0e500a4-ca05-58c2-a6bf-e53d03655c5f, skipping ID generation
2026-03-25 18:34:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0e500a4-ca05-58c2-a6bf-e53d03655c5f with scrape type 1
2026-03-25 18:34:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c0e500a4-ca05-58c2-a6bf-e53d03655c5f sending to next pipeline
2026-03-25 18:34:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c0e500a4-ca05-58c2-a6bf-e53d03655c5f, identifier: 1983322
2026-03-25 18:34:32 [ayvens.es] INFO: Found listing with ID: 1983343
2026-03-25 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983343%27 HTTP/1.1" 200 None
2026-03-25 18:34:32 [ayvens.es] INFO: Scrape type for 1983343: 1
2026-03-25 18:34:32 [ayvens.es] INFO: Extracting data for car ID: 1983343
2026-03-25 18:34:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 055d1592-5463-5a62-94f9-8ee355fd6d47 with identifier: 1983343
2026-03-25 18:34:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 055d1592-5463-5a62-94f9-8ee355fd6d47 with scrape type 1
2026-03-25 18:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 055d1592-5463-5a62-94f9-8ee355fd6d47
2026-03-25 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F944%252Fdf7c7f4f011a465699f557aa369ac87d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/944/df7c7f4f011a465699f557aa369ac87d/images/large/1.jpg not downloaded yet
2026-03-25 18:34:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c0e500a4-ca05-58c2-a6bf-e53d03655c5f with identifier: 1983322
2026-03-25 18:34:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c0e500a4-ca05-58c2-a6bf-e53d03655c5f with identifier: 1983322
2026-03-25 18:34:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c0e500a4-ca05-58c2-a6bf-e53d03655c5f with identifier: 1983322 to the API
2026-03-25 18:34:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/613/a3248a2e1eb34d2b83f78402b2c74efc/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'color': 'Blanco s',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.2L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c0e500a4-ca05-58c2-a6bf-e53d03655c5f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'FIORINO',
 'odometer': 44011,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0e500a4-ca05-58c2-a6bf-e53d03655c5f/c0e500a4-ca05-58c2-a6bf-e53d03655c5f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336201,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/613/a3248a2e1eb34d2b83f78402b2c74efc/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-28',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FIAT FIORINO (O) Cargo SX N1 1.3 MJet 70 kW (95 CV)',
 'transmission': 'manual',
 'trim': '(O) Cargo SX N1 1.3 MJet 70 kW (95 CV)',
 'vin': None,
 'year': 2022}
2026-03-25 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983322%27 HTTP/1.1" 200 None
2026-03-25 18:34:32 [ayvens.es] INFO: Saving data for 1983322: {'created_time': 1774463672.789738, 'last_price_update_time': 1774463672.789748, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983322') HTTP/1.1" 204 0
2026-03-25 18:34:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ec683d0>
2026-03-25 18:34:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92d14cfe-c682-5eb9-b393-ac34774fffe6/92d14cfe-c682-5eb9-b393-ac34774fffe6_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F869%252F4f9990536a324b7b9ba9ee21e5b5629d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/869/4f9990536a324b7b9ba9ee21e5b5629d/images/large/1.jpg saved to cache
2026-03-25 18:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 92d14cfe-c682-5eb9-b393-ac34774fffe6
2026-03-25 18:34:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 92d14cfe-c682-5eb9-b393-ac34774fffe6, skipping ID generation
2026-03-25 18:34:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92d14cfe-c682-5eb9-b393-ac34774fffe6 with scrape type 1
2026-03-25 18:34:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 92d14cfe-c682-5eb9-b393-ac34774fffe6 sending to next pipeline
2026-03-25 18:34:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 92d14cfe-c682-5eb9-b393-ac34774fffe6, identifier: 1983323
2026-03-25 18:34:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/535/2187cd30e6694e47a8a286c151f47b0f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/458/f622846b5bc44bf7a3db724f24eb092d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:33 [ayvens.es] INFO: Found listing with ID: 1983344
2026-03-25 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983344%27 HTTP/1.1" 200 None
2026-03-25 18:34:33 [ayvens.es] INFO: Scrape type for 1983344: 1
2026-03-25 18:34:33 [ayvens.es] INFO: Extracting data for car ID: 1983344
2026-03-25 18:34:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94a8ac4d-8188-50b7-819c-47d3281b3c6e with identifier: 1983344
2026-03-25 18:34:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94a8ac4d-8188-50b7-819c-47d3281b3c6e with scrape type 1
2026-03-25 18:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 94a8ac4d-8188-50b7-819c-47d3281b3c6e
2026-03-25 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F954%252F34748f0c2d0a4687bcf1168bce115d43%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/954/34748f0c2d0a4687bcf1168bce115d43/images/large/1.jpg not downloaded yet
2026-03-25 18:34:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 92d14cfe-c682-5eb9-b393-ac34774fffe6 with identifier: 1983323
2026-03-25 18:34:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 92d14cfe-c682-5eb9-b393-ac34774fffe6 with identifier: 1983323
2026-03-25 18:34:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 92d14cfe-c682-5eb9-b393-ac34774fffe6 with identifier: 1983323 to the API
2026-03-25 18:34:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/869/4f9990536a324b7b9ba9ee21e5b5629d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 201,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '92d14cfe-c682-5eb9-b393-ac34774fffe6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT CUSTOM',
 'odometer': 193352,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92d14cfe-c682-5eb9-b393-ac34774fffe6/92d14cfe-c682-5eb9-b393-ac34774fffe6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325847,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/869/4f9990536a324b7b9ba9ee21e5b5629d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-20',
 'seats_number': 6,
 'seller_name': None,
 'title': 'FORD TRANSIT CUSTOM Van Doble 2.0 TDCI 96kW 300 L2 Trend+++Revisar '
          'peritacion+++',
 'transmission': 'manual',
 'trim': 'Van Doble 2.0 TDCI 96kW 300 L2 Trend+++Revisar peritacion+++',
 'vin': None,
 'year': 2021}
2026-03-25 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983323%27 HTTP/1.1" 200 None
2026-03-25 18:34:33 [ayvens.es] INFO: Saving data for 1983323: {'created_time': 1774463673.473774, 'last_price_update_time': 1774463673.473785, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983323') HTTP/1.1" 204 0
2026-03-25 18:34:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e5c8290>
2026-03-25 18:34:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e869898-566d-5835-bddc-5c3bfc4d44be/3e869898-566d-5835-bddc-5c3bfc4d44be_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F682%252F88146a334dc848829edae5a4898bde2f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/682/88146a334dc848829edae5a4898bde2f/images/large/1.jpg saved to cache
2026-03-25 18:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3e869898-566d-5835-bddc-5c3bfc4d44be
2026-03-25 18:34:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3e869898-566d-5835-bddc-5c3bfc4d44be, skipping ID generation
2026-03-25 18:34:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e869898-566d-5835-bddc-5c3bfc4d44be with scrape type 1
2026-03-25 18:34:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3e869898-566d-5835-bddc-5c3bfc4d44be sending to next pipeline
2026-03-25 18:34:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3e869898-566d-5835-bddc-5c3bfc4d44be, identifier: 1983325
2026-03-25 18:34:33 [ayvens.es] INFO: Found listing with ID: 1983345
2026-03-25 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983345%27 HTTP/1.1" 200 None
2026-03-25 18:34:33 [ayvens.es] INFO: Scrape type for 1983345: 1
2026-03-25 18:34:33 [ayvens.es] INFO: Extracting data for car ID: 1983345
2026-03-25 18:34:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d0e611b-0142-5671-b50f-fb9be16346a4 with identifier: 1983345
2026-03-25 18:34:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d0e611b-0142-5671-b50f-fb9be16346a4 with scrape type 1
2026-03-25 18:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7d0e611b-0142-5671-b50f-fb9be16346a4
2026-03-25 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F107%252Fb31cbde0869f4b4a9db36cd8a58faaa1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/107/b31cbde0869f4b4a9db36cd8a58faaa1/images/large/1.jpg not downloaded yet
2026-03-25 18:34:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3e869898-566d-5835-bddc-5c3bfc4d44be with identifier: 1983325
2026-03-25 18:34:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:34:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3e869898-566d-5835-bddc-5c3bfc4d44be with identifier: 1983325
2026-03-25 18:34:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3e869898-566d-5835-bddc-5c3bfc4d44be with identifier: 1983325 to the API
2026-03-25 18:34:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/682/88146a334dc848829edae5a4898bde2f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Gris selenita',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '3e869898-566d-5835-bddc-5c3bfc4d44be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'C-CLASS',
 'odometer': 116469,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e869898-566d-5835-bddc-5c3bfc4d44be/3e869898-566d-5835-bddc-5c3bfc4d44be_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 517816,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/682/88146a334dc848829edae5a4898bde2f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ C-CLASS C 220 d',
 'transmission': 'manual',
 'trim': 'C 220 d',
 'vin': None,
 'year': 2023}
2026-03-25 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983325%27 HTTP/1.1" 200 None
2026-03-25 18:34:33 [ayvens.es] INFO: Saving data for 1983325: {'created_time': 1774463673.946733, 'last_price_update_time': 1774463673.946746, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983325') HTTP/1.1" 204 0
2026-03-25 18:34:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/597/ff80183bc47643d582d842764e4b9a38/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/217/80701d02fd764560a43229be313481d7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/623/34951740387349f7904e4f147b28f09f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/108/f25c052cc541443db19ef827c7aee310/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:33 [ayvens.es] INFO: Found listing with ID: 1983346
2026-03-25 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983346%27 HTTP/1.1" 200 None
2026-03-25 18:34:33 [ayvens.es] INFO: Scrape type for 1983346: 1
2026-03-25 18:34:33 [ayvens.es] INFO: Extracting data for car ID: 1983346
2026-03-25 18:34:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0cea8245-42dd-59b8-a9bd-38ee1aaa6ca2 with identifier: 1983346
2026-03-25 18:34:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cea8245-42dd-59b8-a9bd-38ee1aaa6ca2 with scrape type 1
2026-03-25 18:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0cea8245-42dd-59b8-a9bd-38ee1aaa6ca2
2026-03-25 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F150%252Fa13960833d3f4a0087878ece60c9ae3a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/150/a13960833d3f4a0087878ece60c9ae3a/images/large/1.jpg not downloaded yet
2026-03-25 18:34:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ea05590>
2026-03-25 18:34:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3d43fd3-b12d-5401-9120-592e44bf005b/d3d43fd3-b12d-5401-9120-592e44bf005b_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F535%252F2187cd30e6694e47a8a286c151f47b0f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/535/2187cd30e6694e47a8a286c151f47b0f/images/large/1.jpg saved to cache
2026-03-25 18:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d3d43fd3-b12d-5401-9120-592e44bf005b
2026-03-25 18:34:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d3d43fd3-b12d-5401-9120-592e44bf005b, skipping ID generation
2026-03-25 18:34:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3d43fd3-b12d-5401-9120-592e44bf005b with scrape type 1
2026-03-25 18:34:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d3d43fd3-b12d-5401-9120-592e44bf005b sending to next pipeline
2026-03-25 18:34:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d3d43fd3-b12d-5401-9120-592e44bf005b, identifier: 1983324
2026-03-25 18:34:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ea77310>
2026-03-25 18:34:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17ccb512-4720-52b4-be43-d9cf1ba1e427/17ccb512-4720-52b4-be43-d9cf1ba1e427_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F458%252Ff622846b5bc44bf7a3db724f24eb092d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/458/f622846b5bc44bf7a3db724f24eb092d/images/large/1.jpg saved to cache
2026-03-25 18:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 17ccb512-4720-52b4-be43-d9cf1ba1e427
2026-03-25 18:34:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 17ccb512-4720-52b4-be43-d9cf1ba1e427, skipping ID generation
2026-03-25 18:34:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17ccb512-4720-52b4-be43-d9cf1ba1e427 with scrape type 1
2026-03-25 18:34:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 17ccb512-4720-52b4-be43-d9cf1ba1e427 sending to next pipeline
2026-03-25 18:34:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 17ccb512-4720-52b4-be43-d9cf1ba1e427, identifier: 1983326
2026-03-25 18:34:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d3d43fd3-b12d-5401-9120-592e44bf005b with identifier: 1983324
2026-03-25 18:34:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d3d43fd3-b12d-5401-9120-592e44bf005b with identifier: 1983324
2026-03-25 18:34:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d3d43fd3-b12d-5401-9120-592e44bf005b with identifier: 1983324 to the API
2026-03-25 18:34:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/535/2187cd30e6694e47a8a286c151f47b0f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd3d43fd3-b12d-5401-9120-592e44bf005b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'DACIA',
 'model': 'DUSTER',
 'odometer': 194758,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3d43fd3-b12d-5401-9120-592e44bf005b/d3d43fd3-b12d-5401-9120-592e44bf005b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 351196,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/535/2187cd30e6694e47a8a286c151f47b0f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DACIA DUSTER Comfort Blue dCi 85kW (115CV) 4X4',
 'transmission': 'manual',
 'trim': 'Comfort Blue dCi 85kW (115CV) 4X4',
 'vin': None,
 'year': 2022}
2026-03-25 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983324%27 HTTP/1.1" 200 None
2026-03-25 18:34:34 [ayvens.es] INFO: Saving data for 1983324: {'created_time': 1774463674.62488, 'last_price_update_time': 1774463674.624895, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983324') HTTP/1.1" 204 0
2026-03-25 18:34:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 17ccb512-4720-52b4-be43-d9cf1ba1e427 with identifier: 1983326
2026-03-25 18:34:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 17ccb512-4720-52b4-be43-d9cf1ba1e427 with identifier: 1983326
2026-03-25 18:34:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 17ccb512-4720-52b4-be43-d9cf1ba1e427 with identifier: 1983326 to the API
2026-03-25 18:34:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/458/f622846b5bc44bf7a3db724f24eb092d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.7L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '17ccb512-4720-52b4-be43-d9cf1ba1e427',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'X-TRAIL',
 'odometer': 178997,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17ccb512-4720-52b4-be43-d9cf1ba1e427/17ccb512-4720-52b4-be43-d9cf1ba1e427_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 345923,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/458/f622846b5bc44bf7a3db724f24eb092d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN X-TRAIL 5P dCi 110 kW (150 CV) E6D 4X4-i ACENTA',
 'transmission': 'manual',
 'trim': '5P dCi 110 kW (150 CV) E6D 4X4-i ACENTA',
 'vin': None,
 'year': 2020}
2026-03-25 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983326%27 HTTP/1.1" 200 None
2026-03-25 18:34:34 [ayvens.es] INFO: Saving data for 1983326: {'created_time': 1774463674.948994, 'last_price_update_time': 1774463674.949008, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983326') HTTP/1.1" 204 0
2026-03-25 18:34:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/648/4079f3de9cdf4efea4c723b47bb705fc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:34 [ayvens.es] INFO: Found listing with ID: 1983347
2026-03-25 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983347%27 HTTP/1.1" 200 None
2026-03-25 18:34:34 [ayvens.es] INFO: Scrape type for 1983347: 1
2026-03-25 18:34:34 [ayvens.es] INFO: Extracting data for car ID: 1983347
2026-03-25 18:34:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd1d46fb-f8d8-580f-a010-43ac5e56e458 with identifier: 1983347
2026-03-25 18:34:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd1d46fb-f8d8-580f-a010-43ac5e56e458 with scrape type 1
2026-03-25 18:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item cd1d46fb-f8d8-580f-a010-43ac5e56e458
2026-03-25 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F048%252Fc3cb5ea029c94c2ba5dc13eadb4ed2ac%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/048/c3cb5ea029c94c2ba5dc13eadb4ed2ac/images/large/1.jpg not downloaded yet
2026-03-25 18:34:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/316/ab67115dea144516a162e9cd4b422e43/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:35 [ayvens.es] INFO: Found listing with ID: 1983348
2026-03-25 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983348%27 HTTP/1.1" 200 None
2026-03-25 18:34:35 [ayvens.es] INFO: Scrape type for 1983348: 1
2026-03-25 18:34:35 [ayvens.es] INFO: Extracting data for car ID: 1983348
2026-03-25 18:34:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 132fdaa0-e466-58f1-a5bb-a390fa3a8d66 with identifier: 1983348
2026-03-25 18:34:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 132fdaa0-e466-58f1-a5bb-a390fa3a8d66 with scrape type 1
2026-03-25 18:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 132fdaa0-e466-58f1-a5bb-a390fa3a8d66
2026-03-25 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F662%252F619561454b5e406eb7602359406e894e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/662/619561454b5e406eb7602359406e894e/images/large/1.jpg not downloaded yet
2026-03-25 18:34:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8eaabb10>
2026-03-25 18:34:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eea1f09-c08e-5a39-83a6-59729f41dfce/0eea1f09-c08e-5a39-83a6-59729f41dfce_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F597%252Fff80183bc47643d582d842764e4b9a38%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/597/ff80183bc47643d582d842764e4b9a38/images/large/1.jpg saved to cache
2026-03-25 18:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0eea1f09-c08e-5a39-83a6-59729f41dfce
2026-03-25 18:34:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0eea1f09-c08e-5a39-83a6-59729f41dfce, skipping ID generation
2026-03-25 18:34:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0eea1f09-c08e-5a39-83a6-59729f41dfce with scrape type 1
2026-03-25 18:34:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0eea1f09-c08e-5a39-83a6-59729f41dfce sending to next pipeline
2026-03-25 18:34:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0eea1f09-c08e-5a39-83a6-59729f41dfce, identifier: 1983328
2026-03-25 18:34:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8f0ca850>
2026-03-25 18:34:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_561a301c-a18b-5d87-a76c-3bcd19e08bf4/561a301c-a18b-5d87-a76c-3bcd19e08bf4_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F217%252F80701d02fd764560a43229be313481d7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/217/80701d02fd764560a43229be313481d7/images/large/1.jpg saved to cache
2026-03-25 18:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 561a301c-a18b-5d87-a76c-3bcd19e08bf4
2026-03-25 18:34:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 561a301c-a18b-5d87-a76c-3bcd19e08bf4, skipping ID generation
2026-03-25 18:34:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 561a301c-a18b-5d87-a76c-3bcd19e08bf4 with scrape type 1
2026-03-25 18:34:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 561a301c-a18b-5d87-a76c-3bcd19e08bf4 sending to next pipeline
2026-03-25 18:34:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 561a301c-a18b-5d87-a76c-3bcd19e08bf4, identifier: 1983331
2026-03-25 18:34:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ef2ba10>
2026-03-25 18:34:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ab0d626-9af5-5ad6-9789-cfe0d63a83b0/4ab0d626-9af5-5ad6-9789-cfe0d63a83b0_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F623%252F34951740387349f7904e4f147b28f09f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/623/34951740387349f7904e4f147b28f09f/images/large/1.jpg saved to cache
2026-03-25 18:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4ab0d626-9af5-5ad6-9789-cfe0d63a83b0
2026-03-25 18:34:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4ab0d626-9af5-5ad6-9789-cfe0d63a83b0, skipping ID generation
2026-03-25 18:34:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ab0d626-9af5-5ad6-9789-cfe0d63a83b0 with scrape type 1
2026-03-25 18:34:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4ab0d626-9af5-5ad6-9789-cfe0d63a83b0 sending to next pipeline
2026-03-25 18:34:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4ab0d626-9af5-5ad6-9789-cfe0d63a83b0, identifier: 1983327
2026-03-25 18:34:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8efe6850>
2026-03-25 18:34:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a54d8eaf-eb50-57a5-bac4-67196a4c5bf2/a54d8eaf-eb50-57a5-bac4-67196a4c5bf2_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F108%252Ff25c052cc541443db19ef827c7aee310%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/108/f25c052cc541443db19ef827c7aee310/images/large/1.jpg saved to cache
2026-03-25 18:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a54d8eaf-eb50-57a5-bac4-67196a4c5bf2
2026-03-25 18:34:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a54d8eaf-eb50-57a5-bac4-67196a4c5bf2, skipping ID generation
2026-03-25 18:34:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a54d8eaf-eb50-57a5-bac4-67196a4c5bf2 with scrape type 1
2026-03-25 18:34:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a54d8eaf-eb50-57a5-bac4-67196a4c5bf2 sending to next pipeline
2026-03-25 18:34:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a54d8eaf-eb50-57a5-bac4-67196a4c5bf2, identifier: 1983330
2026-03-25 18:34:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/177/129e3b922cd94e819179a2fbe3596566/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0eea1f09-c08e-5a39-83a6-59729f41dfce with identifier: 1983328
2026-03-25 18:34:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0eea1f09-c08e-5a39-83a6-59729f41dfce with identifier: 1983328
2026-03-25 18:34:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0eea1f09-c08e-5a39-83a6-59729f41dfce with identifier: 1983328 to the API
2026-03-25 18:34:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/597/ff80183bc47643d582d842764e4b9a38/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '0eea1f09-c08e-5a39-83a6-59729f41dfce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ATECA',
 'odometer': 74589,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eea1f09-c08e-5a39-83a6-59729f41dfce/0eea1f09-c08e-5a39-83a6-59729f41dfce_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 547133,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/597/ff80183bc47643d582d842764e4b9a38/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ATECA 1.5 TSI 110kW DSG S&S Style Edition Nav',
 'transmission': 'manual',
 'trim': '1.5 TSI 110kW DSG S&S Style Edition Nav',
 'vin': None,
 'year': 2019}
2026-03-25 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983328%27 HTTP/1.1" 200 None
2026-03-25 18:34:36 [ayvens.es] INFO: Saving data for 1983328: {'created_time': 1774463676.057118, 'last_price_update_time': 1774463676.057129, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983328') HTTP/1.1" 204 0
2026-03-25 18:34:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 561a301c-a18b-5d87-a76c-3bcd19e08bf4 with identifier: 1983331
2026-03-25 18:34:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:34:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 561a301c-a18b-5d87-a76c-3bcd19e08bf4 with identifier: 1983331
2026-03-25 18:34:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 561a301c-a18b-5d87-a76c-3bcd19e08bf4 with identifier: 1983331 to the API
2026-03-25 18:34:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/217/80701d02fd764560a43229be313481d7/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'color': 'Blanco polar solido',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '561a301c-a18b-5d87-a76c-3bcd19e08bf4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLA',
 'odometer': 153520,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_561a301c-a18b-5d87-a76c-3bcd19e08bf4/561a301c-a18b-5d87-a76c-3bcd19e08bf4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 351461,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/217/80701d02fd764560a43229be313481d7/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLA GLA 200 D',
 'transmission': 'manual',
 'trim': 'GLA 200 D',
 'vin': None,
 'year': 2021}
2026-03-25 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983331%27 HTTP/1.1" 200 None
2026-03-25 18:34:36 [ayvens.es] INFO: Saving data for 1983331: {'created_time': 1774463676.370215, 'last_price_update_time': 1774463676.370228, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983331') HTTP/1.1" 204 0
2026-03-25 18:34:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4ab0d626-9af5-5ad6-9789-cfe0d63a83b0 with identifier: 1983327
2026-03-25 18:34:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4ab0d626-9af5-5ad6-9789-cfe0d63a83b0 with identifier: 1983327
2026-03-25 18:34:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 4ab0d626-9af5-5ad6-9789-cfe0d63a83b0 with identifier: 1983327 to the API
2026-03-25 18:34:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/623/34951740387349f7904e4f147b28f09f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '4ab0d626-9af5-5ad6-9789-cfe0d63a83b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MEGANE',
 'odometer': 179554,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ab0d626-9af5-5ad6-9789-cfe0d63a83b0/4ab0d626-9af5-5ad6-9789-cfe0d63a83b0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 487936,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/623/34951740387349f7904e4f147b28f09f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT MEGANE Equilibre Blue dCi 85 kW (115CV)',
 'transmission': 'manual',
 'trim': 'Equilibre Blue dCi 85 kW (115CV)',
 'vin': None,
 'year': 2023}
2026-03-25 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983327%27 HTTP/1.1" 200 None
2026-03-25 18:34:36 [ayvens.es] INFO: Saving data for 1983327: {'created_time': 1774463676.664976, 'last_price_update_time': 1774463676.664986, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983327') HTTP/1.1" 204 0
2026-03-25 18:34:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a54d8eaf-eb50-57a5-bac4-67196a4c5bf2 with identifier: 1983330
2026-03-25 18:34:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a54d8eaf-eb50-57a5-bac4-67196a4c5bf2 with identifier: 1983330
2026-03-25 18:34:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a54d8eaf-eb50-57a5-bac4-67196a4c5bf2 with identifier: 1983330 to the API
2026-03-25 18:34:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/108/f25c052cc541443db19ef827c7aee310/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 90,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a54d8eaf-eb50-57a5-bac4-67196a4c5bf2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'DACIA',
 'model': 'SANDERO',
 'odometer': 129713,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a54d8eaf-eb50-57a5-bac4-67196a4c5bf2/a54d8eaf-eb50-57a5-bac4-67196a4c5bf2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328485,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/108/f25c052cc541443db19ef827c7aee310/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DACIA SANDERO Ambiance dCi 75 EU6',
 'transmission': 'manual',
 'trim': 'Ambiance dCi 75 EU6',
 'vin': None,
 'year': 2018}
2026-03-25 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983330%27 HTTP/1.1" 200 None
2026-03-25 18:34:37 [ayvens.es] INFO: Saving data for 1983330: {'created_time': 1774463677.316053, 'last_price_update_time': 1774463677.316064, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983330') HTTP/1.1" 204 0
2026-03-25 18:34:37 [ayvens.es] INFO: Found listing with ID: 1983349
2026-03-25 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983349%27 HTTP/1.1" 200 None
2026-03-25 18:34:37 [ayvens.es] INFO: Scrape type for 1983349: 1
2026-03-25 18:34:37 [ayvens.es] INFO: Extracting data for car ID: 1983349
2026-03-25 18:34:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 306d75cf-d6c4-5884-afb7-f7b044283c4e with identifier: 1983349
2026-03-25 18:34:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 306d75cf-d6c4-5884-afb7-f7b044283c4e with scrape type 1
2026-03-25 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 306d75cf-d6c4-5884-afb7-f7b044283c4e
2026-03-25 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F979%252Fd670848fd84c49358aa5c7e725f2bb51%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/979/d670848fd84c49358aa5c7e725f2bb51/images/large/1.jpg not downloaded yet
2026-03-25 18:34:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/525/145406586c674a329870640eb1ae95ff/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/597/58fc2c612df74c80b5e54f61a941b527/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/885/bd9d356170f94c86ae62cf52853d777e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/911/3143149f9afd43d881fa1f3b28f46467/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:37 [ayvens.es] INFO: Found listing with ID: 1983350
2026-03-25 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983350%27 HTTP/1.1" 200 None
2026-03-25 18:34:37 [ayvens.es] INFO: Scrape type for 1983350: 1
2026-03-25 18:34:37 [ayvens.es] INFO: Extracting data for car ID: 1983350
2026-03-25 18:34:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 222fa4c4-1e2d-5824-bec8-c656f6e8d4c5 with identifier: 1983350
2026-03-25 18:34:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 222fa4c4-1e2d-5824-bec8-c656f6e8d4c5 with scrape type 1
2026-03-25 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 222fa4c4-1e2d-5824-bec8-c656f6e8d4c5
2026-03-25 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F992%252Fdc98fb52306d48d5a7da08f63b6c0e85%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/992/dc98fb52306d48d5a7da08f63b6c0e85/images/large/1.jpg not downloaded yet
2026-03-25 18:34:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e5b9b90>
2026-03-25 18:34:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b12d1ca-d21b-505c-b88d-a924bc36cf17/9b12d1ca-d21b-505c-b88d-a924bc36cf17_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F648%252F4079f3de9cdf4efea4c723b47bb705fc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/648/4079f3de9cdf4efea4c723b47bb705fc/images/large/1.jpg saved to cache
2026-03-25 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9b12d1ca-d21b-505c-b88d-a924bc36cf17
2026-03-25 18:34:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9b12d1ca-d21b-505c-b88d-a924bc36cf17, skipping ID generation
2026-03-25 18:34:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b12d1ca-d21b-505c-b88d-a924bc36cf17 with scrape type 1
2026-03-25 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9b12d1ca-d21b-505c-b88d-a924bc36cf17 sending to next pipeline
2026-03-25 18:34:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9b12d1ca-d21b-505c-b88d-a924bc36cf17, identifier: 1983329
2026-03-25 18:34:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ea58550>
2026-03-25 18:34:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6481a1d-4cbf-5930-8bdd-b162c36ff6e3/f6481a1d-4cbf-5930-8bdd-b162c36ff6e3_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F316%252Fab67115dea144516a162e9cd4b422e43%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/316/ab67115dea144516a162e9cd4b422e43/images/large/1.jpg saved to cache
2026-03-25 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f6481a1d-4cbf-5930-8bdd-b162c36ff6e3
2026-03-25 18:34:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f6481a1d-4cbf-5930-8bdd-b162c36ff6e3, skipping ID generation
2026-03-25 18:34:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6481a1d-4cbf-5930-8bdd-b162c36ff6e3 with scrape type 1
2026-03-25 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f6481a1d-4cbf-5930-8bdd-b162c36ff6e3 sending to next pipeline
2026-03-25 18:34:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f6481a1d-4cbf-5930-8bdd-b162c36ff6e3, identifier: 1983332
2026-03-25 18:34:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e55f1d0>
2026-03-25 18:34:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2ec4c0a-319a-53b9-b8f8-4d1b33c4ef40/b2ec4c0a-319a-53b9-b8f8-4d1b33c4ef40_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F177%252F129e3b922cd94e819179a2fbe3596566%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/177/129e3b922cd94e819179a2fbe3596566/images/large/1.jpg saved to cache
2026-03-25 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b2ec4c0a-319a-53b9-b8f8-4d1b33c4ef40
2026-03-25 18:34:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b2ec4c0a-319a-53b9-b8f8-4d1b33c4ef40, skipping ID generation
2026-03-25 18:34:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2ec4c0a-319a-53b9-b8f8-4d1b33c4ef40 with scrape type 1
2026-03-25 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b2ec4c0a-319a-53b9-b8f8-4d1b33c4ef40 sending to next pipeline
2026-03-25 18:34:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b2ec4c0a-319a-53b9-b8f8-4d1b33c4ef40, identifier: 1983333
2026-03-25 18:34:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9b12d1ca-d21b-505c-b88d-a924bc36cf17 with identifier: 1983329
2026-03-25 18:34:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:34:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9b12d1ca-d21b-505c-b88d-a924bc36cf17 with identifier: 1983329
2026-03-25 18:34:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9b12d1ca-d21b-505c-b88d-a924bc36cf17 with identifier: 1983329 to the API
2026-03-25 18:34:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/648/4079f3de9cdf4efea4c723b47bb705fc/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'color': 'Gris manganeso',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '9b12d1ca-d21b-505c-b88d-a924bc36cf17',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT',
 'odometer': 172717,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b12d1ca-d21b-505c-b88d-a924bc36cf17/9b12d1ca-d21b-505c-b88d-a924bc36cf17_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 553274,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/648/4079f3de9cdf4efea4c723b47bb705fc/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT Variant Executive 2.0 TDI 90kW (122CV) D',
 'transmission': 'manual',
 'trim': 'Variant Executive 2.0 TDI 90kW (122CV) D',
 'vin': None,
 'year': 2022}
2026-03-25 18:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983329%27 HTTP/1.1" 200 None
2026-03-25 18:34:38 [ayvens.es] INFO: Saving data for 1983329: {'created_time': 1774463678.485088, 'last_price_update_time': 1774463678.485098, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983329') HTTP/1.1" 204 0
2026-03-25 18:34:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f6481a1d-4cbf-5930-8bdd-b162c36ff6e3 with identifier: 1983332
2026-03-25 18:34:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:34:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f6481a1d-4cbf-5930-8bdd-b162c36ff6e3 with identifier: 1983332
2026-03-25 18:34:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f6481a1d-4cbf-5930-8bdd-b162c36ff6e3 with identifier: 1983332 to the API
2026-03-25 18:34:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/316/ab67115dea144516a162e9cd4b422e43/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'Plata pirita',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f6481a1d-4cbf-5930-8bdd-b162c36ff6e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT',
 'odometer': 50349,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6481a1d-4cbf-5930-8bdd-b162c36ff6e3/f6481a1d-4cbf-5930-8bdd-b162c36ff6e3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 572349,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/316/ab67115dea144516a162e9cd4b422e43/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT Executive 2.0 TDI 90kW (122CV) DSG',
 'transmission': 'manual',
 'trim': 'Executive 2.0 TDI 90kW (122CV) DSG',
 'vin': None,
 'year': 2020}
2026-03-25 18:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983332%27 HTTP/1.1" 200 None
2026-03-25 18:34:38 [ayvens.es] INFO: Saving data for 1983332: {'created_time': 1774463678.982599, 'last_price_update_time': 1774463678.982609, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983332') HTTP/1.1" 204 0
2026-03-25 18:34:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b2ec4c0a-319a-53b9-b8f8-4d1b33c4ef40 with identifier: 1983333
2026-03-25 18:34:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b2ec4c0a-319a-53b9-b8f8-4d1b33c4ef40 with identifier: 1983333
2026-03-25 18:34:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b2ec4c0a-319a-53b9-b8f8-4d1b33c4ef40 with identifier: 1983333 to the API
2026-03-25 18:34:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/177/129e3b922cd94e819179a2fbe3596566/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'British green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b2ec4c0a-319a-53b9-b8f8-4d1b33c4ef40',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'COUNTRYMAN',
 'odometer': 89132,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2ec4c0a-319a-53b9-b8f8-4d1b33c4ef40/b2ec4c0a-319a-53b9-b8f8-4d1b33c4ef40_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 339963,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/177/129e3b922cd94e819179a2fbe3596566/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI COUNTRYMAN Cooper',
 'transmission': 'manual',
 'trim': 'Cooper',
 'vin': None,
 'year': 2022}
2026-03-25 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983333%27 HTTP/1.1" 200 None
2026-03-25 18:34:39 [ayvens.es] INFO: Saving data for 1983333: {'created_time': 1774463679.275704, 'last_price_update_time': 1774463679.275713, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983333') HTTP/1.1" 204 0
2026-03-25 18:34:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/819/db6fd6488d2644bba9cef1cf5a8f696a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:39 [ayvens.es] INFO: Found listing with ID: 1983351
2026-03-25 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983351%27 HTTP/1.1" 200 None
2026-03-25 18:34:39 [ayvens.es] INFO: Scrape type for 1983351: 1
2026-03-25 18:34:39 [ayvens.es] INFO: Extracting data for car ID: 1983351
2026-03-25 18:34:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b55f1116-b4b3-51bc-9328-9eefbcd5f89b with identifier: 1983351
2026-03-25 18:34:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b55f1116-b4b3-51bc-9328-9eefbcd5f89b with scrape type 1
2026-03-25 18:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b55f1116-b4b3-51bc-9328-9eefbcd5f89b
2026-03-25 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F735%252F0880ad3dee584fe3aff6310c04b9b0fd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/735/0880ad3dee584fe3aff6310c04b9b0fd/images/large/1.jpg not downloaded yet
2026-03-25 18:34:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ea3c450>
2026-03-25 18:34:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5434c540-9d70-5196-8914-8fd8308d0bde/5434c540-9d70-5196-8914-8fd8308d0bde_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F525%252F145406586c674a329870640eb1ae95ff%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/525/145406586c674a329870640eb1ae95ff/images/large/1.jpg saved to cache
2026-03-25 18:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5434c540-9d70-5196-8914-8fd8308d0bde
2026-03-25 18:34:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5434c540-9d70-5196-8914-8fd8308d0bde, skipping ID generation
2026-03-25 18:34:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5434c540-9d70-5196-8914-8fd8308d0bde with scrape type 1
2026-03-25 18:34:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5434c540-9d70-5196-8914-8fd8308d0bde sending to next pipeline
2026-03-25 18:34:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5434c540-9d70-5196-8914-8fd8308d0bde, identifier: 1983334
2026-03-25 18:34:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8f250910>
2026-03-25 18:34:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58503a43-efc7-5192-b461-17a58e20af74/58503a43-efc7-5192-b461-17a58e20af74_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F597%252F58fc2c612df74c80b5e54f61a941b527%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/597/58fc2c612df74c80b5e54f61a941b527/images/large/1.jpg saved to cache
2026-03-25 18:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 58503a43-efc7-5192-b461-17a58e20af74
2026-03-25 18:34:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 58503a43-efc7-5192-b461-17a58e20af74, skipping ID generation
2026-03-25 18:34:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58503a43-efc7-5192-b461-17a58e20af74 with scrape type 1
2026-03-25 18:34:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 58503a43-efc7-5192-b461-17a58e20af74 sending to next pipeline
2026-03-25 18:34:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 58503a43-efc7-5192-b461-17a58e20af74, identifier: 1983335
2026-03-25 18:34:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e5ba010>
2026-03-25 18:34:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef84855c-a0e7-5547-a2b9-d5799e30c11a/ef84855c-a0e7-5547-a2b9-d5799e30c11a_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F885%252Fbd9d356170f94c86ae62cf52853d777e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/885/bd9d356170f94c86ae62cf52853d777e/images/large/1.jpg saved to cache
2026-03-25 18:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ef84855c-a0e7-5547-a2b9-d5799e30c11a
2026-03-25 18:34:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ef84855c-a0e7-5547-a2b9-d5799e30c11a, skipping ID generation
2026-03-25 18:34:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef84855c-a0e7-5547-a2b9-d5799e30c11a with scrape type 1
2026-03-25 18:34:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ef84855c-a0e7-5547-a2b9-d5799e30c11a sending to next pipeline
2026-03-25 18:34:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ef84855c-a0e7-5547-a2b9-d5799e30c11a, identifier: 1983336
2026-03-25 18:34:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ef9a4d0>
2026-03-25 18:34:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf1ee3fe-6a58-5722-9221-3e396fdd98e2/bf1ee3fe-6a58-5722-9221-3e396fdd98e2_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F911%252F3143149f9afd43d881fa1f3b28f46467%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/911/3143149f9afd43d881fa1f3b28f46467/images/large/1.jpg saved to cache
2026-03-25 18:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bf1ee3fe-6a58-5722-9221-3e396fdd98e2
2026-03-25 18:34:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bf1ee3fe-6a58-5722-9221-3e396fdd98e2, skipping ID generation
2026-03-25 18:34:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf1ee3fe-6a58-5722-9221-3e396fdd98e2 with scrape type 1
2026-03-25 18:34:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bf1ee3fe-6a58-5722-9221-3e396fdd98e2 sending to next pipeline
2026-03-25 18:34:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: bf1ee3fe-6a58-5722-9221-3e396fdd98e2, identifier: 1983337
2026-03-25 18:34:40 [ayvens.es] INFO: Found listing with ID: 1983352
2026-03-25 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983352%27 HTTP/1.1" 200 None
2026-03-25 18:34:40 [ayvens.es] INFO: Scrape type for 1983352: 1
2026-03-25 18:34:40 [ayvens.es] INFO: Extracting data for car ID: 1983352
2026-03-25 18:34:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66746b94-acab-52e8-9165-0f0e597c0130 with identifier: 1983352
2026-03-25 18:34:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66746b94-acab-52e8-9165-0f0e597c0130 with scrape type 1
2026-03-25 18:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 66746b94-acab-52e8-9165-0f0e597c0130
2026-03-25 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F153%252F8ffaacede2b946bbbfedb43dc70700f2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/153/8ffaacede2b946bbbfedb43dc70700f2/images/large/1.jpg not downloaded yet
2026-03-25 18:34:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5434c540-9d70-5196-8914-8fd8308d0bde with identifier: 1983334
2026-03-25 18:34:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5434c540-9d70-5196-8914-8fd8308d0bde with identifier: 1983334
2026-03-25 18:34:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5434c540-9d70-5196-8914-8fd8308d0bde with identifier: 1983334 to the API
2026-03-25 18:34:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/525/145406586c674a329870640eb1ae95ff/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '5434c540-9d70-5196-8914-8fd8308d0bde',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ARONA',
 'odometer': 101245,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5434c540-9d70-5196-8914-8fd8308d0bde/5434c540-9d70-5196-8914-8fd8308d0bde_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 492976,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/525/145406586c674a329870640eb1ae95ff/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ARONA 1.6 TDI 70kW (95CV) Style Ecomotive',
 'transmission': 'manual',
 'trim': '1.6 TDI 70kW (95CV) Style Ecomotive',
 'vin': None,
 'year': 2020}
2026-03-25 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983334%27 HTTP/1.1" 200 None
2026-03-25 18:34:40 [ayvens.es] INFO: Saving data for 1983334: {'created_time': 1774463680.379857, 'last_price_update_time': 1774463680.379869, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983334') HTTP/1.1" 204 0
2026-03-25 18:34:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 58503a43-efc7-5192-b461-17a58e20af74 with identifier: 1983335
2026-03-25 18:34:40 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:34:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 58503a43-efc7-5192-b461-17a58e20af74 with identifier: 1983335
2026-03-25 18:34:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 58503a43-efc7-5192-b461-17a58e20af74 with identifier: 1983335 to the API
2026-03-25 18:34:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/597/58fc2c612df74c80b5e54f61a941b527/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'Atlas white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '58503a43-efc7-5192-b461-17a58e20af74',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'TUCSON',
 'odometer': 201867,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58503a43-efc7-5192-b461-17a58e20af74/58503a43-efc7-5192-b461-17a58e20af74_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 360803,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/597/58fc2c612df74c80b5e54f61a941b527/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI TUCSON 1.6 CRDI 100kW (136CV) 48V Maxx',
 'transmission': 'manual',
 'trim': '1.6 CRDI 100kW (136CV) 48V Maxx',
 'vin': None,
 'year': 2023}
2026-03-25 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983335%27 HTTP/1.1" 200 None
2026-03-25 18:34:40 [ayvens.es] INFO: Saving data for 1983335: {'created_time': 1774463680.954405, 'last_price_update_time': 1774463680.954416, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983335') HTTP/1.1" 204 0
2026-03-25 18:34:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ef84855c-a0e7-5547-a2b9-d5799e30c11a with identifier: 1983336
2026-03-25 18:34:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ef84855c-a0e7-5547-a2b9-d5799e30c11a with identifier: 1983336
2026-03-25 18:34:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ef84855c-a0e7-5547-a2b9-d5799e30c11a with identifier: 1983336 to the API
2026-03-25 18:34:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/885/bd9d356170f94c86ae62cf52853d777e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 96,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'ef84855c-a0e7-5547-a2b9-d5799e30c11a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'CORSA',
 'odometer': 67434,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef84855c-a0e7-5547-a2b9-d5799e30c11a/ef84855c-a0e7-5547-a2b9-d5799e30c11a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332614,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/885/bd9d356170f94c86ae62cf52853d777e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL CORSA 1.2T XHL 74kW (100CV) Edition',
 'transmission': 'manual',
 'trim': '1.2T XHL 74kW (100CV) Edition',
 'vin': None,
 'year': 2020}
2026-03-25 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983336%27 HTTP/1.1" 200 None
2026-03-25 18:34:41 [ayvens.es] INFO: Saving data for 1983336: {'created_time': 1774463681.250878, 'last_price_update_time': 1774463681.250888, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983336') HTTP/1.1" 204 0
2026-03-25 18:34:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: bf1ee3fe-6a58-5722-9221-3e396fdd98e2 with identifier: 1983337
2026-03-25 18:34:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: bf1ee3fe-6a58-5722-9221-3e396fdd98e2 with identifier: 1983337
2026-03-25 18:34:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: bf1ee3fe-6a58-5722-9221-3e396fdd98e2 with identifier: 1983337 to the API
2026-03-25 18:34:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/911/3143149f9afd43d881fa1f3b28f46467/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'bf1ee3fe-6a58-5722-9221-3e396fdd98e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '208',
 'odometer': 66489,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf1ee3fe-6a58-5722-9221-3e396fdd98e2/bf1ee3fe-6a58-5722-9221-3e396fdd98e2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 359761,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/911/3143149f9afd43d881fa1f3b28f46467/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 208 BlueHDi 73kW (100CV) Active',
 'transmission': 'manual',
 'trim': 'BlueHDi 73kW (100CV) Active',
 'vin': None,
 'year': 2022}
2026-03-25 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983337%27 HTTP/1.1" 200 None
2026-03-25 18:34:41 [ayvens.es] INFO: Saving data for 1983337: {'created_time': 1774463681.545239, 'last_price_update_time': 1774463681.545254, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983337') HTTP/1.1" 204 0
2026-03-25 18:34:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/363/b84b29bd3e4b4fedaf6063b46d02d194/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:41 [ayvens.es] INFO: Found listing with ID: 1983353
2026-03-25 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983353%27 HTTP/1.1" 200 None
2026-03-25 18:34:41 [ayvens.es] INFO: Scrape type for 1983353: 1
2026-03-25 18:34:41 [ayvens.es] INFO: Extracting data for car ID: 1983353
2026-03-25 18:34:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36259515-2319-584b-a6b8-044eb2af76d7 with identifier: 1983353
2026-03-25 18:34:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36259515-2319-584b-a6b8-044eb2af76d7 with scrape type 1
2026-03-25 18:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 36259515-2319-584b-a6b8-044eb2af76d7
2026-03-25 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F220%252Fb08ffe114a3e432a96ae0daf26af7c2c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/220/b08ffe114a3e432a96ae0daf26af7c2c/images/large/1.jpg not downloaded yet
2026-03-25 18:34:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/516/3256688c7a634536ab80e1b0e5892e9f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/944/df7c7f4f011a465699f557aa369ac87d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/490/478656d86c5247028ee6bc57f8636a4b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/107/b31cbde0869f4b4a9db36cd8a58faaa1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/338/b204408395b543c6893a985781469aa1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/954/34748f0c2d0a4687bcf1168bce115d43/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:41 [ayvens.es] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 400
2026-03-25 18:34:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8f08c310>
2026-03-25 18:34:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d46d0f53-3f53-5d65-9a71-dca27c218565/d46d0f53-3f53-5d65-9a71-dca27c218565_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F819%252Fdb6fd6488d2644bba9cef1cf5a8f696a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/819/db6fd6488d2644bba9cef1cf5a8f696a/images/large/1.jpg saved to cache
2026-03-25 18:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d46d0f53-3f53-5d65-9a71-dca27c218565
2026-03-25 18:34:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d46d0f53-3f53-5d65-9a71-dca27c218565, skipping ID generation
2026-03-25 18:34:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d46d0f53-3f53-5d65-9a71-dca27c218565 with scrape type 1
2026-03-25 18:34:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d46d0f53-3f53-5d65-9a71-dca27c218565 sending to next pipeline
2026-03-25 18:34:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d46d0f53-3f53-5d65-9a71-dca27c218565, identifier: 1983338
2026-03-25 18:34:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d46d0f53-3f53-5d65-9a71-dca27c218565 with identifier: 1983338
2026-03-25 18:34:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:34:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d46d0f53-3f53-5d65-9a71-dca27c218565 with identifier: 1983338
2026-03-25 18:34:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d46d0f53-3f53-5d65-9a71-dca27c218565 with identifier: 1983338 to the API
2026-03-25 18:34:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/819/db6fd6488d2644bba9cef1cf5a8f696a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'color': 'Sophistograu',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd46d0f53-3f53-5d65-9a71-dca27c218565',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X4',
 'odometer': 39524,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d46d0f53-3f53-5d65-9a71-dca27c218565/d46d0f53-3f53-5d65-9a71-dca27c218565_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 484063,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/819/db6fd6488d2644bba9cef1cf5a8f696a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X4 xDrive20d',
 'transmission': 'manual',
 'trim': 'xDrive20d',
 'vin': None,
 'year': 2021}
2026-03-25 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983338%27 HTTP/1.1" 200 None
2026-03-25 18:34:42 [ayvens.es] INFO: Saving data for 1983338: {'created_time': 1774463682.061017, 'last_price_update_time': 1774463682.06103, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983338') HTTP/1.1" 204 0
2026-03-25 18:34:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/150/a13960833d3f4a0087878ece60c9ae3a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 18:34:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ee9c810>
2026-03-25 18:34:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a8e7637-a87f-5ea7-8633-57101f65215e/0a8e7637-a87f-5ea7-8633-57101f65215e_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F363%252Fb84b29bd3e4b4fedaf6063b46d02d194%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/363/b84b29bd3e4b4fedaf6063b46d02d194/images/large/1.jpg saved to cache
2026-03-25 18:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0a8e7637-a87f-5ea7-8633-57101f65215e
2026-03-25 18:34:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0a8e7637-a87f-5ea7-8633-57101f65215e, skipping ID generation
2026-03-25 18:34:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a8e7637-a87f-5ea7-8633-57101f65215e with scrape type 1
2026-03-25 18:34:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0a8e7637-a87f-5ea7-8633-57101f65215e sending to next pipeline
2026-03-25 18:34:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0a8e7637-a87f-5ea7-8633-57101f65215e, identifier: 1983339
2026-03-25 18:34:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8efb8a90>
2026-03-25 18:34:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b61dfe9-0f8d-5667-abf6-7f517d0ca3ec/5b61dfe9-0f8d-5667-abf6-7f517d0ca3ec_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F516%252F3256688c7a634536ab80e1b0e5892e9f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/516/3256688c7a634536ab80e1b0e5892e9f/images/large/1.jpg saved to cache
2026-03-25 18:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5b61dfe9-0f8d-5667-abf6-7f517d0ca3ec
2026-03-25 18:34:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5b61dfe9-0f8d-5667-abf6-7f517d0ca3ec, skipping ID generation
2026-03-25 18:34:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b61dfe9-0f8d-5667-abf6-7f517d0ca3ec with scrape type 1
2026-03-25 18:34:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5b61dfe9-0f8d-5667-abf6-7f517d0ca3ec sending to next pipeline
2026-03-25 18:34:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 5b61dfe9-0f8d-5667-abf6-7f517d0ca3ec, identifier: 1983340
2026-03-25 18:34:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ea8b050>
2026-03-25 18:34:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_055d1592-5463-5a62-94f9-8ee355fd6d47/055d1592-5463-5a62-94f9-8ee355fd6d47_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F944%252Fdf7c7f4f011a465699f557aa369ac87d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/944/df7c7f4f011a465699f557aa369ac87d/images/large/1.jpg saved to cache
2026-03-25 18:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 055d1592-5463-5a62-94f9-8ee355fd6d47
2026-03-25 18:34:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 055d1592-5463-5a62-94f9-8ee355fd6d47, skipping ID generation
2026-03-25 18:34:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 055d1592-5463-5a62-94f9-8ee355fd6d47 with scrape type 1
2026-03-25 18:34:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 055d1592-5463-5a62-94f9-8ee355fd6d47 sending to next pipeline
2026-03-25 18:34:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 055d1592-5463-5a62-94f9-8ee355fd6d47, identifier: 1983343
2026-03-25 18:34:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8f19d410>
2026-03-25 18:34:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_167a4e15-afcd-5752-bf5e-435dae7e3122/167a4e15-afcd-5752-bf5e-435dae7e3122_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F490%252F478656d86c5247028ee6bc57f8636a4b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/490/478656d86c5247028ee6bc57f8636a4b/images/large/1.jpg saved to cache
2026-03-25 18:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 167a4e15-afcd-5752-bf5e-435dae7e3122
2026-03-25 18:34:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 167a4e15-afcd-5752-bf5e-435dae7e3122, skipping ID generation
2026-03-25 18:34:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 167a4e15-afcd-5752-bf5e-435dae7e3122 with scrape type 1
2026-03-25 18:34:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 167a4e15-afcd-5752-bf5e-435dae7e3122 sending to next pipeline
2026-03-25 18:34:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 167a4e15-afcd-5752-bf5e-435dae7e3122, identifier: 1983341
2026-03-25 18:34:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8f1a2450>
2026-03-25 18:34:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d0e611b-0142-5671-b50f-fb9be16346a4/7d0e611b-0142-5671-b50f-fb9be16346a4_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F107%252Fb31cbde0869f4b4a9db36cd8a58faaa1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/107/b31cbde0869f4b4a9db36cd8a58faaa1/images/large/1.jpg saved to cache
2026-03-25 18:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7d0e611b-0142-5671-b50f-fb9be16346a4
2026-03-25 18:34:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7d0e611b-0142-5671-b50f-fb9be16346a4, skipping ID generation
2026-03-25 18:34:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d0e611b-0142-5671-b50f-fb9be16346a4 with scrape type 1
2026-03-25 18:34:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7d0e611b-0142-5671-b50f-fb9be16346a4 sending to next pipeline
2026-03-25 18:34:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7d0e611b-0142-5671-b50f-fb9be16346a4, identifier: 1983345
2026-03-25 18:34:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ee0a210>
2026-03-25 18:34:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad9009e4-2d8c-5067-a595-70871e06c7c5/ad9009e4-2d8c-5067-a595-70871e06c7c5_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F338%252Fb204408395b543c6893a985781469aa1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/338/b204408395b543c6893a985781469aa1/images/large/1.jpg saved to cache
2026-03-25 18:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ad9009e4-2d8c-5067-a595-70871e06c7c5
2026-03-25 18:34:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ad9009e4-2d8c-5067-a595-70871e06c7c5, skipping ID generation
2026-03-25 18:34:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad9009e4-2d8c-5067-a595-70871e06c7c5 with scrape type 1
2026-03-25 18:34:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ad9009e4-2d8c-5067-a595-70871e06c7c5 sending to next pipeline
2026-03-25 18:34:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ad9009e4-2d8c-5067-a595-70871e06c7c5, identifier: 1983342
2026-03-25 18:34:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8efbbf90>
2026-03-25 18:34:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94a8ac4d-8188-50b7-819c-47d3281b3c6e/94a8ac4d-8188-50b7-819c-47d3281b3c6e_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F954%252F34748f0c2d0a4687bcf1168bce115d43%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/954/34748f0c2d0a4687bcf1168bce115d43/images/large/1.jpg saved to cache
2026-03-25 18:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 94a8ac4d-8188-50b7-819c-47d3281b3c6e
2026-03-25 18:34:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 94a8ac4d-8188-50b7-819c-47d3281b3c6e, skipping ID generation
2026-03-25 18:34:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94a8ac4d-8188-50b7-819c-47d3281b3c6e with scrape type 1
2026-03-25 18:34:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 94a8ac4d-8188-50b7-819c-47d3281b3c6e sending to next pipeline
2026-03-25 18:34:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 94a8ac4d-8188-50b7-819c-47d3281b3c6e, identifier: 1983344
2026-03-25 18:34:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0a8e7637-a87f-5ea7-8633-57101f65215e with identifier: 1983339
2026-03-25 18:34:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0a8e7637-a87f-5ea7-8633-57101f65215e with identifier: 1983339
2026-03-25 18:34:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0a8e7637-a87f-5ea7-8633-57101f65215e with identifier: 1983339 to the API
2026-03-25 18:34:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/363/b84b29bd3e4b4fedaf6063b46d02d194/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'Cassa white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '0a8e7637-a87f-5ea7-8633-57101f65215e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'SPORTAGE',
 'odometer': 87681,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a8e7637-a87f-5ea7-8633-57101f65215e/0a8e7637-a87f-5ea7-8633-57101f65215e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 474299,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/363/b84b29bd3e4b4fedaf6063b46d02d194/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA SPORTAGE 1.6 MHEV Business 100kW (136CV) 4x4',
 'transmission': 'manual',
 'trim': '1.6 MHEV Business 100kW (136CV) 4x4',
 'vin': None,
 'year': 2020}
2026-03-25 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983339%27 HTTP/1.1" 200 None
2026-03-25 18:34:43 [ayvens.es] INFO: Saving data for 1983339: {'created_time': 1774463683.601389, 'last_price_update_time': 1774463683.6014, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983339') HTTP/1.1" 204 0
2026-03-25 18:34:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 5b61dfe9-0f8d-5667-abf6-7f517d0ca3ec with identifier: 1983340
2026-03-25 18:34:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 5b61dfe9-0f8d-5667-abf6-7f517d0ca3ec with identifier: 1983340
2026-03-25 18:34:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 5b61dfe9-0f8d-5667-abf6-7f517d0ca3ec with identifier: 1983340 to the API
2026-03-25 18:34:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/516/3256688c7a634536ab80e1b0e5892e9f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '5b61dfe9-0f8d-5667-abf6-7f517d0ca3ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '208',
 'odometer': 61769,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b61dfe9-0f8d-5667-abf6-7f517d0ca3ec/5b61dfe9-0f8d-5667-abf6-7f517d0ca3ec_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 583850,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/516/3256688c7a634536ab80e1b0e5892e9f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 208 BlueHDi 73kW (100CV) Active',
 'transmission': 'manual',
 'trim': 'BlueHDi 73kW (100CV) Active',
 'vin': None,
 'year': 2022}
2026-03-25 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983340%27 HTTP/1.1" 200 None
2026-03-25 18:34:43 [ayvens.es] INFO: Saving data for 1983340: {'created_time': 1774463683.891157, 'last_price_update_time': 1774463683.891169, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983340') HTTP/1.1" 204 0
2026-03-25 18:34:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 055d1592-5463-5a62-94f9-8ee355fd6d47 with identifier: 1983343
2026-03-25 18:34:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 055d1592-5463-5a62-94f9-8ee355fd6d47 with identifier: 1983343
2026-03-25 18:34:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 055d1592-5463-5a62-94f9-8ee355fd6d47 with identifier: 1983343 to the API
2026-03-25 18:34:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/944/df7c7f4f011a465699f557aa369ac87d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 246,
 'color': 'Serie',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.3L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '055d1592-5463-5a62-94f9-8ee355fd6d47',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'IVECO',
 'model': 'DAILY',
 'odometer': 124622,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_055d1592-5463-5a62-94f9-8ee355fd6d47/055d1592-5463-5a62-94f9-8ee355fd6d47_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 481403,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/944/df7c7f4f011a465699f557aa369ac87d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-28',
 'seats_number': 3,
 'seller_name': None,
 'title': 'IVECO DAILY 2.3 TD 33S 16 V 3520/H2 12 M3+++Revisar peritacion+++',
 'transmission': 'manual',
 'trim': '2.3 TD 33S 16 V 3520/H2 12 M3+++Revisar peritacion+++',
 'vin': None,
 'year': 2021}
2026-03-25 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983343%27 HTTP/1.1" 200 None
2026-03-25 18:34:44 [ayvens.es] INFO: Saving data for 1983343: {'created_time': 1774463684.181676, 'last_price_update_time': 1774463684.181686, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983343') HTTP/1.1" 204 0
2026-03-25 18:34:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 167a4e15-afcd-5752-bf5e-435dae7e3122 with identifier: 1983341
2026-03-25 18:34:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 167a4e15-afcd-5752-bf5e-435dae7e3122 with identifier: 1983341
2026-03-25 18:34:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 167a4e15-afcd-5752-bf5e-435dae7e3122 with identifier: 1983341 to the API
2026-03-25 18:34:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/490/478656d86c5247028ee6bc57f8636a4b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '167a4e15-afcd-5752-bf5e-435dae7e3122',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KAROQ',
 'odometer': 99723,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_167a4e15-afcd-5752-bf5e-435dae7e3122/167a4e15-afcd-5752-bf5e-435dae7e3122_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 357237,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/490/478656d86c5247028ee6bc57f8636a4b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA KAROQ 2.0 TDI 110kW (150CV) DSG 4X4 Ambition',
 'transmission': 'manual',
 'trim': '2.0 TDI 110kW (150CV) DSG 4X4 Ambition',
 'vin': None,
 'year': 2022}
2026-03-25 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983341%27 HTTP/1.1" 200 None
2026-03-25 18:34:44 [ayvens.es] INFO: Saving data for 1983341: {'created_time': 1774463684.471598, 'last_price_update_time': 1774463684.471608, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983341') HTTP/1.1" 204 0
2026-03-25 18:34:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7d0e611b-0142-5671-b50f-fb9be16346a4 with identifier: 1983345
2026-03-25 18:34:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7d0e611b-0142-5671-b50f-fb9be16346a4 with identifier: 1983345
2026-03-25 18:34:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7d0e611b-0142-5671-b50f-fb9be16346a4 with identifier: 1983345 to the API
2026-03-25 18:34:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/107/b31cbde0869f4b4a9db36cd8a58faaa1/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 220,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '7d0e611b-0142-5671-b50f-fb9be16346a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'RANGER',
 'odometer': 182799,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d0e611b-0142-5671-b50f-fb9be16346a4/7d0e611b-0142-5671-b50f-fb9be16346a4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 334645,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/107/b31cbde0869f4b4a9db36cd8a58faaa1/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD RANGER 2.0 Ecoblue 125kW 4x4 Doble Cab. XL S/S+++Revisar '
          'peritacion+++',
 'transmission': 'manual',
 'trim': '2.0 Ecoblue 125kW 4x4 Doble Cab. XL S/S+++Revisar peritacion+++',
 'vin': None,
 'year': 2021}
2026-03-25 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983345%27 HTTP/1.1" 200 None
2026-03-25 18:34:44 [ayvens.es] INFO: Saving data for 1983345: {'created_time': 1774463684.76803, 'last_price_update_time': 1774463684.768043, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983345') HTTP/1.1" 204 0
2026-03-25 18:34:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ad9009e4-2d8c-5067-a595-70871e06c7c5 with identifier: 1983342
2026-03-25 18:34:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ad9009e4-2d8c-5067-a595-70871e06c7c5 with identifier: 1983342
2026-03-25 18:34:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ad9009e4-2d8c-5067-a595-70871e06c7c5 with identifier: 1983342 to the API
2026-03-25 18:34:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/338/b204408395b543c6893a985781469aa1/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 164,
 'color': 'Cassa white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ad9009e4-2d8c-5067-a595-70871e06c7c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'SPORTAGE',
 'odometer': 112766,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad9009e4-2d8c-5067-a595-70871e06c7c5/ad9009e4-2d8c-5067-a595-70871e06c7c5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 345802,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/338/b204408395b543c6893a985781469aa1/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA SPORTAGE 1.6 MHEV Business 100kW (136CV) 4x4',
 'transmission': 'manual',
 'trim': '1.6 MHEV Business 100kW (136CV) 4x4',
 'vin': None,
 'year': 2021}
2026-03-25 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983342%27 HTTP/1.1" 200 None
2026-03-25 18:34:45 [ayvens.es] INFO: Saving data for 1983342: {'created_time': 1774463685.063437, 'last_price_update_time': 1774463685.063449, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983342') HTTP/1.1" 204 0
2026-03-25 18:34:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 94a8ac4d-8188-50b7-819c-47d3281b3c6e with identifier: 1983344
2026-03-25 18:34:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 94a8ac4d-8188-50b7-819c-47d3281b3c6e with identifier: 1983344
2026-03-25 18:34:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 94a8ac4d-8188-50b7-819c-47d3281b3c6e with identifier: 1983344 to the API
2026-03-25 18:34:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/954/34748f0c2d0a4687bcf1168bce115d43/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'color': 'Blanco glaciar',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '94a8ac4d-8188-50b7-819c-47d3281b3c6e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'DACIA',
 'model': 'DUSTER',
 'odometer': 112422,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94a8ac4d-8188-50b7-819c-47d3281b3c6e/94a8ac4d-8188-50b7-819c-47d3281b3c6e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 348117,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/954/34748f0c2d0a4687bcf1168bce115d43/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DACIA DUSTER Prestige Bl. dCi 85kW(115CV) 4X4+++Revisar '
          'peritacion+++',
 'transmission': 'manual',
 'trim': 'Prestige Bl. dCi 85kW(115CV) 4X4+++Revisar peritacion+++',
 'vin': None,
 'year': 2021}
2026-03-25 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983344%27 HTTP/1.1" 200 None
2026-03-25 18:34:45 [ayvens.es] INFO: Saving data for 1983344: {'created_time': 1774463685.357056, 'last_price_update_time': 1774463685.357066, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983344') HTTP/1.1" 204 0
2026-03-25 18:34:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/992/dc98fb52306d48d5a7da08f63b6c0e85/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8d42e410>
2026-03-25 18:34:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cea8245-42dd-59b8-a9bd-38ee1aaa6ca2/0cea8245-42dd-59b8-a9bd-38ee1aaa6ca2_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F150%252Fa13960833d3f4a0087878ece60c9ae3a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/150/a13960833d3f4a0087878ece60c9ae3a/images/large/1.jpg saved to cache
2026-03-25 18:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0cea8245-42dd-59b8-a9bd-38ee1aaa6ca2
2026-03-25 18:34:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0cea8245-42dd-59b8-a9bd-38ee1aaa6ca2, skipping ID generation
2026-03-25 18:34:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cea8245-42dd-59b8-a9bd-38ee1aaa6ca2 with scrape type 1
2026-03-25 18:34:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0cea8245-42dd-59b8-a9bd-38ee1aaa6ca2 sending to next pipeline
2026-03-25 18:34:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 0cea8245-42dd-59b8-a9bd-38ee1aaa6ca2, identifier: 1983346
2026-03-25 18:34:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/735/0880ad3dee584fe3aff6310c04b9b0fd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/662/619561454b5e406eb7602359406e894e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 0cea8245-42dd-59b8-a9bd-38ee1aaa6ca2 with identifier: 1983346
2026-03-25 18:34:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:34:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 0cea8245-42dd-59b8-a9bd-38ee1aaa6ca2 with identifier: 1983346
2026-03-25 18:34:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 0cea8245-42dd-59b8-a9bd-38ee1aaa6ca2 with identifier: 1983346 to the API
2026-03-25 18:34:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/150/a13960833d3f4a0087878ece60c9ae3a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 97,
 'color': 'Azul desert island m',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '0cea8245-42dd-59b8-a9bd-38ee1aaa6ca2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'PUMA',
 'odometer': 68644,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cea8245-42dd-59b8-a9bd-38ee1aaa6ca2/0cea8245-42dd-59b8-a9bd-38ee1aaa6ca2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 377782,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/150/a13960833d3f4a0087878ece60c9ae3a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD PUMA 1.0 EcoBoost 92kW (125cv) Titanium MHEV+++Revisar '
          'peritacion+++',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost 92kW (125cv) Titanium MHEV+++Revisar peritacion+++',
 'vin': None,
 'year': 2020}
2026-03-25 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983346%27 HTTP/1.1" 200 None
2026-03-25 18:34:45 [ayvens.es] INFO: Saving data for 1983346: {'created_time': 1774463685.840778, 'last_price_update_time': 1774463685.840788, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983346') HTTP/1.1" 204 0
2026-03-25 18:34:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/048/c3cb5ea029c94c2ba5dc13eadb4ed2ac/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/979/d670848fd84c49358aa5c7e725f2bb51/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/153/8ffaacede2b946bbbfedb43dc70700f2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/220/b08ffe114a3e432a96ae0daf26af7c2c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ea6f650>
2026-03-25 18:34:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_222fa4c4-1e2d-5824-bec8-c656f6e8d4c5/222fa4c4-1e2d-5824-bec8-c656f6e8d4c5_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F992%252Fdc98fb52306d48d5a7da08f63b6c0e85%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/992/dc98fb52306d48d5a7da08f63b6c0e85/images/large/1.jpg saved to cache
2026-03-25 18:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 222fa4c4-1e2d-5824-bec8-c656f6e8d4c5
2026-03-25 18:34:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 222fa4c4-1e2d-5824-bec8-c656f6e8d4c5, skipping ID generation
2026-03-25 18:34:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 222fa4c4-1e2d-5824-bec8-c656f6e8d4c5 with scrape type 1
2026-03-25 18:34:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 222fa4c4-1e2d-5824-bec8-c656f6e8d4c5 sending to next pipeline
2026-03-25 18:34:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 222fa4c4-1e2d-5824-bec8-c656f6e8d4c5, identifier: 1983350
2026-03-25 18:34:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e5510d0>
2026-03-25 18:34:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b55f1116-b4b3-51bc-9328-9eefbcd5f89b/b55f1116-b4b3-51bc-9328-9eefbcd5f89b_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F735%252F0880ad3dee584fe3aff6310c04b9b0fd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/735/0880ad3dee584fe3aff6310c04b9b0fd/images/large/1.jpg saved to cache
2026-03-25 18:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b55f1116-b4b3-51bc-9328-9eefbcd5f89b
2026-03-25 18:34:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b55f1116-b4b3-51bc-9328-9eefbcd5f89b, skipping ID generation
2026-03-25 18:34:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b55f1116-b4b3-51bc-9328-9eefbcd5f89b with scrape type 1
2026-03-25 18:34:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b55f1116-b4b3-51bc-9328-9eefbcd5f89b sending to next pipeline
2026-03-25 18:34:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b55f1116-b4b3-51bc-9328-9eefbcd5f89b, identifier: 1983351
2026-03-25 18:34:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ea5b690>
2026-03-25 18:34:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_132fdaa0-e466-58f1-a5bb-a390fa3a8d66/132fdaa0-e466-58f1-a5bb-a390fa3a8d66_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F662%252F619561454b5e406eb7602359406e894e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/662/619561454b5e406eb7602359406e894e/images/large/1.jpg saved to cache
2026-03-25 18:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 132fdaa0-e466-58f1-a5bb-a390fa3a8d66
2026-03-25 18:34:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 132fdaa0-e466-58f1-a5bb-a390fa3a8d66, skipping ID generation
2026-03-25 18:34:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 132fdaa0-e466-58f1-a5bb-a390fa3a8d66 with scrape type 1
2026-03-25 18:34:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 132fdaa0-e466-58f1-a5bb-a390fa3a8d66 sending to next pipeline
2026-03-25 18:34:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 132fdaa0-e466-58f1-a5bb-a390fa3a8d66, identifier: 1983348
2026-03-25 18:34:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 222fa4c4-1e2d-5824-bec8-c656f6e8d4c5 with identifier: 1983350
2026-03-25 18:34:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:34:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 222fa4c4-1e2d-5824-bec8-c656f6e8d4c5 with identifier: 1983350
2026-03-25 18:34:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 222fa4c4-1e2d-5824-bec8-c656f6e8d4c5 with identifier: 1983350 to the API
2026-03-25 18:34:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/992/dc98fb52306d48d5a7da08f63b6c0e85/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'Negro perla',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '222fa4c4-1e2d-5824-bec8-c656f6e8d4c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C5 AIRCROSS',
 'odometer': 133209,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_222fa4c4-1e2d-5824-bec8-c656f6e8d4c5/222fa4c4-1e2d-5824-bec8-c656f6e8d4c5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353699,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/992/dc98fb52306d48d5a7da08f63b6c0e85/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C5 AIRCROSS BlueHdi 96kW (130CV) S&S EAT8 Feel',
 'transmission': 'manual',
 'trim': 'BlueHdi 96kW (130CV) S&S EAT8 Feel',
 'vin': None,
 'year': 2020}
2026-03-25 18:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983350%27 HTTP/1.1" 200 None
2026-03-25 18:34:46 [ayvens.es] INFO: Saving data for 1983350: {'created_time': 1774463686.667477, 'last_price_update_time': 1774463686.667489, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983350') HTTP/1.1" 204 0
2026-03-25 18:34:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b55f1116-b4b3-51bc-9328-9eefbcd5f89b with identifier: 1983351
2026-03-25 18:34:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:34:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b55f1116-b4b3-51bc-9328-9eefbcd5f89b with identifier: 1983351
2026-03-25 18:34:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b55f1116-b4b3-51bc-9328-9eefbcd5f89b with identifier: 1983351 to the API
2026-03-25 18:34:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/735/0880ad3dee584fe3aff6310c04b9b0fd/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 151,
 'color': 'Portofino blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b55f1116-b4b3-51bc-9328-9eefbcd5f89b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'JAGUAR',
 'model': 'F-PACE',
 'odometer': 84293,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b55f1116-b4b3-51bc-9328-9eefbcd5f89b/b55f1116-b4b3-51bc-9328-9eefbcd5f89b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 405728,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/735/0880ad3dee584fe3aff6310c04b9b0fd/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'JAGUAR F-PACE 2.0L i4D AWD Automatico Prestige',
 'transmission': 'manual',
 'trim': '2.0L i4D AWD Automatico Prestige',
 'vin': None,
 'year': 2020}
2026-03-25 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983351%27 HTTP/1.1" 200 None
2026-03-25 18:34:47 [ayvens.es] INFO: Saving data for 1983351: {'created_time': 1774463687.011553, 'last_price_update_time': 1774463687.011563, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983351') HTTP/1.1" 204 0
2026-03-25 18:34:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 132fdaa0-e466-58f1-a5bb-a390fa3a8d66 with identifier: 1983348
2026-03-25 18:34:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 132fdaa0-e466-58f1-a5bb-a390fa3a8d66 with identifier: 1983348
2026-03-25 18:34:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 132fdaa0-e466-58f1-a5bb-a390fa3a8d66 with identifier: 1983348 to the API
2026-03-25 18:34:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/662/619561454b5e406eb7602359406e894e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.2L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '132fdaa0-e466-58f1-a5bb-a390fa3a8d66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'FIORINO',
 'odometer': 93744,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_132fdaa0-e466-58f1-a5bb-a390fa3a8d66/132fdaa0-e466-58f1-a5bb-a390fa3a8d66_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 451324,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/662/619561454b5e406eb7602359406e894e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-30',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FIAT FIORINO Cargo Base 1.3 Mjet 59kW (80CV) E6',
 'transmission': 'manual',
 'trim': 'Cargo Base 1.3 Mjet 59kW (80CV) E6',
 'vin': None,
 'year': 2017}
2026-03-25 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983348%27 HTTP/1.1" 200 None
2026-03-25 18:34:47 [ayvens.es] INFO: Saving data for 1983348: {'created_time': 1774463687.292801, 'last_price_update_time': 1774463687.292812, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983348') HTTP/1.1" 204 0
2026-03-25 18:34:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae90a313d0>
2026-03-25 18:34:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd1d46fb-f8d8-580f-a010-43ac5e56e458/cd1d46fb-f8d8-580f-a010-43ac5e56e458_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F048%252Fc3cb5ea029c94c2ba5dc13eadb4ed2ac%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/048/c3cb5ea029c94c2ba5dc13eadb4ed2ac/images/large/1.jpg saved to cache
2026-03-25 18:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cd1d46fb-f8d8-580f-a010-43ac5e56e458
2026-03-25 18:34:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cd1d46fb-f8d8-580f-a010-43ac5e56e458, skipping ID generation
2026-03-25 18:34:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd1d46fb-f8d8-580f-a010-43ac5e56e458 with scrape type 1
2026-03-25 18:34:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cd1d46fb-f8d8-580f-a010-43ac5e56e458 sending to next pipeline
2026-03-25 18:34:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: cd1d46fb-f8d8-580f-a010-43ac5e56e458, identifier: 1983347
2026-03-25 18:34:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ea4a7d0>
2026-03-25 18:34:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_306d75cf-d6c4-5884-afb7-f7b044283c4e/306d75cf-d6c4-5884-afb7-f7b044283c4e_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F979%252Fd670848fd84c49358aa5c7e725f2bb51%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/979/d670848fd84c49358aa5c7e725f2bb51/images/large/1.jpg saved to cache
2026-03-25 18:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 306d75cf-d6c4-5884-afb7-f7b044283c4e
2026-03-25 18:34:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 306d75cf-d6c4-5884-afb7-f7b044283c4e, skipping ID generation
2026-03-25 18:34:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 306d75cf-d6c4-5884-afb7-f7b044283c4e with scrape type 1
2026-03-25 18:34:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 306d75cf-d6c4-5884-afb7-f7b044283c4e sending to next pipeline
2026-03-25 18:34:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 306d75cf-d6c4-5884-afb7-f7b044283c4e, identifier: 1983349
2026-03-25 18:34:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ee78a90>
2026-03-25 18:34:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66746b94-acab-52e8-9165-0f0e597c0130/66746b94-acab-52e8-9165-0f0e597c0130_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F153%252F8ffaacede2b946bbbfedb43dc70700f2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/153/8ffaacede2b946bbbfedb43dc70700f2/images/large/1.jpg saved to cache
2026-03-25 18:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 66746b94-acab-52e8-9165-0f0e597c0130
2026-03-25 18:34:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 66746b94-acab-52e8-9165-0f0e597c0130, skipping ID generation
2026-03-25 18:34:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66746b94-acab-52e8-9165-0f0e597c0130 with scrape type 1
2026-03-25 18:34:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 66746b94-acab-52e8-9165-0f0e597c0130 sending to next pipeline
2026-03-25 18:34:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 66746b94-acab-52e8-9165-0f0e597c0130, identifier: 1983352
2026-03-25 18:34:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ea49e50>
2026-03-25 18:34:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36259515-2319-584b-a6b8-044eb2af76d7/36259515-2319-584b-a6b8-044eb2af76d7_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F220%252Fb08ffe114a3e432a96ae0daf26af7c2c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/220/b08ffe114a3e432a96ae0daf26af7c2c/images/large/1.jpg saved to cache
2026-03-25 18:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 36259515-2319-584b-a6b8-044eb2af76d7
2026-03-25 18:34:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 36259515-2319-584b-a6b8-044eb2af76d7, skipping ID generation
2026-03-25 18:34:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36259515-2319-584b-a6b8-044eb2af76d7 with scrape type 1
2026-03-25 18:34:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 36259515-2319-584b-a6b8-044eb2af76d7 sending to next pipeline
2026-03-25 18:34:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 36259515-2319-584b-a6b8-044eb2af76d7, identifier: 1983353
2026-03-25 18:34:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: cd1d46fb-f8d8-580f-a010-43ac5e56e458 with identifier: 1983347
2026-03-25 18:34:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: cd1d46fb-f8d8-580f-a010-43ac5e56e458 with identifier: 1983347
2026-03-25 18:34:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: cd1d46fb-f8d8-580f-a010-43ac5e56e458 with identifier: 1983347 to the API
2026-03-25 18:34:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/048/c3cb5ea029c94c2ba5dc13eadb4ed2ac/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 172,
 'color': 'Blanco s',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'cd1d46fb-f8d8-580f-a010-43ac5e56e458',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT',
 'odometer': 165212,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd1d46fb-f8d8-580f-a010-43ac5e56e458/cd1d46fb-f8d8-580f-a010-43ac5e56e458_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 557978,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/048/c3cb5ea029c94c2ba5dc13eadb4ed2ac/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-24',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 310 96kW L2H2 Van Trend FWD',
 'transmission': 'manual',
 'trim': '310 96kW L2H2 Van Trend FWD',
 'vin': None,
 'year': 2019}
2026-03-25 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983347%27 HTTP/1.1" 200 None
2026-03-25 18:34:48 [ayvens.es] INFO: Saving data for 1983347: {'created_time': 1774463688.320891, 'last_price_update_time': 1774463688.320906, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983347') HTTP/1.1" 204 0
2026-03-25 18:34:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 306d75cf-d6c4-5884-afb7-f7b044283c4e with identifier: 1983349
2026-03-25 18:34:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 306d75cf-d6c4-5884-afb7-f7b044283c4e with identifier: 1983349
2026-03-25 18:34:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 306d75cf-d6c4-5884-afb7-f7b044283c4e with identifier: 1983349 to the API
2026-03-25 18:34:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/979/d670848fd84c49358aa5c7e725f2bb51/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 92,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '306d75cf-d6c4-5884-afb7-f7b044283c4e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': 96127,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_306d75cf-d6c4-5884-afb7-f7b044283c4e/306d75cf-d6c4-5884-afb7-f7b044283c4e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 462349,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/979/d670848fd84c49358aa5c7e725f2bb51/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FOCUS 1.5 Ecoblue 88kW Trend+',
 'transmission': 'manual',
 'trim': '1.5 Ecoblue 88kW Trend+',
 'vin': None,
 'year': 2020}
2026-03-25 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983349%27 HTTP/1.1" 200 None
2026-03-25 18:34:48 [ayvens.es] INFO: Saving data for 1983349: {'created_time': 1774463688.609021, 'last_price_update_time': 1774463688.609031, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983349') HTTP/1.1" 204 0
2026-03-25 18:34:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 66746b94-acab-52e8-9165-0f0e597c0130 with identifier: 1983352
2026-03-25 18:34:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 66746b94-acab-52e8-9165-0f0e597c0130 with identifier: 1983352
2026-03-25 18:34:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 66746b94-acab-52e8-9165-0f0e597c0130 with identifier: 1983352 to the API
2026-03-25 18:34:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/153/8ffaacede2b946bbbfedb43dc70700f2/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.2L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '66746b94-acab-52e8-9165-0f0e597c0130',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'FIORINO',
 'odometer': 35886,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66746b94-acab-52e8-9165-0f0e597c0130/66746b94-acab-52e8-9165-0f0e597c0130_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 580122,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/153/8ffaacede2b946bbbfedb43dc70700f2/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-27',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FIAT FIORINO (O) Cargo Base N1 1.3 MJet 70 kW (95 CV)',
 'transmission': 'manual',
 'trim': '(O) Cargo Base N1 1.3 MJet 70 kW (95 CV)',
 'vin': None,
 'year': 2021}
2026-03-25 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983352%27 HTTP/1.1" 200 None
2026-03-25 18:34:48 [ayvens.es] INFO: Saving data for 1983352: {'created_time': 1774463688.920528, 'last_price_update_time': 1774463688.920538, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983352') HTTP/1.1" 204 0
2026-03-25 18:34:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 36259515-2319-584b-a6b8-044eb2af76d7 with identifier: 1983353
2026-03-25 18:34:48 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:34:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 36259515-2319-584b-a6b8-044eb2af76d7 with identifier: 1983353
2026-03-25 18:34:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 36259515-2319-584b-a6b8-044eb2af76d7 with identifier: 1983353 to the API
2026-03-25 18:34:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/220/b08ffe114a3e432a96ae0daf26af7c2c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'Blanco glaciar',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '36259515-2319-584b-a6b8-044eb2af76d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'DACIA',
 'model': 'DUSTER',
 'odometer': 293395,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36259515-2319-584b-a6b8-044eb2af76d7/36259515-2319-584b-a6b8-044eb2af76d7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 464791,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/220/b08ffe114a3e432a96ae0daf26af7c2c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DACIA DUSTER Comfort Blue dCi 85kW (115CV) 4X4',
 'transmission': 'manual',
 'trim': 'Comfort Blue dCi 85kW (115CV) 4X4',
 'vin': None,
 'year': 2022}
2026-03-25 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983353%27 HTTP/1.1" 200 None
2026-03-25 18:34:49 [ayvens.es] INFO: Saving data for 1983353: {'created_time': 1774463689.240675, 'last_price_update_time': 1774463689.240688, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983353') HTTP/1.1" 204 0
2026-03-25 18:34:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-25 18:34:49 [ayvens.es] INFO: Found listing with ID: 1983354
2026-03-25 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983354%27 HTTP/1.1" 200 None
2026-03-25 18:34:49 [ayvens.es] INFO: Scrape type for 1983354: 1
2026-03-25 18:34:49 [ayvens.es] INFO: Extracting data for car ID: 1983354
2026-03-25 18:34:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d4d6341-f785-58d8-a20e-6dbb0eeab4a6 with identifier: 1983354
2026-03-25 18:34:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d4d6341-f785-58d8-a20e-6dbb0eeab4a6 with scrape type 1
2026-03-25 18:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3d4d6341-f785-58d8-a20e-6dbb0eeab4a6
2026-03-25 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F705%252Fd62fc18141ae401b8e64d60949c19765%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/705/d62fc18141ae401b8e64d60949c19765/images/large/1.jpg not downloaded yet
2026-03-25 18:34:49 [ayvens.es] INFO: Found listing with ID: 1983355
2026-03-25 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983355%27 HTTP/1.1" 200 None
2026-03-25 18:34:49 [ayvens.es] INFO: Scrape type for 1983355: 1
2026-03-25 18:34:49 [ayvens.es] INFO: Extracting data for car ID: 1983355
2026-03-25 18:34:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84820689-4506-5f49-9705-df4b5564459e with identifier: 1983355
2026-03-25 18:34:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84820689-4506-5f49-9705-df4b5564459e with scrape type 1
2026-03-25 18:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 84820689-4506-5f49-9705-df4b5564459e
2026-03-25 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F531%252F2407e0f6de694df7baee2848c057ffc7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/531/2407e0f6de694df7baee2848c057ffc7/images/large/1.jpg not downloaded yet
2026-03-25 18:34:49 [ayvens.es] INFO: Found listing with ID: 1983356
2026-03-25 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983356%27 HTTP/1.1" 200 None
2026-03-25 18:34:49 [ayvens.es] INFO: Scrape type for 1983356: 1
2026-03-25 18:34:49 [ayvens.es] INFO: Extracting data for car ID: 1983356
2026-03-25 18:34:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60329998-cfeb-53d4-b504-b8335c5f186a with identifier: 1983356
2026-03-25 18:34:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60329998-cfeb-53d4-b504-b8335c5f186a with scrape type 1
2026-03-25 18:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 60329998-cfeb-53d4-b504-b8335c5f186a
2026-03-25 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F849%252F2e45d4d135994c73948f43953ac92ce1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/849/2e45d4d135994c73948f43953ac92ce1/images/large/1.jpg not downloaded yet
2026-03-25 18:34:49 [ayvens.es] INFO: Found listing with ID: 1983357
2026-03-25 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983357%27 HTTP/1.1" 200 None
2026-03-25 18:34:49 [ayvens.es] INFO: Scrape type for 1983357: 1
2026-03-25 18:34:49 [ayvens.es] INFO: Extracting data for car ID: 1983357
2026-03-25 18:34:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29d8f69b-f468-5aea-8639-d190c4a28536 with identifier: 1983357
2026-03-25 18:34:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29d8f69b-f468-5aea-8639-d190c4a28536 with scrape type 1
2026-03-25 18:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 29d8f69b-f468-5aea-8639-d190c4a28536
2026-03-25 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F969%252F03d5408322ec4f258b52c8884d55bad7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/969/03d5408322ec4f258b52c8884d55bad7/images/large/1.jpg not downloaded yet
2026-03-25 18:34:49 [ayvens.es] INFO: Found listing with ID: 1983358
2026-03-25 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983358%27 HTTP/1.1" 200 None
2026-03-25 18:34:49 [ayvens.es] INFO: Scrape type for 1983358: 1
2026-03-25 18:34:49 [ayvens.es] INFO: Extracting data for car ID: 1983358
2026-03-25 18:34:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6cd2a3fc-215b-5477-b9cd-ff41f9130ad2 with identifier: 1983358
2026-03-25 18:34:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cd2a3fc-215b-5477-b9cd-ff41f9130ad2 with scrape type 1
2026-03-25 18:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6cd2a3fc-215b-5477-b9cd-ff41f9130ad2
2026-03-25 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F216%252F293ad3975d88495c8160d7b718eb3feb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/216/293ad3975d88495c8160d7b718eb3feb/images/large/1.jpg not downloaded yet
2026-03-25 18:34:49 [ayvens.es] INFO: Found listing with ID: 1983359
2026-03-25 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983359%27 HTTP/1.1" 200 None
2026-03-25 18:34:49 [ayvens.es] INFO: Scrape type for 1983359: 1
2026-03-25 18:34:49 [ayvens.es] INFO: Extracting data for car ID: 1983359
2026-03-25 18:34:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b939fb27-d4c2-5611-a448-5558db49b031 with identifier: 1983359
2026-03-25 18:34:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b939fb27-d4c2-5611-a448-5558db49b031 with scrape type 1
2026-03-25 18:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b939fb27-d4c2-5611-a448-5558db49b031
2026-03-25 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F049%252F9aa7dd89b59f479a9d09748149b2b4cd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/049/9aa7dd89b59f479a9d09748149b2b4cd/images/large/1.jpg not downloaded yet
2026-03-25 18:34:49 [ayvens.es] INFO: Found listing with ID: 1983360
2026-03-25 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983360%27 HTTP/1.1" 200 None
2026-03-25 18:34:49 [ayvens.es] INFO: Scrape type for 1983360: 1
2026-03-25 18:34:49 [ayvens.es] INFO: Extracting data for car ID: 1983360
2026-03-25 18:34:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6c9f38b-b4aa-5597-b2cf-837ecd137471 with identifier: 1983360
2026-03-25 18:34:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6c9f38b-b4aa-5597-b2cf-837ecd137471 with scrape type 1
2026-03-25 18:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f6c9f38b-b4aa-5597-b2cf-837ecd137471
2026-03-25 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F573%252F18ea94a6207b43a19d2504a51c00d980%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/573/18ea94a6207b43a19d2504a51c00d980/images/large/1.jpg not downloaded yet
2026-03-25 18:34:49 [ayvens.es] INFO: Found listing with ID: 1983361
2026-03-25 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983361%27 HTTP/1.1" 200 None
2026-03-25 18:34:49 [ayvens.es] INFO: Scrape type for 1983361: 1
2026-03-25 18:34:49 [ayvens.es] INFO: Extracting data for car ID: 1983361
2026-03-25 18:34:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e639cc2d-8302-5d90-99ba-645feb377709 with identifier: 1983361
2026-03-25 18:34:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e639cc2d-8302-5d90-99ba-645feb377709 with scrape type 1
2026-03-25 18:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e639cc2d-8302-5d90-99ba-645feb377709
2026-03-25 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F342%252F3a2cfe1f569f4c2e8bdd9954be8dd9a6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/342/3a2cfe1f569f4c2e8bdd9954be8dd9a6/images/large/1.jpg not downloaded yet
2026-03-25 18:34:49 [ayvens.es] INFO: Found listing with ID: 1983362
2026-03-25 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983362%27 HTTP/1.1" 200 None
2026-03-25 18:34:49 [ayvens.es] INFO: Scrape type for 1983362: 1
2026-03-25 18:34:49 [ayvens.es] INFO: Extracting data for car ID: 1983362
2026-03-25 18:34:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c334c5db-ea70-5b62-ad80-bc5ce8958610 with identifier: 1983362
2026-03-25 18:34:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c334c5db-ea70-5b62-ad80-bc5ce8958610 with scrape type 1
2026-03-25 18:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c334c5db-ea70-5b62-ad80-bc5ce8958610
2026-03-25 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F114%252Fbfcd6da546dc4dbcb96aff0aea5abb40%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/114/bfcd6da546dc4dbcb96aff0aea5abb40/images/large/1.jpg not downloaded yet
2026-03-25 18:34:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/705/d62fc18141ae401b8e64d60949c19765/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:49 [ayvens.es] INFO: Found listing with ID: 1983363
2026-03-25 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983363%27 HTTP/1.1" 200 None
2026-03-25 18:34:49 [ayvens.es] INFO: Scrape type for 1983363: 1
2026-03-25 18:34:49 [ayvens.es] INFO: Extracting data for car ID: 1983363
2026-03-25 18:34:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89c8a2c8-80ff-5d49-abf7-752c55ad3d27 with identifier: 1983363
2026-03-25 18:34:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89c8a2c8-80ff-5d49-abf7-752c55ad3d27 with scrape type 1
2026-03-25 18:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 89c8a2c8-80ff-5d49-abf7-752c55ad3d27
2026-03-25 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F562%252Fa4c15f21415c4660bf8e5bb18482398e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/562/a4c15f21415c4660bf8e5bb18482398e/images/large/1.jpg not downloaded yet
2026-03-25 18:34:49 [ayvens.es] INFO: Found listing with ID: 1983364
2026-03-25 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983364%27 HTTP/1.1" 200 None
2026-03-25 18:34:49 [ayvens.es] INFO: Scrape type for 1983364: 1
2026-03-25 18:34:49 [ayvens.es] INFO: Extracting data for car ID: 1983364
2026-03-25 18:34:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84c60246-f163-5410-8f22-b17f08e36342 with identifier: 1983364
2026-03-25 18:34:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84c60246-f163-5410-8f22-b17f08e36342 with scrape type 1
2026-03-25 18:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 84c60246-f163-5410-8f22-b17f08e36342
2026-03-25 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F727%252Fc108199d6cf34fe9ab5242565934e290%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/727/c108199d6cf34fe9ab5242565934e290/images/large/1.jpg not downloaded yet
2026-03-25 18:34:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/531/2407e0f6de694df7baee2848c057ffc7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/969/03d5408322ec4f258b52c8884d55bad7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/849/2e45d4d135994c73948f43953ac92ce1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:49 [ayvens.es] INFO: Found listing with ID: 1983365
2026-03-25 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983365%27 HTTP/1.1" 200 None
2026-03-25 18:34:49 [ayvens.es] INFO: Scrape type for 1983365: 1
2026-03-25 18:34:49 [ayvens.es] INFO: Extracting data for car ID: 1983365
2026-03-25 18:34:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3b6466d-5afd-5fe3-bc91-a48eff2873a0 with identifier: 1983365
2026-03-25 18:34:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3b6466d-5afd-5fe3-bc91-a48eff2873a0 with scrape type 1
2026-03-25 18:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f3b6466d-5afd-5fe3-bc91-a48eff2873a0
2026-03-25 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F351%252F66c86b422ece4b87995cc67be4ced9bf%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/351/66c86b422ece4b87995cc67be4ced9bf/images/large/1.jpg not downloaded yet
2026-03-25 18:34:49 [ayvens.es] INFO: Found listing with ID: 1983366
2026-03-25 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983366%27 HTTP/1.1" 200 None
2026-03-25 18:34:49 [ayvens.es] INFO: Scrape type for 1983366: 1
2026-03-25 18:34:49 [ayvens.es] INFO: Extracting data for car ID: 1983366
2026-03-25 18:34:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f90fdc52-0dc9-5e06-9a8d-bab2b50ddbb4 with identifier: 1983366
2026-03-25 18:34:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f90fdc52-0dc9-5e06-9a8d-bab2b50ddbb4 with scrape type 1
2026-03-25 18:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f90fdc52-0dc9-5e06-9a8d-bab2b50ddbb4
2026-03-25 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F699%252F0c0a5c06f8d5456ca24b7d7ca54d8c66%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/699/0c0a5c06f8d5456ca24b7d7ca54d8c66/images/large/1.jpg not downloaded yet
2026-03-25 18:34:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e553bd0>
2026-03-25 18:34:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d4d6341-f785-58d8-a20e-6dbb0eeab4a6/3d4d6341-f785-58d8-a20e-6dbb0eeab4a6_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F705%252Fd62fc18141ae401b8e64d60949c19765%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/705/d62fc18141ae401b8e64d60949c19765/images/large/1.jpg saved to cache
2026-03-25 18:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3d4d6341-f785-58d8-a20e-6dbb0eeab4a6
2026-03-25 18:34:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3d4d6341-f785-58d8-a20e-6dbb0eeab4a6, skipping ID generation
2026-03-25 18:34:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d4d6341-f785-58d8-a20e-6dbb0eeab4a6 with scrape type 1
2026-03-25 18:34:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3d4d6341-f785-58d8-a20e-6dbb0eeab4a6 sending to next pipeline
2026-03-25 18:34:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3d4d6341-f785-58d8-a20e-6dbb0eeab4a6, identifier: 1983354
2026-03-25 18:34:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/049/9aa7dd89b59f479a9d09748149b2b4cd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/216/293ad3975d88495c8160d7b718eb3feb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:50 [ayvens.es] INFO: Found listing with ID: 1983367
2026-03-25 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983367%27 HTTP/1.1" 200 None
2026-03-25 18:34:50 [ayvens.es] INFO: Scrape type for 1983367: 1
2026-03-25 18:34:50 [ayvens.es] INFO: Extracting data for car ID: 1983367
2026-03-25 18:34:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2544a7fc-a73f-5412-a77c-0ff2a74b9586 with identifier: 1983367
2026-03-25 18:34:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2544a7fc-a73f-5412-a77c-0ff2a74b9586 with scrape type 1
2026-03-25 18:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2544a7fc-a73f-5412-a77c-0ff2a74b9586
2026-03-25 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F419%252F5a99421e443c46138f77e296352d3646%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/419/5a99421e443c46138f77e296352d3646/images/large/1.jpg not downloaded yet
2026-03-25 18:34:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3d4d6341-f785-58d8-a20e-6dbb0eeab4a6 with identifier: 1983354
2026-03-25 18:34:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3d4d6341-f785-58d8-a20e-6dbb0eeab4a6 with identifier: 1983354
2026-03-25 18:34:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3d4d6341-f785-58d8-a20e-6dbb0eeab4a6 with identifier: 1983354 to the API
2026-03-25 18:34:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/705/d62fc18141ae401b8e64d60949c19765/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.2L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '3d4d6341-f785-58d8-a20e-6dbb0eeab4a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'DOBLO CARGO',
 'odometer': 139010,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d4d6341-f785-58d8-a20e-6dbb0eeab4a6/3d4d6341-f785-58d8-a20e-6dbb0eeab4a6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 317884,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/705/d62fc18141ae401b8e64d60949c19765/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-29',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FIAT DOBLO CARGO Cargo Base 1.3 Multijet 70kW (95CV)',
 'transmission': 'manual',
 'trim': 'Cargo Base 1.3 Multijet 70kW (95CV)',
 'vin': None,
 'year': 2019}
2026-03-25 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983354%27 HTTP/1.1" 200 None
2026-03-25 18:34:50 [ayvens.es] INFO: Saving data for 1983354: {'created_time': 1774463690.475582, 'last_price_update_time': 1774463690.475592, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983354') HTTP/1.1" 204 0
2026-03-25 18:34:50 [ayvens.es] INFO: Found listing with ID: 1983368
2026-03-25 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983368%27 HTTP/1.1" 200 None
2026-03-25 18:34:50 [ayvens.es] INFO: Scrape type for 1983368: 1
2026-03-25 18:34:50 [ayvens.es] INFO: Extracting data for car ID: 1983368
2026-03-25 18:34:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c930ce85-2b97-5987-a6a5-a3bdf9fc08f1 with identifier: 1983368
2026-03-25 18:34:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c930ce85-2b97-5987-a6a5-a3bdf9fc08f1 with scrape type 1
2026-03-25 18:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c930ce85-2b97-5987-a6a5-a3bdf9fc08f1
2026-03-25 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F150%252Fdb429adf254c4b9d8009b6f504d7f39f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/150/db429adf254c4b9d8009b6f504d7f39f/images/large/1.jpg not downloaded yet
2026-03-25 18:34:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ea33b10>
2026-03-25 18:34:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84820689-4506-5f49-9705-df4b5564459e/84820689-4506-5f49-9705-df4b5564459e_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F531%252F2407e0f6de694df7baee2848c057ffc7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/531/2407e0f6de694df7baee2848c057ffc7/images/large/1.jpg saved to cache
2026-03-25 18:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 84820689-4506-5f49-9705-df4b5564459e
2026-03-25 18:34:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 84820689-4506-5f49-9705-df4b5564459e, skipping ID generation
2026-03-25 18:34:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84820689-4506-5f49-9705-df4b5564459e with scrape type 1
2026-03-25 18:34:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 84820689-4506-5f49-9705-df4b5564459e sending to next pipeline
2026-03-25 18:34:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 84820689-4506-5f49-9705-df4b5564459e, identifier: 1983355
2026-03-25 18:34:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8eaa91d0>
2026-03-25 18:34:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29d8f69b-f468-5aea-8639-d190c4a28536/29d8f69b-f468-5aea-8639-d190c4a28536_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F969%252F03d5408322ec4f258b52c8884d55bad7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/969/03d5408322ec4f258b52c8884d55bad7/images/large/1.jpg saved to cache
2026-03-25 18:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 29d8f69b-f468-5aea-8639-d190c4a28536
2026-03-25 18:34:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 29d8f69b-f468-5aea-8639-d190c4a28536, skipping ID generation
2026-03-25 18:34:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29d8f69b-f468-5aea-8639-d190c4a28536 with scrape type 1
2026-03-25 18:34:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 29d8f69b-f468-5aea-8639-d190c4a28536 sending to next pipeline
2026-03-25 18:34:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 29d8f69b-f468-5aea-8639-d190c4a28536, identifier: 1983357
2026-03-25 18:34:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ea24f90>
2026-03-25 18:34:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60329998-cfeb-53d4-b504-b8335c5f186a/60329998-cfeb-53d4-b504-b8335c5f186a_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F849%252F2e45d4d135994c73948f43953ac92ce1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/849/2e45d4d135994c73948f43953ac92ce1/images/large/1.jpg saved to cache
2026-03-25 18:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 60329998-cfeb-53d4-b504-b8335c5f186a
2026-03-25 18:34:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 60329998-cfeb-53d4-b504-b8335c5f186a, skipping ID generation
2026-03-25 18:34:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60329998-cfeb-53d4-b504-b8335c5f186a with scrape type 1
2026-03-25 18:34:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 60329998-cfeb-53d4-b504-b8335c5f186a sending to next pipeline
2026-03-25 18:34:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 60329998-cfeb-53d4-b504-b8335c5f186a, identifier: 1983356
2026-03-25 18:34:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ed74b50>
2026-03-25 18:34:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b939fb27-d4c2-5611-a448-5558db49b031/b939fb27-d4c2-5611-a448-5558db49b031_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F049%252F9aa7dd89b59f479a9d09748149b2b4cd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/049/9aa7dd89b59f479a9d09748149b2b4cd/images/large/1.jpg saved to cache
2026-03-25 18:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b939fb27-d4c2-5611-a448-5558db49b031
2026-03-25 18:34:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b939fb27-d4c2-5611-a448-5558db49b031, skipping ID generation
2026-03-25 18:34:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b939fb27-d4c2-5611-a448-5558db49b031 with scrape type 1
2026-03-25 18:34:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b939fb27-d4c2-5611-a448-5558db49b031 sending to next pipeline
2026-03-25 18:34:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b939fb27-d4c2-5611-a448-5558db49b031, identifier: 1983359
2026-03-25 18:34:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ed0d1d0>
2026-03-25 18:34:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cd2a3fc-215b-5477-b9cd-ff41f9130ad2/6cd2a3fc-215b-5477-b9cd-ff41f9130ad2_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F216%252F293ad3975d88495c8160d7b718eb3feb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/216/293ad3975d88495c8160d7b718eb3feb/images/large/1.jpg saved to cache
2026-03-25 18:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6cd2a3fc-215b-5477-b9cd-ff41f9130ad2
2026-03-25 18:34:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6cd2a3fc-215b-5477-b9cd-ff41f9130ad2, skipping ID generation
2026-03-25 18:34:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cd2a3fc-215b-5477-b9cd-ff41f9130ad2 with scrape type 1
2026-03-25 18:34:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6cd2a3fc-215b-5477-b9cd-ff41f9130ad2 sending to next pipeline
2026-03-25 18:34:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6cd2a3fc-215b-5477-b9cd-ff41f9130ad2, identifier: 1983358
2026-03-25 18:34:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/573/18ea94a6207b43a19d2504a51c00d980/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:51 [ayvens.es] INFO: Found listing with ID: 1983369
2026-03-25 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983369%27 HTTP/1.1" 200 None
2026-03-25 18:34:51 [ayvens.es] INFO: Scrape type for 1983369: 1
2026-03-25 18:34:51 [ayvens.es] INFO: Extracting data for car ID: 1983369
2026-03-25 18:34:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ef968f9-49f2-57cf-8058-011817b9f66b with identifier: 1983369
2026-03-25 18:34:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ef968f9-49f2-57cf-8058-011817b9f66b with scrape type 1
2026-03-25 18:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9ef968f9-49f2-57cf-8058-011817b9f66b
2026-03-25 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F099%252F4c055a6360694fdbb8fa8c1e81a196e1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/099/4c055a6360694fdbb8fa8c1e81a196e1/images/large/1.jpg not downloaded yet
2026-03-25 18:34:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 84820689-4506-5f49-9705-df4b5564459e with identifier: 1983355
2026-03-25 18:34:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 84820689-4506-5f49-9705-df4b5564459e with identifier: 1983355
2026-03-25 18:34:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 84820689-4506-5f49-9705-df4b5564459e with identifier: 1983355 to the API
2026-03-25 18:34:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/531/2407e0f6de694df7baee2848c057ffc7/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '84820689-4506-5f49-9705-df4b5564459e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'MONDEO',
 'odometer': 184364,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84820689-4506-5f49-9705-df4b5564459e/84820689-4506-5f49-9705-df4b5564459e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 480892,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/531/2407e0f6de694df7baee2848c057ffc7/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD MONDEO 2.0 TDCi 110kW (150CV) Titanium',
 'transmission': 'manual',
 'trim': '2.0 TDCi 110kW (150CV) Titanium',
 'vin': None,
 'year': 2021}
2026-03-25 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983355%27 HTTP/1.1" 200 None
2026-03-25 18:34:51 [ayvens.es] INFO: Saving data for 1983355: {'created_time': 1774463691.736583, 'last_price_update_time': 1774463691.736599, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983355') HTTP/1.1" 204 0
2026-03-25 18:34:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 29d8f69b-f468-5aea-8639-d190c4a28536 with identifier: 1983357
2026-03-25 18:34:51 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:34:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 29d8f69b-f468-5aea-8639-d190c4a28536 with identifier: 1983357
2026-03-25 18:34:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 29d8f69b-f468-5aea-8639-d190c4a28536 with identifier: 1983357 to the API
2026-03-25 18:34:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/969/03d5408322ec4f258b52c8884d55bad7/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'Santorini black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '29d8f69b-f468-5aea-8639-d190c4a28536',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'JAGUAR',
 'model': 'E-PACE',
 'odometer': 115513,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29d8f69b-f468-5aea-8639-d190c4a28536/29d8f69b-f468-5aea-8639-d190c4a28536_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 376263,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/969/03d5408322ec4f258b52c8884d55bad7/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'JAGUAR E-PACE 2.0D 110kW S',
 'transmission': 'manual',
 'trim': '2.0D 110kW S',
 'vin': None,
 'year': 2018}
2026-03-25 18:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983357%27 HTTP/1.1" 200 None
2026-03-25 18:34:52 [ayvens.es] INFO: Saving data for 1983357: {'created_time': 1774463692.054768, 'last_price_update_time': 1774463692.054779, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983357') HTTP/1.1" 204 0
2026-03-25 18:34:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 60329998-cfeb-53d4-b504-b8335c5f186a with identifier: 1983356
2026-03-25 18:34:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 60329998-cfeb-53d4-b504-b8335c5f186a with identifier: 1983356
2026-03-25 18:34:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 60329998-cfeb-53d4-b504-b8335c5f186a with identifier: 1983356 to the API
2026-03-25 18:34:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/849/2e45d4d135994c73948f43953ac92ce1/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '60329998-cfeb-53d4-b504-b8335c5f186a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': 155290,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60329998-cfeb-53d4-b504-b8335c5f186a/60329998-cfeb-53d4-b504-b8335c5f186a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 373197,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/849/2e45d4d135994c73948f43953ac92ce1/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FOCUS 1.5 Ecoblue 88kW Trend+ SB',
 'transmission': 'manual',
 'trim': '1.5 Ecoblue 88kW Trend+ SB',
 'vin': None,
 'year': 2022}
2026-03-25 18:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983356%27 HTTP/1.1" 200 None
2026-03-25 18:34:52 [ayvens.es] INFO: Saving data for 1983356: {'created_time': 1774463692.744509, 'last_price_update_time': 1774463692.74452, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983356') HTTP/1.1" 204 0
2026-03-25 18:34:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b939fb27-d4c2-5611-a448-5558db49b031 with identifier: 1983359
2026-03-25 18:34:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b939fb27-d4c2-5611-a448-5558db49b031 with identifier: 1983359
2026-03-25 18:34:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b939fb27-d4c2-5611-a448-5558db49b031 with identifier: 1983359 to the API
2026-03-25 18:34:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/049/9aa7dd89b59f479a9d09748149b2b4cd/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Blanco s',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b939fb27-d4c2-5611-a448-5558db49b031',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT CONNECT',
 'odometer': 158087,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b939fb27-d4c2-5611-a448-5558db49b031/b939fb27-d4c2-5611-a448-5558db49b031_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 555254,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/049/9aa7dd89b59f479a9d09748149b2b4cd/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-24',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FORD TRANSIT CONNECT Van 1.5 TDCi 74kW Trend 200 L1',
 'transmission': 'manual',
 'trim': 'Van 1.5 TDCi 74kW Trend 200 L1',
 'vin': None,
 'year': 2019}
2026-03-25 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983359%27 HTTP/1.1" 200 None
2026-03-25 18:34:53 [ayvens.es] INFO: Saving data for 1983359: {'created_time': 1774463693.060911, 'last_price_update_time': 1774463693.060923, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983359') HTTP/1.1" 204 0
2026-03-25 18:34:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6cd2a3fc-215b-5477-b9cd-ff41f9130ad2 with identifier: 1983358
2026-03-25 18:34:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6cd2a3fc-215b-5477-b9cd-ff41f9130ad2 with identifier: 1983358
2026-03-25 18:34:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 6cd2a3fc-215b-5477-b9cd-ff41f9130ad2 with identifier: 1983358 to the API
2026-03-25 18:34:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/216/293ad3975d88495c8160d7b718eb3feb/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '6cd2a3fc-215b-5477-b9cd-ff41f9130ad2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT CONNECT',
 'odometer': 162597,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cd2a3fc-215b-5477-b9cd-ff41f9130ad2/6cd2a3fc-215b-5477-b9cd-ff41f9130ad2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 393893,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/216/293ad3975d88495c8160d7b718eb3feb/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-08',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FORD TRANSIT CONNECT Van 1.5 TDCi 74kW Trend 200 L1',
 'transmission': 'manual',
 'trim': 'Van 1.5 TDCi 74kW Trend 200 L1',
 'vin': None,
 'year': 2019}
2026-03-25 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983358%27 HTTP/1.1" 200 None
2026-03-25 18:34:53 [ayvens.es] INFO: Saving data for 1983358: {'created_time': 1774463693.360377, 'last_price_update_time': 1774463693.360389, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983358') HTTP/1.1" 204 0
2026-03-25 18:34:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/342/3a2cfe1f569f4c2e8bdd9954be8dd9a6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/114/bfcd6da546dc4dbcb96aff0aea5abb40/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/727/c108199d6cf34fe9ab5242565934e290/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:53 [ayvens.es] INFO: Found listing with ID: 1983370
2026-03-25 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983370%27 HTTP/1.1" 200 None
2026-03-25 18:34:53 [ayvens.es] INFO: Scrape type for 1983370: 1
2026-03-25 18:34:53 [ayvens.es] INFO: Extracting data for car ID: 1983370
2026-03-25 18:34:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82576d07-fc62-52a9-a4e5-1e06986c719d with identifier: 1983370
2026-03-25 18:34:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82576d07-fc62-52a9-a4e5-1e06986c719d with scrape type 1
2026-03-25 18:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 82576d07-fc62-52a9-a4e5-1e06986c719d
2026-03-25 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F484%252F8e6f03f5472c4254a8a5cc70df7e04d7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/484/8e6f03f5472c4254a8a5cc70df7e04d7/images/large/1.jpg not downloaded yet
2026-03-25 18:34:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ed2b790>
2026-03-25 18:34:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6c9f38b-b4aa-5597-b2cf-837ecd137471/f6c9f38b-b4aa-5597-b2cf-837ecd137471_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F573%252F18ea94a6207b43a19d2504a51c00d980%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/573/18ea94a6207b43a19d2504a51c00d980/images/large/1.jpg saved to cache
2026-03-25 18:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f6c9f38b-b4aa-5597-b2cf-837ecd137471
2026-03-25 18:34:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f6c9f38b-b4aa-5597-b2cf-837ecd137471, skipping ID generation
2026-03-25 18:34:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6c9f38b-b4aa-5597-b2cf-837ecd137471 with scrape type 1
2026-03-25 18:34:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f6c9f38b-b4aa-5597-b2cf-837ecd137471 sending to next pipeline
2026-03-25 18:34:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f6c9f38b-b4aa-5597-b2cf-837ecd137471, identifier: 1983360
2026-03-25 18:34:53 [ayvens.es] INFO: Found listing with ID: 1983371
2026-03-25 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983371%27 HTTP/1.1" 200 None
2026-03-25 18:34:53 [ayvens.es] INFO: Scrape type for 1983371: 1
2026-03-25 18:34:53 [ayvens.es] INFO: Extracting data for car ID: 1983371
2026-03-25 18:34:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e31557dc-57d3-511d-9d0a-398a48d49f2e with identifier: 1983371
2026-03-25 18:34:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e31557dc-57d3-511d-9d0a-398a48d49f2e with scrape type 1
2026-03-25 18:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e31557dc-57d3-511d-9d0a-398a48d49f2e
2026-03-25 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F766%252Fbf08c2684bea4924b5236abdf8d5ff9e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/766/bf08c2684bea4924b5236abdf8d5ff9e/images/large/1.jpg not downloaded yet
2026-03-25 18:34:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f6c9f38b-b4aa-5597-b2cf-837ecd137471 with identifier: 1983360
2026-03-25 18:34:53 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:34:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f6c9f38b-b4aa-5597-b2cf-837ecd137471 with identifier: 1983360
2026-03-25 18:34:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f6c9f38b-b4aa-5597-b2cf-837ecd137471 with identifier: 1983360 to the API
2026-03-25 18:34:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/573/18ea94a6207b43a19d2504a51c00d980/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'color': 'Blanco blanquise',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f6c9f38b-b4aa-5597-b2cf-837ecd137471',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'JUMPY',
 'odometer': 147373,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6c9f38b-b4aa-5597-b2cf-837ecd137471/f6c9f38b-b4aa-5597-b2cf-837ecd137471_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 338209,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/573/18ea94a6207b43a19d2504a51c00d980/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-08',
 'seats_number': 3,
 'seller_name': None,
 'title': 'CITROËN JUMPY Talla M BlueHDi 90KW (122CV) Club',
 'transmission': 'manual',
 'trim': 'Talla M BlueHDi 90KW (122CV) Club',
 'vin': None,
 'year': 2019}
2026-03-25 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983360%27 HTTP/1.1" 200 None
2026-03-25 18:34:53 [ayvens.es] INFO: Saving data for 1983360: {'created_time': 1774463693.899558, 'last_price_update_time': 1774463693.899568, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983360') HTTP/1.1" 204 0
2026-03-25 18:34:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/562/a4c15f21415c4660bf8e5bb18482398e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/699/0c0a5c06f8d5456ca24b7d7ca54d8c66/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:53 [ayvens.es] INFO: Found listing with ID: 1983372
2026-03-25 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983372%27 HTTP/1.1" 200 None
2026-03-25 18:34:53 [ayvens.es] INFO: Scrape type for 1983372: 1
2026-03-25 18:34:53 [ayvens.es] INFO: Extracting data for car ID: 1983372
2026-03-25 18:34:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8dae128f-8dbd-5cea-a840-33deeadeaa9b with identifier: 1983372
2026-03-25 18:34:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8dae128f-8dbd-5cea-a840-33deeadeaa9b with scrape type 1
2026-03-25 18:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8dae128f-8dbd-5cea-a840-33deeadeaa9b
2026-03-25 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F024%252Fe983d20b00a147f78394f9a095e59cd1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/024/e983d20b00a147f78394f9a095e59cd1/images/large/1.jpg not downloaded yet
2026-03-25 18:34:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e5572d0>
2026-03-25 18:34:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e639cc2d-8302-5d90-99ba-645feb377709/e639cc2d-8302-5d90-99ba-645feb377709_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F342%252F3a2cfe1f569f4c2e8bdd9954be8dd9a6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/342/3a2cfe1f569f4c2e8bdd9954be8dd9a6/images/large/1.jpg saved to cache
2026-03-25 18:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e639cc2d-8302-5d90-99ba-645feb377709
2026-03-25 18:34:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e639cc2d-8302-5d90-99ba-645feb377709, skipping ID generation
2026-03-25 18:34:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e639cc2d-8302-5d90-99ba-645feb377709 with scrape type 1
2026-03-25 18:34:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e639cc2d-8302-5d90-99ba-645feb377709 sending to next pipeline
2026-03-25 18:34:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e639cc2d-8302-5d90-99ba-645feb377709, identifier: 1983361
2026-03-25 18:34:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ed17150>
2026-03-25 18:34:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c334c5db-ea70-5b62-ad80-bc5ce8958610/c334c5db-ea70-5b62-ad80-bc5ce8958610_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F114%252Fbfcd6da546dc4dbcb96aff0aea5abb40%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/114/bfcd6da546dc4dbcb96aff0aea5abb40/images/large/1.jpg saved to cache
2026-03-25 18:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c334c5db-ea70-5b62-ad80-bc5ce8958610
2026-03-25 18:34:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c334c5db-ea70-5b62-ad80-bc5ce8958610, skipping ID generation
2026-03-25 18:34:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c334c5db-ea70-5b62-ad80-bc5ce8958610 with scrape type 1
2026-03-25 18:34:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c334c5db-ea70-5b62-ad80-bc5ce8958610 sending to next pipeline
2026-03-25 18:34:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c334c5db-ea70-5b62-ad80-bc5ce8958610, identifier: 1983362
2026-03-25 18:34:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ee8cf90>
2026-03-25 18:34:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84c60246-f163-5410-8f22-b17f08e36342/84c60246-f163-5410-8f22-b17f08e36342_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F727%252Fc108199d6cf34fe9ab5242565934e290%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/727/c108199d6cf34fe9ab5242565934e290/images/large/1.jpg saved to cache
2026-03-25 18:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 84c60246-f163-5410-8f22-b17f08e36342
2026-03-25 18:34:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 84c60246-f163-5410-8f22-b17f08e36342, skipping ID generation
2026-03-25 18:34:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84c60246-f163-5410-8f22-b17f08e36342 with scrape type 1
2026-03-25 18:34:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 84c60246-f163-5410-8f22-b17f08e36342 sending to next pipeline
2026-03-25 18:34:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 84c60246-f163-5410-8f22-b17f08e36342, identifier: 1983364
2026-03-25 18:34:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/351/66c86b422ece4b87995cc67be4ced9bf/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:54 [ayvens.es] INFO: Found listing with ID: 1983373
2026-03-25 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983373%27 HTTP/1.1" 200 None
2026-03-25 18:34:54 [ayvens.es] INFO: Scrape type for 1983373: 1
2026-03-25 18:34:54 [ayvens.es] INFO: Extracting data for car ID: 1983373
2026-03-25 18:34:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90c1384c-e680-5b86-bb14-f78be9d407a4 with identifier: 1983373
2026-03-25 18:34:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90c1384c-e680-5b86-bb14-f78be9d407a4 with scrape type 1
2026-03-25 18:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 90c1384c-e680-5b86-bb14-f78be9d407a4
2026-03-25 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F054%252F69b8fc423d9f41ad983d5c2c13d3728f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/054/69b8fc423d9f41ad983d5c2c13d3728f/images/large/1.jpg not downloaded yet
2026-03-25 18:34:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e639cc2d-8302-5d90-99ba-645feb377709 with identifier: 1983361
2026-03-25 18:34:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e639cc2d-8302-5d90-99ba-645feb377709 with identifier: 1983361
2026-03-25 18:34:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e639cc2d-8302-5d90-99ba-645feb377709 with identifier: 1983361 to the API
2026-03-25 18:34:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/342/3a2cfe1f569f4c2e8bdd9954be8dd9a6/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'color': 'Blanco s',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.2L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e639cc2d-8302-5d90-99ba-645feb377709',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'FIORINO',
 'odometer': 113953,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e639cc2d-8302-5d90-99ba-645feb377709/e639cc2d-8302-5d90-99ba-645feb377709_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344766,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/342/3a2cfe1f569f4c2e8bdd9954be8dd9a6/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-01',
 'seats_number': 2,
 'seller_name': None,
 'title': 'FIAT FIORINO Cargo SX N1 1.3 MJet 59 kW (80 CV)',
 'transmission': 'manual',
 'trim': 'Cargo SX N1 1.3 MJet 59 kW (80 CV)',
 'vin': None,
 'year': 2020}
2026-03-25 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983361%27 HTTP/1.1" 200 None
2026-03-25 18:34:54 [ayvens.es] INFO: Saving data for 1983361: {'created_time': 1774463694.86687, 'last_price_update_time': 1774463694.866883, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983361') HTTP/1.1" 204 0
2026-03-25 18:34:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c334c5db-ea70-5b62-ad80-bc5ce8958610 with identifier: 1983362
2026-03-25 18:34:54 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:34:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c334c5db-ea70-5b62-ad80-bc5ce8958610 with identifier: 1983362
2026-03-25 18:34:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c334c5db-ea70-5b62-ad80-bc5ce8958610 with identifier: 1983362 to the API
2026-03-25 18:34:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/114/bfcd6da546dc4dbcb96aff0aea5abb40/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 195,
 'color': 'Blanco banquise',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.2L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c334c5db-ea70-5b62-ad80-bc5ce8958610',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'BOXER',
 'odometer': 228920,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c334c5db-ea70-5b62-ad80-bc5ce8958610/c334c5db-ea70-5b62-ad80-bc5ce8958610_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 335878,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/114/bfcd6da546dc4dbcb96aff0aea5abb40/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-01',
 'seats_number': 3,
 'seller_name': None,
 'title': 'PEUGEOT BOXER 335 L2H2 HDi 130+++Revisar peritacion+++',
 'transmission': 'manual',
 'trim': '335 L2H2 HDi 130+++Revisar peritacion+++',
 'vin': None,
 'year': 2017}
2026-03-25 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983362%27 HTTP/1.1" 200 None
2026-03-25 18:34:55 [ayvens.es] INFO: Saving data for 1983362: {'created_time': 1774463695.181254, 'last_price_update_time': 1774463695.181264, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983362') HTTP/1.1" 204 0
2026-03-25 18:34:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 84c60246-f163-5410-8f22-b17f08e36342 with identifier: 1983364
2026-03-25 18:34:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 84c60246-f163-5410-8f22-b17f08e36342 with identifier: 1983364
2026-03-25 18:34:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 84c60246-f163-5410-8f22-b17f08e36342 with identifier: 1983364 to the API
2026-03-25 18:34:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/727/c108199d6cf34fe9ab5242565934e290/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '84c60246-f163-5410-8f22-b17f08e36342',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'PARTNER',
 'odometer': 171387,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84c60246-f163-5410-8f22-b17f08e36342/84c60246-f163-5410-8f22-b17f08e36342_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 319797,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/727/c108199d6cf34fe9ab5242565934e290/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-07',
 'seats_number': 2,
 'seller_name': None,
 'title': 'PEUGEOT PARTNER Furgon Confort L1 1.6 BlueHDi 55KW (75)',
 'transmission': 'manual',
 'trim': 'Furgon Confort L1 1.6 BlueHDi 55KW (75)',
 'vin': None,
 'year': 2018}
2026-03-25 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983364%27 HTTP/1.1" 200 None
2026-03-25 18:34:55 [ayvens.es] INFO: Saving data for 1983364: {'created_time': 1774463695.475613, 'last_price_update_time': 1774463695.475622, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983364') HTTP/1.1" 204 0
2026-03-25 18:34:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/150/db429adf254c4b9d8009b6f504d7f39f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/419/5a99421e443c46138f77e296352d3646/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:55 [ayvens.es] INFO: Found listing with ID: 1983374
2026-03-25 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983374%27 HTTP/1.1" 200 None
2026-03-25 18:34:55 [ayvens.es] INFO: Scrape type for 1983374: 1
2026-03-25 18:34:55 [ayvens.es] INFO: Extracting data for car ID: 1983374
2026-03-25 18:34:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec4cd7ed-1744-502f-b328-5f33a533167a with identifier: 1983374
2026-03-25 18:34:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec4cd7ed-1744-502f-b328-5f33a533167a with scrape type 1
2026-03-25 18:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ec4cd7ed-1744-502f-b328-5f33a533167a
2026-03-25 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F809%252F2621aa8ac1404122badbdaee30411809%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/809/2621aa8ac1404122badbdaee30411809/images/large/1.jpg not downloaded yet
2026-03-25 18:34:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae90b04d90>
2026-03-25 18:34:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89c8a2c8-80ff-5d49-abf7-752c55ad3d27/89c8a2c8-80ff-5d49-abf7-752c55ad3d27_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F562%252Fa4c15f21415c4660bf8e5bb18482398e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/562/a4c15f21415c4660bf8e5bb18482398e/images/large/1.jpg saved to cache
2026-03-25 18:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 89c8a2c8-80ff-5d49-abf7-752c55ad3d27
2026-03-25 18:34:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 89c8a2c8-80ff-5d49-abf7-752c55ad3d27, skipping ID generation
2026-03-25 18:34:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89c8a2c8-80ff-5d49-abf7-752c55ad3d27 with scrape type 1
2026-03-25 18:34:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 89c8a2c8-80ff-5d49-abf7-752c55ad3d27 sending to next pipeline
2026-03-25 18:34:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 89c8a2c8-80ff-5d49-abf7-752c55ad3d27, identifier: 1983363
2026-03-25 18:34:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8f42e690>
2026-03-25 18:34:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f90fdc52-0dc9-5e06-9a8d-bab2b50ddbb4/f90fdc52-0dc9-5e06-9a8d-bab2b50ddbb4_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F699%252F0c0a5c06f8d5456ca24b7d7ca54d8c66%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/699/0c0a5c06f8d5456ca24b7d7ca54d8c66/images/large/1.jpg saved to cache
2026-03-25 18:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f90fdc52-0dc9-5e06-9a8d-bab2b50ddbb4
2026-03-25 18:34:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f90fdc52-0dc9-5e06-9a8d-bab2b50ddbb4, skipping ID generation
2026-03-25 18:34:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f90fdc52-0dc9-5e06-9a8d-bab2b50ddbb4 with scrape type 1
2026-03-25 18:34:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f90fdc52-0dc9-5e06-9a8d-bab2b50ddbb4 sending to next pipeline
2026-03-25 18:34:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f90fdc52-0dc9-5e06-9a8d-bab2b50ddbb4, identifier: 1983366
2026-03-25 18:34:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ec47150>
2026-03-25 18:34:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3b6466d-5afd-5fe3-bc91-a48eff2873a0/f3b6466d-5afd-5fe3-bc91-a48eff2873a0_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F351%252F66c86b422ece4b87995cc67be4ced9bf%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/351/66c86b422ece4b87995cc67be4ced9bf/images/large/1.jpg saved to cache
2026-03-25 18:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f3b6466d-5afd-5fe3-bc91-a48eff2873a0
2026-03-25 18:34:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f3b6466d-5afd-5fe3-bc91-a48eff2873a0, skipping ID generation
2026-03-25 18:34:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3b6466d-5afd-5fe3-bc91-a48eff2873a0 with scrape type 1
2026-03-25 18:34:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f3b6466d-5afd-5fe3-bc91-a48eff2873a0 sending to next pipeline
2026-03-25 18:34:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f3b6466d-5afd-5fe3-bc91-a48eff2873a0, identifier: 1983365
2026-03-25 18:34:55 [ayvens.es] INFO: Found listing with ID: 1983375
2026-03-25 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983375%27 HTTP/1.1" 200 None
2026-03-25 18:34:55 [ayvens.es] INFO: Scrape type for 1983375: 1
2026-03-25 18:34:55 [ayvens.es] INFO: Extracting data for car ID: 1983375
2026-03-25 18:34:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9644e3c1-1590-5287-8d67-dbe408871dae with identifier: 1983375
2026-03-25 18:34:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9644e3c1-1590-5287-8d67-dbe408871dae with scrape type 1
2026-03-25 18:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9644e3c1-1590-5287-8d67-dbe408871dae
2026-03-25 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F887%252F387c421cc35d4c10b901f2adeb39aa30%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/887/387c421cc35d4c10b901f2adeb39aa30/images/large/1.jpg not downloaded yet
2026-03-25 18:34:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 89c8a2c8-80ff-5d49-abf7-752c55ad3d27 with identifier: 1983363
2026-03-25 18:34:56 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:34:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 89c8a2c8-80ff-5d49-abf7-752c55ad3d27 with identifier: 1983363
2026-03-25 18:34:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 89c8a2c8-80ff-5d49-abf7-752c55ad3d27 with identifier: 1983363 to the API
2026-03-25 18:34:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/562/a4c15f21415c4660bf8e5bb18482398e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 185,
 'color': 'Hielo blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '89c8a2c8-80ff-5d49-abf7-752c55ad3d27',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'NV300',
 'odometer': 109720,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89c8a2c8-80ff-5d49-abf7-752c55ad3d27/89c8a2c8-80ff-5d49-abf7-752c55ad3d27_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 575842,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/562/a4c15f21415c4660bf8e5bb18482398e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-24',
 'seats_number': 6,
 'seller_name': None,
 'title': 'NISSAN NV300 Combi 6 2.0dCi 88kW L1H1 1T Optima+++Revisar '
          'peritacion+++',
 'transmission': 'manual',
 'trim': 'Combi 6 2.0dCi 88kW L1H1 1T Optima+++Revisar peritacion+++',
 'vin': None,
 'year': 2020}
2026-03-25 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983363%27 HTTP/1.1" 200 None
2026-03-25 18:34:56 [ayvens.es] INFO: Saving data for 1983363: {'created_time': 1774463696.27182, 'last_price_update_time': 1774463696.27183, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983363') HTTP/1.1" 204 0
2026-03-25 18:34:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f90fdc52-0dc9-5e06-9a8d-bab2b50ddbb4 with identifier: 1983366
2026-03-25 18:34:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f90fdc52-0dc9-5e06-9a8d-bab2b50ddbb4 with identifier: 1983366
2026-03-25 18:34:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f90fdc52-0dc9-5e06-9a8d-bab2b50ddbb4 with identifier: 1983366 to the API
2026-03-25 18:34:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/699/0c0a5c06f8d5456ca24b7d7ca54d8c66/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'color': 'Rojo',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f90fdc52-0dc9-5e06-9a8d-bab2b50ddbb4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'PROACE CITY VERSO',
 'odometer': 128369,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f90fdc52-0dc9-5e06-9a8d-bab2b50ddbb4/f90fdc52-0dc9-5e06-9a8d-bab2b50ddbb4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 355963,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/699/0c0a5c06f8d5456ca24b7d7ca54d8c66/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA PROACE CITY VERSO 1.5D 96kW (130CV) Combi GX Plus L1',
 'transmission': 'manual',
 'trim': '1.5D 96kW (130CV) Combi GX Plus L1',
 'vin': None,
 'year': 2023}
2026-03-25 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983366%27 HTTP/1.1" 200 None
2026-03-25 18:34:56 [ayvens.es] INFO: Saving data for 1983366: {'created_time': 1774463696.548643, 'last_price_update_time': 1774463696.548653, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983366') HTTP/1.1" 204 0
2026-03-25 18:34:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f3b6466d-5afd-5fe3-bc91-a48eff2873a0 with identifier: 1983365
2026-03-25 18:34:56 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:34:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f3b6466d-5afd-5fe3-bc91-a48eff2873a0 with identifier: 1983365
2026-03-25 18:34:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f3b6466d-5afd-5fe3-bc91-a48eff2873a0 with identifier: 1983365 to the API
2026-03-25 18:34:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/351/66c86b422ece4b87995cc67be4ced9bf/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 146,
 'color': 'Mineral blanco',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f3b6466d-5afd-5fe3-bc91-a48eff2873a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 118914,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3b6466d-5afd-5fe3-bc91-a48eff2873a0/f3b6466d-5afd-5fe3-bc91-a48eff2873a0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 478535,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/351/66c86b422ece4b87995cc67be4ced9bf/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-15',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS (O) Profesional Blue dCi 59 kW (80CV)',
 'transmission': 'manual',
 'trim': '(O) Profesional Blue dCi 59 kW (80CV)',
 'vin': None,
 'year': 2021}
2026-03-25 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983365%27 HTTP/1.1" 200 None
2026-03-25 18:34:56 [ayvens.es] INFO: Saving data for 1983365: {'created_time': 1774463696.8469, 'last_price_update_time': 1774463696.846918, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983365') HTTP/1.1" 204 0
2026-03-25 18:34:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/099/4c055a6360694fdbb8fa8c1e81a196e1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/484/8e6f03f5472c4254a8a5cc70df7e04d7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:56 [ayvens.es] INFO: Found listing with ID: 1983376
2026-03-25 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983376%27 HTTP/1.1" 200 None
2026-03-25 18:34:56 [ayvens.es] INFO: Scrape type for 1983376: 1
2026-03-25 18:34:56 [ayvens.es] INFO: Extracting data for car ID: 1983376
2026-03-25 18:34:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c16b7e0-a354-5ffa-8872-829c97b94138 with identifier: 1983376
2026-03-25 18:34:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c16b7e0-a354-5ffa-8872-829c97b94138 with scrape type 1
2026-03-25 18:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1c16b7e0-a354-5ffa-8872-829c97b94138
2026-03-25 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F827%252F0c493729da8646a19abf8be4274ba997%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/827/0c493729da8646a19abf8be4274ba997/images/large/1.jpg not downloaded yet
2026-03-25 18:34:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ea83f50>
2026-03-25 18:34:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c930ce85-2b97-5987-a6a5-a3bdf9fc08f1/c930ce85-2b97-5987-a6a5-a3bdf9fc08f1_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F150%252Fdb429adf254c4b9d8009b6f504d7f39f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/150/db429adf254c4b9d8009b6f504d7f39f/images/large/1.jpg saved to cache
2026-03-25 18:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c930ce85-2b97-5987-a6a5-a3bdf9fc08f1
2026-03-25 18:34:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c930ce85-2b97-5987-a6a5-a3bdf9fc08f1, skipping ID generation
2026-03-25 18:34:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c930ce85-2b97-5987-a6a5-a3bdf9fc08f1 with scrape type 1
2026-03-25 18:34:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c930ce85-2b97-5987-a6a5-a3bdf9fc08f1 sending to next pipeline
2026-03-25 18:34:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c930ce85-2b97-5987-a6a5-a3bdf9fc08f1, identifier: 1983368
2026-03-25 18:34:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae90902510>
2026-03-25 18:34:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2544a7fc-a73f-5412-a77c-0ff2a74b9586/2544a7fc-a73f-5412-a77c-0ff2a74b9586_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F419%252F5a99421e443c46138f77e296352d3646%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/419/5a99421e443c46138f77e296352d3646/images/large/1.jpg saved to cache
2026-03-25 18:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2544a7fc-a73f-5412-a77c-0ff2a74b9586
2026-03-25 18:34:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2544a7fc-a73f-5412-a77c-0ff2a74b9586, skipping ID generation
2026-03-25 18:34:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2544a7fc-a73f-5412-a77c-0ff2a74b9586 with scrape type 1
2026-03-25 18:34:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2544a7fc-a73f-5412-a77c-0ff2a74b9586 sending to next pipeline
2026-03-25 18:34:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 2544a7fc-a73f-5412-a77c-0ff2a74b9586, identifier: 1983367
2026-03-25 18:34:57 [ayvens.es] INFO: Found listing with ID: 1983377
2026-03-25 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983377%27 HTTP/1.1" 200 None
2026-03-25 18:34:57 [ayvens.es] INFO: Scrape type for 1983377: 1
2026-03-25 18:34:57 [ayvens.es] INFO: Extracting data for car ID: 1983377
2026-03-25 18:34:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fce5df19-c82e-5359-90aa-4e664c6010b7 with identifier: 1983377
2026-03-25 18:34:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fce5df19-c82e-5359-90aa-4e664c6010b7 with scrape type 1
2026-03-25 18:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item fce5df19-c82e-5359-90aa-4e664c6010b7
2026-03-25 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F348%252Ff3490177c5cb4c78b5a94f7297250533%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/348/f3490177c5cb4c78b5a94f7297250533/images/large/1.jpg not downloaded yet
2026-03-25 18:34:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c930ce85-2b97-5987-a6a5-a3bdf9fc08f1 with identifier: 1983368
2026-03-25 18:34:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c930ce85-2b97-5987-a6a5-a3bdf9fc08f1 with identifier: 1983368
2026-03-25 18:34:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c930ce85-2b97-5987-a6a5-a3bdf9fc08f1 with identifier: 1983368 to the API
2026-03-25 18:34:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/150/db429adf254c4b9d8009b6f504d7f39f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 168,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c930ce85-2b97-5987-a6a5-a3bdf9fc08f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'PROACE',
 'odometer': 131317,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c930ce85-2b97-5987-a6a5-a3bdf9fc08f1/c930ce85-2b97-5987-a6a5-a3bdf9fc08f1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325768,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/150/db429adf254c4b9d8009b6f504d7f39f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-05',
 'seats_number': 3,
 'seller_name': None,
 'title': 'TOYOTA PROACE 2.0D 120CV BUSINESS 1PL 2PT L2',
 'transmission': 'manual',
 'trim': '2.0D 120CV BUSINESS 1PL 2PT L2',
 'vin': None,
 'year': 2020}
2026-03-25 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983368%27 HTTP/1.1" 200 None
2026-03-25 18:34:57 [ayvens.es] INFO: Saving data for 1983368: {'created_time': 1774463697.564999, 'last_price_update_time': 1774463697.565009, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983368') HTTP/1.1" 204 0
2026-03-25 18:34:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 2544a7fc-a73f-5412-a77c-0ff2a74b9586 with identifier: 1983367
2026-03-25 18:34:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:34:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 2544a7fc-a73f-5412-a77c-0ff2a74b9586 with identifier: 1983367
2026-03-25 18:34:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 2544a7fc-a73f-5412-a77c-0ff2a74b9586 with identifier: 1983367 to the API
2026-03-25 18:34:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/419/5a99421e443c46138f77e296352d3646/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'Azul caribe',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '2544a7fc-a73f-5412-a77c-0ff2a74b9586',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TOURAN',
 'odometer': 167126,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2544a7fc-a73f-5412-a77c-0ff2a74b9586/2544a7fc-a73f-5412-a77c-0ff2a74b9586_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 373608,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/419/5a99421e443c46138f77e296352d3646/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-15',
 'seats_number': 7,
 'seller_name': None,
 'title': 'VOLKSWAGEN TOURAN Advance 2.0 TDI 110kW (150CV)',
 'transmission': 'manual',
 'trim': 'Advance 2.0 TDI 110kW (150CV)',
 'vin': None,
 'year': 2020}
2026-03-25 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983367%27 HTTP/1.1" 200 None
2026-03-25 18:34:57 [ayvens.es] INFO: Saving data for 1983367: {'created_time': 1774463697.843671, 'last_price_update_time': 1774463697.843681, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983367') HTTP/1.1" 204 0
2026-03-25 18:34:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/024/e983d20b00a147f78394f9a095e59cd1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/766/bf08c2684bea4924b5236abdf8d5ff9e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:57 [ayvens.es] INFO: Found listing with ID: 1983378
2026-03-25 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983378%27 HTTP/1.1" 200 None
2026-03-25 18:34:57 [ayvens.es] INFO: Scrape type for 1983378: 1
2026-03-25 18:34:57 [ayvens.es] INFO: Extracting data for car ID: 1983378
2026-03-25 18:34:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3764d85a-cbbd-5039-80ab-82a279c54091 with identifier: 1983378
2026-03-25 18:34:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3764d85a-cbbd-5039-80ab-82a279c54091 with scrape type 1
2026-03-25 18:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3764d85a-cbbd-5039-80ab-82a279c54091
2026-03-25 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F731%252Fcf616cfa47c2409eb7b813afafb20d55%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/731/cf616cfa47c2409eb7b813afafb20d55/images/large/1.jpg not downloaded yet
2026-03-25 18:34:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ea18550>
2026-03-25 18:34:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ef968f9-49f2-57cf-8058-011817b9f66b/9ef968f9-49f2-57cf-8058-011817b9f66b_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F099%252F4c055a6360694fdbb8fa8c1e81a196e1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/099/4c055a6360694fdbb8fa8c1e81a196e1/images/large/1.jpg saved to cache
2026-03-25 18:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9ef968f9-49f2-57cf-8058-011817b9f66b
2026-03-25 18:34:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9ef968f9-49f2-57cf-8058-011817b9f66b, skipping ID generation
2026-03-25 18:34:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ef968f9-49f2-57cf-8058-011817b9f66b with scrape type 1
2026-03-25 18:34:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9ef968f9-49f2-57cf-8058-011817b9f66b sending to next pipeline
2026-03-25 18:34:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9ef968f9-49f2-57cf-8058-011817b9f66b, identifier: 1983369
2026-03-25 18:34:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8efe4910>
2026-03-25 18:34:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82576d07-fc62-52a9-a4e5-1e06986c719d/82576d07-fc62-52a9-a4e5-1e06986c719d_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F484%252F8e6f03f5472c4254a8a5cc70df7e04d7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/484/8e6f03f5472c4254a8a5cc70df7e04d7/images/large/1.jpg saved to cache
2026-03-25 18:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 82576d07-fc62-52a9-a4e5-1e06986c719d
2026-03-25 18:34:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 82576d07-fc62-52a9-a4e5-1e06986c719d, skipping ID generation
2026-03-25 18:34:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82576d07-fc62-52a9-a4e5-1e06986c719d with scrape type 1
2026-03-25 18:34:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 82576d07-fc62-52a9-a4e5-1e06986c719d sending to next pipeline
2026-03-25 18:34:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 82576d07-fc62-52a9-a4e5-1e06986c719d, identifier: 1983370
2026-03-25 18:34:58 [ayvens.es] INFO: Found listing with ID: 1983379
2026-03-25 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983379%27 HTTP/1.1" 200 None
2026-03-25 18:34:58 [ayvens.es] INFO: Scrape type for 1983379: 1
2026-03-25 18:34:58 [ayvens.es] INFO: Extracting data for car ID: 1983379
2026-03-25 18:34:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42ec551b-0d14-536d-b46a-b40af28de000 with identifier: 1983379
2026-03-25 18:34:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42ec551b-0d14-536d-b46a-b40af28de000 with scrape type 1
2026-03-25 18:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 42ec551b-0d14-536d-b46a-b40af28de000
2026-03-25 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F843%252F47db27d367834be3a861a9ca129b2a79%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/843/47db27d367834be3a861a9ca129b2a79/images/large/1.jpg not downloaded yet
2026-03-25 18:34:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9ef968f9-49f2-57cf-8058-011817b9f66b with identifier: 1983369
2026-03-25 18:34:58 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:34:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9ef968f9-49f2-57cf-8058-011817b9f66b with identifier: 1983369
2026-03-25 18:34:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9ef968f9-49f2-57cf-8058-011817b9f66b with identifier: 1983369 to the API
2026-03-25 18:34:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/099/4c055a6360694fdbb8fa8c1e81a196e1/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'color': 'Azul ral',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '9ef968f9-49f2-57cf-8058-011817b9f66b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'PARTNER',
 'odometer': 195992,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ef968f9-49f2-57cf-8058-011817b9f66b/9ef968f9-49f2-57cf-8058-011817b9f66b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 363258,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/099/4c055a6360694fdbb8fa8c1e81a196e1/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-10',
 'seats_number': 2,
 'seller_name': None,
 'title': 'PEUGEOT PARTNER Premium Standard 1000kg BlueHDi 73kW',
 'transmission': 'manual',
 'trim': 'Premium Standard 1000kg BlueHDi 73kW',
 'vin': None,
 'year': 2020}
2026-03-25 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983369%27 HTTP/1.1" 200 None
2026-03-25 18:34:58 [ayvens.es] INFO: Saving data for 1983369: {'created_time': 1774463698.567692, 'last_price_update_time': 1774463698.567702, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983369') HTTP/1.1" 204 0
2026-03-25 18:34:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 82576d07-fc62-52a9-a4e5-1e06986c719d with identifier: 1983370
2026-03-25 18:34:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 82576d07-fc62-52a9-a4e5-1e06986c719d with identifier: 1983370
2026-03-25 18:34:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 82576d07-fc62-52a9-a4e5-1e06986c719d with identifier: 1983370 to the API
2026-03-25 18:34:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/484/8e6f03f5472c4254a8a5cc70df7e04d7/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Mineral blanco opaca',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '82576d07-fc62-52a9-a4e5-1e06986c719d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO',
 'odometer': 172549,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82576d07-fc62-52a9-a4e5-1e06986c719d/82576d07-fc62-52a9-a4e5-1e06986c719d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 343143,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/484/8e6f03f5472c4254a8a5cc70df7e04d7/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT KANGOO Profesional N1 Energy dCi 55kW (75CV)',
 'transmission': 'manual',
 'trim': 'Profesional N1 Energy dCi 55kW (75CV)',
 'vin': None,
 'year': 2019}
2026-03-25 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983370%27 HTTP/1.1" 200 None
2026-03-25 18:34:58 [ayvens.es] INFO: Saving data for 1983370: {'created_time': 1774463698.926934, 'last_price_update_time': 1774463698.926944, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983370') HTTP/1.1" 204 0
2026-03-25 18:34:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/809/2621aa8ac1404122badbdaee30411809/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/054/69b8fc423d9f41ad983d5c2c13d3728f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:58 [ayvens.es] INFO: Found listing with ID: 1983380
2026-03-25 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983380%27 HTTP/1.1" 200 None
2026-03-25 18:34:58 [ayvens.es] INFO: Scrape type for 1983380: 1
2026-03-25 18:34:58 [ayvens.es] INFO: Extracting data for car ID: 1983380
2026-03-25 18:34:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d3e3a36-481b-5ef4-afe1-22fadba3f54f with identifier: 1983380
2026-03-25 18:34:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d3e3a36-481b-5ef4-afe1-22fadba3f54f with scrape type 1
2026-03-25 18:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8d3e3a36-481b-5ef4-afe1-22fadba3f54f
2026-03-25 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F697%252Fd8795d998f6941c4983a4d27c732d604%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/697/d8795d998f6941c4983a4d27c732d604/images/large/1.jpg not downloaded yet
2026-03-25 18:34:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e573310>
2026-03-25 18:34:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8dae128f-8dbd-5cea-a840-33deeadeaa9b/8dae128f-8dbd-5cea-a840-33deeadeaa9b_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F024%252Fe983d20b00a147f78394f9a095e59cd1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/024/e983d20b00a147f78394f9a095e59cd1/images/large/1.jpg saved to cache
2026-03-25 18:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8dae128f-8dbd-5cea-a840-33deeadeaa9b
2026-03-25 18:34:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8dae128f-8dbd-5cea-a840-33deeadeaa9b, skipping ID generation
2026-03-25 18:34:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8dae128f-8dbd-5cea-a840-33deeadeaa9b with scrape type 1
2026-03-25 18:34:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8dae128f-8dbd-5cea-a840-33deeadeaa9b sending to next pipeline
2026-03-25 18:34:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8dae128f-8dbd-5cea-a840-33deeadeaa9b, identifier: 1983372
2026-03-25 18:34:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e573950>
2026-03-25 18:34:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e31557dc-57d3-511d-9d0a-398a48d49f2e/e31557dc-57d3-511d-9d0a-398a48d49f2e_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F766%252Fbf08c2684bea4924b5236abdf8d5ff9e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/766/bf08c2684bea4924b5236abdf8d5ff9e/images/large/1.jpg saved to cache
2026-03-25 18:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e31557dc-57d3-511d-9d0a-398a48d49f2e
2026-03-25 18:34:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e31557dc-57d3-511d-9d0a-398a48d49f2e, skipping ID generation
2026-03-25 18:34:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e31557dc-57d3-511d-9d0a-398a48d49f2e with scrape type 1
2026-03-25 18:34:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e31557dc-57d3-511d-9d0a-398a48d49f2e sending to next pipeline
2026-03-25 18:34:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e31557dc-57d3-511d-9d0a-398a48d49f2e, identifier: 1983371
2026-03-25 18:34:59 [ayvens.es] INFO: Found listing with ID: 1983381
2026-03-25 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983381%27 HTTP/1.1" 200 None
2026-03-25 18:34:59 [ayvens.es] INFO: Scrape type for 1983381: 1
2026-03-25 18:34:59 [ayvens.es] INFO: Extracting data for car ID: 1983381
2026-03-25 18:34:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77bc8c22-a64e-5722-b914-2ba07fab1a9d with identifier: 1983381
2026-03-25 18:34:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77bc8c22-a64e-5722-b914-2ba07fab1a9d with scrape type 1
2026-03-25 18:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 77bc8c22-a64e-5722-b914-2ba07fab1a9d
2026-03-25 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F424%252Ff3d2780eed4b4763ac5cff71cacf2cbd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/424/f3d2780eed4b4763ac5cff71cacf2cbd/images/large/1.jpg not downloaded yet
2026-03-25 18:34:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8dae128f-8dbd-5cea-a840-33deeadeaa9b with identifier: 1983372
2026-03-25 18:34:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8dae128f-8dbd-5cea-a840-33deeadeaa9b with identifier: 1983372
2026-03-25 18:34:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8dae128f-8dbd-5cea-a840-33deeadeaa9b with identifier: 1983372 to the API
2026-03-25 18:34:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/024/e983d20b00a147f78394f9a095e59cd1/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '8dae128f-8dbd-5cea-a840-33deeadeaa9b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 242299,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dae128f-8dbd-5cea-a840-33deeadeaa9b/8dae128f-8dbd-5cea-a840-33deeadeaa9b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 355058,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/024/e983d20b00a147f78394f9a095e59cd1/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO Sp. T. Business dCi 55kW (75CV) -18',
 'transmission': 'manual',
 'trim': 'Sp. T. Business dCi 55kW (75CV) -18',
 'vin': None,
 'year': 2019}
2026-03-25 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983372%27 HTTP/1.1" 200 None
2026-03-25 18:34:59 [ayvens.es] INFO: Saving data for 1983372: {'created_time': 1774463699.593752, 'last_price_update_time': 1774463699.593762, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983372') HTTP/1.1" 204 0
2026-03-25 18:34:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e31557dc-57d3-511d-9d0a-398a48d49f2e with identifier: 1983371
2026-03-25 18:34:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e31557dc-57d3-511d-9d0a-398a48d49f2e with identifier: 1983371
2026-03-25 18:34:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e31557dc-57d3-511d-9d0a-398a48d49f2e with identifier: 1983371 to the API
2026-03-25 18:34:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:34:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:34:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/766/bf08c2684bea4924b5236abdf8d5ff9e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 179,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.4L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e31557dc-57d3-511d-9d0a-398a48d49f2e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'HILUX',
 'odometer': 107549,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e31557dc-57d3-511d-9d0a-398a48d49f2e/e31557dc-57d3-511d-9d0a-398a48d49f2e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 345525,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/766/bf08c2684bea4924b5236abdf8d5ff9e/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA HILUX 2.4 D-4D Cabina Doble GX',
 'transmission': 'manual',
 'trim': '2.4 D-4D Cabina Doble GX',
 'vin': None,
 'year': 2022}
2026-03-25 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983371%27 HTTP/1.1" 200 None
2026-03-25 18:34:59 [ayvens.es] INFO: Saving data for 1983371: {'created_time': 1774463699.857891, 'last_price_update_time': 1774463699.857902, 'auction_closing_time': 1774526400.0}
2026-03-25 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983371') HTTP/1.1" 204 0
2026-03-25 18:34:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/827/0c493729da8646a19abf8be4274ba997/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/887/387c421cc35d4c10b901f2adeb39aa30/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:34:59 [ayvens.es] INFO: Found listing with ID: 1983382
2026-03-25 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983382%27 HTTP/1.1" 200 None
2026-03-25 18:34:59 [ayvens.es] INFO: Scrape type for 1983382: 1
2026-03-25 18:34:59 [ayvens.es] INFO: Extracting data for car ID: 1983382
2026-03-25 18:34:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4855747f-59d1-571b-a8ca-6a6aa2809c33 with identifier: 1983382
2026-03-25 18:34:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4855747f-59d1-571b-a8ca-6a6aa2809c33 with scrape type 1
2026-03-25 18:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4855747f-59d1-571b-a8ca-6a6aa2809c33
2026-03-25 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F235%252Fd383240f49c4464c8d5d8c38239f5532%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/235/d383240f49c4464c8d5d8c38239f5532/images/large/1.jpg not downloaded yet
2026-03-25 18:34:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:34:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ea496d0>
2026-03-25 18:34:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:34:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:34:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:34:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec4cd7ed-1744-502f-b328-5f33a533167a/ec4cd7ed-1744-502f-b328-5f33a533167a_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F809%252F2621aa8ac1404122badbdaee30411809%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/809/2621aa8ac1404122badbdaee30411809/images/large/1.jpg saved to cache
2026-03-25 18:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ec4cd7ed-1744-502f-b328-5f33a533167a
2026-03-25 18:34:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ec4cd7ed-1744-502f-b328-5f33a533167a, skipping ID generation
2026-03-25 18:34:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec4cd7ed-1744-502f-b328-5f33a533167a with scrape type 1
2026-03-25 18:34:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ec4cd7ed-1744-502f-b328-5f33a533167a sending to next pipeline
2026-03-25 18:35:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ec4cd7ed-1744-502f-b328-5f33a533167a, identifier: 1983374
2026-03-25 18:35:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:35:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8d42eb90>
2026-03-25 18:35:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:35:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:35:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:35:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90c1384c-e680-5b86-bb14-f78be9d407a4/90c1384c-e680-5b86-bb14-f78be9d407a4_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F054%252F69b8fc423d9f41ad983d5c2c13d3728f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/054/69b8fc423d9f41ad983d5c2c13d3728f/images/large/1.jpg saved to cache
2026-03-25 18:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 90c1384c-e680-5b86-bb14-f78be9d407a4
2026-03-25 18:35:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 90c1384c-e680-5b86-bb14-f78be9d407a4, skipping ID generation
2026-03-25 18:35:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90c1384c-e680-5b86-bb14-f78be9d407a4 with scrape type 1
2026-03-25 18:35:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 90c1384c-e680-5b86-bb14-f78be9d407a4 sending to next pipeline
2026-03-25 18:35:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 90c1384c-e680-5b86-bb14-f78be9d407a4, identifier: 1983373
2026-03-25 18:35:00 [ayvens.es] INFO: Found listing with ID: 1983383
2026-03-25 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983383%27 HTTP/1.1" 200 None
2026-03-25 18:35:00 [ayvens.es] INFO: Scrape type for 1983383: 1
2026-03-25 18:35:00 [ayvens.es] INFO: Extracting data for car ID: 1983383
2026-03-25 18:35:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9963689-1867-5e59-a5d3-517c003988f0 with identifier: 1983383
2026-03-25 18:35:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9963689-1867-5e59-a5d3-517c003988f0 with scrape type 1
2026-03-25 18:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a9963689-1867-5e59-a5d3-517c003988f0
2026-03-25 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F318%252F813cb279acbb4a45a2cd1e3c316173d9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/318/813cb279acbb4a45a2cd1e3c316173d9/images/large/1.jpg not downloaded yet
2026-03-25 18:35:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ec4cd7ed-1744-502f-b328-5f33a533167a with identifier: 1983374
2026-03-25 18:35:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ec4cd7ed-1744-502f-b328-5f33a533167a with identifier: 1983374
2026-03-25 18:35:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ec4cd7ed-1744-502f-b328-5f33a533167a with identifier: 1983374 to the API
2026-03-25 18:35:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:35:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:35:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/809/2621aa8ac1404122badbdaee30411809/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'Blanco banquise',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'ec4cd7ed-1744-502f-b328-5f33a533167a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 107298,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec4cd7ed-1744-502f-b328-5f33a533167a/ec4cd7ed-1744-502f-b328-5f33a533167a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353468,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/809/2621aa8ac1404122badbdaee30411809/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.2 PureTech 96KW (130CV) S&S Allure',
 'transmission': 'manual',
 'trim': '1.2 PureTech 96KW (130CV) S&S Allure',
 'vin': None,
 'year': 2020}
2026-03-25 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983374%27 HTTP/1.1" 200 None
2026-03-25 18:35:00 [ayvens.es] INFO: Saving data for 1983374: {'created_time': 1774463700.559142, 'last_price_update_time': 1774463700.559152, 'auction_closing_time': 1774526400.0}
2026-03-25 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983374') HTTP/1.1" 204 0
2026-03-25 18:35:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 90c1384c-e680-5b86-bb14-f78be9d407a4 with identifier: 1983373
2026-03-25 18:35:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 90c1384c-e680-5b86-bb14-f78be9d407a4 with identifier: 1983373
2026-03-25 18:35:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 90c1384c-e680-5b86-bb14-f78be9d407a4 with identifier: 1983373 to the API
2026-03-25 18:35:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:35:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:35:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/054/69b8fc423d9f41ad983d5c2c13d3728f/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '90c1384c-e680-5b86-bb14-f78be9d407a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO',
 'odometer': 224539,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90c1384c-e680-5b86-bb14-f78be9d407a4/90c1384c-e680-5b86-bb14-f78be9d407a4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 368059,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/054/69b8fc423d9f41ad983d5c2c13d3728f/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT KANGOO (O) Profes. M1-AF Blue dCi 70 kW(95 CV) -SS)',
 'transmission': 'manual',
 'trim': '(O) Profes. M1-AF Blue dCi 70 kW(95 CV) -SS)',
 'vin': None,
 'year': 2021}
2026-03-25 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983373%27 HTTP/1.1" 200 None
2026-03-25 18:35:00 [ayvens.es] INFO: Saving data for 1983373: {'created_time': 1774463700.856713, 'last_price_update_time': 1774463700.856725, 'auction_closing_time': 1774526400.0}
2026-03-25 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983373') HTTP/1.1" 204 0
2026-03-25 18:35:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/348/f3490177c5cb4c78b5a94f7297250533/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:35:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/731/cf616cfa47c2409eb7b813afafb20d55/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:35:00 [ayvens.es] INFO: Found listing with ID: 1983384
2026-03-25 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983384%27 HTTP/1.1" 200 None
2026-03-25 18:35:00 [ayvens.es] INFO: Scrape type for 1983384: 1
2026-03-25 18:35:00 [ayvens.es] INFO: Extracting data for car ID: 1983384
2026-03-25 18:35:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 065142a7-4860-50e1-80cb-037e94e4ba1e with identifier: 1983384
2026-03-25 18:35:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 065142a7-4860-50e1-80cb-037e94e4ba1e with scrape type 1
2026-03-25 18:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 065142a7-4860-50e1-80cb-037e94e4ba1e
2026-03-25 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F721%252F550d21945d1844fb90131877f5d2aade%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/721/550d21945d1844fb90131877f5d2aade/images/large/1.jpg not downloaded yet
2026-03-25 18:35:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:35:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ec6eb90>
2026-03-25 18:35:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:35:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:35:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:35:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c16b7e0-a354-5ffa-8872-829c97b94138/1c16b7e0-a354-5ffa-8872-829c97b94138_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F827%252F0c493729da8646a19abf8be4274ba997%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/827/0c493729da8646a19abf8be4274ba997/images/large/1.jpg saved to cache
2026-03-25 18:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1c16b7e0-a354-5ffa-8872-829c97b94138
2026-03-25 18:35:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1c16b7e0-a354-5ffa-8872-829c97b94138, skipping ID generation
2026-03-25 18:35:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c16b7e0-a354-5ffa-8872-829c97b94138 with scrape type 1
2026-03-25 18:35:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1c16b7e0-a354-5ffa-8872-829c97b94138 sending to next pipeline
2026-03-25 18:35:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1c16b7e0-a354-5ffa-8872-829c97b94138, identifier: 1983376
2026-03-25 18:35:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:35:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8efd7d90>
2026-03-25 18:35:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:35:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:35:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:35:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9644e3c1-1590-5287-8d67-dbe408871dae/9644e3c1-1590-5287-8d67-dbe408871dae_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F887%252F387c421cc35d4c10b901f2adeb39aa30%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/887/387c421cc35d4c10b901f2adeb39aa30/images/large/1.jpg saved to cache
2026-03-25 18:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9644e3c1-1590-5287-8d67-dbe408871dae
2026-03-25 18:35:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9644e3c1-1590-5287-8d67-dbe408871dae, skipping ID generation
2026-03-25 18:35:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9644e3c1-1590-5287-8d67-dbe408871dae with scrape type 1
2026-03-25 18:35:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9644e3c1-1590-5287-8d67-dbe408871dae sending to next pipeline
2026-03-25 18:35:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 9644e3c1-1590-5287-8d67-dbe408871dae, identifier: 1983375
2026-03-25 18:35:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1c16b7e0-a354-5ffa-8872-829c97b94138 with identifier: 1983376
2026-03-25 18:35:01 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:35:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1c16b7e0-a354-5ffa-8872-829c97b94138 with identifier: 1983376
2026-03-25 18:35:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1c16b7e0-a354-5ffa-8872-829c97b94138 with identifier: 1983376 to the API
2026-03-25 18:35:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:35:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:35:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/827/0c493729da8646a19abf8be4274ba997/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'color': 'Blanco perlado',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '1c16b7e0-a354-5ffa-8872-829c97b94138',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 194564,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c16b7e0-a354-5ffa-8872-829c97b94138/1c16b7e0-a354-5ffa-8872-829c97b94138_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 327186,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/827/0c493729da8646a19abf8be4274ba997/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI 1.5 dCi ACENTA',
 'transmission': 'manual',
 'trim': '1.5 dCi ACENTA',
 'vin': None,
 'year': 2017}
2026-03-25 18:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983376%27 HTTP/1.1" 200 None
2026-03-25 18:35:01 [ayvens.es] INFO: Saving data for 1983376: {'created_time': 1774463701.508135, 'last_price_update_time': 1774463701.508145, 'auction_closing_time': 1774526400.0}
2026-03-25 18:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983376') HTTP/1.1" 204 0
2026-03-25 18:35:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 9644e3c1-1590-5287-8d67-dbe408871dae with identifier: 1983375
2026-03-25 18:35:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 9644e3c1-1590-5287-8d67-dbe408871dae with identifier: 1983375
2026-03-25 18:35:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 9644e3c1-1590-5287-8d67-dbe408871dae with identifier: 1983375 to the API
2026-03-25 18:35:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:35:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:35:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/887/387c421cc35d4c10b901f2adeb39aa30/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 179,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.4L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '9644e3c1-1590-5287-8d67-dbe408871dae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'HILUX',
 'odometer': 136507,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9644e3c1-1590-5287-8d67-dbe408871dae/9644e3c1-1590-5287-8d67-dbe408871dae_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330731,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/887/387c421cc35d4c10b901f2adeb39aa30/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA HILUX 2.4 D-4D Cabina Doble GX',
 'transmission': 'manual',
 'trim': '2.4 D-4D Cabina Doble GX',
 'vin': None,
 'year': 2020}
2026-03-25 18:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983375%27 HTTP/1.1" 200 None
2026-03-25 18:35:01 [ayvens.es] INFO: Saving data for 1983375: {'created_time': 1774463701.776704, 'last_price_update_time': 1774463701.776715, 'auction_closing_time': 1774526400.0}
2026-03-25 18:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983375') HTTP/1.1" 204 0
2026-03-25 18:35:01 [ayvens.es] INFO: Found listing with ID: 1983385
2026-03-25 18:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983385%27 HTTP/1.1" 200 None
2026-03-25 18:35:01 [ayvens.es] INFO: Scrape type for 1983385: 1
2026-03-25 18:35:01 [ayvens.es] INFO: Extracting data for car ID: 1983385
2026-03-25 18:35:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce73904d-6be0-53b1-acc8-2805c7d91380 with identifier: 1983385
2026-03-25 18:35:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce73904d-6be0-53b1-acc8-2805c7d91380 with scrape type 1
2026-03-25 18:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ce73904d-6be0-53b1-acc8-2805c7d91380
2026-03-25 18:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F900%252Fb00e00462b0843ac95ec07a1e6da5dfe%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/900/b00e00462b0843ac95ec07a1e6da5dfe/images/large/1.jpg not downloaded yet
2026-03-25 18:35:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:35:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8d4218d0>
2026-03-25 18:35:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:35:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:35:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:35:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fce5df19-c82e-5359-90aa-4e664c6010b7/fce5df19-c82e-5359-90aa-4e664c6010b7_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F348%252Ff3490177c5cb4c78b5a94f7297250533%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/348/f3490177c5cb4c78b5a94f7297250533/images/large/1.jpg saved to cache
2026-03-25 18:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fce5df19-c82e-5359-90aa-4e664c6010b7
2026-03-25 18:35:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fce5df19-c82e-5359-90aa-4e664c6010b7, skipping ID generation
2026-03-25 18:35:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fce5df19-c82e-5359-90aa-4e664c6010b7 with scrape type 1
2026-03-25 18:35:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fce5df19-c82e-5359-90aa-4e664c6010b7 sending to next pipeline
2026-03-25 18:35:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: fce5df19-c82e-5359-90aa-4e664c6010b7, identifier: 1983377
2026-03-25 18:35:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:35:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8eed4350>
2026-03-25 18:35:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:35:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:35:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:35:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3764d85a-cbbd-5039-80ab-82a279c54091/3764d85a-cbbd-5039-80ab-82a279c54091_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F731%252Fcf616cfa47c2409eb7b813afafb20d55%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/731/cf616cfa47c2409eb7b813afafb20d55/images/large/1.jpg saved to cache
2026-03-25 18:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3764d85a-cbbd-5039-80ab-82a279c54091
2026-03-25 18:35:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3764d85a-cbbd-5039-80ab-82a279c54091, skipping ID generation
2026-03-25 18:35:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3764d85a-cbbd-5039-80ab-82a279c54091 with scrape type 1
2026-03-25 18:35:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3764d85a-cbbd-5039-80ab-82a279c54091 sending to next pipeline
2026-03-25 18:35:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3764d85a-cbbd-5039-80ab-82a279c54091, identifier: 1983378
2026-03-25 18:35:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/697/d8795d998f6941c4983a4d27c732d604/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:35:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/843/47db27d367834be3a861a9ca129b2a79/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:35:02 [ayvens.es] INFO: Found listing with ID: 1983386
2026-03-25 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983386%27 HTTP/1.1" 200 None
2026-03-25 18:35:02 [ayvens.es] INFO: Scrape type for 1983386: 1
2026-03-25 18:35:02 [ayvens.es] INFO: Extracting data for car ID: 1983386
2026-03-25 18:35:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d970a520-8ecd-5d78-870e-1fa50993b68d with identifier: 1983386
2026-03-25 18:35:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d970a520-8ecd-5d78-870e-1fa50993b68d with scrape type 1
2026-03-25 18:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d970a520-8ecd-5d78-870e-1fa50993b68d
2026-03-25 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F833%252F6f1da1ab6fde43498c2a112dc0f5c441%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/833/6f1da1ab6fde43498c2a112dc0f5c441/images/large/1.jpg not downloaded yet
2026-03-25 18:35:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: fce5df19-c82e-5359-90aa-4e664c6010b7 with identifier: 1983377
2026-03-25 18:35:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: fce5df19-c82e-5359-90aa-4e664c6010b7 with identifier: 1983377
2026-03-25 18:35:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: fce5df19-c82e-5359-90aa-4e664c6010b7 with identifier: 1983377 to the API
2026-03-25 18:35:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:35:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:35:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/348/f3490177c5cb4c78b5a94f7297250533/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'Metalizado',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'fce5df19-c82e-5359-90aa-4e664c6010b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'GRANDLAND X',
 'odometer': 123496,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fce5df19-c82e-5359-90aa-4e664c6010b7/fce5df19-c82e-5359-90aa-4e664c6010b7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 365255,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/348/f3490177c5cb4c78b5a94f7297250533/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL GRANDLAND X 1.5 CDTi Edition',
 'transmission': 'manual',
 'trim': '1.5 CDTi Edition',
 'vin': None,
 'year': 2022}
2026-03-25 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983377%27 HTTP/1.1" 200 None
2026-03-25 18:35:02 [ayvens.es] INFO: Saving data for 1983377: {'created_time': 1774463702.525835, 'last_price_update_time': 1774463702.525845, 'auction_closing_time': 1774526400.0}
2026-03-25 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983377') HTTP/1.1" 204 0
2026-03-25 18:35:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3764d85a-cbbd-5039-80ab-82a279c54091 with identifier: 1983378
2026-03-25 18:35:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3764d85a-cbbd-5039-80ab-82a279c54091 with identifier: 1983378
2026-03-25 18:35:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3764d85a-cbbd-5039-80ab-82a279c54091 with identifier: 1983378 to the API
2026-03-25 18:35:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:35:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:35:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/731/cf616cfa47c2409eb7b813afafb20d55/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'color': 'Blanco candy s',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '3764d85a-cbbd-5039-80ab-82a279c54091',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CADDY',
 'odometer': 89179,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3764d85a-cbbd-5039-80ab-82a279c54091/3764d85a-cbbd-5039-80ab-82a279c54091_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 327617,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/731/cf616cfa47c2409eb7b813afafb20d55/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-02',
 'seats_number': 2,
 'seller_name': None,
 'title': 'VOLKSWAGEN CADDY Cargo 2.0 TDI 90kW (122CV) 4MOTION',
 'transmission': 'manual',
 'trim': 'Cargo 2.0 TDI 90kW (122CV) 4MOTION',
 'vin': None,
 'year': 2022}
2026-03-25 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983378%27 HTTP/1.1" 200 None
2026-03-25 18:35:02 [ayvens.es] INFO: Saving data for 1983378: {'created_time': 1774463702.816764, 'last_price_update_time': 1774463702.816777, 'auction_closing_time': 1774526400.0}
2026-03-25 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983378') HTTP/1.1" 204 0
2026-03-25 18:35:02 [ayvens.es] INFO: Found listing with ID: 1983387
2026-03-25 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983387%27 HTTP/1.1" 200 None
2026-03-25 18:35:02 [ayvens.es] INFO: Scrape type for 1983387: 1
2026-03-25 18:35:02 [ayvens.es] INFO: Extracting data for car ID: 1983387
2026-03-25 18:35:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5c207c2-537f-53fe-a9a2-b20fdf625c1f with identifier: 1983387
2026-03-25 18:35:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5c207c2-537f-53fe-a9a2-b20fdf625c1f with scrape type 1
2026-03-25 18:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b5c207c2-537f-53fe-a9a2-b20fdf625c1f
2026-03-25 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F654%252F9181427b94914f79ab596f42c8c3d6f8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/654/9181427b94914f79ab596f42c8c3d6f8/images/large/1.jpg not downloaded yet
2026-03-25 18:35:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/424/f3d2780eed4b4763ac5cff71cacf2cbd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:35:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/235/d383240f49c4464c8d5d8c38239f5532/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:35:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:35:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8d421bd0>
2026-03-25 18:35:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:35:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:35:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:35:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d3e3a36-481b-5ef4-afe1-22fadba3f54f/8d3e3a36-481b-5ef4-afe1-22fadba3f54f_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F697%252Fd8795d998f6941c4983a4d27c732d604%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/697/d8795d998f6941c4983a4d27c732d604/images/large/1.jpg saved to cache
2026-03-25 18:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8d3e3a36-481b-5ef4-afe1-22fadba3f54f
2026-03-25 18:35:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8d3e3a36-481b-5ef4-afe1-22fadba3f54f, skipping ID generation
2026-03-25 18:35:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d3e3a36-481b-5ef4-afe1-22fadba3f54f with scrape type 1
2026-03-25 18:35:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8d3e3a36-481b-5ef4-afe1-22fadba3f54f sending to next pipeline
2026-03-25 18:35:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8d3e3a36-481b-5ef4-afe1-22fadba3f54f, identifier: 1983380
2026-03-25 18:35:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:35:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae90a2eb10>
2026-03-25 18:35:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:35:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:35:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:35:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42ec551b-0d14-536d-b46a-b40af28de000/42ec551b-0d14-536d-b46a-b40af28de000_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F843%252F47db27d367834be3a861a9ca129b2a79%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/843/47db27d367834be3a861a9ca129b2a79/images/large/1.jpg saved to cache
2026-03-25 18:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 42ec551b-0d14-536d-b46a-b40af28de000
2026-03-25 18:35:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 42ec551b-0d14-536d-b46a-b40af28de000, skipping ID generation
2026-03-25 18:35:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42ec551b-0d14-536d-b46a-b40af28de000 with scrape type 1
2026-03-25 18:35:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 42ec551b-0d14-536d-b46a-b40af28de000 sending to next pipeline
2026-03-25 18:35:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 42ec551b-0d14-536d-b46a-b40af28de000, identifier: 1983379
2026-03-25 18:35:03 [ayvens.es] INFO: Found listing with ID: 1983388
2026-03-25 18:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983388%27 HTTP/1.1" 200 None
2026-03-25 18:35:03 [ayvens.es] INFO: Scrape type for 1983388: 1
2026-03-25 18:35:03 [ayvens.es] INFO: Extracting data for car ID: 1983388
2026-03-25 18:35:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f947572-d00a-50b9-a9a6-39c9b92decd3 with identifier: 1983388
2026-03-25 18:35:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f947572-d00a-50b9-a9a6-39c9b92decd3 with scrape type 1
2026-03-25 18:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1f947572-d00a-50b9-a9a6-39c9b92decd3
2026-03-25 18:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F864%252F6b5966a3ed054333ae3da5d3754c4c4d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/864/6b5966a3ed054333ae3da5d3754c4c4d/images/large/1.jpg not downloaded yet
2026-03-25 18:35:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8d3e3a36-481b-5ef4-afe1-22fadba3f54f with identifier: 1983380
2026-03-25 18:35:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8d3e3a36-481b-5ef4-afe1-22fadba3f54f with identifier: 1983380
2026-03-25 18:35:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8d3e3a36-481b-5ef4-afe1-22fadba3f54f with identifier: 1983380 to the API
2026-03-25 18:35:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:35:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:35:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/697/d8795d998f6941c4983a4d27c732d604/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'color': 'Blanco candy s',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '8d3e3a36-481b-5ef4-afe1-22fadba3f54f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CADDY',
 'odometer': 72708,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d3e3a36-481b-5ef4-afe1-22fadba3f54f/8d3e3a36-481b-5ef4-afe1-22fadba3f54f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 334160,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/697/d8795d998f6941c4983a4d27c732d604/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-30',
 'seats_number': 2,
 'seller_name': None,
 'title': 'VOLKSWAGEN CADDY Cargo 2.0 TDI 90kW (122CV) 4MOTION',
 'transmission': 'manual',
 'trim': 'Cargo 2.0 TDI 90kW (122CV) 4MOTION',
 'vin': None,
 'year': 2022}
2026-03-25 18:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983380%27 HTTP/1.1" 200 None
2026-03-25 18:35:03 [ayvens.es] INFO: Saving data for 1983380: {'created_time': 1774463703.581291, 'last_price_update_time': 1774463703.581306, 'auction_closing_time': 1774526400.0}
2026-03-25 18:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983380') HTTP/1.1" 204 0
2026-03-25 18:35:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 42ec551b-0d14-536d-b46a-b40af28de000 with identifier: 1983379
2026-03-25 18:35:03 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:35:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 42ec551b-0d14-536d-b46a-b40af28de000 with identifier: 1983379
2026-03-25 18:35:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 42ec551b-0d14-536d-b46a-b40af28de000 with identifier: 1983379 to the API
2026-03-25 18:35:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:35:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:35:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/843/47db27d367834be3a861a9ca129b2a79/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'Plata pirita',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '42ec551b-0d14-536d-b46a-b40af28de000',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT',
 'odometer': 129996,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42ec551b-0d14-536d-b46a-b40af28de000/42ec551b-0d14-536d-b46a-b40af28de000_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 376996,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/843/47db27d367834be3a861a9ca129b2a79/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT Executive 2.0 TDI 110kW (150CV)',
 'transmission': 'manual',
 'trim': 'Executive 2.0 TDI 110kW (150CV)',
 'vin': None,
 'year': 2020}
2026-03-25 18:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983379%27 HTTP/1.1" 200 None
2026-03-25 18:35:03 [ayvens.es] INFO: Saving data for 1983379: {'created_time': 1774463703.895504, 'last_price_update_time': 1774463703.895515, 'auction_closing_time': 1774526400.0}
2026-03-25 18:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983379') HTTP/1.1" 204 0
2026-03-25 18:35:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/318/813cb279acbb4a45a2cd1e3c316173d9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:35:03 [ayvens.es] INFO: Found listing with ID: 1983389
2026-03-25 18:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983389%27 HTTP/1.1" 200 None
2026-03-25 18:35:03 [ayvens.es] INFO: Scrape type for 1983389: 1
2026-03-25 18:35:03 [ayvens.es] INFO: Extracting data for car ID: 1983389
2026-03-25 18:35:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d784d8a-b276-565c-9cbc-5befd7786133 with identifier: 1983389
2026-03-25 18:35:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d784d8a-b276-565c-9cbc-5befd7786133 with scrape type 1
2026-03-25 18:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6d784d8a-b276-565c-9cbc-5befd7786133
2026-03-25 18:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F061%252F166787fb582143bba5ef299a1ec3a481%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/061/166787fb582143bba5ef299a1ec3a481/images/large/1.jpg not downloaded yet
2026-03-25 18:35:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:35:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae90b0f3d0>
2026-03-25 18:35:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:35:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:35:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:35:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77bc8c22-a64e-5722-b914-2ba07fab1a9d/77bc8c22-a64e-5722-b914-2ba07fab1a9d_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F424%252Ff3d2780eed4b4763ac5cff71cacf2cbd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/424/f3d2780eed4b4763ac5cff71cacf2cbd/images/large/1.jpg saved to cache
2026-03-25 18:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 77bc8c22-a64e-5722-b914-2ba07fab1a9d
2026-03-25 18:35:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 77bc8c22-a64e-5722-b914-2ba07fab1a9d, skipping ID generation
2026-03-25 18:35:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77bc8c22-a64e-5722-b914-2ba07fab1a9d with scrape type 1
2026-03-25 18:35:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 77bc8c22-a64e-5722-b914-2ba07fab1a9d sending to next pipeline
2026-03-25 18:35:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 77bc8c22-a64e-5722-b914-2ba07fab1a9d, identifier: 1983381
2026-03-25 18:35:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:35:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ed76c10>
2026-03-25 18:35:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:35:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:35:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:35:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4855747f-59d1-571b-a8ca-6a6aa2809c33/4855747f-59d1-571b-a8ca-6a6aa2809c33_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F235%252Fd383240f49c4464c8d5d8c38239f5532%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/235/d383240f49c4464c8d5d8c38239f5532/images/large/1.jpg saved to cache
2026-03-25 18:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4855747f-59d1-571b-a8ca-6a6aa2809c33
2026-03-25 18:35:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4855747f-59d1-571b-a8ca-6a6aa2809c33, skipping ID generation
2026-03-25 18:35:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4855747f-59d1-571b-a8ca-6a6aa2809c33 with scrape type 1
2026-03-25 18:35:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4855747f-59d1-571b-a8ca-6a6aa2809c33 sending to next pipeline
2026-03-25 18:35:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4855747f-59d1-571b-a8ca-6a6aa2809c33, identifier: 1983382
2026-03-25 18:35:04 [ayvens.es] INFO: Found listing with ID: 1983390
2026-03-25 18:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983390%27 HTTP/1.1" 200 None
2026-03-25 18:35:04 [ayvens.es] INFO: Scrape type for 1983390: 1
2026-03-25 18:35:04 [ayvens.es] INFO: Extracting data for car ID: 1983390
2026-03-25 18:35:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3019ca5f-4672-579d-bfd1-7a924b39c044 with identifier: 1983390
2026-03-25 18:35:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3019ca5f-4672-579d-bfd1-7a924b39c044 with scrape type 1
2026-03-25 18:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3019ca5f-4672-579d-bfd1-7a924b39c044
2026-03-25 18:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F225%252F9f2a1e76d61d4486a83718c5629c314a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/225/9f2a1e76d61d4486a83718c5629c314a/images/large/1.jpg not downloaded yet
2026-03-25 18:35:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 77bc8c22-a64e-5722-b914-2ba07fab1a9d with identifier: 1983381
2026-03-25 18:35:04 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:35:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 77bc8c22-a64e-5722-b914-2ba07fab1a9d with identifier: 1983381
2026-03-25 18:35:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 77bc8c22-a64e-5722-b914-2ba07fab1a9d with identifier: 1983381 to the API
2026-03-25 18:35:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:35:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:35:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/424/f3d2780eed4b4763ac5cff71cacf2cbd/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Blanco polar',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '77bc8c22-a64e-5722-b914-2ba07fab1a9d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'CROSSLAND',
 'odometer': 127449,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77bc8c22-a64e-5722-b914-2ba07fab1a9d/77bc8c22-a64e-5722-b914-2ba07fab1a9d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 346117,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/424/f3d2780eed4b4763ac5cff71cacf2cbd/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL CROSSLAND 1.5D 81kW (110CV) Edition',
 'transmission': 'manual',
 'trim': '1.5D 81kW (110CV) Edition',
 'vin': None,
 'year': 2021}
2026-03-25 18:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983381%27 HTTP/1.1" 200 None
2026-03-25 18:35:04 [ayvens.es] INFO: Saving data for 1983381: {'created_time': 1774463704.679098, 'last_price_update_time': 1774463704.679108, 'auction_closing_time': 1774526400.0}
2026-03-25 18:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983381') HTTP/1.1" 204 0
2026-03-25 18:35:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4855747f-59d1-571b-a8ca-6a6aa2809c33 with identifier: 1983382
2026-03-25 18:35:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4855747f-59d1-571b-a8ca-6a6aa2809c33 with identifier: 1983382
2026-03-25 18:35:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 4855747f-59d1-571b-a8ca-6a6aa2809c33 with identifier: 1983382 to the API
2026-03-25 18:35:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:35:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:35:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/235/d383240f49c4464c8d5d8c38239f5532/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Blanco glaciar',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'electric',
 'id': '4855747f-59d1-571b-a8ca-6a6aa2809c33',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'ID.4',
 'odometer': 59399,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4855747f-59d1-571b-a8ca-6a6aa2809c33/4855747f-59d1-571b-a8ca-6a6aa2809c33_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 384387,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/235/d383240f49c4464c8d5d8c38239f5532/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN ID.4 Pro 128kW (174CV) Automatico',
 'transmission': 'manual',
 'trim': 'Pro 128kW (174CV) Automatico',
 'vin': None,
 'year': 2022}
2026-03-25 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983382%27 HTTP/1.1" 200 None
2026-03-25 18:35:05 [ayvens.es] INFO: Saving data for 1983382: {'created_time': 1774463705.073625, 'last_price_update_time': 1774463705.073636, 'auction_closing_time': 1774526400.0}
2026-03-25 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983382') HTTP/1.1" 204 0
2026-03-25 18:35:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/721/550d21945d1844fb90131877f5d2aade/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:35:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/900/b00e00462b0843ac95ec07a1e6da5dfe/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:35:05 [ayvens.es] INFO: Found listing with ID: 1983391
2026-03-25 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983391%27 HTTP/1.1" 200 None
2026-03-25 18:35:05 [ayvens.es] INFO: Scrape type for 1983391: 1
2026-03-25 18:35:05 [ayvens.es] INFO: Extracting data for car ID: 1983391
2026-03-25 18:35:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da511c67-f065-544d-9022-0cf3a71928c2 with identifier: 1983391
2026-03-25 18:35:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da511c67-f065-544d-9022-0cf3a71928c2 with scrape type 1
2026-03-25 18:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item da511c67-f065-544d-9022-0cf3a71928c2
2026-03-25 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F422%252F38f434b7bf0d44fca532a9634910d877%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/422/38f434b7bf0d44fca532a9634910d877/images/large/1.jpg not downloaded yet
2026-03-25 18:35:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/833/6f1da1ab6fde43498c2a112dc0f5c441/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:35:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:35:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ea59650>
2026-03-25 18:35:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:35:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:35:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:35:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9963689-1867-5e59-a5d3-517c003988f0/a9963689-1867-5e59-a5d3-517c003988f0_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F318%252F813cb279acbb4a45a2cd1e3c316173d9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/318/813cb279acbb4a45a2cd1e3c316173d9/images/large/1.jpg saved to cache
2026-03-25 18:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a9963689-1867-5e59-a5d3-517c003988f0
2026-03-25 18:35:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a9963689-1867-5e59-a5d3-517c003988f0, skipping ID generation
2026-03-25 18:35:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9963689-1867-5e59-a5d3-517c003988f0 with scrape type 1
2026-03-25 18:35:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a9963689-1867-5e59-a5d3-517c003988f0 sending to next pipeline
2026-03-25 18:35:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a9963689-1867-5e59-a5d3-517c003988f0, identifier: 1983383
2026-03-25 18:35:05 [ayvens.es] INFO: Found listing with ID: 1983392
2026-03-25 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983392%27 HTTP/1.1" 200 None
2026-03-25 18:35:05 [ayvens.es] INFO: Scrape type for 1983392: 1
2026-03-25 18:35:05 [ayvens.es] INFO: Extracting data for car ID: 1983392
2026-03-25 18:35:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3666e0c-5702-51a1-826a-6eedae99f80e with identifier: 1983392
2026-03-25 18:35:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3666e0c-5702-51a1-826a-6eedae99f80e with scrape type 1
2026-03-25 18:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c3666e0c-5702-51a1-826a-6eedae99f80e
2026-03-25 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F763%252Fe7a17842fecd45739a27d284e9fb8afb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/763/e7a17842fecd45739a27d284e9fb8afb/images/large/1.jpg not downloaded yet
2026-03-25 18:35:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a9963689-1867-5e59-a5d3-517c003988f0 with identifier: 1983383
2026-03-25 18:35:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a9963689-1867-5e59-a5d3-517c003988f0 with identifier: 1983383
2026-03-25 18:35:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a9963689-1867-5e59-a5d3-517c003988f0 with identifier: 1983383 to the API
2026-03-25 18:35:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:35:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:35:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/318/813cb279acbb4a45a2cd1e3c316173d9/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 173,
 'color': 'Fuji white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a9963689-1867-5e59-a5d3-517c003988f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER EVOQUE',
 'odometer': 46555,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9963689-1867-5e59-a5d3-517c003988f0/a9963689-1867-5e59-a5d3-517c003988f0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 357971,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/318/813cb279acbb4a45a2cd1e3c316173d9/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER RANGE ROVER EVOQUE 2.0 D163 R-Dynamic SE AUTO 4WD MHEV',
 'transmission': 'manual',
 'trim': '2.0 D163 R-Dynamic SE AUTO 4WD MHEV',
 'vin': None,
 'year': 2021}
2026-03-25 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983383%27 HTTP/1.1" 200 None
2026-03-25 18:35:05 [ayvens.es] INFO: Saving data for 1983383: {'created_time': 1774463705.666419, 'last_price_update_time': 1774463705.66643, 'auction_closing_time': 1774526400.0}
2026-03-25 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983383') HTTP/1.1" 204 0
2026-03-25 18:35:05 [scrapy.extensions.logstats] INFO: Crawled 9 pages (at 1 pages/min), scraped 430 items (at 109 items/min)
2026-03-25 18:35:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 175MiB
2026-03-25 18:35:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/654/9181427b94914f79ab596f42c8c3d6f8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:35:05 [ayvens.es] INFO: Found listing with ID: 1983393
2026-03-25 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983393%27 HTTP/1.1" 200 None
2026-03-25 18:35:05 [ayvens.es] INFO: Scrape type for 1983393: 1
2026-03-25 18:35:05 [ayvens.es] INFO: Extracting data for car ID: 1983393
2026-03-25 18:35:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7cb5c72f-a699-5c32-a8be-63cbb0ad8774 with identifier: 1983393
2026-03-25 18:35:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7cb5c72f-a699-5c32-a8be-63cbb0ad8774 with scrape type 1
2026-03-25 18:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7cb5c72f-a699-5c32-a8be-63cbb0ad8774
2026-03-25 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F128%252F135dc816e8814bd3ac971f28b2c8dcc6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/128/135dc816e8814bd3ac971f28b2c8dcc6/images/large/1.jpg not downloaded yet
2026-03-25 18:35:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:35:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8f19c450>
2026-03-25 18:35:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:35:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:35:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:35:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_065142a7-4860-50e1-80cb-037e94e4ba1e/065142a7-4860-50e1-80cb-037e94e4ba1e_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F721%252F550d21945d1844fb90131877f5d2aade%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/721/550d21945d1844fb90131877f5d2aade/images/large/1.jpg saved to cache
2026-03-25 18:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 065142a7-4860-50e1-80cb-037e94e4ba1e
2026-03-25 18:35:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 065142a7-4860-50e1-80cb-037e94e4ba1e, skipping ID generation
2026-03-25 18:35:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 065142a7-4860-50e1-80cb-037e94e4ba1e with scrape type 1
2026-03-25 18:35:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 065142a7-4860-50e1-80cb-037e94e4ba1e sending to next pipeline
2026-03-25 18:35:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 065142a7-4860-50e1-80cb-037e94e4ba1e, identifier: 1983384
2026-03-25 18:35:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:35:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8d422350>
2026-03-25 18:35:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:35:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:35:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:35:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce73904d-6be0-53b1-acc8-2805c7d91380/ce73904d-6be0-53b1-acc8-2805c7d91380_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F900%252Fb00e00462b0843ac95ec07a1e6da5dfe%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/900/b00e00462b0843ac95ec07a1e6da5dfe/images/large/1.jpg saved to cache
2026-03-25 18:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ce73904d-6be0-53b1-acc8-2805c7d91380
2026-03-25 18:35:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ce73904d-6be0-53b1-acc8-2805c7d91380, skipping ID generation
2026-03-25 18:35:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce73904d-6be0-53b1-acc8-2805c7d91380 with scrape type 1
2026-03-25 18:35:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ce73904d-6be0-53b1-acc8-2805c7d91380 sending to next pipeline
2026-03-25 18:35:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ce73904d-6be0-53b1-acc8-2805c7d91380, identifier: 1983385
2026-03-25 18:35:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:35:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ec44a50>
2026-03-25 18:35:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:35:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:35:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:35:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d970a520-8ecd-5d78-870e-1fa50993b68d/d970a520-8ecd-5d78-870e-1fa50993b68d_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F833%252F6f1da1ab6fde43498c2a112dc0f5c441%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/833/6f1da1ab6fde43498c2a112dc0f5c441/images/large/1.jpg saved to cache
2026-03-25 18:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d970a520-8ecd-5d78-870e-1fa50993b68d
2026-03-25 18:35:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d970a520-8ecd-5d78-870e-1fa50993b68d, skipping ID generation
2026-03-25 18:35:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d970a520-8ecd-5d78-870e-1fa50993b68d with scrape type 1
2026-03-25 18:35:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d970a520-8ecd-5d78-870e-1fa50993b68d sending to next pipeline
2026-03-25 18:35:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d970a520-8ecd-5d78-870e-1fa50993b68d, identifier: 1983386
2026-03-25 18:35:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/864/6b5966a3ed054333ae3da5d3754c4c4d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:35:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 065142a7-4860-50e1-80cb-037e94e4ba1e with identifier: 1983384
2026-03-25 18:35:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 065142a7-4860-50e1-80cb-037e94e4ba1e with identifier: 1983384
2026-03-25 18:35:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 065142a7-4860-50e1-80cb-037e94e4ba1e with identifier: 1983384 to the API
2026-03-25 18:35:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:35:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:35:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/721/550d21945d1844fb90131877f5d2aade/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '065142a7-4860-50e1-80cb-037e94e4ba1e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'BERLINGO',
 'odometer': 136447,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_065142a7-4860-50e1-80cb-037e94e4ba1e/065142a7-4860-50e1-80cb-037e94e4ba1e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 513891,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/721/550d21945d1844fb90131877f5d2aade/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN BERLINGO Talla M BlueHDi 100 S&S FEEL',
 'transmission': 'manual',
 'trim': 'Talla M BlueHDi 100 S&S FEEL',
 'vin': None,
 'year': 2021}
2026-03-25 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983384%27 HTTP/1.1" 200 None
2026-03-25 18:35:06 [ayvens.es] INFO: Saving data for 1983384: {'created_time': 1774463706.592893, 'last_price_update_time': 1774463706.592903, 'auction_closing_time': 1774526400.0}
2026-03-25 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983384') HTTP/1.1" 204 0
2026-03-25 18:35:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ce73904d-6be0-53b1-acc8-2805c7d91380 with identifier: 1983385
2026-03-25 18:35:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ce73904d-6be0-53b1-acc8-2805c7d91380 with identifier: 1983385
2026-03-25 18:35:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ce73904d-6be0-53b1-acc8-2805c7d91380 with identifier: 1983385 to the API
2026-03-25 18:35:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:35:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:35:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/900/b00e00462b0843ac95ec07a1e6da5dfe/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 90,
 'color': 'Blanco banquise',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ce73904d-6be0-53b1-acc8-2805c7d91380',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C4 CACTUS',
 'odometer': 207938,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce73904d-6be0-53b1-acc8-2805c7d91380/ce73904d-6be0-53b1-acc8-2805c7d91380_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 383787,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/900/b00e00462b0843ac95ec07a1e6da5dfe/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C4 CACTUS BlueHDi 100 S&S Shine',
 'transmission': 'manual',
 'trim': 'BlueHDi 100 S&S Shine',
 'vin': None,
 'year': 2019}
2026-03-25 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983385%27 HTTP/1.1" 200 None
2026-03-25 18:35:06 [ayvens.es] INFO: Saving data for 1983385: {'created_time': 1774463706.886503, 'last_price_update_time': 1774463706.886514, 'auction_closing_time': 1774526400.0}
2026-03-25 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983385') HTTP/1.1" 204 0
2026-03-25 18:35:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d970a520-8ecd-5d78-870e-1fa50993b68d with identifier: 1983386
2026-03-25 18:35:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d970a520-8ecd-5d78-870e-1fa50993b68d with identifier: 1983386
2026-03-25 18:35:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d970a520-8ecd-5d78-870e-1fa50993b68d with identifier: 1983386 to the API
2026-03-25 18:35:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:35:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:35:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/833/6f1da1ab6fde43498c2a112dc0f5c441/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd970a520-8ecd-5d78-870e-1fa50993b68d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MEGANE',
 'odometer': 60625,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d970a520-8ecd-5d78-870e-1fa50993b68d/d970a520-8ecd-5d78-870e-1fa50993b68d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330686,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/833/6f1da1ab6fde43498c2a112dc0f5c441/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT MEGANE Equilibre Blue dCi 85 kW (115CV)',
 'transmission': 'manual',
 'trim': 'Equilibre Blue dCi 85 kW (115CV)',
 'vin': None,
 'year': 2022}
2026-03-25 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983386%27 HTTP/1.1" 200 None
2026-03-25 18:35:07 [ayvens.es] INFO: Saving data for 1983386: {'created_time': 1774463707.163813, 'last_price_update_time': 1774463707.163823, 'auction_closing_time': 1774526400.0}
2026-03-25 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983386') HTTP/1.1" 204 0
2026-03-25 18:35:07 [ayvens.es] INFO: Found listing with ID: 1983394
2026-03-25 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983394%27 HTTP/1.1" 200 None
2026-03-25 18:35:07 [ayvens.es] INFO: Scrape type for 1983394: 1
2026-03-25 18:35:07 [ayvens.es] INFO: Extracting data for car ID: 1983394
2026-03-25 18:35:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69085eab-7e4d-5370-b5f4-9c547ff8f74d with identifier: 1983394
2026-03-25 18:35:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69085eab-7e4d-5370-b5f4-9c547ff8f74d with scrape type 1
2026-03-25 18:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 69085eab-7e4d-5370-b5f4-9c547ff8f74d
2026-03-25 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F736%252F6638fb2e90804206a5cb10c8f857959d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/736/6638fb2e90804206a5cb10c8f857959d/images/large/1.jpg not downloaded yet
2026-03-25 18:35:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:35:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8f08e190>
2026-03-25 18:35:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:35:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:35:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:35:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5c207c2-537f-53fe-a9a2-b20fdf625c1f/b5c207c2-537f-53fe-a9a2-b20fdf625c1f_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F654%252F9181427b94914f79ab596f42c8c3d6f8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/654/9181427b94914f79ab596f42c8c3d6f8/images/large/1.jpg saved to cache
2026-03-25 18:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b5c207c2-537f-53fe-a9a2-b20fdf625c1f
2026-03-25 18:35:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b5c207c2-537f-53fe-a9a2-b20fdf625c1f, skipping ID generation
2026-03-25 18:35:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5c207c2-537f-53fe-a9a2-b20fdf625c1f with scrape type 1
2026-03-25 18:35:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b5c207c2-537f-53fe-a9a2-b20fdf625c1f sending to next pipeline
2026-03-25 18:35:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b5c207c2-537f-53fe-a9a2-b20fdf625c1f, identifier: 1983387
2026-03-25 18:35:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/061/166787fb582143bba5ef299a1ec3a481/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:35:07 [ayvens.es] INFO: Found listing with ID: 1983395
2026-03-25 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983395%27 HTTP/1.1" 200 None
2026-03-25 18:35:07 [ayvens.es] INFO: Scrape type for 1983395: 1
2026-03-25 18:35:07 [ayvens.es] INFO: Extracting data for car ID: 1983395
2026-03-25 18:35:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3090931-9851-5578-a792-179afbece4dc with identifier: 1983395
2026-03-25 18:35:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3090931-9851-5578-a792-179afbece4dc with scrape type 1
2026-03-25 18:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d3090931-9851-5578-a792-179afbece4dc
2026-03-25 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F555%252F4dfb4bb5b0c44cc0868c5fd717aeaa7b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/555/4dfb4bb5b0c44cc0868c5fd717aeaa7b/images/large/1.jpg not downloaded yet
2026-03-25 18:35:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b5c207c2-537f-53fe-a9a2-b20fdf625c1f with identifier: 1983387
2026-03-25 18:35:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b5c207c2-537f-53fe-a9a2-b20fdf625c1f with identifier: 1983387
2026-03-25 18:35:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b5c207c2-537f-53fe-a9a2-b20fdf625c1f with identifier: 1983387 to the API
2026-03-25 18:35:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:35:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:35:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/654/9181427b94914f79ab596f42c8c3d6f8/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 164,
 'color': 'Cassa white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b5c207c2-537f-53fe-a9a2-b20fdf625c1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'SPORTAGE',
 'odometer': 111130,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5c207c2-537f-53fe-a9a2-b20fdf625c1f/b5c207c2-537f-53fe-a9a2-b20fdf625c1f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 337679,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/654/9181427b94914f79ab596f42c8c3d6f8/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA SPORTAGE 1.6 MHEV Business 100kW (136CV) 4x4',
 'transmission': 'manual',
 'trim': '1.6 MHEV Business 100kW (136CV) 4x4',
 'vin': None,
 'year': 2022}
2026-03-25 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983387%27 HTTP/1.1" 200 None
2026-03-25 18:35:07 [ayvens.es] INFO: Saving data for 1983387: {'created_time': 1774463707.747792, 'last_price_update_time': 1774463707.747803, 'auction_closing_time': 1774526400.0}
2026-03-25 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983387') HTTP/1.1" 204 0
2026-03-25 18:35:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:35:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8efa6710>
2026-03-25 18:35:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:35:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:35:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:35:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f947572-d00a-50b9-a9a6-39c9b92decd3/1f947572-d00a-50b9-a9a6-39c9b92decd3_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F864%252F6b5966a3ed054333ae3da5d3754c4c4d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/864/6b5966a3ed054333ae3da5d3754c4c4d/images/large/1.jpg saved to cache
2026-03-25 18:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1f947572-d00a-50b9-a9a6-39c9b92decd3
2026-03-25 18:35:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1f947572-d00a-50b9-a9a6-39c9b92decd3, skipping ID generation
2026-03-25 18:35:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f947572-d00a-50b9-a9a6-39c9b92decd3 with scrape type 1
2026-03-25 18:35:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1f947572-d00a-50b9-a9a6-39c9b92decd3 sending to next pipeline
2026-03-25 18:35:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 1f947572-d00a-50b9-a9a6-39c9b92decd3, identifier: 1983388
2026-03-25 18:35:07 [ayvens.es] INFO: Found listing with ID: 1983396
2026-03-25 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983396%27 HTTP/1.1" 200 None
2026-03-25 18:35:07 [ayvens.es] INFO: Scrape type for 1983396: 1
2026-03-25 18:35:07 [ayvens.es] INFO: Extracting data for car ID: 1983396
2026-03-25 18:35:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db515e0f-086b-5fb8-ae81-9e0137d9b52f with identifier: 1983396
2026-03-25 18:35:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db515e0f-086b-5fb8-ae81-9e0137d9b52f with scrape type 1
2026-03-25 18:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item db515e0f-086b-5fb8-ae81-9e0137d9b52f
2026-03-25 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F201%252F2a5a04bb67e74c4f98573d6c3b835b77%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/201/2a5a04bb67e74c4f98573d6c3b835b77/images/large/1.jpg not downloaded yet
2026-03-25 18:35:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 1f947572-d00a-50b9-a9a6-39c9b92decd3 with identifier: 1983388
2026-03-25 18:35:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 1f947572-d00a-50b9-a9a6-39c9b92decd3 with identifier: 1983388
2026-03-25 18:35:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 1f947572-d00a-50b9-a9a6-39c9b92decd3 with identifier: 1983388 to the API
2026-03-25 18:35:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:35:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:35:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/864/6b5966a3ed054333ae3da5d3754c4c4d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 170,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '1f947572-d00a-50b9-a9a6-39c9b92decd3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'TRAFIC',
 'odometer': 237914,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f947572-d00a-50b9-a9a6-39c9b92decd3/1f947572-d00a-50b9-a9a6-39c9b92decd3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 331918,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/864/6b5966a3ed054333ae3da5d3754c4c4d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-31',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT TRAFIC Furgon 27 L1H1 dCi 88kW (120CV)+++Revisar '
          'peritacion+++',
 'transmission': 'manual',
 'trim': 'Furgon 27 L1H1 dCi 88kW (120CV)+++Revisar peritacion+++',
 'vin': None,
 'year': 2019}
2026-03-25 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983388%27 HTTP/1.1" 200 None
2026-03-25 18:35:08 [ayvens.es] INFO: Saving data for 1983388: {'created_time': 1774463708.199422, 'last_price_update_time': 1774463708.199434, 'auction_closing_time': 1774526400.0}
2026-03-25 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983388') HTTP/1.1" 204 0
2026-03-25 18:35:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/225/9f2a1e76d61d4486a83718c5629c314a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:35:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:35:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8f315fd0>
2026-03-25 18:35:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:35:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:35:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:35:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d784d8a-b276-565c-9cbc-5befd7786133/6d784d8a-b276-565c-9cbc-5befd7786133_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F061%252F166787fb582143bba5ef299a1ec3a481%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/061/166787fb582143bba5ef299a1ec3a481/images/large/1.jpg saved to cache
2026-03-25 18:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6d784d8a-b276-565c-9cbc-5befd7786133
2026-03-25 18:35:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6d784d8a-b276-565c-9cbc-5befd7786133, skipping ID generation
2026-03-25 18:35:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d784d8a-b276-565c-9cbc-5befd7786133 with scrape type 1
2026-03-25 18:35:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6d784d8a-b276-565c-9cbc-5befd7786133 sending to next pipeline
2026-03-25 18:35:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 6d784d8a-b276-565c-9cbc-5befd7786133, identifier: 1983389
2026-03-25 18:35:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/422/38f434b7bf0d44fca532a9634910d877/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:35:08 [ayvens.es] INFO: Found listing with ID: 1983397
2026-03-25 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983397%27 HTTP/1.1" 200 None
2026-03-25 18:35:08 [ayvens.es] INFO: Scrape type for 1983397: 1
2026-03-25 18:35:08 [ayvens.es] INFO: Extracting data for car ID: 1983397
2026-03-25 18:35:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 455aa0ba-365f-551b-a7e1-592d89cd5221 with identifier: 1983397
2026-03-25 18:35:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 455aa0ba-365f-551b-a7e1-592d89cd5221 with scrape type 1
2026-03-25 18:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 455aa0ba-365f-551b-a7e1-592d89cd5221
2026-03-25 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F318%252F21241b327f784c50b137abe135dd470a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/318/21241b327f784c50b137abe135dd470a/images/large/1.jpg not downloaded yet
2026-03-25 18:35:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 6d784d8a-b276-565c-9cbc-5befd7786133 with identifier: 1983389
2026-03-25 18:35:08 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:35:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 6d784d8a-b276-565c-9cbc-5befd7786133 with identifier: 1983389
2026-03-25 18:35:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 6d784d8a-b276-565c-9cbc-5befd7786133 with identifier: 1983389 to the API
2026-03-25 18:35:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:35:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:35:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/061/166787fb582143bba5ef299a1ec3a481/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'Blanco nacarado',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '6d784d8a-b276-565c-9cbc-5befd7786133',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008',
 'odometer': 124799,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d784d8a-b276-565c-9cbc-5befd7786133/6d784d8a-b276-565c-9cbc-5befd7786133_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342190,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/061/166787fb582143bba5ef299a1ec3a481/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-26',
 'seats_number': 7,
 'seller_name': None,
 'title': 'PEUGEOT 5008 1.5 BlueHDi 96kW (130CV) S&S Allure+++Revisar '
          'peritacion+++',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi 96kW (130CV) S&S Allure+++Revisar peritacion+++',
 'vin': None,
 'year': 2021}
2026-03-25 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983389%27 HTTP/1.1" 200 None
2026-03-25 18:35:08 [ayvens.es] INFO: Saving data for 1983389: {'created_time': 1774463708.700282, 'last_price_update_time': 1774463708.700292, 'auction_closing_time': 1774526400.0}
2026-03-25 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983389') HTTP/1.1" 204 0
2026-03-25 18:35:08 [ayvens.es] INFO: Found listing with ID: 1983398
2026-03-25 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983398%27 HTTP/1.1" 200 None
2026-03-25 18:35:08 [ayvens.es] INFO: Scrape type for 1983398: 1
2026-03-25 18:35:08 [ayvens.es] INFO: Extracting data for car ID: 1983398
2026-03-25 18:35:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d900bd12-c6a6-5e02-9db8-92152ca8b114 with identifier: 1983398
2026-03-25 18:35:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d900bd12-c6a6-5e02-9db8-92152ca8b114 with scrape type 1
2026-03-25 18:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d900bd12-c6a6-5e02-9db8-92152ca8b114
2026-03-25 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F620%252F0ee33525780a4cb0bea137b7ca7e1ce1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/620/0ee33525780a4cb0bea137b7ca7e1ce1/images/large/1.jpg not downloaded yet
2026-03-25 18:35:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:35:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ea59990>
2026-03-25 18:35:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:35:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:35:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:35:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3019ca5f-4672-579d-bfd1-7a924b39c044/3019ca5f-4672-579d-bfd1-7a924b39c044_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F225%252F9f2a1e76d61d4486a83718c5629c314a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/225/9f2a1e76d61d4486a83718c5629c314a/images/large/1.jpg saved to cache
2026-03-25 18:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3019ca5f-4672-579d-bfd1-7a924b39c044
2026-03-25 18:35:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3019ca5f-4672-579d-bfd1-7a924b39c044, skipping ID generation
2026-03-25 18:35:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3019ca5f-4672-579d-bfd1-7a924b39c044 with scrape type 1
2026-03-25 18:35:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3019ca5f-4672-579d-bfd1-7a924b39c044 sending to next pipeline
2026-03-25 18:35:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 3019ca5f-4672-579d-bfd1-7a924b39c044, identifier: 1983390
2026-03-25 18:35:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 3019ca5f-4672-579d-bfd1-7a924b39c044 with identifier: 1983390
2026-03-25 18:35:08 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:35:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 3019ca5f-4672-579d-bfd1-7a924b39c044 with identifier: 1983390
2026-03-25 18:35:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 3019ca5f-4672-579d-bfd1-7a924b39c044 with identifier: 1983390 to the API
2026-03-25 18:35:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:35:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:35:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/225/9f2a1e76d61d4486a83718c5629c314a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'color': 'Banquise blanco s',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '3019ca5f-4672-579d-bfd1-7a924b39c044',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'JUMPY',
 'odometer': 40476,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3019ca5f-4672-579d-bfd1-7a924b39c044/3019ca5f-4672-579d-bfd1-7a924b39c044_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330592,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/225/9f2a1e76d61d4486a83718c5629c314a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-21',
 'seats_number': 3,
 'seller_name': None,
 'title': 'CITROËN JUMPY Talla M BlueHDi 120 S&S 6v Club (CA)+++Revisar '
          'peritacion+++',
 'transmission': 'manual',
 'trim': 'Talla M BlueHDi 120 S&S 6v Club (CA)+++Revisar peritacion+++',
 'vin': None,
 'year': 2020}
2026-03-25 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983390%27 HTTP/1.1" 200 None
2026-03-25 18:35:09 [ayvens.es] INFO: Saving data for 1983390: {'created_time': 1774463709.302363, 'last_price_update_time': 1774463709.302374, 'auction_closing_time': 1774526400.0}
2026-03-25 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983390') HTTP/1.1" 204 0
2026-03-25 18:35:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:35:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8edb7c50>
2026-03-25 18:35:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:35:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:35:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:35:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da511c67-f065-544d-9022-0cf3a71928c2/da511c67-f065-544d-9022-0cf3a71928c2_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F422%252F38f434b7bf0d44fca532a9634910d877%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/422/38f434b7bf0d44fca532a9634910d877/images/large/1.jpg saved to cache
2026-03-25 18:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item da511c67-f065-544d-9022-0cf3a71928c2
2026-03-25 18:35:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: da511c67-f065-544d-9022-0cf3a71928c2, skipping ID generation
2026-03-25 18:35:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da511c67-f065-544d-9022-0cf3a71928c2 with scrape type 1
2026-03-25 18:35:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item da511c67-f065-544d-9022-0cf3a71928c2 sending to next pipeline
2026-03-25 18:35:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: da511c67-f065-544d-9022-0cf3a71928c2, identifier: 1983391
2026-03-25 18:35:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/128/135dc816e8814bd3ac971f28b2c8dcc6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:35:09 [ayvens.es] INFO: Found listing with ID: 1983399
2026-03-25 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983399%27 HTTP/1.1" 200 None
2026-03-25 18:35:09 [ayvens.es] INFO: Scrape type for 1983399: 1
2026-03-25 18:35:09 [ayvens.es] INFO: Extracting data for car ID: 1983399
2026-03-25 18:35:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba81e9a9-8aaf-5b27-a9d2-9a6f18c1540b with identifier: 1983399
2026-03-25 18:35:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba81e9a9-8aaf-5b27-a9d2-9a6f18c1540b with scrape type 1
2026-03-25 18:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ba81e9a9-8aaf-5b27-a9d2-9a6f18c1540b
2026-03-25 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F645%252Fb4480e42b1844edc9591b38fef34cec7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/645/b4480e42b1844edc9591b38fef34cec7/images/large/1.jpg not downloaded yet
2026-03-25 18:35:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: da511c67-f065-544d-9022-0cf3a71928c2 with identifier: 1983391
2026-03-25 18:35:09 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:35:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: da511c67-f065-544d-9022-0cf3a71928c2 with identifier: 1983391
2026-03-25 18:35:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: da511c67-f065-544d-9022-0cf3a71928c2 with identifier: 1983391 to the API
2026-03-25 18:35:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:35:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:35:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/422/38f434b7bf0d44fca532a9634910d877/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 94,
 'color': 'Gris plata',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'da511c67-f065-544d-9022-0cf3a71928c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '308',
 'odometer': 160575,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da511c67-f065-544d-9022-0cf3a71928c2/da511c67-f065-544d-9022-0cf3a71928c2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 470571,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/422/38f434b7bf0d44fca532a9634910d877/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 308 SW Access 1.6 BlueHDI 73KW (100CV)',
 'transmission': 'manual',
 'trim': 'SW Access 1.6 BlueHDI 73KW (100CV)',
 'vin': None,
 'year': 2016}
2026-03-25 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983391%27 HTTP/1.1" 200 None
2026-03-25 18:35:09 [ayvens.es] INFO: Saving data for 1983391: {'created_time': 1774463709.833799, 'last_price_update_time': 1774463709.833815, 'auction_closing_time': 1774526400.0}
2026-03-25 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983391') HTTP/1.1" 204 0
2026-03-25 18:35:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/763/e7a17842fecd45739a27d284e9fb8afb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:35:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/736/6638fb2e90804206a5cb10c8f857959d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:35:09 [ayvens.es] INFO: Found listing with ID: 1983400
2026-03-25 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983400%27 HTTP/1.1" 200 None
2026-03-25 18:35:09 [ayvens.es] INFO: Scrape type for 1983400: 1
2026-03-25 18:35:09 [ayvens.es] INFO: Extracting data for car ID: 1983400
2026-03-25 18:35:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e77266d0-c494-5cd7-8e6f-8fa651a97806 with identifier: 1983400
2026-03-25 18:35:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e77266d0-c494-5cd7-8e6f-8fa651a97806 with scrape type 1
2026-03-25 18:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e77266d0-c494-5cd7-8e6f-8fa651a97806
2026-03-25 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F944%252Fe0fd25083a4b47089632e526916fc08d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/944/e0fd25083a4b47089632e526916fc08d/images/large/1.jpg not downloaded yet
2026-03-25 18:35:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:35:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8edac390>
2026-03-25 18:35:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:35:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:35:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:35:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7cb5c72f-a699-5c32-a8be-63cbb0ad8774/7cb5c72f-a699-5c32-a8be-63cbb0ad8774_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F128%252F135dc816e8814bd3ac971f28b2c8dcc6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/128/135dc816e8814bd3ac971f28b2c8dcc6/images/large/1.jpg saved to cache
2026-03-25 18:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7cb5c72f-a699-5c32-a8be-63cbb0ad8774
2026-03-25 18:35:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7cb5c72f-a699-5c32-a8be-63cbb0ad8774, skipping ID generation
2026-03-25 18:35:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7cb5c72f-a699-5c32-a8be-63cbb0ad8774 with scrape type 1
2026-03-25 18:35:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7cb5c72f-a699-5c32-a8be-63cbb0ad8774 sending to next pipeline
2026-03-25 18:35:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 7cb5c72f-a699-5c32-a8be-63cbb0ad8774, identifier: 1983393
2026-03-25 18:35:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/555/4dfb4bb5b0c44cc0868c5fd717aeaa7b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:35:10 [ayvens.es] INFO: Found listing with ID: 1983401
2026-03-25 18:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983401%27 HTTP/1.1" 200 None
2026-03-25 18:35:10 [ayvens.es] INFO: Scrape type for 1983401: 1
2026-03-25 18:35:10 [ayvens.es] INFO: Extracting data for car ID: 1983401
2026-03-25 18:35:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f67890c3-96dd-5334-9de0-82ed5f7648af with identifier: 1983401
2026-03-25 18:35:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f67890c3-96dd-5334-9de0-82ed5f7648af with scrape type 1
2026-03-25 18:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f67890c3-96dd-5334-9de0-82ed5f7648af
2026-03-25 18:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F003%252F2c22c6e217254442875ce0fa4d133668%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/003/2c22c6e217254442875ce0fa4d133668/images/large/1.jpg not downloaded yet
2026-03-25 18:35:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 7cb5c72f-a699-5c32-a8be-63cbb0ad8774 with identifier: 1983393
2026-03-25 18:35:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 7cb5c72f-a699-5c32-a8be-63cbb0ad8774 with identifier: 1983393
2026-03-25 18:35:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 7cb5c72f-a699-5c32-a8be-63cbb0ad8774 with identifier: 1983393 to the API
2026-03-25 18:35:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:35:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:35:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/128/135dc816e8814bd3ac971f28b2c8dcc6/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'color': 'Glaciersilber',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '7cb5c72f-a699-5c32-a8be-63cbb0ad8774',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X4',
 'odometer': 111505,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cb5c72f-a699-5c32-a8be-63cbb0ad8774/7cb5c72f-a699-5c32-a8be-63cbb0ad8774_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325923,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/128/135dc816e8814bd3ac971f28b2c8dcc6/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X4 xDrive20d',
 'transmission': 'manual',
 'trim': 'xDrive20d',
 'vin': None,
 'year': 2021}
2026-03-25 18:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983393%27 HTTP/1.1" 200 None
2026-03-25 18:35:10 [ayvens.es] INFO: Saving data for 1983393: {'created_time': 1774463710.350348, 'last_price_update_time': 1774463710.350358, 'auction_closing_time': 1774526400.0}
2026-03-25 18:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983393') HTTP/1.1" 204 0
2026-03-25 18:35:10 [ayvens.es] INFO: Found listing with ID: 1983402
2026-03-25 18:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983402%27 HTTP/1.1" 200 None
2026-03-25 18:35:10 [ayvens.es] INFO: Scrape type for 1983402: 1
2026-03-25 18:35:10 [ayvens.es] INFO: Extracting data for car ID: 1983402
2026-03-25 18:35:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23c58486-77b1-5240-966e-45086c5f8f7a with identifier: 1983402
2026-03-25 18:35:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23c58486-77b1-5240-966e-45086c5f8f7a with scrape type 1
2026-03-25 18:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 23c58486-77b1-5240-966e-45086c5f8f7a
2026-03-25 18:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F026%252Fb84726cd6ab84ea199fdea6736faa6cf%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/026/b84726cd6ab84ea199fdea6736faa6cf/images/large/1.jpg not downloaded yet
2026-03-25 18:35:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/201/2a5a04bb67e74c4f98573d6c3b835b77/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:35:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/318/21241b327f784c50b137abe135dd470a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:35:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:35:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8eaa2f90>
2026-03-25 18:35:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:35:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:35:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:35:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3666e0c-5702-51a1-826a-6eedae99f80e/c3666e0c-5702-51a1-826a-6eedae99f80e_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F763%252Fe7a17842fecd45739a27d284e9fb8afb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/763/e7a17842fecd45739a27d284e9fb8afb/images/large/1.jpg saved to cache
2026-03-25 18:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c3666e0c-5702-51a1-826a-6eedae99f80e
2026-03-25 18:35:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c3666e0c-5702-51a1-826a-6eedae99f80e, skipping ID generation
2026-03-25 18:35:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3666e0c-5702-51a1-826a-6eedae99f80e with scrape type 1
2026-03-25 18:35:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c3666e0c-5702-51a1-826a-6eedae99f80e sending to next pipeline
2026-03-25 18:35:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c3666e0c-5702-51a1-826a-6eedae99f80e, identifier: 1983392
2026-03-25 18:35:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:35:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ed97f10>
2026-03-25 18:35:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:35:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:35:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:35:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69085eab-7e4d-5370-b5f4-9c547ff8f74d/69085eab-7e4d-5370-b5f4-9c547ff8f74d_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F736%252F6638fb2e90804206a5cb10c8f857959d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/736/6638fb2e90804206a5cb10c8f857959d/images/large/1.jpg saved to cache
2026-03-25 18:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 69085eab-7e4d-5370-b5f4-9c547ff8f74d
2026-03-25 18:35:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 69085eab-7e4d-5370-b5f4-9c547ff8f74d, skipping ID generation
2026-03-25 18:35:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69085eab-7e4d-5370-b5f4-9c547ff8f74d with scrape type 1
2026-03-25 18:35:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 69085eab-7e4d-5370-b5f4-9c547ff8f74d sending to next pipeline
2026-03-25 18:35:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 69085eab-7e4d-5370-b5f4-9c547ff8f74d, identifier: 1983394
2026-03-25 18:35:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:35:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8f253f90>
2026-03-25 18:35:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:35:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:35:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:35:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3090931-9851-5578-a792-179afbece4dc/d3090931-9851-5578-a792-179afbece4dc_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F555%252F4dfb4bb5b0c44cc0868c5fd717aeaa7b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/555/4dfb4bb5b0c44cc0868c5fd717aeaa7b/images/large/1.jpg saved to cache
2026-03-25 18:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d3090931-9851-5578-a792-179afbece4dc
2026-03-25 18:35:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d3090931-9851-5578-a792-179afbece4dc, skipping ID generation
2026-03-25 18:35:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3090931-9851-5578-a792-179afbece4dc with scrape type 1
2026-03-25 18:35:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d3090931-9851-5578-a792-179afbece4dc sending to next pipeline
2026-03-25 18:35:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d3090931-9851-5578-a792-179afbece4dc, identifier: 1983395
2026-03-25 18:35:10 [ayvens.es] INFO: Found listing with ID: 1983403
2026-03-25 18:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983403%27 HTTP/1.1" 200 None
2026-03-25 18:35:10 [ayvens.es] INFO: Scrape type for 1983403: 1
2026-03-25 18:35:10 [ayvens.es] INFO: Extracting data for car ID: 1983403
2026-03-25 18:35:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4069b695-6a6a-5daa-af91-86ffa094dac3 with identifier: 1983403
2026-03-25 18:35:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4069b695-6a6a-5daa-af91-86ffa094dac3 with scrape type 1
2026-03-25 18:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4069b695-6a6a-5daa-af91-86ffa094dac3
2026-03-25 18:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F473%252F22ce3b1e2ddf45b19ffbb17f5e3443dc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/473/22ce3b1e2ddf45b19ffbb17f5e3443dc/images/large/1.jpg not downloaded yet
2026-03-25 18:35:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c3666e0c-5702-51a1-826a-6eedae99f80e with identifier: 1983392
2026-03-25 18:35:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c3666e0c-5702-51a1-826a-6eedae99f80e with identifier: 1983392
2026-03-25 18:35:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c3666e0c-5702-51a1-826a-6eedae99f80e with identifier: 1983392 to the API
2026-03-25 18:35:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:35:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:35:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/763/e7a17842fecd45739a27d284e9fb8afb/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Blanco glaciar',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c3666e0c-5702-51a1-826a-6eedae99f80e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 162045,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3666e0c-5702-51a1-826a-6eedae99f80e/c3666e0c-5702-51a1-826a-6eedae99f80e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 582726,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/763/e7a17842fecd45739a27d284e9fb8afb/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO (O) Business dCi 55kW (75CV) -18',
 'transmission': 'manual',
 'trim': '(O) Business dCi 55kW (75CV) -18',
 'vin': None,
 'year': 2019}
2026-03-25 18:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983392%27 HTTP/1.1" 200 None
2026-03-25 18:35:11 [ayvens.es] INFO: Saving data for 1983392: {'created_time': 1774463711.280299, 'last_price_update_time': 1774463711.280309, 'auction_closing_time': 1774526400.0}
2026-03-25 18:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983392') HTTP/1.1" 204 0
2026-03-25 18:35:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 69085eab-7e4d-5370-b5f4-9c547ff8f74d with identifier: 1983394
2026-03-25 18:35:11 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:35:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 69085eab-7e4d-5370-b5f4-9c547ff8f74d with identifier: 1983394
2026-03-25 18:35:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 69085eab-7e4d-5370-b5f4-9c547ff8f74d with identifier: 1983394 to the API
2026-03-25 18:35:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:35:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:35:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/736/6638fb2e90804206a5cb10c8f857959d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'Blanco nevada',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '69085eab-7e4d-5370-b5f4-9c547ff8f74d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ATECA',
 'odometer': 189760,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69085eab-7e4d-5370-b5f4-9c547ff8f74d/69085eab-7e4d-5370-b5f4-9c547ff8f74d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330751,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/736/6638fb2e90804206a5cb10c8f857959d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ATECA 2.0 TDI 85kW (115CV) S&S Style Go "M"',
 'transmission': 'manual',
 'trim': '2.0 TDI 85kW (115CV) S&S Style Go "M"',
 'vin': None,
 'year': 2021}
2026-03-25 18:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983394%27 HTTP/1.1" 200 None
2026-03-25 18:35:11 [ayvens.es] INFO: Saving data for 1983394: {'created_time': 1774463711.557103, 'last_price_update_time': 1774463711.557113, 'auction_closing_time': 1774526400.0}
2026-03-25 18:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983394') HTTP/1.1" 204 0
2026-03-25 18:35:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d3090931-9851-5578-a792-179afbece4dc with identifier: 1983395
2026-03-25 18:35:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d3090931-9851-5578-a792-179afbece4dc with identifier: 1983395
2026-03-25 18:35:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d3090931-9851-5578-a792-179afbece4dc with identifier: 1983395 to the API
2026-03-25 18:35:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:35:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:35:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/555/4dfb4bb5b0c44cc0868c5fd717aeaa7b/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'color': 'Blanco candy s',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd3090931-9851-5578-a792-179afbece4dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'CADDY',
 'odometer': 260367,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3090931-9851-5578-a792-179afbece4dc/d3090931-9851-5578-a792-179afbece4dc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 321064,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/555/4dfb4bb5b0c44cc0868c5fd717aeaa7b/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN CADDY Profesional Kombi 2.0 TDI 55kW BMT',
 'transmission': 'manual',
 'trim': 'Profesional Kombi 2.0 TDI 55kW BMT',
 'vin': None,
 'year': 2020}
2026-03-25 18:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983395%27 HTTP/1.1" 200 None
2026-03-25 18:35:11 [ayvens.es] INFO: Saving data for 1983395: {'created_time': 1774463711.832391, 'last_price_update_time': 1774463711.832401, 'auction_closing_time': 1774526400.0}
2026-03-25 18:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983395') HTTP/1.1" 204 0
2026-03-25 18:35:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/620/0ee33525780a4cb0bea137b7ca7e1ce1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:35:11 [ayvens.es] INFO: Found listing with ID: 1983404
2026-03-25 18:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983404%27 HTTP/1.1" 200 None
2026-03-25 18:35:11 [ayvens.es] INFO: Scrape type for 1983404: 1
2026-03-25 18:35:11 [ayvens.es] INFO: Extracting data for car ID: 1983404
2026-03-25 18:35:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f77f0d6f-b1d8-55f6-a7d8-3a98a123ea54 with identifier: 1983404
2026-03-25 18:35:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f77f0d6f-b1d8-55f6-a7d8-3a98a123ea54 with scrape type 1
2026-03-25 18:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item f77f0d6f-b1d8-55f6-a7d8-3a98a123ea54
2026-03-25 18:35:11 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item f77f0d6f-b1d8-55f6-a7d8-3a98a123ea54
2026-03-25 18:35:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f77f0d6f-b1d8-55f6-a7d8-3a98a123ea54, identifier: 1983404
2026-03-25 18:35:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f77f0d6f-b1d8-55f6-a7d8-3a98a123ea54 with identifier: 1983404
2026-03-25 18:35:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f77f0d6f-b1d8-55f6-a7d8-3a98a123ea54 with identifier: 1983404
2026-03-25 18:35:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f77f0d6f-b1d8-55f6-a7d8-3a98a123ea54 with identifier: 1983404 to the API
2026-03-25 18:35:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:35:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:35:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f77f0d6f-b1d8-55f6-a7d8-3a98a123ea54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': 194879,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FOCUS 1.5 Ecoblue 70kW Trend+',
 'transmission': 'manual',
 'trim': '1.5 Ecoblue 70kW Trend+',
 'vin': None,
 'year': 2022}
2026-03-25 18:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983404%27 HTTP/1.1" 200 None
2026-03-25 18:35:12 [ayvens.es] INFO: Saving data for 1983404: {'created_time': 1774463712.236768, 'last_price_update_time': 1774463712.236779, 'auction_closing_time': 1774526400.0}
2026-03-25 18:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983404') HTTP/1.1" 204 0
2026-03-25 18:35:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:35:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8f04e650>
2026-03-25 18:35:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:35:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:35:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:35:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db515e0f-086b-5fb8-ae81-9e0137d9b52f/db515e0f-086b-5fb8-ae81-9e0137d9b52f_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F201%252F2a5a04bb67e74c4f98573d6c3b835b77%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/201/2a5a04bb67e74c4f98573d6c3b835b77/images/large/1.jpg saved to cache
2026-03-25 18:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item db515e0f-086b-5fb8-ae81-9e0137d9b52f
2026-03-25 18:35:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: db515e0f-086b-5fb8-ae81-9e0137d9b52f, skipping ID generation
2026-03-25 18:35:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db515e0f-086b-5fb8-ae81-9e0137d9b52f with scrape type 1
2026-03-25 18:35:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item db515e0f-086b-5fb8-ae81-9e0137d9b52f sending to next pipeline
2026-03-25 18:35:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: db515e0f-086b-5fb8-ae81-9e0137d9b52f, identifier: 1983396
2026-03-25 18:35:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:35:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ea49fd0>
2026-03-25 18:35:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:35:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:35:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:35:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_455aa0ba-365f-551b-a7e1-592d89cd5221/455aa0ba-365f-551b-a7e1-592d89cd5221_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F318%252F21241b327f784c50b137abe135dd470a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/318/21241b327f784c50b137abe135dd470a/images/large/1.jpg saved to cache
2026-03-25 18:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 455aa0ba-365f-551b-a7e1-592d89cd5221
2026-03-25 18:35:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 455aa0ba-365f-551b-a7e1-592d89cd5221, skipping ID generation
2026-03-25 18:35:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 455aa0ba-365f-551b-a7e1-592d89cd5221 with scrape type 1
2026-03-25 18:35:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 455aa0ba-365f-551b-a7e1-592d89cd5221 sending to next pipeline
2026-03-25 18:35:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 455aa0ba-365f-551b-a7e1-592d89cd5221, identifier: 1983397
2026-03-25 18:35:12 [ayvens.es] INFO: Found listing with ID: 1983405
2026-03-25 18:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983405%27 HTTP/1.1" 200 None
2026-03-25 18:35:12 [ayvens.es] INFO: Scrape type for 1983405: 1
2026-03-25 18:35:12 [ayvens.es] INFO: Extracting data for car ID: 1983405
2026-03-25 18:35:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc1031ef-4864-5027-a292-b568abad2f79 with identifier: 1983405
2026-03-25 18:35:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc1031ef-4864-5027-a292-b568abad2f79 with scrape type 1
2026-03-25 18:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item fc1031ef-4864-5027-a292-b568abad2f79
2026-03-25 18:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F871%252F1237ec435d244addb9aaefc4fbe93ce4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/871/1237ec435d244addb9aaefc4fbe93ce4/images/large/1.jpg not downloaded yet
2026-03-25 18:35:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: db515e0f-086b-5fb8-ae81-9e0137d9b52f with identifier: 1983396
2026-03-25 18:35:12 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:35:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: db515e0f-086b-5fb8-ae81-9e0137d9b52f with identifier: 1983396
2026-03-25 18:35:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: db515e0f-086b-5fb8-ae81-9e0137d9b52f with identifier: 1983396 to the API
2026-03-25 18:35:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:35:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:35:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/201/2a5a04bb67e74c4f98573d6c3b835b77/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'color': 'Gris artense',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'db515e0f-086b-5fb8-ae81-9e0137d9b52f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008',
 'odometer': 82791,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db515e0f-086b-5fb8-ae81-9e0137d9b52f/db515e0f-086b-5fb8-ae81-9e0137d9b52f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 463295,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/201/2a5a04bb67e74c4f98573d6c3b835b77/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-16',
 'seats_number': 7,
 'seller_name': None,
 'title': 'PEUGEOT 5008 Allure 1.5L BlueHDi 96kW (130CV) S&S',
 'transmission': 'manual',
 'trim': 'Allure 1.5L BlueHDi 96kW (130CV) S&S',
 'vin': None,
 'year': 2020}
2026-03-25 18:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983396%27 HTTP/1.1" 200 None
2026-03-25 18:35:12 [ayvens.es] INFO: Saving data for 1983396: {'created_time': 1774463712.876266, 'last_price_update_time': 1774463712.876276, 'auction_closing_time': 1774526400.0}
2026-03-25 18:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983396') HTTP/1.1" 204 0
2026-03-25 18:35:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 455aa0ba-365f-551b-a7e1-592d89cd5221 with identifier: 1983397
2026-03-25 18:35:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 455aa0ba-365f-551b-a7e1-592d89cd5221 with identifier: 1983397
2026-03-25 18:35:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 455aa0ba-365f-551b-a7e1-592d89cd5221 with identifier: 1983397 to the API
2026-03-25 18:35:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:35:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:35:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/318/21241b327f784c50b137abe135dd470a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 85,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '455aa0ba-365f-551b-a7e1-592d89cd5221',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 121978,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_455aa0ba-365f-551b-a7e1-592d89cd5221/455aa0ba-365f-551b-a7e1-592d89cd5221_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353471,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/318/21241b327f784c50b137abe135dd470a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO (O) Business Energy dCi 55kW (75CV)',
 'transmission': 'manual',
 'trim': '(O) Business Energy dCi 55kW (75CV)',
 'vin': None,
 'year': 2019}
2026-03-25 18:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983397%27 HTTP/1.1" 200 None
2026-03-25 18:35:13 [ayvens.es] INFO: Saving data for 1983397: {'created_time': 1774463713.160471, 'last_price_update_time': 1774463713.160481, 'auction_closing_time': 1774526400.0}
2026-03-25 18:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983397') HTTP/1.1" 204 0
2026-03-25 18:35:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/944/e0fd25083a4b47089632e526916fc08d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:35:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/645/b4480e42b1844edc9591b38fef34cec7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:35:13 [ayvens.es] INFO: Found listing with ID: 1983406
2026-03-25 18:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983406%27 HTTP/1.1" 200 None
2026-03-25 18:35:13 [ayvens.es] INFO: Scrape type for 1983406: 1
2026-03-25 18:35:13 [ayvens.es] INFO: Extracting data for car ID: 1983406
2026-03-25 18:35:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e904d6e7-937a-58c6-8203-1a71224dca46 with identifier: 1983406
2026-03-25 18:35:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e904d6e7-937a-58c6-8203-1a71224dca46 with scrape type 1
2026-03-25 18:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e904d6e7-937a-58c6-8203-1a71224dca46
2026-03-25 18:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F083%252Fdbbb8abf4ac542fbb6670502c151478a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/083/dbbb8abf4ac542fbb6670502c151478a/images/large/1.jpg not downloaded yet
2026-03-25 18:35:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:35:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8efa6a10>
2026-03-25 18:35:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:35:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:35:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:35:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d900bd12-c6a6-5e02-9db8-92152ca8b114/d900bd12-c6a6-5e02-9db8-92152ca8b114_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F620%252F0ee33525780a4cb0bea137b7ca7e1ce1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/620/0ee33525780a4cb0bea137b7ca7e1ce1/images/large/1.jpg saved to cache
2026-03-25 18:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d900bd12-c6a6-5e02-9db8-92152ca8b114
2026-03-25 18:35:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d900bd12-c6a6-5e02-9db8-92152ca8b114, skipping ID generation
2026-03-25 18:35:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d900bd12-c6a6-5e02-9db8-92152ca8b114 with scrape type 1
2026-03-25 18:35:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d900bd12-c6a6-5e02-9db8-92152ca8b114 sending to next pipeline
2026-03-25 18:35:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d900bd12-c6a6-5e02-9db8-92152ca8b114, identifier: 1983398
2026-03-25 18:35:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d900bd12-c6a6-5e02-9db8-92152ca8b114 with identifier: 1983398
2026-03-25 18:35:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d900bd12-c6a6-5e02-9db8-92152ca8b114 with identifier: 1983398
2026-03-25 18:35:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d900bd12-c6a6-5e02-9db8-92152ca8b114 with identifier: 1983398 to the API
2026-03-25 18:35:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:35:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:35:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/620/0ee33525780a4cb0bea137b7ca7e1ce1/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 188,
 'color': 'Blanco glaciar',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd900bd12-c6a6-5e02-9db8-92152ca8b114',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'TRAFIC',
 'odometer': 46813,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d900bd12-c6a6-5e02-9db8-92152ca8b114/d900bd12-c6a6-5e02-9db8-92152ca8b114_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 346210,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/620/0ee33525780a4cb0bea137b7ca7e1ce1/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-06-21',
 'seats_number': 9,
 'seller_name': None,
 'title': 'RENAULT TRAFIC (O) Authentic Energy Blue dCi 81 kW (110CV)',
 'transmission': 'manual',
 'trim': '(O) Authentic Energy Blue dCi 81 kW (110CV)',
 'vin': None,
 'year': 2024}
2026-03-25 18:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983398%27 HTTP/1.1" 200 None
2026-03-25 18:35:13 [ayvens.es] INFO: Saving data for 1983398: {'created_time': 1774463713.7566, 'last_price_update_time': 1774463713.75661, 'auction_closing_time': 1774526400.0}
2026-03-25 18:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983398') HTTP/1.1" 204 0
2026-03-25 18:35:13 [ayvens.es] INFO: Found listing with ID: 1983407
2026-03-25 18:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983407%27 HTTP/1.1" 200 None
2026-03-25 18:35:13 [ayvens.es] INFO: Scrape type for 1983407: 1
2026-03-25 18:35:13 [ayvens.es] INFO: Extracting data for car ID: 1983407
2026-03-25 18:35:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dfa9d97f-6952-51d9-be46-548ef322721e with identifier: 1983407
2026-03-25 18:35:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfa9d97f-6952-51d9-be46-548ef322721e with scrape type 1
2026-03-25 18:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item dfa9d97f-6952-51d9-be46-548ef322721e
2026-03-25 18:35:13 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item dfa9d97f-6952-51d9-be46-548ef322721e
2026-03-25 18:35:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: dfa9d97f-6952-51d9-be46-548ef322721e, identifier: 1983407
2026-03-25 18:35:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/003/2c22c6e217254442875ce0fa4d133668/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:35:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: dfa9d97f-6952-51d9-be46-548ef322721e with identifier: 1983407
2026-03-25 18:35:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: dfa9d97f-6952-51d9-be46-548ef322721e with identifier: 1983407
2026-03-25 18:35:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: dfa9d97f-6952-51d9-be46-548ef322721e with identifier: 1983407 to the API
2026-03-25 18:35:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:35:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:35:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'dfa9d97f-6952-51d9-be46-548ef322721e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': 183549,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FOCUS 1.5 Ecoblue 70kW Trend+',
 'transmission': 'manual',
 'trim': '1.5 Ecoblue 70kW Trend+',
 'vin': None,
 'year': 2022}
2026-03-25 18:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983407%27 HTTP/1.1" 200 None
2026-03-25 18:35:14 [ayvens.es] INFO: Saving data for 1983407: {'created_time': 1774463714.143783, 'last_price_update_time': 1774463714.143798, 'auction_closing_time': 1774526400.0}
2026-03-25 18:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983407') HTTP/1.1" 204 0
2026-03-25 18:35:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:35:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ea53dd0>
2026-03-25 18:35:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:35:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:35:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:35:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e77266d0-c494-5cd7-8e6f-8fa651a97806/e77266d0-c494-5cd7-8e6f-8fa651a97806_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F944%252Fe0fd25083a4b47089632e526916fc08d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/944/e0fd25083a4b47089632e526916fc08d/images/large/1.jpg saved to cache
2026-03-25 18:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e77266d0-c494-5cd7-8e6f-8fa651a97806
2026-03-25 18:35:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e77266d0-c494-5cd7-8e6f-8fa651a97806, skipping ID generation
2026-03-25 18:35:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e77266d0-c494-5cd7-8e6f-8fa651a97806 with scrape type 1
2026-03-25 18:35:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e77266d0-c494-5cd7-8e6f-8fa651a97806 sending to next pipeline
2026-03-25 18:35:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e77266d0-c494-5cd7-8e6f-8fa651a97806, identifier: 1983400
2026-03-25 18:35:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:35:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8d42c790>
2026-03-25 18:35:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:35:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:35:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:35:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba81e9a9-8aaf-5b27-a9d2-9a6f18c1540b/ba81e9a9-8aaf-5b27-a9d2-9a6f18c1540b_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F645%252Fb4480e42b1844edc9591b38fef34cec7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/645/b4480e42b1844edc9591b38fef34cec7/images/large/1.jpg saved to cache
2026-03-25 18:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ba81e9a9-8aaf-5b27-a9d2-9a6f18c1540b
2026-03-25 18:35:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ba81e9a9-8aaf-5b27-a9d2-9a6f18c1540b, skipping ID generation
2026-03-25 18:35:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba81e9a9-8aaf-5b27-a9d2-9a6f18c1540b with scrape type 1
2026-03-25 18:35:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ba81e9a9-8aaf-5b27-a9d2-9a6f18c1540b sending to next pipeline
2026-03-25 18:35:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ba81e9a9-8aaf-5b27-a9d2-9a6f18c1540b, identifier: 1983399
2026-03-25 18:35:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/026/b84726cd6ab84ea199fdea6736faa6cf/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:35:14 [ayvens.es] INFO: Found listing with ID: 1983408
2026-03-25 18:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983408%27 HTTP/1.1" 200 None
2026-03-25 18:35:14 [ayvens.es] INFO: Scrape type for 1983408: 1
2026-03-25 18:35:14 [ayvens.es] INFO: Extracting data for car ID: 1983408
2026-03-25 18:35:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34e55560-e95c-511a-927d-59fe782c1927 with identifier: 1983408
2026-03-25 18:35:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34e55560-e95c-511a-927d-59fe782c1927 with scrape type 1
2026-03-25 18:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 34e55560-e95c-511a-927d-59fe782c1927
2026-03-25 18:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F966%252F30d1b9593a894089a87d752bf3050cfa%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/966/30d1b9593a894089a87d752bf3050cfa/images/large/1.jpg not downloaded yet
2026-03-25 18:35:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e77266d0-c494-5cd7-8e6f-8fa651a97806 with identifier: 1983400
2026-03-25 18:35:14 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:35:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e77266d0-c494-5cd7-8e6f-8fa651a97806 with identifier: 1983400
2026-03-25 18:35:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e77266d0-c494-5cd7-8e6f-8fa651a97806 with identifier: 1983400 to the API
2026-03-25 18:35:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:35:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:35:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/944/e0fd25083a4b47089632e526916fc08d/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 93,
 'color': 'Plata perla moondust',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e77266d0-c494-5cd7-8e6f-8fa651a97806',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': 145160,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e77266d0-c494-5cd7-8e6f-8fa651a97806/e77266d0-c494-5cd7-8e6f-8fa651a97806_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 361766,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/944/e0fd25083a4b47089632e526916fc08d/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FOCUS 1.5 Ecoblue 88kW ST-Line SportBr',
 'transmission': 'manual',
 'trim': '1.5 Ecoblue 88kW ST-Line SportBr',
 'vin': None,
 'year': 2020}
2026-03-25 18:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983400%27 HTTP/1.1" 200 None
2026-03-25 18:35:14 [ayvens.es] INFO: Saving data for 1983400: {'created_time': 1774463714.731678, 'last_price_update_time': 1774463714.731688, 'auction_closing_time': 1774526400.0}
2026-03-25 18:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983400') HTTP/1.1" 204 0
2026-03-25 18:35:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ba81e9a9-8aaf-5b27-a9d2-9a6f18c1540b with identifier: 1983399
2026-03-25 18:35:14 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:35:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ba81e9a9-8aaf-5b27-a9d2-9a6f18c1540b with identifier: 1983399
2026-03-25 18:35:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ba81e9a9-8aaf-5b27-a9d2-9a6f18c1540b with identifier: 1983399 to the API
2026-03-25 18:35:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:35:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:35:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/645/b4480e42b1844edc9591b38fef34cec7/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'color': 'Gris platino',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ba81e9a9-8aaf-5b27-a9d2-9a6f18c1540b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN ALLSPACE',
 'odometer': 101201,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba81e9a9-8aaf-5b27-a9d2-9a6f18c1540b/ba81e9a9-8aaf-5b27-a9d2-9a6f18c1540b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 357749,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/645/b4480e42b1844edc9591b38fef34cec7/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-27',
 'seats_number': 7,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN ALLSPACE Advance 2.0 TDI 110kW (150CV) DSG',
 'transmission': 'manual',
 'trim': 'Advance 2.0 TDI 110kW (150CV) DSG',
 'vin': None,
 'year': 2019}
2026-03-25 18:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983399%27 HTTP/1.1" 200 None
2026-03-25 18:35:15 [ayvens.es] INFO: Saving data for 1983399: {'created_time': 1774463715.052897, 'last_price_update_time': 1774463715.052911, 'auction_closing_time': 1774526400.0}
2026-03-25 18:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983399') HTTP/1.1" 204 0
2026-03-25 18:35:15 [ayvens.es] INFO: Found listing with ID: 1983409
2026-03-25 18:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983409%27 HTTP/1.1" 200 None
2026-03-25 18:35:15 [ayvens.es] INFO: Scrape type for 1983409: 1
2026-03-25 18:35:15 [ayvens.es] INFO: Extracting data for car ID: 1983409
2026-03-25 18:35:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38823773-392b-522a-b2a7-e65a8160e2f0 with identifier: 1983409
2026-03-25 18:35:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38823773-392b-522a-b2a7-e65a8160e2f0 with scrape type 1
2026-03-25 18:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 38823773-392b-522a-b2a7-e65a8160e2f0
2026-03-25 18:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F132%252F1aa130b51cf44ebdbd6fe4bac9ed5f47%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/132/1aa130b51cf44ebdbd6fe4bac9ed5f47/images/large/1.jpg not downloaded yet
2026-03-25 18:35:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/473/22ce3b1e2ddf45b19ffbb17f5e3443dc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:35:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:35:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8f42e190>
2026-03-25 18:35:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:35:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:35:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:35:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f67890c3-96dd-5334-9de0-82ed5f7648af/f67890c3-96dd-5334-9de0-82ed5f7648af_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F003%252F2c22c6e217254442875ce0fa4d133668%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/003/2c22c6e217254442875ce0fa4d133668/images/large/1.jpg saved to cache
2026-03-25 18:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f67890c3-96dd-5334-9de0-82ed5f7648af
2026-03-25 18:35:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f67890c3-96dd-5334-9de0-82ed5f7648af, skipping ID generation
2026-03-25 18:35:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f67890c3-96dd-5334-9de0-82ed5f7648af with scrape type 1
2026-03-25 18:35:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f67890c3-96dd-5334-9de0-82ed5f7648af sending to next pipeline
2026-03-25 18:35:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f67890c3-96dd-5334-9de0-82ed5f7648af, identifier: 1983401
2026-03-25 18:35:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:35:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e568750>
2026-03-25 18:35:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:35:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:35:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:35:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23c58486-77b1-5240-966e-45086c5f8f7a/23c58486-77b1-5240-966e-45086c5f8f7a_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F026%252Fb84726cd6ab84ea199fdea6736faa6cf%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/026/b84726cd6ab84ea199fdea6736faa6cf/images/large/1.jpg saved to cache
2026-03-25 18:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 23c58486-77b1-5240-966e-45086c5f8f7a
2026-03-25 18:35:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 23c58486-77b1-5240-966e-45086c5f8f7a, skipping ID generation
2026-03-25 18:35:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23c58486-77b1-5240-966e-45086c5f8f7a with scrape type 1
2026-03-25 18:35:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 23c58486-77b1-5240-966e-45086c5f8f7a sending to next pipeline
2026-03-25 18:35:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 23c58486-77b1-5240-966e-45086c5f8f7a, identifier: 1983402
2026-03-25 18:35:15 [ayvens.es] INFO: Found listing with ID: 1983410
2026-03-25 18:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983410%27 HTTP/1.1" 200 None
2026-03-25 18:35:15 [ayvens.es] INFO: Scrape type for 1983410: 1
2026-03-25 18:35:15 [ayvens.es] INFO: Extracting data for car ID: 1983410
2026-03-25 18:35:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c430a35-dfdb-5ef9-8013-0878225cfa52 with identifier: 1983410
2026-03-25 18:35:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c430a35-dfdb-5ef9-8013-0878225cfa52 with scrape type 1
2026-03-25 18:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8c430a35-dfdb-5ef9-8013-0878225cfa52
2026-03-25 18:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F211%252F7b42d3f2660443f49d7fb359481a190a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/211/7b42d3f2660443f49d7fb359481a190a/images/large/1.jpg not downloaded yet
2026-03-25 18:35:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f67890c3-96dd-5334-9de0-82ed5f7648af with identifier: 1983401
2026-03-25 18:35:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f67890c3-96dd-5334-9de0-82ed5f7648af with identifier: 1983401
2026-03-25 18:35:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f67890c3-96dd-5334-9de0-82ed5f7648af with identifier: 1983401 to the API
2026-03-25 18:35:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:35:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:35:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/003/2c22c6e217254442875ce0fa4d133668/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'Blanco glaciar',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f67890c3-96dd-5334-9de0-82ed5f7648af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'DACIA',
 'model': 'DUSTER',
 'odometer': 111196,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f67890c3-96dd-5334-9de0-82ed5f7648af/f67890c3-96dd-5334-9de0-82ed5f7648af_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329188,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/003/2c22c6e217254442875ce0fa4d133668/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DACIA DUSTER Comfort Blue dCi 85kW (115CV) 4X4',
 'transmission': 'manual',
 'trim': 'Comfort Blue dCi 85kW (115CV) 4X4',
 'vin': None,
 'year': 2022}
2026-03-25 18:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983401%27 HTTP/1.1" 200 None
2026-03-25 18:35:15 [ayvens.es] INFO: Saving data for 1983401: {'created_time': 1774463715.792948, 'last_price_update_time': 1774463715.792958, 'auction_closing_time': 1774526400.0}
2026-03-25 18:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983401') HTTP/1.1" 204 0
2026-03-25 18:35:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 23c58486-77b1-5240-966e-45086c5f8f7a with identifier: 1983402
2026-03-25 18:35:15 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:35:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 23c58486-77b1-5240-966e-45086c5f8f7a with identifier: 1983402
2026-03-25 18:35:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 23c58486-77b1-5240-966e-45086c5f8f7a with identifier: 1983402 to the API
2026-03-25 18:35:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:35:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:35:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/026/b84726cd6ab84ea199fdea6736faa6cf/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'color': 'Eiger grey',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '23c58486-77b1-5240-966e-45086c5f8f7a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER VELAR',
 'odometer': 126875,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23c58486-77b1-5240-966e-45086c5f8f7a/23c58486-77b1-5240-966e-45086c5f8f7a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 374173,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/026/b84726cd6ab84ea199fdea6736faa6cf/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER RANGE ROVER VELAR (O) 2.0 D180 132kW R-Dynamic S 4WD '
          'Auto',
 'transmission': 'manual',
 'trim': '(O) 2.0 D180 132kW R-Dynamic S 4WD Auto',
 'vin': None,
 'year': 2020}
2026-03-25 18:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983402%27 HTTP/1.1" 200 None
2026-03-25 18:35:16 [ayvens.es] INFO: Saving data for 1983402: {'created_time': 1774463716.091507, 'last_price_update_time': 1774463716.091517, 'auction_closing_time': 1774526400.0}
2026-03-25 18:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983402') HTTP/1.1" 204 0
2026-03-25 18:35:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/871/1237ec435d244addb9aaefc4fbe93ce4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:35:16 [ayvens.es] INFO: Found listing with ID: 1983411
2026-03-25 18:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983411%27 HTTP/1.1" 200 None
2026-03-25 18:35:16 [ayvens.es] INFO: Scrape type for 1983411: 1
2026-03-25 18:35:16 [ayvens.es] INFO: Extracting data for car ID: 1983411
2026-03-25 18:35:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34758461-cad7-5f80-b2d2-a455258444fa with identifier: 1983411
2026-03-25 18:35:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34758461-cad7-5f80-b2d2-a455258444fa with scrape type 1
2026-03-25 18:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 34758461-cad7-5f80-b2d2-a455258444fa
2026-03-25 18:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F919%252Ff91dc5035c604bf997304dfd1f8a2a18%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/919/f91dc5035c604bf997304dfd1f8a2a18/images/large/1.jpg not downloaded yet
2026-03-25 18:35:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:35:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8f04e7d0>
2026-03-25 18:35:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:35:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:35:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:35:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4069b695-6a6a-5daa-af91-86ffa094dac3/4069b695-6a6a-5daa-af91-86ffa094dac3_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F473%252F22ce3b1e2ddf45b19ffbb17f5e3443dc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/473/22ce3b1e2ddf45b19ffbb17f5e3443dc/images/large/1.jpg saved to cache
2026-03-25 18:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4069b695-6a6a-5daa-af91-86ffa094dac3
2026-03-25 18:35:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4069b695-6a6a-5daa-af91-86ffa094dac3, skipping ID generation
2026-03-25 18:35:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4069b695-6a6a-5daa-af91-86ffa094dac3 with scrape type 1
2026-03-25 18:35:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4069b695-6a6a-5daa-af91-86ffa094dac3 sending to next pipeline
2026-03-25 18:35:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4069b695-6a6a-5daa-af91-86ffa094dac3, identifier: 1983403
2026-03-25 18:35:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/083/dbbb8abf4ac542fbb6670502c151478a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:35:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4069b695-6a6a-5daa-af91-86ffa094dac3 with identifier: 1983403
2026-03-25 18:35:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4069b695-6a6a-5daa-af91-86ffa094dac3 with identifier: 1983403
2026-03-25 18:35:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 4069b695-6a6a-5daa-af91-86ffa094dac3 with identifier: 1983403 to the API
2026-03-25 18:35:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:35:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:35:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/473/22ce3b1e2ddf45b19ffbb17f5e3443dc/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'color': 'Blanco puro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '4069b695-6a6a-5daa-af91-86ffa094dac3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF',
 'odometer': 141513,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4069b695-6a6a-5daa-af91-86ffa094dac3/4069b695-6a6a-5daa-af91-86ffa094dac3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 346745,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/473/22ce3b1e2ddf45b19ffbb17f5e3443dc/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF 2.0 TDI 85kW (115CV)',
 'transmission': 'manual',
 'trim': '2.0 TDI 85kW (115CV)',
 'vin': None,
 'year': 2021}
2026-03-25 18:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983403%27 HTTP/1.1" 200 None
2026-03-25 18:35:16 [ayvens.es] INFO: Saving data for 1983403: {'created_time': 1774463716.647572, 'last_price_update_time': 1774463716.647583, 'auction_closing_time': 1774526400.0}
2026-03-25 18:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983403') HTTP/1.1" 204 0
2026-03-25 18:35:16 [ayvens.es] INFO: Found listing with ID: 1983412
2026-03-25 18:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983412%27 HTTP/1.1" 200 None
2026-03-25 18:35:16 [ayvens.es] INFO: Scrape type for 1983412: 1
2026-03-25 18:35:16 [ayvens.es] INFO: Extracting data for car ID: 1983412
2026-03-25 18:35:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2863834-f302-57f6-a347-9b58ca215334 with identifier: 1983412
2026-03-25 18:35:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2863834-f302-57f6-a347-9b58ca215334 with scrape type 1
2026-03-25 18:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f2863834-f302-57f6-a347-9b58ca215334
2026-03-25 18:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F961%252F7e04a9f9efd24198acc6252713c3204c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/961/7e04a9f9efd24198acc6252713c3204c/images/large/1.jpg not downloaded yet
2026-03-25 18:35:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:35:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8efa6b90>
2026-03-25 18:35:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:35:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:35:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:35:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc1031ef-4864-5027-a292-b568abad2f79/fc1031ef-4864-5027-a292-b568abad2f79_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F871%252F1237ec435d244addb9aaefc4fbe93ce4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/871/1237ec435d244addb9aaefc4fbe93ce4/images/large/1.jpg saved to cache
2026-03-25 18:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fc1031ef-4864-5027-a292-b568abad2f79
2026-03-25 18:35:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fc1031ef-4864-5027-a292-b568abad2f79, skipping ID generation
2026-03-25 18:35:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc1031ef-4864-5027-a292-b568abad2f79 with scrape type 1
2026-03-25 18:35:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fc1031ef-4864-5027-a292-b568abad2f79 sending to next pipeline
2026-03-25 18:35:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: fc1031ef-4864-5027-a292-b568abad2f79, identifier: 1983405
2026-03-25 18:35:16 [ayvens.es] INFO: Found listing with ID: 1983413
2026-03-25 18:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983413%27 HTTP/1.1" 200 None
2026-03-25 18:35:16 [ayvens.es] INFO: Scrape type for 1983413: 1
2026-03-25 18:35:16 [ayvens.es] INFO: Extracting data for car ID: 1983413
2026-03-25 18:35:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a505507d-57f4-505d-a65e-5f109b1d1715 with identifier: 1983413
2026-03-25 18:35:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a505507d-57f4-505d-a65e-5f109b1d1715 with scrape type 1
2026-03-25 18:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a505507d-57f4-505d-a65e-5f109b1d1715
2026-03-25 18:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F922%252F5b7578eda4d142ddab59b00c428ca6b3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/922/5b7578eda4d142ddab59b00c428ca6b3/images/large/1.jpg not downloaded yet
2026-03-25 18:35:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: fc1031ef-4864-5027-a292-b568abad2f79 with identifier: 1983405
2026-03-25 18:35:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: fc1031ef-4864-5027-a292-b568abad2f79 with identifier: 1983405
2026-03-25 18:35:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: fc1031ef-4864-5027-a292-b568abad2f79 with identifier: 1983405 to the API
2026-03-25 18:35:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:35:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:35:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/871/1237ec435d244addb9aaefc4fbe93ce4/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'fc1031ef-4864-5027-a292-b568abad2f79',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C3 AIRCROSS',
 'odometer': 88370,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc1031ef-4864-5027-a292-b568abad2f79/fc1031ef-4864-5027-a292-b568abad2f79_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354399,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/871/1237ec435d244addb9aaefc4fbe93ce4/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C3 AIRCROSS BlueHDi 81kW (110CV) S&S Feel Pack',
 'transmission': 'manual',
 'trim': 'BlueHDi 81kW (110CV) S&S Feel Pack',
 'vin': None,
 'year': 2022}
2026-03-25 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983405%27 HTTP/1.1" 200 None
2026-03-25 18:35:17 [ayvens.es] INFO: Saving data for 1983405: {'created_time': 1774463717.184513, 'last_price_update_time': 1774463717.184524, 'auction_closing_time': 1774526400.0}
2026-03-25 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983405') HTTP/1.1" 204 0
2026-03-25 18:35:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:35:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8efe6490>
2026-03-25 18:35:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:35:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:35:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:35:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e904d6e7-937a-58c6-8203-1a71224dca46/e904d6e7-937a-58c6-8203-1a71224dca46_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F083%252Fdbbb8abf4ac542fbb6670502c151478a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/083/dbbb8abf4ac542fbb6670502c151478a/images/large/1.jpg saved to cache
2026-03-25 18:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e904d6e7-937a-58c6-8203-1a71224dca46
2026-03-25 18:35:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e904d6e7-937a-58c6-8203-1a71224dca46, skipping ID generation
2026-03-25 18:35:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e904d6e7-937a-58c6-8203-1a71224dca46 with scrape type 1
2026-03-25 18:35:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e904d6e7-937a-58c6-8203-1a71224dca46 sending to next pipeline
2026-03-25 18:35:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e904d6e7-937a-58c6-8203-1a71224dca46, identifier: 1983406
2026-03-25 18:35:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/132/1aa130b51cf44ebdbd6fe4bac9ed5f47/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:35:17 [ayvens.es] INFO: Found listing with ID: 1983414
2026-03-25 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983414%27 HTTP/1.1" 200 None
2026-03-25 18:35:17 [ayvens.es] INFO: Scrape type for 1983414: 1
2026-03-25 18:35:17 [ayvens.es] INFO: Extracting data for car ID: 1983414
2026-03-25 18:35:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97ba2aa8-e914-503e-9cf5-87d59b974493 with identifier: 1983414
2026-03-25 18:35:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97ba2aa8-e914-503e-9cf5-87d59b974493 with scrape type 1
2026-03-25 18:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 97ba2aa8-e914-503e-9cf5-87d59b974493
2026-03-25 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F379%252F728bbb453c15449392997a22f944a3df%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/379/728bbb453c15449392997a22f944a3df/images/large/1.jpg not downloaded yet
2026-03-25 18:35:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e904d6e7-937a-58c6-8203-1a71224dca46 with identifier: 1983406
2026-03-25 18:35:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e904d6e7-937a-58c6-8203-1a71224dca46 with identifier: 1983406
2026-03-25 18:35:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e904d6e7-937a-58c6-8203-1a71224dca46 with identifier: 1983406 to the API
2026-03-25 18:35:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:35:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:35:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/083/dbbb8abf4ac542fbb6670502c151478a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e904d6e7-937a-58c6-8203-1a71224dca46',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C3 AIRCROSS',
 'odometer': 69615,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e904d6e7-937a-58c6-8203-1a71224dca46/e904d6e7-937a-58c6-8203-1a71224dca46_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332005,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/083/dbbb8abf4ac542fbb6670502c151478a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C3 AIRCROSS BlueHDi 81kW (110CV) S&S Feel Pack',
 'transmission': 'manual',
 'trim': 'BlueHDi 81kW (110CV) S&S Feel Pack',
 'vin': None,
 'year': 2022}
2026-03-25 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983406%27 HTTP/1.1" 200 None
2026-03-25 18:35:17 [ayvens.es] INFO: Saving data for 1983406: {'created_time': 1774463717.768673, 'last_price_update_time': 1774463717.768684, 'auction_closing_time': 1774526400.0}
2026-03-25 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983406') HTTP/1.1" 204 0
2026-03-25 18:35:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/966/30d1b9593a894089a87d752bf3050cfa/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:35:17 [ayvens.es] INFO: Found listing with ID: 1983415
2026-03-25 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983415%27 HTTP/1.1" 200 None
2026-03-25 18:35:17 [ayvens.es] INFO: Scrape type for 1983415: 1
2026-03-25 18:35:17 [ayvens.es] INFO: Extracting data for car ID: 1983415
2026-03-25 18:35:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4af3e31e-b069-54b7-a067-772991831d20 with identifier: 1983415
2026-03-25 18:35:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4af3e31e-b069-54b7-a067-772991831d20 with scrape type 1
2026-03-25 18:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4af3e31e-b069-54b7-a067-772991831d20
2026-03-25 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F306%252Ff63d0af2d0e84c698b9fd5c8548a936a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/306/f63d0af2d0e84c698b9fd5c8548a936a/images/large/1.jpg not downloaded yet
2026-03-25 18:35:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:35:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e57ce10>
2026-03-25 18:35:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:35:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:35:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:35:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38823773-392b-522a-b2a7-e65a8160e2f0/38823773-392b-522a-b2a7-e65a8160e2f0_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F132%252F1aa130b51cf44ebdbd6fe4bac9ed5f47%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/132/1aa130b51cf44ebdbd6fe4bac9ed5f47/images/large/1.jpg saved to cache
2026-03-25 18:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 38823773-392b-522a-b2a7-e65a8160e2f0
2026-03-25 18:35:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 38823773-392b-522a-b2a7-e65a8160e2f0, skipping ID generation
2026-03-25 18:35:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38823773-392b-522a-b2a7-e65a8160e2f0 with scrape type 1
2026-03-25 18:35:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 38823773-392b-522a-b2a7-e65a8160e2f0 sending to next pipeline
2026-03-25 18:35:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 38823773-392b-522a-b2a7-e65a8160e2f0, identifier: 1983409
2026-03-25 18:35:18 [ayvens.es] INFO: Found listing with ID: 1983416
2026-03-25 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983416%27 HTTP/1.1" 200 None
2026-03-25 18:35:18 [ayvens.es] INFO: Scrape type for 1983416: 1
2026-03-25 18:35:18 [ayvens.es] INFO: Extracting data for car ID: 1983416
2026-03-25 18:35:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16260c84-5d4c-5048-b7c6-0394bb2042d7 with identifier: 1983416
2026-03-25 18:35:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16260c84-5d4c-5048-b7c6-0394bb2042d7 with scrape type 1
2026-03-25 18:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 16260c84-5d4c-5048-b7c6-0394bb2042d7
2026-03-25 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F955%252F3d7624ef47594c3692aae5161e89ad20%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/955/3d7624ef47594c3692aae5161e89ad20/images/large/1.jpg not downloaded yet
2026-03-25 18:35:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 38823773-392b-522a-b2a7-e65a8160e2f0 with identifier: 1983409
2026-03-25 18:35:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:35:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 38823773-392b-522a-b2a7-e65a8160e2f0 with identifier: 1983409
2026-03-25 18:35:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 38823773-392b-522a-b2a7-e65a8160e2f0 with identifier: 1983409 to the API
2026-03-25 18:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:35:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:35:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/132/1aa130b51cf44ebdbd6fe4bac9ed5f47/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'Sapporo white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '38823773-392b-522a-b2a7-e65a8160e2f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'JUKE',
 'odometer': 69898,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38823773-392b-522a-b2a7-e65a8160e2f0/38823773-392b-522a-b2a7-e65a8160e2f0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 323467,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/132/1aa130b51cf44ebdbd6fe4bac9ed5f47/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN JUKE DIG-T 84 kW (114 CV) 6M/T Acenta',
 'transmission': 'manual',
 'trim': 'DIG-T 84 kW (114 CV) 6M/T Acenta',
 'vin': None,
 'year': 2022}
2026-03-25 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983409%27 HTTP/1.1" 200 None
2026-03-25 18:35:18 [ayvens.es] INFO: Saving data for 1983409: {'created_time': 1774463718.339785, 'last_price_update_time': 1774463718.339795, 'auction_closing_time': 1774526400.0}
2026-03-25 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983409') HTTP/1.1" 204 0
2026-03-25 18:35:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/961/7e04a9f9efd24198acc6252713c3204c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:35:18 [ayvens.es] INFO: Found listing with ID: 1983417
2026-03-25 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983417%27 HTTP/1.1" 200 None
2026-03-25 18:35:18 [ayvens.es] INFO: Scrape type for 1983417: 1
2026-03-25 18:35:18 [ayvens.es] INFO: Extracting data for car ID: 1983417
2026-03-25 18:35:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e53a02e9-86c8-5b98-9994-fae7cbe38302 with identifier: 1983417
2026-03-25 18:35:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e53a02e9-86c8-5b98-9994-fae7cbe38302 with scrape type 1
2026-03-25 18:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e53a02e9-86c8-5b98-9994-fae7cbe38302
2026-03-25 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F455%252F3ad2961a63c940f4bd767d19c13d89f6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/455/3ad2961a63c940f4bd767d19c13d89f6/images/large/1.jpg not downloaded yet
2026-03-25 18:35:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/211/7b42d3f2660443f49d7fb359481a190a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:35:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:35:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae90fcf750>
2026-03-25 18:35:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:35:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:35:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:35:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34e55560-e95c-511a-927d-59fe782c1927/34e55560-e95c-511a-927d-59fe782c1927_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F966%252F30d1b9593a894089a87d752bf3050cfa%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/966/30d1b9593a894089a87d752bf3050cfa/images/large/1.jpg saved to cache
2026-03-25 18:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 34e55560-e95c-511a-927d-59fe782c1927
2026-03-25 18:35:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 34e55560-e95c-511a-927d-59fe782c1927, skipping ID generation
2026-03-25 18:35:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34e55560-e95c-511a-927d-59fe782c1927 with scrape type 1
2026-03-25 18:35:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 34e55560-e95c-511a-927d-59fe782c1927 sending to next pipeline
2026-03-25 18:35:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 34e55560-e95c-511a-927d-59fe782c1927, identifier: 1983408
2026-03-25 18:35:18 [ayvens.es] INFO: Found listing with ID: 1983418
2026-03-25 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983418%27 HTTP/1.1" 200 None
2026-03-25 18:35:18 [ayvens.es] INFO: Scrape type for 1983418: 1
2026-03-25 18:35:18 [ayvens.es] INFO: Extracting data for car ID: 1983418
2026-03-25 18:35:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0bd770b-557b-5e6d-abf0-62d09e7c7e00 with identifier: 1983418
2026-03-25 18:35:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0bd770b-557b-5e6d-abf0-62d09e7c7e00 with scrape type 1
2026-03-25 18:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d0bd770b-557b-5e6d-abf0-62d09e7c7e00
2026-03-25 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F690%252Fcca73ec27c3141a7bb9beaa921bd3021%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/690/cca73ec27c3141a7bb9beaa921bd3021/images/large/1.jpg not downloaded yet
2026-03-25 18:35:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 34e55560-e95c-511a-927d-59fe782c1927 with identifier: 1983408
2026-03-25 18:35:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:35:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 34e55560-e95c-511a-927d-59fe782c1927 with identifier: 1983408
2026-03-25 18:35:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 34e55560-e95c-511a-927d-59fe782c1927 with identifier: 1983408 to the API
2026-03-25 18:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:35:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:35:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/966/30d1b9593a894089a87d752bf3050cfa/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '34e55560-e95c-511a-927d-59fe782c1927',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF',
 'odometer': 117023,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34e55560-e95c-511a-927d-59fe782c1927/34e55560-e95c-511a-927d-59fe782c1927_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 339004,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/966/30d1b9593a894089a87d752bf3050cfa/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF Edition 1.6 TDI 110CV BMT',
 'transmission': 'manual',
 'trim': 'Edition 1.6 TDI 110CV BMT',
 'vin': None,
 'year': 2016}
2026-03-25 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983408%27 HTTP/1.1" 200 None
2026-03-25 18:35:18 [ayvens.es] INFO: Saving data for 1983408: {'created_time': 1774463718.859564, 'last_price_update_time': 1774463718.859576, 'auction_closing_time': 1774526400.0}
2026-03-25 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983408') HTTP/1.1" 204 0
2026-03-25 18:35:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/919/f91dc5035c604bf997304dfd1f8a2a18/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:35:18 [ayvens.es] INFO: Found listing with ID: 1983419
2026-03-25 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983419%27 HTTP/1.1" 200 None
2026-03-25 18:35:18 [ayvens.es] INFO: Scrape type for 1983419: 1
2026-03-25 18:35:18 [ayvens.es] INFO: Extracting data for car ID: 1983419
2026-03-25 18:35:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 393a1284-085e-5a7c-98d6-57ab48d20f41 with identifier: 1983419
2026-03-25 18:35:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 393a1284-085e-5a7c-98d6-57ab48d20f41 with scrape type 1
2026-03-25 18:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 393a1284-085e-5a7c-98d6-57ab48d20f41
2026-03-25 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F693%252F92a48f82d208408eb0bec48c37c54ab0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/693/92a48f82d208408eb0bec48c37c54ab0/images/large/1.jpg not downloaded yet
2026-03-25 18:35:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/922/5b7578eda4d142ddab59b00c428ca6b3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:35:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:35:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e576e10>
2026-03-25 18:35:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:35:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:35:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:35:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2863834-f302-57f6-a347-9b58ca215334/f2863834-f302-57f6-a347-9b58ca215334_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F961%252F7e04a9f9efd24198acc6252713c3204c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/961/7e04a9f9efd24198acc6252713c3204c/images/large/1.jpg saved to cache
2026-03-25 18:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f2863834-f302-57f6-a347-9b58ca215334
2026-03-25 18:35:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f2863834-f302-57f6-a347-9b58ca215334, skipping ID generation
2026-03-25 18:35:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2863834-f302-57f6-a347-9b58ca215334 with scrape type 1
2026-03-25 18:35:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f2863834-f302-57f6-a347-9b58ca215334 sending to next pipeline
2026-03-25 18:35:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: f2863834-f302-57f6-a347-9b58ca215334, identifier: 1983412
2026-03-25 18:35:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:35:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ea82510>
2026-03-25 18:35:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:35:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c430a35-dfdb-5ef9-8013-0878225cfa52/8c430a35-dfdb-5ef9-8013-0878225cfa52_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F211%252F7b42d3f2660443f49d7fb359481a190a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/211/7b42d3f2660443f49d7fb359481a190a/images/large/1.jpg saved to cache
2026-03-25 18:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8c430a35-dfdb-5ef9-8013-0878225cfa52
2026-03-25 18:35:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8c430a35-dfdb-5ef9-8013-0878225cfa52, skipping ID generation
2026-03-25 18:35:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c430a35-dfdb-5ef9-8013-0878225cfa52 with scrape type 1
2026-03-25 18:35:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8c430a35-dfdb-5ef9-8013-0878225cfa52 sending to next pipeline
2026-03-25 18:35:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 8c430a35-dfdb-5ef9-8013-0878225cfa52, identifier: 1983410
2026-03-25 18:35:19 [ayvens.es] INFO: Found listing with ID: 1983420
2026-03-25 18:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983420%27 HTTP/1.1" 200 None
2026-03-25 18:35:19 [ayvens.es] INFO: Scrape type for 1983420: 1
2026-03-25 18:35:19 [ayvens.es] INFO: Extracting data for car ID: 1983420
2026-03-25 18:35:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1978cc0-6fb2-54e5-b945-a5db91159c0e with identifier: 1983420
2026-03-25 18:35:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1978cc0-6fb2-54e5-b945-a5db91159c0e with scrape type 1
2026-03-25 18:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c1978cc0-6fb2-54e5-b945-a5db91159c0e
2026-03-25 18:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F810%252Fd95ba56a660a4396ae1ce1b4604f8a45%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/810/d95ba56a660a4396ae1ce1b4604f8a45/images/large/1.jpg not downloaded yet
2026-03-25 18:35:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: f2863834-f302-57f6-a347-9b58ca215334 with identifier: 1983412
2026-03-25 18:35:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:35:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: f2863834-f302-57f6-a347-9b58ca215334 with identifier: 1983412
2026-03-25 18:35:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: f2863834-f302-57f6-a347-9b58ca215334 with identifier: 1983412 to the API
2026-03-25 18:35:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:35:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:35:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/961/7e04a9f9efd24198acc6252713c3204c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Blanco glaciar',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f2863834-f302-57f6-a347-9b58ca215334',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3',
 'odometer': 137413,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2863834-f302-57f6-a347-9b58ca215334/f2863834-f302-57f6-a347-9b58ca215334_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 299069,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/961/7e04a9f9efd24198acc6252713c3204c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 Sportback Advanced 35 TDI 110kW S tronic',
 'transmission': 'manual',
 'trim': 'Sportback Advanced 35 TDI 110kW S tronic',
 'vin': None,
 'year': 2022}
2026-03-25 18:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983412%27 HTTP/1.1" 200 None
2026-03-25 18:35:19 [ayvens.es] INFO: Saving data for 1983412: {'created_time': 1774463719.541921, 'last_price_update_time': 1774463719.541932, 'auction_closing_time': 1774526400.0}
2026-03-25 18:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983412') HTTP/1.1" 204 0
2026-03-25 18:35:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 8c430a35-dfdb-5ef9-8013-0878225cfa52 with identifier: 1983410
2026-03-25 18:35:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 8c430a35-dfdb-5ef9-8013-0878225cfa52 with identifier: 1983410
2026-03-25 18:35:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 8c430a35-dfdb-5ef9-8013-0878225cfa52 with identifier: 1983410 to the API
2026-03-25 18:35:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:35:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:35:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/211/7b42d3f2660443f49d7fb359481a190a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '8c430a35-dfdb-5ef9-8013-0878225cfa52',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'EXPRESS',
 'odometer': 82311,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c430a35-dfdb-5ef9-8013-0878225cfa52/8c430a35-dfdb-5ef9-8013-0878225cfa52_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 527280,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/211/7b42d3f2660443f49d7fb359481a190a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-17',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT EXPRESS Confort 1.5 Blue dCi 55 kW (75 cv)',
 'transmission': 'manual',
 'trim': 'Confort 1.5 Blue dCi 55 kW (75 cv)',
 'vin': None,
 'year': 2022}
2026-03-25 18:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983410%27 HTTP/1.1" 200 None
2026-03-25 18:35:19 [ayvens.es] INFO: Saving data for 1983410: {'created_time': 1774463719.832843, 'last_price_update_time': 1774463719.832854, 'auction_closing_time': 1774526400.0}
2026-03-25 18:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983410') HTTP/1.1" 204 0
2026-03-25 18:35:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/379/728bbb453c15449392997a22f944a3df/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:35:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/306/f63d0af2d0e84c698b9fd5c8548a936a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:35:19 [ayvens.es] INFO: Found listing with ID: 1983421
2026-03-25 18:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983421%27 HTTP/1.1" 200 None
2026-03-25 18:35:19 [ayvens.es] INFO: Scrape type for 1983421: 1
2026-03-25 18:35:19 [ayvens.es] INFO: Extracting data for car ID: 1983421
2026-03-25 18:35:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28f82a3d-f45f-5818-abab-c152b735de4c with identifier: 1983421
2026-03-25 18:35:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28f82a3d-f45f-5818-abab-c152b735de4c with scrape type 1
2026-03-25 18:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 28f82a3d-f45f-5818-abab-c152b735de4c
2026-03-25 18:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F435%252F75813fed650e45289555133bdaa97a42%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/435/75813fed650e45289555133bdaa97a42/images/large/1.jpg not downloaded yet
2026-03-25 18:35:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:35:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8eed7bd0>
2026-03-25 18:35:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:35:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:35:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34758461-cad7-5f80-b2d2-a455258444fa/34758461-cad7-5f80-b2d2-a455258444fa_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F919%252Ff91dc5035c604bf997304dfd1f8a2a18%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/919/f91dc5035c604bf997304dfd1f8a2a18/images/large/1.jpg saved to cache
2026-03-25 18:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 34758461-cad7-5f80-b2d2-a455258444fa
2026-03-25 18:35:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 34758461-cad7-5f80-b2d2-a455258444fa, skipping ID generation
2026-03-25 18:35:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34758461-cad7-5f80-b2d2-a455258444fa with scrape type 1
2026-03-25 18:35:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 34758461-cad7-5f80-b2d2-a455258444fa sending to next pipeline
2026-03-25 18:35:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 34758461-cad7-5f80-b2d2-a455258444fa, identifier: 1983411
2026-03-25 18:35:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:35:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ecddd90>
2026-03-25 18:35:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:35:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:35:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:35:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a505507d-57f4-505d-a65e-5f109b1d1715/a505507d-57f4-505d-a65e-5f109b1d1715_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F922%252F5b7578eda4d142ddab59b00c428ca6b3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/922/5b7578eda4d142ddab59b00c428ca6b3/images/large/1.jpg saved to cache
2026-03-25 18:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a505507d-57f4-505d-a65e-5f109b1d1715
2026-03-25 18:35:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a505507d-57f4-505d-a65e-5f109b1d1715, skipping ID generation
2026-03-25 18:35:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a505507d-57f4-505d-a65e-5f109b1d1715 with scrape type 1
2026-03-25 18:35:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a505507d-57f4-505d-a65e-5f109b1d1715 sending to next pipeline
2026-03-25 18:35:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: a505507d-57f4-505d-a65e-5f109b1d1715, identifier: 1983413
2026-03-25 18:35:20 [ayvens.es] INFO: Found listing with ID: 1983422
2026-03-25 18:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983422%27 HTTP/1.1" 200 None
2026-03-25 18:35:20 [ayvens.es] INFO: Scrape type for 1983422: 1
2026-03-25 18:35:20 [ayvens.es] INFO: Extracting data for car ID: 1983422
2026-03-25 18:35:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99a6301b-8b68-59d3-9a82-1bd263538278 with identifier: 1983422
2026-03-25 18:35:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99a6301b-8b68-59d3-9a82-1bd263538278 with scrape type 1
2026-03-25 18:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 99a6301b-8b68-59d3-9a82-1bd263538278
2026-03-25 18:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F626%252F2933dd0ab2d24da3b452fef6e8737c50%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/626/2933dd0ab2d24da3b452fef6e8737c50/images/large/1.jpg not downloaded yet
2026-03-25 18:35:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 34758461-cad7-5f80-b2d2-a455258444fa with identifier: 1983411
2026-03-25 18:35:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:35:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 34758461-cad7-5f80-b2d2-a455258444fa with identifier: 1983411
2026-03-25 18:35:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 34758461-cad7-5f80-b2d2-a455258444fa with identifier: 1983411 to the API
2026-03-25 18:35:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:35:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:35:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/919/f91dc5035c604bf997304dfd1f8a2a18/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'color': 'Bronce chestnut',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '34758461-cad7-5f80-b2d2-a455258444fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 113431,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34758461-cad7-5f80-b2d2-a455258444fa/34758461-cad7-5f80-b2d2-a455258444fa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 511051,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/919/f91dc5035c604bf997304dfd1f8a2a18/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI dCi 81 kW (110 CV) N-CONNECTA',
 'transmission': 'manual',
 'trim': 'dCi 81 kW (110 CV) N-CONNECTA',
 'vin': None,
 'year': 2017}
2026-03-25 18:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983411%27 HTTP/1.1" 200 None
2026-03-25 18:35:20 [ayvens.es] INFO: Saving data for 1983411: {'created_time': 1774463720.489252, 'last_price_update_time': 1774463720.489262, 'auction_closing_time': 1774526400.0}
2026-03-25 18:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983411') HTTP/1.1" 204 0
2026-03-25 18:35:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: a505507d-57f4-505d-a65e-5f109b1d1715 with identifier: 1983413
2026-03-25 18:35:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: a505507d-57f4-505d-a65e-5f109b1d1715 with identifier: 1983413
2026-03-25 18:35:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: a505507d-57f4-505d-a65e-5f109b1d1715 with identifier: 1983413 to the API
2026-03-25 18:35:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:35:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:35:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/922/5b7578eda4d142ddab59b00c428ca6b3/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a505507d-57f4-505d-a65e-5f109b1d1715',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MEGANE',
 'odometer': 83967,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a505507d-57f4-505d-a65e-5f109b1d1715/a505507d-57f4-505d-a65e-5f109b1d1715_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 456677,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/922/5b7578eda4d142ddab59b00c428ca6b3/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT MEGANE Life Blue dCi 85 kW (115CV)',
 'transmission': 'manual',
 'trim': 'Life Blue dCi 85 kW (115CV)',
 'vin': None,
 'year': 2021}
2026-03-25 18:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983413%27 HTTP/1.1" 200 None
2026-03-25 18:35:20 [ayvens.es] INFO: Saving data for 1983413: {'created_time': 1774463720.783931, 'last_price_update_time': 1774463720.783987, 'auction_closing_time': 1774526400.0}
2026-03-25 18:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983413') HTTP/1.1" 204 0
2026-03-25 18:35:20 [ayvens.es] INFO: Found listing with ID: 1983423
2026-03-25 18:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983423%27 HTTP/1.1" 200 None
2026-03-25 18:35:20 [ayvens.es] INFO: Scrape type for 1983423: 1
2026-03-25 18:35:20 [ayvens.es] INFO: Extracting data for car ID: 1983423
2026-03-25 18:35:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffef1412-3e5c-574f-b2f2-3d9ef29eb2b9 with identifier: 1983423
2026-03-25 18:35:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffef1412-3e5c-574f-b2f2-3d9ef29eb2b9 with scrape type 1
2026-03-25 18:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ffef1412-3e5c-574f-b2f2-3d9ef29eb2b9
2026-03-25 18:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F693%252Fe0510bb5034442ed99622282820bc851%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/693/e0510bb5034442ed99622282820bc851/images/large/1.jpg not downloaded yet
2026-03-25 18:35:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:35:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e555350>
2026-03-25 18:35:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:35:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:35:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:35:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97ba2aa8-e914-503e-9cf5-87d59b974493/97ba2aa8-e914-503e-9cf5-87d59b974493_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F379%252F728bbb453c15449392997a22f944a3df%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/379/728bbb453c15449392997a22f944a3df/images/large/1.jpg saved to cache
2026-03-25 18:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 97ba2aa8-e914-503e-9cf5-87d59b974493
2026-03-25 18:35:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 97ba2aa8-e914-503e-9cf5-87d59b974493, skipping ID generation
2026-03-25 18:35:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97ba2aa8-e914-503e-9cf5-87d59b974493 with scrape type 1
2026-03-25 18:35:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 97ba2aa8-e914-503e-9cf5-87d59b974493 sending to next pipeline
2026-03-25 18:35:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 97ba2aa8-e914-503e-9cf5-87d59b974493, identifier: 1983414
2026-03-25 18:35:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:35:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ed2bf10>
2026-03-25 18:35:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:35:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:35:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:35:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4af3e31e-b069-54b7-a067-772991831d20/4af3e31e-b069-54b7-a067-772991831d20_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F306%252Ff63d0af2d0e84c698b9fd5c8548a936a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/306/f63d0af2d0e84c698b9fd5c8548a936a/images/large/1.jpg saved to cache
2026-03-25 18:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4af3e31e-b069-54b7-a067-772991831d20
2026-03-25 18:35:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4af3e31e-b069-54b7-a067-772991831d20, skipping ID generation
2026-03-25 18:35:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4af3e31e-b069-54b7-a067-772991831d20 with scrape type 1
2026-03-25 18:35:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4af3e31e-b069-54b7-a067-772991831d20 sending to next pipeline
2026-03-25 18:35:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 4af3e31e-b069-54b7-a067-772991831d20, identifier: 1983415
2026-03-25 18:35:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 97ba2aa8-e914-503e-9cf5-87d59b974493 with identifier: 1983414
2026-03-25 18:35:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 97ba2aa8-e914-503e-9cf5-87d59b974493 with identifier: 1983414
2026-03-25 18:35:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 97ba2aa8-e914-503e-9cf5-87d59b974493 with identifier: 1983414 to the API
2026-03-25 18:35:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:35:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:35:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/379/728bbb453c15449392997a22f944a3df/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Gris monta',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.9L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '97ba2aa8-e914-503e-9cf5-87d59b974493',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA',
 'odometer': 95344,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97ba2aa8-e914-503e-9cf5-87d59b974493/97ba2aa8-e914-503e-9cf5-87d59b974493_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 489534,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/379/728bbb453c15449392997a22f944a3df/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA CLA 220 D DCT',
 'transmission': 'manual',
 'trim': 'CLA 220 D DCT',
 'vin': None,
 'year': 2021}
2026-03-25 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983414%27 HTTP/1.1" 200 None
2026-03-25 18:35:21 [ayvens.es] INFO: Saving data for 1983414: {'created_time': 1774463721.399382, 'last_price_update_time': 1774463721.399392, 'auction_closing_time': 1774526400.0}
2026-03-25 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983414') HTTP/1.1" 204 0
2026-03-25 18:35:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 4af3e31e-b069-54b7-a067-772991831d20 with identifier: 1983415
2026-03-25 18:35:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 4af3e31e-b069-54b7-a067-772991831d20 with identifier: 1983415
2026-03-25 18:35:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 4af3e31e-b069-54b7-a067-772991831d20 with identifier: 1983415 to the API
2026-03-25 18:35:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:35:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:35:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/306/f63d0af2d0e84c698b9fd5c8548a936a/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'British green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '4af3e31e-b069-54b7-a067-772991831d20',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'COUNTRYMAN',
 'odometer': 75563,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4af3e31e-b069-54b7-a067-772991831d20/4af3e31e-b069-54b7-a067-772991831d20_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353518,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/306/f63d0af2d0e84c698b9fd5c8548a936a/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI COUNTRYMAN Cooper',
 'transmission': 'manual',
 'trim': 'Cooper',
 'vin': None,
 'year': 2022}
2026-03-25 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983415%27 HTTP/1.1" 200 None
2026-03-25 18:35:21 [ayvens.es] INFO: Saving data for 1983415: {'created_time': 1774463721.693152, 'last_price_update_time': 1774463721.693163, 'auction_closing_time': 1774526400.0}
2026-03-25 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983415') HTTP/1.1" 204 0
2026-03-25 18:35:21 [ayvens.es] INFO: Found listing with ID: 1983424
2026-03-25 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983424%27 HTTP/1.1" 200 None
2026-03-25 18:35:21 [ayvens.es] INFO: Scrape type for 1983424: 1
2026-03-25 18:35:21 [ayvens.es] INFO: Extracting data for car ID: 1983424
2026-03-25 18:35:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb4321c3-1be2-5511-aa6a-5e8929b09c5e with identifier: 1983424
2026-03-25 18:35:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb4321c3-1be2-5511-aa6a-5e8929b09c5e with scrape type 1
2026-03-25 18:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item eb4321c3-1be2-5511-aa6a-5e8929b09c5e
2026-03-25 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F704%252Fdb428dda4a704796b387d8d7782e4384%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/704/db428dda4a704796b387d8d7782e4384/images/large/1.jpg not downloaded yet
2026-03-25 18:35:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/955/3d7624ef47594c3692aae5161e89ad20/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:35:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/455/3ad2961a63c940f4bd767d19c13d89f6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:35:21 [ayvens.es] INFO: Found listing with ID: 1983425
2026-03-25 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983425%27 HTTP/1.1" 200 None
2026-03-25 18:35:21 [ayvens.es] INFO: Scrape type for 1983425: 1
2026-03-25 18:35:21 [ayvens.es] INFO: Extracting data for car ID: 1983425
2026-03-25 18:35:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10b19642-86c1-5a84-80e9-f4ffb7933384 with identifier: 1983425
2026-03-25 18:35:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10b19642-86c1-5a84-80e9-f4ffb7933384 with scrape type 1
2026-03-25 18:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 10b19642-86c1-5a84-80e9-f4ffb7933384
2026-03-25 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F529%252Fe3b6d59d56b3463d8ade3d1e6782dca4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/529/e3b6d59d56b3463d8ade3d1e6782dca4/images/large/1.jpg not downloaded yet
2026-03-25 18:35:21 [ayvens.es] INFO: Found listing with ID: 1983426
2026-03-25 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983426%27 HTTP/1.1" 200 None
2026-03-25 18:35:21 [ayvens.es] INFO: Scrape type for 1983426: 1
2026-03-25 18:35:21 [ayvens.es] INFO: Extracting data for car ID: 1983426
2026-03-25 18:35:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b44c9502-601a-5b9c-9fe4-5e1a4b0d5da0 with identifier: 1983426
2026-03-25 18:35:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b44c9502-601a-5b9c-9fe4-5e1a4b0d5da0 with scrape type 1
2026-03-25 18:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item b44c9502-601a-5b9c-9fe4-5e1a4b0d5da0
2026-03-25 18:35:21 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item b44c9502-601a-5b9c-9fe4-5e1a4b0d5da0
2026-03-25 18:35:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: b44c9502-601a-5b9c-9fe4-5e1a4b0d5da0, identifier: 1983426
2026-03-25 18:35:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/435/75813fed650e45289555133bdaa97a42/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:35:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: b44c9502-601a-5b9c-9fe4-5e1a4b0d5da0 with identifier: 1983426
2026-03-25 18:35:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:35:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: b44c9502-601a-5b9c-9fe4-5e1a4b0d5da0 with identifier: 1983426
2026-03-25 18:35:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: b44c9502-601a-5b9c-9fe4-5e1a4b0d5da0 with identifier: 1983426 to the API
2026-03-25 18:35:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:35:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:35:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Negro perla nera',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b44c9502-601a-5b9c-9fe4-5e1a4b0d5da0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C5 AIRCROSS',
 'odometer': 155367,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C5 AIRCROSS BlueHdi 96kW (130CV) S&S C Series',
 'transmission': 'manual',
 'trim': 'BlueHdi 96kW (130CV) S&S C Series',
 'vin': None,
 'year': 2021}
2026-03-25 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983426%27 HTTP/1.1" 200 None
2026-03-25 18:35:22 [ayvens.es] INFO: Saving data for 1983426: {'created_time': 1774463722.225861, 'last_price_update_time': 1774463722.225871, 'auction_closing_time': 1774526400.0}
2026-03-25 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983426') HTTP/1.1" 204 0
2026-03-25 18:35:22 [ayvens.es] INFO: Found listing with ID: 1983427
2026-03-25 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983427%27 HTTP/1.1" 200 None
2026-03-25 18:35:22 [ayvens.es] INFO: Scrape type for 1983427: 1
2026-03-25 18:35:22 [ayvens.es] INFO: Extracting data for car ID: 1983427
2026-03-25 18:35:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44c2b2d9-d18d-5aa5-9f28-df5302f2ed19 with identifier: 1983427
2026-03-25 18:35:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44c2b2d9-d18d-5aa5-9f28-df5302f2ed19 with scrape type 1
2026-03-25 18:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 44c2b2d9-d18d-5aa5-9f28-df5302f2ed19
2026-03-25 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F453%252F3ed4a5987db84421ba14120364fcb169%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/453/3ed4a5987db84421ba14120364fcb169/images/large/1.jpg not downloaded yet
2026-03-25 18:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/810/d95ba56a660a4396ae1ce1b4604f8a45/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:35:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:35:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8d42d190>
2026-03-25 18:35:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:35:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:35:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:35:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16260c84-5d4c-5048-b7c6-0394bb2042d7/16260c84-5d4c-5048-b7c6-0394bb2042d7_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F955%252F3d7624ef47594c3692aae5161e89ad20%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/955/3d7624ef47594c3692aae5161e89ad20/images/large/1.jpg saved to cache
2026-03-25 18:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 16260c84-5d4c-5048-b7c6-0394bb2042d7
2026-03-25 18:35:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 16260c84-5d4c-5048-b7c6-0394bb2042d7, skipping ID generation
2026-03-25 18:35:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16260c84-5d4c-5048-b7c6-0394bb2042d7 with scrape type 1
2026-03-25 18:35:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 16260c84-5d4c-5048-b7c6-0394bb2042d7 sending to next pipeline
2026-03-25 18:35:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 16260c84-5d4c-5048-b7c6-0394bb2042d7, identifier: 1983416
2026-03-25 18:35:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:35:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ef2a690>
2026-03-25 18:35:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:35:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:35:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:35:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e53a02e9-86c8-5b98-9994-fae7cbe38302/e53a02e9-86c8-5b98-9994-fae7cbe38302_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F455%252F3ad2961a63c940f4bd767d19c13d89f6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/455/3ad2961a63c940f4bd767d19c13d89f6/images/large/1.jpg saved to cache
2026-03-25 18:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e53a02e9-86c8-5b98-9994-fae7cbe38302
2026-03-25 18:35:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e53a02e9-86c8-5b98-9994-fae7cbe38302, skipping ID generation
2026-03-25 18:35:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e53a02e9-86c8-5b98-9994-fae7cbe38302 with scrape type 1
2026-03-25 18:35:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e53a02e9-86c8-5b98-9994-fae7cbe38302 sending to next pipeline
2026-03-25 18:35:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: e53a02e9-86c8-5b98-9994-fae7cbe38302, identifier: 1983417
2026-03-25 18:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/690/cca73ec27c3141a7bb9beaa921bd3021/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/693/92a48f82d208408eb0bec48c37c54ab0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:35:22 [ayvens.es] INFO: Found listing with ID: 1983428
2026-03-25 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983428%27 HTTP/1.1" 200 None
2026-03-25 18:35:22 [ayvens.es] INFO: Scrape type for 1983428: 1
2026-03-25 18:35:22 [ayvens.es] INFO: Extracting data for car ID: 1983428
2026-03-25 18:35:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65a040e3-5348-5d21-b1a6-d60f79cfc765 with identifier: 1983428
2026-03-25 18:35:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65a040e3-5348-5d21-b1a6-d60f79cfc765 with scrape type 1
2026-03-25 18:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 65a040e3-5348-5d21-b1a6-d60f79cfc765
2026-03-25 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F814%252F78a1e973ade44628836bded38fd686ef%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/814/78a1e973ade44628836bded38fd686ef/images/large/1.jpg not downloaded yet
2026-03-25 18:35:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 16260c84-5d4c-5048-b7c6-0394bb2042d7 with identifier: 1983416
2026-03-25 18:35:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 16260c84-5d4c-5048-b7c6-0394bb2042d7 with identifier: 1983416
2026-03-25 18:35:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 16260c84-5d4c-5048-b7c6-0394bb2042d7 with identifier: 1983416 to the API
2026-03-25 18:35:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:35:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:35:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/955/3d7624ef47594c3692aae5161e89ad20/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 46,
 'color': 'Negro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.4L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': '16260c84-5d4c-5048-b7c6-0394bb2042d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'MITSUBISHI',
 'model': 'OUTLANDER',
 'odometer': 91978,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16260c84-5d4c-5048-b7c6-0394bb2042d7/16260c84-5d4c-5048-b7c6-0394bb2042d7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 558313,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/955/3d7624ef47594c3692aae5161e89ad20/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MITSUBISHI OUTLANDER 2.4 PHEV Kaiteki+ Auto 4WD',
 'transmission': 'manual',
 'trim': '2.4 PHEV Kaiteki+ Auto 4WD',
 'vin': None,
 'year': 2021}
2026-03-25 18:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983416%27 HTTP/1.1" 200 None
2026-03-25 18:35:23 [ayvens.es] INFO: Saving data for 1983416: {'created_time': 1774463723.048294, 'last_price_update_time': 1774463723.048308, 'auction_closing_time': 1774526400.0}
2026-03-25 18:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983416') HTTP/1.1" 204 0
2026-03-25 18:35:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: e53a02e9-86c8-5b98-9994-fae7cbe38302 with identifier: 1983417
2026-03-25 18:35:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:35:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: e53a02e9-86c8-5b98-9994-fae7cbe38302 with identifier: 1983417
2026-03-25 18:35:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: e53a02e9-86c8-5b98-9994-fae7cbe38302 with identifier: 1983417 to the API
2026-03-25 18:35:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:35:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:35:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/455/3ad2961a63c940f4bd767d19c13d89f6/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Negro profundo',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e53a02e9-86c8-5b98-9994-fae7cbe38302',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN',
 'odometer': 105690,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e53a02e9-86c8-5b98-9994-fae7cbe38302/e53a02e9-86c8-5b98-9994-fae7cbe38302_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 638610,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/455/3ad2961a63c940f4bd767d19c13d89f6/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN Advance 2.0 TDI 110kW (150CV)',
 'transmission': 'manual',
 'trim': 'Advance 2.0 TDI 110kW (150CV)',
 'vin': None,
 'year': 2020}
2026-03-25 18:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983417%27 HTTP/1.1" 200 None
2026-03-25 18:35:23 [ayvens.es] INFO: Saving data for 1983417: {'created_time': 1774463723.36699, 'last_price_update_time': 1774463723.367005, 'auction_closing_time': 1774526400.0}
2026-03-25 18:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983417') HTTP/1.1" 204 0
2026-03-25 18:35:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:35:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae90806990>
2026-03-25 18:35:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:35:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:35:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:35:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28f82a3d-f45f-5818-abab-c152b735de4c/28f82a3d-f45f-5818-abab-c152b735de4c_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F435%252F75813fed650e45289555133bdaa97a42%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/435/75813fed650e45289555133bdaa97a42/images/large/1.jpg saved to cache
2026-03-25 18:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 28f82a3d-f45f-5818-abab-c152b735de4c
2026-03-25 18:35:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 28f82a3d-f45f-5818-abab-c152b735de4c, skipping ID generation
2026-03-25 18:35:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28f82a3d-f45f-5818-abab-c152b735de4c with scrape type 1
2026-03-25 18:35:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 28f82a3d-f45f-5818-abab-c152b735de4c sending to next pipeline
2026-03-25 18:35:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 28f82a3d-f45f-5818-abab-c152b735de4c, identifier: 1983421
2026-03-25 18:35:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/626/2933dd0ab2d24da3b452fef6e8737c50/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:35:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/693/e0510bb5034442ed99622282820bc851/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:35:23 [ayvens.es] INFO: Found listing with ID: 1983429
2026-03-25 18:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983429%27 HTTP/1.1" 200 None
2026-03-25 18:35:23 [ayvens.es] INFO: Scrape type for 1983429: 1
2026-03-25 18:35:23 [ayvens.es] INFO: Extracting data for car ID: 1983429
2026-03-25 18:35:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69817243-a85a-5f00-b407-1746cfc3613c with identifier: 1983429
2026-03-25 18:35:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69817243-a85a-5f00-b407-1746cfc3613c with scrape type 1
2026-03-25 18:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 69817243-a85a-5f00-b407-1746cfc3613c
2026-03-25 18:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F003%252F8eac627460534de2a695829faad91f29%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/003/8eac627460534de2a695829faad91f29/images/large/1.jpg not downloaded yet
2026-03-25 18:35:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 28f82a3d-f45f-5818-abab-c152b735de4c with identifier: 1983421
2026-03-25 18:35:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:35:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 28f82a3d-f45f-5818-abab-c152b735de4c with identifier: 1983421
2026-03-25 18:35:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 28f82a3d-f45f-5818-abab-c152b735de4c with identifier: 1983421 to the API
2026-03-25 18:35:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:35:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:35:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/435/75813fed650e45289555133bdaa97a42/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Blanco candy',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '28f82a3d-f45f-5818-abab-c152b735de4c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'SCALA',
 'odometer': 83212,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28f82a3d-f45f-5818-abab-c152b735de4c/28f82a3d-f45f-5818-abab-c152b735de4c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 339583,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/435/75813fed650e45289555133bdaa97a42/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA SCALA 1.0 TSI 81KW (110 CV) Ambition',
 'transmission': 'manual',
 'trim': '1.0 TSI 81KW (110 CV) Ambition',
 'vin': None,
 'year': 2023}
2026-03-25 18:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983421%27 HTTP/1.1" 200 None
2026-03-25 18:35:23 [ayvens.es] INFO: Saving data for 1983421: {'created_time': 1774463723.890935, 'last_price_update_time': 1774463723.890945, 'auction_closing_time': 1774526400.0}
2026-03-25 18:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983421') HTTP/1.1" 204 0
2026-03-25 18:35:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:35:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e5761d0>
2026-03-25 18:35:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:35:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:35:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:35:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1978cc0-6fb2-54e5-b945-a5db91159c0e/c1978cc0-6fb2-54e5-b945-a5db91159c0e_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F810%252Fd95ba56a660a4396ae1ce1b4604f8a45%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/810/d95ba56a660a4396ae1ce1b4604f8a45/images/large/1.jpg saved to cache
2026-03-25 18:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c1978cc0-6fb2-54e5-b945-a5db91159c0e
2026-03-25 18:35:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c1978cc0-6fb2-54e5-b945-a5db91159c0e, skipping ID generation
2026-03-25 18:35:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1978cc0-6fb2-54e5-b945-a5db91159c0e with scrape type 1
2026-03-25 18:35:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c1978cc0-6fb2-54e5-b945-a5db91159c0e sending to next pipeline
2026-03-25 18:35:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: c1978cc0-6fb2-54e5-b945-a5db91159c0e, identifier: 1983420
2026-03-25 18:35:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:35:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8edad250>
2026-03-25 18:35:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:35:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:35:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:35:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0bd770b-557b-5e6d-abf0-62d09e7c7e00/d0bd770b-557b-5e6d-abf0-62d09e7c7e00_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F690%252Fcca73ec27c3141a7bb9beaa921bd3021%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/690/cca73ec27c3141a7bb9beaa921bd3021/images/large/1.jpg saved to cache
2026-03-25 18:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d0bd770b-557b-5e6d-abf0-62d09e7c7e00
2026-03-25 18:35:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d0bd770b-557b-5e6d-abf0-62d09e7c7e00, skipping ID generation
2026-03-25 18:35:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0bd770b-557b-5e6d-abf0-62d09e7c7e00 with scrape type 1
2026-03-25 18:35:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d0bd770b-557b-5e6d-abf0-62d09e7c7e00 sending to next pipeline
2026-03-25 18:35:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: d0bd770b-557b-5e6d-abf0-62d09e7c7e00, identifier: 1983418
2026-03-25 18:35:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:35:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8d42f090>
2026-03-25 18:35:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:35:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:35:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:35:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_393a1284-085e-5a7c-98d6-57ab48d20f41/393a1284-085e-5a7c-98d6-57ab48d20f41_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F693%252F92a48f82d208408eb0bec48c37c54ab0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/693/92a48f82d208408eb0bec48c37c54ab0/images/large/1.jpg saved to cache
2026-03-25 18:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 393a1284-085e-5a7c-98d6-57ab48d20f41
2026-03-25 18:35:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 393a1284-085e-5a7c-98d6-57ab48d20f41, skipping ID generation
2026-03-25 18:35:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 393a1284-085e-5a7c-98d6-57ab48d20f41 with scrape type 1
2026-03-25 18:35:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 393a1284-085e-5a7c-98d6-57ab48d20f41 sending to next pipeline
2026-03-25 18:35:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 393a1284-085e-5a7c-98d6-57ab48d20f41, identifier: 1983419
2026-03-25 18:35:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/704/db428dda4a704796b387d8d7782e4384/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:35:24 [ayvens.es] INFO: Found listing with ID: 1983430
2026-03-25 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983430%27 HTTP/1.1" 200 None
2026-03-25 18:35:24 [ayvens.es] INFO: Scrape type for 1983430: 1
2026-03-25 18:35:24 [ayvens.es] INFO: Extracting data for car ID: 1983430
2026-03-25 18:35:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec01bcae-dd2a-5c9a-85ff-fd282aae8f70 with identifier: 1983430
2026-03-25 18:35:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec01bcae-dd2a-5c9a-85ff-fd282aae8f70 with scrape type 1
2026-03-25 18:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ec01bcae-dd2a-5c9a-85ff-fd282aae8f70
2026-03-25 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F739%252F38b03a2b33c44a9a9836c11f0ffe5395%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/739/38b03a2b33c44a9a9836c11f0ffe5395/images/large/1.jpg not downloaded yet
2026-03-25 18:35:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: c1978cc0-6fb2-54e5-b945-a5db91159c0e with identifier: 1983420
2026-03-25 18:35:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: c1978cc0-6fb2-54e5-b945-a5db91159c0e with identifier: 1983420
2026-03-25 18:35:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: c1978cc0-6fb2-54e5-b945-a5db91159c0e with identifier: 1983420 to the API
2026-03-25 18:35:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:35:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:35:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/810/d95ba56a660a4396ae1ce1b4604f8a45/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'hybrid',
 'id': 'c1978cc0-6fb2-54e5-b945-a5db91159c0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'COROLLA',
 'odometer': 65218,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1978cc0-6fb2-54e5-b945-a5db91159c0e/c1978cc0-6fb2-54e5-b945-a5db91159c0e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 496001,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/810/d95ba56a660a4396ae1ce1b4604f8a45/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA COROLLA 1.8 125H BUSINESS PLUS E-CVT',
 'transmission': 'manual',
 'trim': '1.8 125H BUSINESS PLUS E-CVT',
 'vin': None,
 'year': 2021}
2026-03-25 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983420%27 HTTP/1.1" 200 None
2026-03-25 18:35:24 [ayvens.es] INFO: Saving data for 1983420: {'created_time': 1774463724.730469, 'last_price_update_time': 1774463724.730481, 'auction_closing_time': 1774526400.0}
2026-03-25 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983420') HTTP/1.1" 204 0
2026-03-25 18:35:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: d0bd770b-557b-5e6d-abf0-62d09e7c7e00 with identifier: 1983418
2026-03-25 18:35:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:35:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: d0bd770b-557b-5e6d-abf0-62d09e7c7e00 with identifier: 1983418
2026-03-25 18:35:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: d0bd770b-557b-5e6d-abf0-62d09e7c7e00 with identifier: 1983418 to the API
2026-03-25 18:35:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:35:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:35:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/690/cca73ec27c3141a7bb9beaa921bd3021/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'Noir perla',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': 'd0bd770b-557b-5e6d-abf0-62d09e7c7e00',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'C4',
 'odometer': 76119,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0bd770b-557b-5e6d-abf0-62d09e7c7e00/d0bd770b-557b-5e6d-abf0-62d09e7c7e00_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 725045,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/690/cca73ec27c3141a7bb9beaa921bd3021/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN C4 PureTech 100 S&S 6v Feel',
 'transmission': 'manual',
 'trim': 'PureTech 100 S&S 6v Feel',
 'vin': None,
 'year': 2023}
2026-03-25 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983418%27 HTTP/1.1" 200 None
2026-03-25 18:35:25 [ayvens.es] INFO: Saving data for 1983418: {'created_time': 1774463725.027475, 'last_price_update_time': 1774463725.027487, 'auction_closing_time': 1774526400.0}
2026-03-25 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983418') HTTP/1.1" 204 0
2026-03-25 18:35:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 393a1284-085e-5a7c-98d6-57ab48d20f41 with identifier: 1983419
2026-03-25 18:35:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:35:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 393a1284-085e-5a7c-98d6-57ab48d20f41 with identifier: 1983419
2026-03-25 18:35:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 393a1284-085e-5a7c-98d6-57ab48d20f41 with identifier: 1983419 to the API
2026-03-25 18:35:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:35:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:35:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/693/92a48f82d208408eb0bec48c37c54ab0/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Enigmatic',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '393a1284-085e-5a7c-98d6-57ab48d20f41',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'COUNTRYMAN',
 'odometer': 43784,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_393a1284-085e-5a7c-98d6-57ab48d20f41/393a1284-085e-5a7c-98d6-57ab48d20f41_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 780344,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/693/92a48f82d208408eb0bec48c37c54ab0/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI COUNTRYMAN Cooper',
 'transmission': 'manual',
 'trim': 'Cooper',
 'vin': None,
 'year': 2022}
2026-03-25 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983419%27 HTTP/1.1" 200 None
2026-03-25 18:35:25 [ayvens.es] INFO: Saving data for 1983419: {'created_time': 1774463725.343554, 'last_price_update_time': 1774463725.343563, 'auction_closing_time': 1774526400.0}
2026-03-25 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983419') HTTP/1.1" 204 0
2026-03-25 18:35:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:35:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ea48cd0>
2026-03-25 18:35:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:35:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:35:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:35:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99a6301b-8b68-59d3-9a82-1bd263538278/99a6301b-8b68-59d3-9a82-1bd263538278_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F626%252F2933dd0ab2d24da3b452fef6e8737c50%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/626/2933dd0ab2d24da3b452fef6e8737c50/images/large/1.jpg saved to cache
2026-03-25 18:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 99a6301b-8b68-59d3-9a82-1bd263538278
2026-03-25 18:35:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 99a6301b-8b68-59d3-9a82-1bd263538278, skipping ID generation
2026-03-25 18:35:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99a6301b-8b68-59d3-9a82-1bd263538278 with scrape type 1
2026-03-25 18:35:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 99a6301b-8b68-59d3-9a82-1bd263538278 sending to next pipeline
2026-03-25 18:35:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 99a6301b-8b68-59d3-9a82-1bd263538278, identifier: 1983422
2026-03-25 18:35:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:35:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e5aadd0>
2026-03-25 18:35:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:35:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:35:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:35:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffef1412-3e5c-574f-b2f2-3d9ef29eb2b9/ffef1412-3e5c-574f-b2f2-3d9ef29eb2b9_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F693%252Fe0510bb5034442ed99622282820bc851%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/693/e0510bb5034442ed99622282820bc851/images/large/1.jpg saved to cache
2026-03-25 18:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ffef1412-3e5c-574f-b2f2-3d9ef29eb2b9
2026-03-25 18:35:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ffef1412-3e5c-574f-b2f2-3d9ef29eb2b9, skipping ID generation
2026-03-25 18:35:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffef1412-3e5c-574f-b2f2-3d9ef29eb2b9 with scrape type 1
2026-03-25 18:35:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ffef1412-3e5c-574f-b2f2-3d9ef29eb2b9 sending to next pipeline
2026-03-25 18:35:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ffef1412-3e5c-574f-b2f2-3d9ef29eb2b9, identifier: 1983423
2026-03-25 18:35:25 [ayvens.es] INFO: Found listing with ID: 1983431
2026-03-25 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983431%27 HTTP/1.1" 200 None
2026-03-25 18:35:25 [ayvens.es] INFO: Scrape type for 1983431: 1
2026-03-25 18:35:25 [ayvens.es] INFO: Extracting data for car ID: 1983431
2026-03-25 18:35:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de928038-57b2-56fc-a74b-2154cde463ce with identifier: 1983431
2026-03-25 18:35:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de928038-57b2-56fc-a74b-2154cde463ce with scrape type 1
2026-03-25 18:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item de928038-57b2-56fc-a74b-2154cde463ce
2026-03-25 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F695%252Ff901e9296cb94a43bd3bed3caa9ecc21%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/695/f901e9296cb94a43bd3bed3caa9ecc21/images/large/1.jpg not downloaded yet
2026-03-25 18:35:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 99a6301b-8b68-59d3-9a82-1bd263538278 with identifier: 1983422
2026-03-25 18:35:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 99a6301b-8b68-59d3-9a82-1bd263538278 with identifier: 1983422
2026-03-25 18:35:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 99a6301b-8b68-59d3-9a82-1bd263538278 with identifier: 1983422 to the API
2026-03-25 18:35:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:35:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:35:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/626/2933dd0ab2d24da3b452fef6e8737c50/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'Blanco banquise',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '99a6301b-8b68-59d3-9a82-1bd263538278',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 104970,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99a6301b-8b68-59d3-9a82-1bd263538278/99a6301b-8b68-59d3-9a82-1bd263538278_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324734,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/626/2933dd0ab2d24da3b452fef6e8737c50/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 Active Pack BlueHDI 81kW (110CV)+++Revisar '
          'peritacion+++',
 'transmission': 'manual',
 'trim': 'Active Pack BlueHDI 81kW (110CV)+++Revisar peritacion+++',
 'vin': None,
 'year': 2021}
2026-03-25 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983422%27 HTTP/1.1" 200 None
2026-03-25 18:35:25 [ayvens.es] INFO: Saving data for 1983422: {'created_time': 1774463725.923523, 'last_price_update_time': 1774463725.923534, 'auction_closing_time': 1774526400.0}
2026-03-25 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983422') HTTP/1.1" 204 0
2026-03-25 18:35:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ffef1412-3e5c-574f-b2f2-3d9ef29eb2b9 with identifier: 1983423
2026-03-25 18:35:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ffef1412-3e5c-574f-b2f2-3d9ef29eb2b9 with identifier: 1983423
2026-03-25 18:35:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ffef1412-3e5c-574f-b2f2-3d9ef29eb2b9 with identifier: 1983423 to the API
2026-03-25 18:35:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:35:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:35:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/693/e0510bb5034442ed99622282820bc851/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ffef1412-3e5c-574f-b2f2-3d9ef29eb2b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'DACIA',
 'model': 'DOKKER',
 'odometer': 158237,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffef1412-3e5c-574f-b2f2-3d9ef29eb2b9/ffef1412-3e5c-574f-b2f2-3d9ef29eb2b9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 289908,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/693/e0510bb5034442ed99622282820bc851/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DACIA DOKKER Essential Blue dCi 70kW (95CV) N1',
 'transmission': 'manual',
 'trim': 'Essential Blue dCi 70kW (95CV) N1',
 'vin': None,
 'year': 2020}
2026-03-25 18:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983423%27 HTTP/1.1" 200 None
2026-03-25 18:35:26 [ayvens.es] INFO: Saving data for 1983423: {'created_time': 1774463726.218615, 'last_price_update_time': 1774463726.218625, 'auction_closing_time': 1774526400.0}
2026-03-25 18:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983423') HTTP/1.1" 204 0
2026-03-25 18:35:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:35:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ec7da10>
2026-03-25 18:35:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:35:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:35:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:35:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb4321c3-1be2-5511-aa6a-5e8929b09c5e/eb4321c3-1be2-5511-aa6a-5e8929b09c5e_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F704%252Fdb428dda4a704796b387d8d7782e4384%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/704/db428dda4a704796b387d8d7782e4384/images/large/1.jpg saved to cache
2026-03-25 18:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eb4321c3-1be2-5511-aa6a-5e8929b09c5e
2026-03-25 18:35:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eb4321c3-1be2-5511-aa6a-5e8929b09c5e, skipping ID generation
2026-03-25 18:35:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb4321c3-1be2-5511-aa6a-5e8929b09c5e with scrape type 1
2026-03-25 18:35:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eb4321c3-1be2-5511-aa6a-5e8929b09c5e sending to next pipeline
2026-03-25 18:35:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: eb4321c3-1be2-5511-aa6a-5e8929b09c5e, identifier: 1983424
2026-03-25 18:35:26 [ayvens.es] INFO: Found listing with ID: 1983432
2026-03-25 18:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983432%27 HTTP/1.1" 200 None
2026-03-25 18:35:26 [ayvens.es] INFO: Scrape type for 1983432: 1
2026-03-25 18:35:26 [ayvens.es] INFO: Extracting data for car ID: 1983432
2026-03-25 18:35:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89a597b4-5222-5681-9d9e-c7d488b2c384 with identifier: 1983432
2026-03-25 18:35:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89a597b4-5222-5681-9d9e-c7d488b2c384 with scrape type 1
2026-03-25 18:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 89a597b4-5222-5681-9d9e-c7d488b2c384
2026-03-25 18:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F824%252Fb2e4e63206b541f9b7ff84b4d42fb250%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/824/b2e4e63206b541f9b7ff84b4d42fb250/images/large/1.jpg not downloaded yet
2026-03-25 18:35:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: eb4321c3-1be2-5511-aa6a-5e8929b09c5e with identifier: 1983424
2026-03-25 18:35:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: eb4321c3-1be2-5511-aa6a-5e8929b09c5e with identifier: 1983424
2026-03-25 18:35:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: eb4321c3-1be2-5511-aa6a-5e8929b09c5e with identifier: 1983424 to the API
2026-03-25 18:35:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:35:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:35:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/704/db428dda4a704796b387d8d7782e4384/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'eb4321c3-1be2-5511-aa6a-5e8929b09c5e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KAROQ',
 'odometer': 183688,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb4321c3-1be2-5511-aa6a-5e8929b09c5e/eb4321c3-1be2-5511-aa6a-5e8929b09c5e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 333697,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/704/db428dda4a704796b387d8d7782e4384/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA KAROQ 2.0 TDI 110kW (150CV) DSG 4X4 Ambition',
 'transmission': 'manual',
 'trim': '2.0 TDI 110kW (150CV) DSG 4X4 Ambition',
 'vin': None,
 'year': 2022}
2026-03-25 18:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983424%27 HTTP/1.1" 200 None
2026-03-25 18:35:26 [ayvens.es] INFO: Saving data for 1983424: {'created_time': 1774463726.6856, 'last_price_update_time': 1774463726.68561, 'auction_closing_time': 1774526400.0}
2026-03-25 18:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983424') HTTP/1.1" 204 0
2026-03-25 18:35:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/529/e3b6d59d56b3463d8ade3d1e6782dca4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:35:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/453/3ed4a5987db84421ba14120364fcb169/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:35:26 [ayvens.es] INFO: Found listing with ID: 1983433
2026-03-25 18:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983433%27 HTTP/1.1" 200 None
2026-03-25 18:35:26 [ayvens.es] INFO: Scrape type for 1983433: 1
2026-03-25 18:35:26 [ayvens.es] INFO: Extracting data for car ID: 1983433
2026-03-25 18:35:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bce2bbf4-6cdc-526d-9961-435fa1f4b058 with identifier: 1983433
2026-03-25 18:35:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bce2bbf4-6cdc-526d-9961-435fa1f4b058 with scrape type 1
2026-03-25 18:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item bce2bbf4-6cdc-526d-9961-435fa1f4b058
2026-03-25 18:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F714%252F299969b27b574b5cbdb2acb63324697c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/714/299969b27b574b5cbdb2acb63324697c/images/large/1.jpg not downloaded yet
2026-03-25 18:35:26 [ayvens.es] INFO: Found listing with ID: 1983434
2026-03-25 18:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983434%27 HTTP/1.1" 200 None
2026-03-25 18:35:26 [ayvens.es] INFO: Scrape type for 1983434: 1
2026-03-25 18:35:26 [ayvens.es] INFO: Extracting data for car ID: 1983434
2026-03-25 18:35:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec126d4a-4230-5085-be86-e6602afd3967 with identifier: 1983434
2026-03-25 18:35:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec126d4a-4230-5085-be86-e6602afd3967 with scrape type 1
2026-03-25 18:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ec126d4a-4230-5085-be86-e6602afd3967
2026-03-25 18:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F648%252F8168de7e93924e689c388db2ae8b3c18%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/648/8168de7e93924e689c388db2ae8b3c18/images/large/1.jpg not downloaded yet
2026-03-25 18:35:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/814/78a1e973ade44628836bded38fd686ef/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:35:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/003/8eac627460534de2a695829faad91f29/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:35:26 [ayvens.es] INFO: Found listing with ID: 1983435
2026-03-25 18:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983435%27 HTTP/1.1" 200 None
2026-03-25 18:35:26 [ayvens.es] INFO: Scrape type for 1983435: 1
2026-03-25 18:35:26 [ayvens.es] INFO: Extracting data for car ID: 1983435
2026-03-25 18:35:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15ff2b05-d962-5972-b931-db26709b3df9 with identifier: 1983435
2026-03-25 18:35:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15ff2b05-d962-5972-b931-db26709b3df9 with scrape type 1
2026-03-25 18:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 15ff2b05-d962-5972-b931-db26709b3df9
2026-03-25 18:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F568%252F39352902857a4c578acf3f533074aad9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-03-25 18:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/568/39352902857a4c578acf3f533074aad9/images/large/1.jpg not downloaded yet
2026-03-25 18:35:26 [ayvens.es] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 500
2026-03-25 18:35:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/739/38b03a2b33c44a9a9836c11f0ffe5395/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:35:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:35:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8eaa89d0>
2026-03-25 18:35:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:35:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:35:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10b19642-86c1-5a84-80e9-f4ffb7933384/10b19642-86c1-5a84-80e9-f4ffb7933384_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F529%252Fe3b6d59d56b3463d8ade3d1e6782dca4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/529/e3b6d59d56b3463d8ade3d1e6782dca4/images/large/1.jpg saved to cache
2026-03-25 18:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 10b19642-86c1-5a84-80e9-f4ffb7933384
2026-03-25 18:35:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 10b19642-86c1-5a84-80e9-f4ffb7933384, skipping ID generation
2026-03-25 18:35:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10b19642-86c1-5a84-80e9-f4ffb7933384 with scrape type 1
2026-03-25 18:35:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 10b19642-86c1-5a84-80e9-f4ffb7933384 sending to next pipeline
2026-03-25 18:35:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 10b19642-86c1-5a84-80e9-f4ffb7933384, identifier: 1983425
2026-03-25 18:35:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:35:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8e5a8bd0>
2026-03-25 18:35:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:35:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44c2b2d9-d18d-5aa5-9f28-df5302f2ed19/44c2b2d9-d18d-5aa5-9f28-df5302f2ed19_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F453%252F3ed4a5987db84421ba14120364fcb169%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/453/3ed4a5987db84421ba14120364fcb169/images/large/1.jpg saved to cache
2026-03-25 18:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 44c2b2d9-d18d-5aa5-9f28-df5302f2ed19
2026-03-25 18:35:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 44c2b2d9-d18d-5aa5-9f28-df5302f2ed19, skipping ID generation
2026-03-25 18:35:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44c2b2d9-d18d-5aa5-9f28-df5302f2ed19 with scrape type 1
2026-03-25 18:35:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 44c2b2d9-d18d-5aa5-9f28-df5302f2ed19 sending to next pipeline
2026-03-25 18:35:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 44c2b2d9-d18d-5aa5-9f28-df5302f2ed19, identifier: 1983427
2026-03-25 18:35:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 10b19642-86c1-5a84-80e9-f4ffb7933384 with identifier: 1983425
2026-03-25 18:35:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:35:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 10b19642-86c1-5a84-80e9-f4ffb7933384 with identifier: 1983425
2026-03-25 18:35:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 10b19642-86c1-5a84-80e9-f4ffb7933384 with identifier: 1983425 to the API
2026-03-25 18:35:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:35:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:35:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/529/e3b6d59d56b3463d8ade3d1e6782dca4/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'Gris magnetico',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '10b19642-86c1-5a84-80e9-f4ffb7933384',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'MONDEO',
 'odometer': 246471,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10b19642-86c1-5a84-80e9-f4ffb7933384/10b19642-86c1-5a84-80e9-f4ffb7933384_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 542844,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/529/e3b6d59d56b3463d8ade3d1e6782dca4/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD MONDEO 2.0 TDCi 88kW (120CV) Trend',
 'transmission': 'manual',
 'trim': '2.0 TDCi 88kW (120CV) Trend',
 'vin': None,
 'year': 2021}
2026-03-25 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983425%27 HTTP/1.1" 200 None
2026-03-25 18:35:27 [ayvens.es] INFO: Saving data for 1983425: {'created_time': 1774463727.621992, 'last_price_update_time': 1774463727.622002, 'auction_closing_time': 1774526400.0}
2026-03-25 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983425') HTTP/1.1" 204 0
2026-03-25 18:35:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 44c2b2d9-d18d-5aa5-9f28-df5302f2ed19 with identifier: 1983427
2026-03-25 18:35:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 44c2b2d9-d18d-5aa5-9f28-df5302f2ed19 with identifier: 1983427
2026-03-25 18:35:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 44c2b2d9-d18d-5aa5-9f28-df5302f2ed19 with identifier: 1983427 to the API
2026-03-25 18:35:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:35:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:35:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/453/3ed4a5987db84421ba14120364fcb169/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'petrol',
 'id': '44c2b2d9-d18d-5aa5-9f28-df5302f2ed19',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '308',
 'odometer': 90901,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44c2b2d9-d18d-5aa5-9f28-df5302f2ed19/44c2b2d9-d18d-5aa5-9f28-df5302f2ed19_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 339652,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/453/3ed4a5987db84421ba14120364fcb169/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 308 SW Allure Pack PureTech 130 S&S',
 'transmission': 'manual',
 'trim': 'SW Allure Pack PureTech 130 S&S',
 'vin': None,
 'year': 2021}
2026-03-25 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983427%27 HTTP/1.1" 200 None
2026-03-25 18:35:27 [ayvens.es] INFO: Saving data for 1983427: {'created_time': 1774463727.906099, 'last_price_update_time': 1774463727.906109, 'auction_closing_time': 1774526400.0}
2026-03-25 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983427') HTTP/1.1" 204 0
2026-03-25 18:35:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 18:35:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:35:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae90a38050>
2026-03-25 18:35:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:35:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65a040e3-5348-5d21-b1a6-d60f79cfc765/65a040e3-5348-5d21-b1a6-d60f79cfc765_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F814%252F78a1e973ade44628836bded38fd686ef%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/814/78a1e973ade44628836bded38fd686ef/images/large/1.jpg saved to cache
2026-03-25 18:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 65a040e3-5348-5d21-b1a6-d60f79cfc765
2026-03-25 18:35:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 65a040e3-5348-5d21-b1a6-d60f79cfc765, skipping ID generation
2026-03-25 18:35:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65a040e3-5348-5d21-b1a6-d60f79cfc765 with scrape type 1
2026-03-25 18:35:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 65a040e3-5348-5d21-b1a6-d60f79cfc765 sending to next pipeline
2026-03-25 18:35:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 65a040e3-5348-5d21-b1a6-d60f79cfc765, identifier: 1983428
2026-03-25 18:35:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:35:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8eff7610>
2026-03-25 18:35:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:35:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69817243-a85a-5f00-b407-1746cfc3613c/69817243-a85a-5f00-b407-1746cfc3613c_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F003%252F8eac627460534de2a695829faad91f29%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/003/8eac627460534de2a695829faad91f29/images/large/1.jpg saved to cache
2026-03-25 18:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 69817243-a85a-5f00-b407-1746cfc3613c
2026-03-25 18:35:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 69817243-a85a-5f00-b407-1746cfc3613c, skipping ID generation
2026-03-25 18:35:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69817243-a85a-5f00-b407-1746cfc3613c with scrape type 1
2026-03-25 18:35:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 69817243-a85a-5f00-b407-1746cfc3613c sending to next pipeline
2026-03-25 18:35:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 69817243-a85a-5f00-b407-1746cfc3613c, identifier: 1983429
2026-03-25 18:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/695/f901e9296cb94a43bd3bed3caa9ecc21/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:35:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 65a040e3-5348-5d21-b1a6-d60f79cfc765 with identifier: 1983428
2026-03-25 18:35:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:35:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 65a040e3-5348-5d21-b1a6-d60f79cfc765 with identifier: 1983428
2026-03-25 18:35:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 65a040e3-5348-5d21-b1a6-d60f79cfc765 with identifier: 1983428 to the API
2026-03-25 18:35:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:35:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:35:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/814/78a1e973ade44628836bded38fd686ef/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'color': 'Blanco alpino',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '65a040e3-5348-5d21-b1a6-d60f79cfc765',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'MOKKA X',
 'odometer': 171038,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65a040e3-5348-5d21-b1a6-d60f79cfc765/65a040e3-5348-5d21-b1a6-d60f79cfc765_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 470353,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/814/78a1e973ade44628836bded38fd686ef/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL MOKKA X 1.6 CDTi 100kW 4X4 S&S Selective',
 'transmission': 'manual',
 'trim': '1.6 CDTi 100kW 4X4 S&S Selective',
 'vin': None,
 'year': 2019}
2026-03-25 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983428%27 HTTP/1.1" 200 None
2026-03-25 18:35:28 [ayvens.es] INFO: Saving data for 1983428: {'created_time': 1774463728.48123, 'last_price_update_time': 1774463728.48124, 'auction_closing_time': 1774526400.0}
2026-03-25 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983428') HTTP/1.1" 204 0
2026-03-25 18:35:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 69817243-a85a-5f00-b407-1746cfc3613c with identifier: 1983429
2026-03-25 18:35:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 69817243-a85a-5f00-b407-1746cfc3613c with identifier: 1983429
2026-03-25 18:35:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 69817243-a85a-5f00-b407-1746cfc3613c with identifier: 1983429 to the API
2026-03-25 18:35:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:35:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:35:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/003/8eac627460534de2a695829faad91f29/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '69817243-a85a-5f00-b407-1746cfc3613c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 30704,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69817243-a85a-5f00-b407-1746cfc3613c/69817243-a85a-5f00-b407-1746cfc3613c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 349311,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/003/8eac627460534de2a695829faad91f29/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 Active BlueHDI 81kW (110CV)',
 'transmission': 'manual',
 'trim': 'Active BlueHDI 81kW (110CV)',
 'vin': None,
 'year': 2021}
2026-03-25 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983429%27 HTTP/1.1" 200 None
2026-03-25 18:35:28 [ayvens.es] INFO: Saving data for 1983429: {'created_time': 1774463728.769113, 'last_price_update_time': 1774463728.76913, 'auction_closing_time': 1774526400.0}
2026-03-25 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983429') HTTP/1.1" 204 0
2026-03-25 18:35:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:35:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae90903810>
2026-03-25 18:35:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:35:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec01bcae-dd2a-5c9a-85ff-fd282aae8f70/ec01bcae-dd2a-5c9a-85ff-fd282aae8f70_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F739%252F38b03a2b33c44a9a9836c11f0ffe5395%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/739/38b03a2b33c44a9a9836c11f0ffe5395/images/large/1.jpg saved to cache
2026-03-25 18:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ec01bcae-dd2a-5c9a-85ff-fd282aae8f70
2026-03-25 18:35:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ec01bcae-dd2a-5c9a-85ff-fd282aae8f70, skipping ID generation
2026-03-25 18:35:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec01bcae-dd2a-5c9a-85ff-fd282aae8f70 with scrape type 1
2026-03-25 18:35:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ec01bcae-dd2a-5c9a-85ff-fd282aae8f70 sending to next pipeline
2026-03-25 18:35:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ec01bcae-dd2a-5c9a-85ff-fd282aae8f70, identifier: 1983430
2026-03-25 18:35:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ec01bcae-dd2a-5c9a-85ff-fd282aae8f70 with identifier: 1983430
2026-03-25 18:35:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ec01bcae-dd2a-5c9a-85ff-fd282aae8f70 with identifier: 1983430
2026-03-25 18:35:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ec01bcae-dd2a-5c9a-85ff-fd282aae8f70 with identifier: 1983430 to the API
2026-03-25 18:35:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:35:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:35:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/739/38b03a2b33c44a9a9836c11f0ffe5395/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 184,
 'color': 'Blanco',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ec01bcae-dd2a-5c9a-85ff-fd282aae8f70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TRANSPORTER',
 'odometer': 63653,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec01bcae-dd2a-5c9a-85ff-fd282aae8f70/ec01bcae-dd2a-5c9a-85ff-fd282aae8f70_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 494904,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/739/38b03a2b33c44a9a9836c11f0ffe5395/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-18',
 'seats_number': 3,
 'seller_name': None,
 'title': 'VOLKSWAGEN TRANSPORTER Furgon Corto TN 2.0 TDI 81kW (110CV)',
 'transmission': 'manual',
 'trim': 'Furgon Corto TN 2.0 TDI 81kW (110CV)',
 'vin': None,
 'year': 2022}
2026-03-25 18:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983430%27 HTTP/1.1" 200 None
2026-03-25 18:35:29 [ayvens.es] INFO: Saving data for 1983430: {'created_time': 1774463729.219323, 'last_price_update_time': 1774463729.219335, 'auction_closing_time': 1774526400.0}
2026-03-25 18:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983430') HTTP/1.1" 204 0
2026-03-25 18:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/824/b2e4e63206b541f9b7ff84b4d42fb250/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/648/8168de7e93924e689c388db2ae8b3c18/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:35:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:35:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8eaa2d50>
2026-03-25 18:35:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:35:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de928038-57b2-56fc-a74b-2154cde463ce/de928038-57b2-56fc-a74b-2154cde463ce_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F695%252Ff901e9296cb94a43bd3bed3caa9ecc21%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/695/f901e9296cb94a43bd3bed3caa9ecc21/images/large/1.jpg saved to cache
2026-03-25 18:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item de928038-57b2-56fc-a74b-2154cde463ce
2026-03-25 18:35:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: de928038-57b2-56fc-a74b-2154cde463ce, skipping ID generation
2026-03-25 18:35:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de928038-57b2-56fc-a74b-2154cde463ce with scrape type 1
2026-03-25 18:35:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item de928038-57b2-56fc-a74b-2154cde463ce sending to next pipeline
2026-03-25 18:35:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: de928038-57b2-56fc-a74b-2154cde463ce, identifier: 1983431
2026-03-25 18:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/568/39352902857a4c578acf3f533074aad9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:35:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: de928038-57b2-56fc-a74b-2154cde463ce with identifier: 1983431
2026-03-25 18:35:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:35:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: de928038-57b2-56fc-a74b-2154cde463ce with identifier: 1983431
2026-03-25 18:35:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: de928038-57b2-56fc-a74b-2154cde463ce with identifier: 1983431 to the API
2026-03-25 18:35:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:35:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:35:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/695/f901e9296cb94a43bd3bed3caa9ecc21/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'Gris indy',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'de928038-57b2-56fc-a74b-2154cde463ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-ROC',
 'odometer': 155487,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de928038-57b2-56fc-a74b-2154cde463ce/de928038-57b2-56fc-a74b-2154cde463ce_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344787,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/695/f901e9296cb94a43bd3bed3caa9ecc21/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-ROC Advance 2.0 TDI 110kW (150CV) DSG',
 'transmission': 'manual',
 'trim': 'Advance 2.0 TDI 110kW (150CV) DSG',
 'vin': None,
 'year': 2021}
2026-03-25 18:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983431%27 HTTP/1.1" 200 None
2026-03-25 18:35:29 [ayvens.es] INFO: Saving data for 1983431: {'created_time': 1774463729.763102, 'last_price_update_time': 1774463729.763112, 'auction_closing_time': 1774526400.0}
2026-03-25 18:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983431') HTTP/1.1" 204 0
2026-03-25 18:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/714/299969b27b574b5cbdb2acb63324697c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-03-25 18:35:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:35:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8f019ed0>
2026-03-25 18:35:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:35:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89a597b4-5222-5681-9d9e-c7d488b2c384/89a597b4-5222-5681-9d9e-c7d488b2c384_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F824%252Fb2e4e63206b541f9b7ff84b4d42fb250%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/824/b2e4e63206b541f9b7ff84b4d42fb250/images/large/1.jpg saved to cache
2026-03-25 18:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 89a597b4-5222-5681-9d9e-c7d488b2c384
2026-03-25 18:35:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 89a597b4-5222-5681-9d9e-c7d488b2c384, skipping ID generation
2026-03-25 18:35:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89a597b4-5222-5681-9d9e-c7d488b2c384 with scrape type 1
2026-03-25 18:35:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 89a597b4-5222-5681-9d9e-c7d488b2c384 sending to next pipeline
2026-03-25 18:35:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 89a597b4-5222-5681-9d9e-c7d488b2c384, identifier: 1983432
2026-03-25 18:35:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:35:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ee09950>
2026-03-25 18:35:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:35:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec126d4a-4230-5085-be86-e6602afd3967/ec126d4a-4230-5085-be86-e6602afd3967_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F648%252F8168de7e93924e689c388db2ae8b3c18%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/648/8168de7e93924e689c388db2ae8b3c18/images/large/1.jpg saved to cache
2026-03-25 18:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ec126d4a-4230-5085-be86-e6602afd3967
2026-03-25 18:35:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ec126d4a-4230-5085-be86-e6602afd3967, skipping ID generation
2026-03-25 18:35:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec126d4a-4230-5085-be86-e6602afd3967 with scrape type 1
2026-03-25 18:35:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ec126d4a-4230-5085-be86-e6602afd3967 sending to next pipeline
2026-03-25 18:35:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: ec126d4a-4230-5085-be86-e6602afd3967, identifier: 1983434
2026-03-25 18:35:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:35:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8ec44290>
2026-03-25 18:35:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:35:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15ff2b05-d962-5972-b931-db26709b3df9/15ff2b05-d962-5972-b931-db26709b3df9_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F568%252F39352902857a4c578acf3f533074aad9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/568/39352902857a4c578acf3f533074aad9/images/large/1.jpg saved to cache
2026-03-25 18:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 15ff2b05-d962-5972-b931-db26709b3df9
2026-03-25 18:35:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 15ff2b05-d962-5972-b931-db26709b3df9, skipping ID generation
2026-03-25 18:35:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15ff2b05-d962-5972-b931-db26709b3df9 with scrape type 1
2026-03-25 18:35:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 15ff2b05-d962-5972-b931-db26709b3df9 sending to next pipeline
2026-03-25 18:35:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: 15ff2b05-d962-5972-b931-db26709b3df9, identifier: 1983435
2026-03-25 18:35:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 89a597b4-5222-5681-9d9e-c7d488b2c384 with identifier: 1983432
2026-03-25 18:35:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:35:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 89a597b4-5222-5681-9d9e-c7d488b2c384 with identifier: 1983432
2026-03-25 18:35:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 89a597b4-5222-5681-9d9e-c7d488b2c384 with identifier: 1983432 to the API
2026-03-25 18:35:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:35:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:35:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/824/b2e4e63206b541f9b7ff84b4d42fb250/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'color': 'Azul atlantico',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '89a597b4-5222-5681-9d9e-c7d488b2c384',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TOURAN',
 'odometer': 59678,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89a597b4-5222-5681-9d9e-c7d488b2c384/89a597b4-5222-5681-9d9e-c7d488b2c384_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 363716,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/824/b2e4e63206b541f9b7ff84b4d42fb250/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-08',
 'seats_number': 7,
 'seller_name': None,
 'title': 'VOLKSWAGEN TOURAN Advance 2.0 TDI 110kW (150CV) DSG',
 'transmission': 'manual',
 'trim': 'Advance 2.0 TDI 110kW (150CV) DSG',
 'vin': None,
 'year': 2023}
2026-03-25 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983432%27 HTTP/1.1" 200 None
2026-03-25 18:35:30 [ayvens.es] INFO: Saving data for 1983432: {'created_time': 1774463730.565071, 'last_price_update_time': 1774463730.565085, 'auction_closing_time': 1774526400.0}
2026-03-25 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983432') HTTP/1.1" 204 0
2026-03-25 18:35:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: ec126d4a-4230-5085-be86-e6602afd3967 with identifier: 1983434
2026-03-25 18:35:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:35:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: ec126d4a-4230-5085-be86-e6602afd3967 with identifier: 1983434
2026-03-25 18:35:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: ec126d4a-4230-5085-be86-e6602afd3967 with identifier: 1983434 to the API
2026-03-25 18:35:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:35:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:35:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/648/8168de7e93924e689c388db2ae8b3c18/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'Plata claro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ec126d4a-4230-5085-be86-e6602afd3967',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-ROC',
 'odometer': 177263,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec126d4a-4230-5085-be86-e6602afd3967/ec126d4a-4230-5085-be86-e6602afd3967_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 327413,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/648/8168de7e93924e689c388db2ae8b3c18/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-ROC Advance 2.0 TDI 110kW (150CV) DSG',
 'transmission': 'manual',
 'trim': 'Advance 2.0 TDI 110kW (150CV) DSG',
 'vin': None,
 'year': 2021}
2026-03-25 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983434%27 HTTP/1.1" 200 None
2026-03-25 18:35:30 [ayvens.es] INFO: Saving data for 1983434: {'created_time': 1774463730.860208, 'last_price_update_time': 1774463730.860221, 'auction_closing_time': 1774526400.0}
2026-03-25 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983434') HTTP/1.1" 204 0
2026-03-25 18:35:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: 15ff2b05-d962-5972-b931-db26709b3df9 with identifier: 1983435
2026-03-25 18:35:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: 15ff2b05-d962-5972-b931-db26709b3df9 with identifier: 1983435
2026-03-25 18:35:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: 15ff2b05-d962-5972-b931-db26709b3df9 with identifier: 1983435 to the API
2026-03-25 18:35:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:35:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:35:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/568/39352902857a4c578acf3f533074aad9/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Blanco puro',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': '15ff2b05-d962-5972-b931-db26709b3df9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-ROC',
 'odometer': 141108,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15ff2b05-d962-5972-b931-db26709b3df9/15ff2b05-d962-5972-b931-db26709b3df9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 363800,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/568/39352902857a4c578acf3f533074aad9/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-ROC (O) Advance R-Line 2.0 TDI 85kW (115CV)',
 'transmission': 'manual',
 'trim': '(O) Advance R-Line 2.0 TDI 85kW (115CV)',
 'vin': None,
 'year': 2022}
2026-03-25 18:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983435%27 HTTP/1.1" 200 None
2026-03-25 18:35:31 [ayvens.es] INFO: Saving data for 1983435: {'created_time': 1774463731.362854, 'last_price_update_time': 1774463731.362866, 'auction_closing_time': 1774526400.0}
2026-03-25 18:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983435') HTTP/1.1" 204 0
2026-03-25 18:35:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 18:35:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fae8d422e50>
2026-03-25 18:35:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 18:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 18:35:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 18:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bce2bbf4-6cdc-526d-9961-435fa1f4b058/bce2bbf4-6cdc-526d-9961-435fa1f4b058_image_0.jpg HTTP/1.1" 201 0
2026-03-25 18:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.es',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F714%252F299969b27b574b5cbdb2acb63324697c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-03-25 18:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/714/299969b27b574b5cbdb2acb63324697c/images/large/1.jpg saved to cache
2026-03-25 18:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bce2bbf4-6cdc-526d-9961-435fa1f4b058
2026-03-25 18:35:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bce2bbf4-6cdc-526d-9961-435fa1f4b058, skipping ID generation
2026-03-25 18:35:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bce2bbf4-6cdc-526d-9961-435fa1f4b058 with scrape type 1
2026-03-25 18:35:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bce2bbf4-6cdc-526d-9961-435fa1f4b058 sending to next pipeline
2026-03-25 18:35:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.es, Processed item id: bce2bbf4-6cdc-526d-9961-435fa1f4b058, identifier: 1983433
2026-03-25 18:35:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.es, Translating item: bce2bbf4-6cdc-526d-9961-435fa1f4b058 with identifier: 1983433
2026-03-25 18:35:31 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-25 18:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-03-25 18:35:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.es, Applying rules to item: bce2bbf4-6cdc-526d-9961-435fa1f4b058 with identifier: 1983433
2026-03-25 18:35:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.es, Posting item: bce2bbf4-6cdc-526d-9961-435fa1f4b058 with identifier: 1983433 to the API
2026-03-25 18:35:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-25 18:35:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-25 18:35:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/714/299969b27b574b5cbdb2acb63324697c/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'Gris indy',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-03-26T12:00:00Z',
 'fuel_type': 'diesel',
 'id': 'bce2bbf4-6cdc-526d-9961-435fa1f4b058',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/41023',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-ROC',
 'odometer': 213059,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bce2bbf4-6cdc-526d-9961-435fa1f4b058/bce2bbf4-6cdc-526d-9961-435fa1f4b058_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 577537,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/714/299969b27b574b5cbdb2acb63324697c/images/large/1.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-ROC Edition 1.6 TDI 85kW (115CV)',
 'transmission': 'manual',
 'trim': 'Edition 1.6 TDI 85kW (115CV)',
 'vin': None,
 'year': 2020}
2026-03-25 18:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20RowKey%20eq%20%271983433%27 HTTP/1.1" 200 None
2026-03-25 18:35:31 [ayvens.es] INFO: Saving data for 1983433: {'created_time': 1774463731.843358, 'last_price_update_time': 1774463731.843368, 'auction_closing_time': 1774526400.0}
2026-03-25 18:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.es',RowKey='1983433') HTTP/1.1" 204 0
2026-03-25 18:35:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-03-25 18:35:32 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-25 18:35:32 [ayvens.es] INFO: ayvens.es Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 9, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0, <ScrapeType.BATCH_SKIPPED: 5>: 0}
2026-03-25 18:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 18:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.es%27%20and%20last_price_update_time%20lt%201774031732 HTTP/1.1" 200 None
2026-03-25 18:35:33 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (482 items) in: file:///var/lib/scrapyd/items/sourcing_v2/ayvens.es/task_38_2026-03-25T18_30_00.jl
2026-03-25 18:35:33 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 230698,
 'downloader/request_count': 485,
 'downloader/request_method_count/GET': 479,
 'downloader/request_method_count/POST': 6,
 'downloader/response_bytes': 192103956,
 'downloader/response_count': 485,
 'downloader/response_status_count/200': 485,
 'elapsed_time_seconds': 327.345395,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 25, 18, 35, 32, 955625, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 482,
 'log_count/DEBUG': 8590,
 'log_count/INFO': 9814,
 'memusage/max': 184242176,
 'memusage/startup': 148049920,
 'photo_download_count': 478,
 'playwright/context_count': 1,
 'playwright/context_count/max_concurrent': 1,
 'playwright/context_count/persistent/False': 1,
 'playwright/context_count/remote/False': 1,
 'playwright/page_count': 1,
 'playwright/page_count/max_concurrent': 1,
 'playwright/request_count': 130,
 'playwright/request_count/aborted': 12,
 'playwright/request_count/method/GET': 126,
 'playwright/request_count/method/POST': 4,
 'playwright/request_count/navigation': 2,
 'playwright/request_count/resource_type/document': 2,
 'playwright/request_count/resource_type/fetch': 1,
 'playwright/request_count/resource_type/font': 16,
 'playwright/request_count/resource_type/image': 25,
 'playwright/request_count/resource_type/script': 80,
 'playwright/request_count/resource_type/stylesheet': 1,
 'playwright/request_count/resource_type/xhr': 5,
 'playwright/response_count': 117,
 'playwright/response_count/method/GET': 114,
 'playwright/response_count/method/POST': 3,
 'playwright/response_count/resource_type/document': 2,
 'playwright/response_count/resource_type/fetch': 1,
 'playwright/response_count/resource_type/font': 16,
 'playwright/response_count/resource_type/image': 13,
 'playwright/response_count/resource_type/script': 80,
 'playwright/response_count/resource_type/stylesheet': 1,
 'playwright/response_count/resource_type/xhr': 4,
 'request_depth_max': 6,
 'response_received_count': 7,
 'scheduler/dequeued': 485,
 'scheduler/dequeued/memory': 485,
 'scheduler/enqueued': 485,
 'scheduler/enqueued/memory': 485,
 'scrape_type/new': 482,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 6,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 6.2357784796040505,
 'scrapy-zyte-api/mean_response_seconds': 6.25248989649117,
 'scrapy-zyte-api/processed': 6,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 6,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 6,
 'scrapy-zyte-api/request_args/httpRequestBody': 6,
 'scrapy-zyte-api/request_args/httpRequestMethod': 6,
 'scrapy-zyte-api/request_args/httpResponseBody': 6,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 6,
 'scrapy-zyte-api/request_args/url': 6,
 'scrapy-zyte-api/status_codes/200': 6,
 'scrapy-zyte-api/success': 6,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'start_time': datetime.datetime(2026, 3, 25, 18, 30, 5, 610230, tzinfo=datetime.timezone.utc)}
2026-03-25 18:35:33 [scrapy.core.engine] INFO: Spider closed (finished)